2024-09-11T23:08:48.918 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-11T23:08:49.170 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T23:08:49.258 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901468 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/suites/fsx}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7901468' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - mds.dir_split install: ceph: flavor: default sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc kclient: client.0: mount_subvol_num: 1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 481 sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc sleep_before_teardown: 0 subset: 57/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi005.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEFeeqyhHVb906RaEil7E0q8Pa8k/QHXTDpZWJe74FYpIqbXTzpgCLgCfDHKkbBujsGXzHqoG8wJzIhJUPt2k7Q= smithi159.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGKItPJJlJSXis3Ac9/et2Lq5phwlFmXOc2zHokwBu15zB0PbxlsrYY/ue6RHl+V81yRO6nx/ry/nnZId3Isleg= smithi172.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDlFcT3PaI+eJE8Kk/O5k5AMp8X6WGpLgDPUsgfI0XOPVQyVUfTxuCFxjD2Q6qSZRCGYuVrztyMA/iFdlIpoC8w= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - ceph-fuse: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - workunit: clients: all: - suites/fsx.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-11T23:08:49.258 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa; will attempt to use it 2024-09-11T23:08:49.259 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks 2024-09-11T23:08:49.259 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-11T23:08:49.261 INFO:teuthology.task.internal:Checking packages... 2024-09-11T23:08:49.283 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc' 2024-09-11T23:08:49.283 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-11T23:08:49.283 INFO:teuthology.packaging:ref: None 2024-09-11T23:08:49.283 INFO:teuthology.packaging:tag: None 2024-09-11T23:08:49.283 INFO:teuthology.packaging:branch: squid 2024-09-11T23:08:49.283 INFO:teuthology.packaging:sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:08:49.284 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-11T23:08:49.497 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-314.g086c737f 2024-09-11T23:08:49.499 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-11T23:08:49.505 INFO:teuthology.task.internal:no buildpackages task found 2024-09-11T23:08:49.505 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-11T23:08:49.548 INFO:teuthology.task.internal:Saving configuration 2024-09-11T23:08:49.565 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-11T23:08:49.591 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-11T23:08:49.620 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi005.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901468', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 23:03:34.631672', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEFeeqyhHVb906RaEil7E0q8Pa8k/QHXTDpZWJe74FYpIqbXTzpgCLgCfDHKkbBujsGXzHqoG8wJzIhJUPt2k7Q='} 2024-09-11T23:08:49.651 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi159.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901468', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 23:03:34.630366', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGKItPJJlJSXis3Ac9/et2Lq5phwlFmXOc2zHokwBu15zB0PbxlsrYY/ue6RHl+V81yRO6nx/ry/nnZId3Isleg='} 2024-09-11T23:08:49.683 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901468', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 23:03:34.628792', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDlFcT3PaI+eJE8Kk/O5k5AMp8X6WGpLgDPUsgfI0XOPVQyVUfTxuCFxjD2Q6qSZRCGYuVrztyMA/iFdlIpoC8w='} 2024-09-11T23:08:49.683 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-11T23:08:49.689 INFO:teuthology.task.internal:roles: ubuntu@smithi005.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-11T23:08:49.689 INFO:teuthology.task.internal:roles: ubuntu@smithi159.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-11T23:08:49.689 INFO:teuthology.task.internal:roles: ubuntu@smithi172.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-11T23:08:49.689 INFO:teuthology.run_tasks:Running task console_log... 2024-09-11T23:08:49.817 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7efdc02b3be0>, signals=[15]) 2024-09-11T23:08:49.817 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-11T23:08:49.822 INFO:teuthology.task.internal:Opening connections... 2024-09-11T23:08:49.823 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi005.front.sepia.ceph.com 2024-09-11T23:08:49.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:08:49.914 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi159.front.sepia.ceph.com 2024-09-11T23:08:49.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:08:50.017 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi172.front.sepia.ceph.com 2024-09-11T23:08:50.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:08:50.102 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-11T23:08:50.108 DEBUG:teuthology.orchestra.run.smithi005:> uname -m 2024-09-11T23:08:50.126 INFO:teuthology.orchestra.run.smithi005.stdout:x86_64 2024-09-11T23:08:50.127 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2024-09-11T23:08:50.184 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="CentOS Stream" 2024-09-11T23:08:50.185 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="9" 2024-09-11T23:08:50.185 INFO:teuthology.orchestra.run.smithi005.stdout:ID="centos" 2024-09-11T23:08:50.185 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="rhel fedora" 2024-09-11T23:08:50.185 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="9" 2024-09-11T23:08:50.185 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el9" 2024-09-11T23:08:50.185 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T23:08:50.185 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31" 2024-09-11T23:08:50.185 INFO:teuthology.orchestra.run.smithi005.stdout:LOGO="fedora-logo-icon" 2024-09-11T23:08:50.185 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T23:08:50.185 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://centos.org/" 2024-09-11T23:08:50.185 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T23:08:50.185 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T23:08:50.186 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T23:08:50.186 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2024-09-11T23:08:50.220 DEBUG:teuthology.orchestra.run.smithi159:> uname -m 2024-09-11T23:08:50.239 INFO:teuthology.orchestra.run.smithi159.stdout:x86_64 2024-09-11T23:08:50.240 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release 2024-09-11T23:08:50.298 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="CentOS Stream" 2024-09-11T23:08:50.298 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="9" 2024-09-11T23:08:50.298 INFO:teuthology.orchestra.run.smithi159.stdout:ID="centos" 2024-09-11T23:08:50.299 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="rhel fedora" 2024-09-11T23:08:50.299 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="9" 2024-09-11T23:08:50.299 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el9" 2024-09-11T23:08:50.299 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T23:08:50.299 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31" 2024-09-11T23:08:50.299 INFO:teuthology.orchestra.run.smithi159.stdout:LOGO="fedora-logo-icon" 2024-09-11T23:08:50.299 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T23:08:50.299 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://centos.org/" 2024-09-11T23:08:50.299 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T23:08:50.299 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T23:08:50.299 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T23:08:50.300 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2024-09-11T23:08:50.329 DEBUG:teuthology.orchestra.run.smithi172:> uname -m 2024-09-11T23:08:50.347 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2024-09-11T23:08:50.348 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2024-09-11T23:08:50.407 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="CentOS Stream" 2024-09-11T23:08:50.407 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="9" 2024-09-11T23:08:50.407 INFO:teuthology.orchestra.run.smithi172.stdout:ID="centos" 2024-09-11T23:08:50.407 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="rhel fedora" 2024-09-11T23:08:50.407 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="9" 2024-09-11T23:08:50.407 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el9" 2024-09-11T23:08:50.407 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T23:08:50.407 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2024-09-11T23:08:50.407 INFO:teuthology.orchestra.run.smithi172.stdout:LOGO="fedora-logo-icon" 2024-09-11T23:08:50.407 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T23:08:50.407 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://centos.org/" 2024-09-11T23:08:50.407 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T23:08:50.408 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T23:08:50.408 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T23:08:50.408 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2024-09-11T23:08:50.437 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-11T23:08:50.446 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-11T23:08:50.465 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-11T23:08:50.465 DEBUG:teuthology.orchestra.run.smithi005:> test '!' -e /home/ubuntu/cephtest 2024-09-11T23:08:50.468 DEBUG:teuthology.orchestra.run.smithi159:> test '!' -e /home/ubuntu/cephtest 2024-09-11T23:08:50.470 DEBUG:teuthology.orchestra.run.smithi172:> test '!' -e /home/ubuntu/cephtest 2024-09-11T23:08:50.487 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-11T23:08:50.493 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-11T23:08:50.493 DEBUG:teuthology.orchestra.run.smithi005:> test -z $(ls -A /var/lib/ceph) 2024-09-11T23:08:50.525 DEBUG:teuthology.orchestra.run.smithi159:> test -z $(ls -A /var/lib/ceph) 2024-09-11T23:08:50.528 DEBUG:teuthology.orchestra.run.smithi172:> test -z $(ls -A /var/lib/ceph) 2024-09-11T23:08:50.556 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-11T23:08:50.660 INFO:teuthology.run_tasks:Running task kernel... 2024-09-11T23:08:50.674 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-11T23:08:50.674 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}, 'mon.c': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-11T23:08:50.674 DEBUG:teuthology.orchestra.run.smithi005:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T23:08:50.675 DEBUG:teuthology.orchestra.run.smithi159:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T23:08:50.675 DEBUG:teuthology.orchestra.run.smithi172:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T23:08:50.693 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:08:50.693 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:08:50.693 DEBUG:teuthology.orchestra.run.smithi159:> uname -r 2024-09-11T23:08:50.694 DEBUG:teuthology.orchestra.run.smithi005:> uname -r 2024-09-11T23:08:50.694 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:08:50.695 DEBUG:teuthology.orchestra.run.smithi172:> uname -r 2024-09-11T23:08:50.752 INFO:teuthology.orchestra.run.smithi005.stdout:5.14.0-503.el9.x86_64 2024-09-11T23:08:50.752 INFO:teuthology.task.kernel:Running kernel on smithi005: 5.14.0-503.el9.x86_64 2024-09-11T23:08:50.752 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum install -y kernel 2024-09-11T23:08:50.754 INFO:teuthology.orchestra.run.smithi172.stdout:5.14.0-503.el9.x86_64 2024-09-11T23:08:50.754 INFO:teuthology.orchestra.run.smithi159.stdout:5.14.0-503.el9.x86_64 2024-09-11T23:08:50.754 INFO:teuthology.task.kernel:Running kernel on smithi172: 5.14.0-503.el9.x86_64 2024-09-11T23:08:50.754 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum install -y kernel 2024-09-11T23:08:50.754 INFO:teuthology.task.kernel:Running kernel on smithi159: 5.14.0-503.el9.x86_64 2024-09-11T23:08:50.755 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum install -y kernel 2024-09-11T23:08:53.052 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.2 MB 00:00 2024-09-11T23:08:53.354 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.2 MB 00:00 2024-09-11T23:08:54.903 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - BaseOS 3.5 MB/s | 8.2 MB 00:02 2024-09-11T23:08:55.655 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - AppStream 17 MB/s | 20 MB 00:01 2024-09-11T23:08:56.654 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - AppStream 32 MB/s | 20 MB 00:00 2024-09-11T23:08:59.494 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - AppStream 3.9 MB/s | 20 MB 00:05 2024-09-11T23:09:01.104 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-11T23:09:01.247 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - CRB 3.6 MB/s | 6.5 MB 00:01 2024-09-11T23:09:02.772 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 19 kB 00:00 2024-09-11T23:09:03.559 INFO:teuthology.orchestra.run.smithi172.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-11T23:09:03.739 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - Extras packages 15 kB/s | 19 kB 00:01 2024-09-11T23:09:04.652 INFO:teuthology.orchestra.run.smithi159.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-11T23:09:04.803 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - CRB 4.7 MB/s | 6.5 MB 00:01 2024-09-11T23:09:06.229 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - Extras packages 107 kB/s | 19 kB 00:00 2024-09-11T23:09:07.349 INFO:teuthology.orchestra.run.smithi005.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-11T23:09:09.098 INFO:teuthology.orchestra.run.smithi172.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-11T23:09:10.099 INFO:teuthology.orchestra.run.smithi159.stdout:lab-extras 43 kB/s | 1.7 kB 00:00 2024-09-11T23:09:11.113 INFO:teuthology.orchestra.run.smithi172.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-11T23:09:11.113 INFO:teuthology.orchestra.run.smithi172.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-11T23:09:11.214 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-11T23:09:11.219 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-11T23:09:11.220 INFO:teuthology.orchestra.run.smithi172.stdout: Package Architecture Version Repository Size 2024-09-11T23:09:11.220 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-11T23:09:11.220 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-11T23:09:11.220 INFO:teuthology.orchestra.run.smithi172.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-11T23:09:11.220 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-09-11T23:09:11.220 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-11T23:09:11.220 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-11T23:09:11.220 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-11T23:09:11.220 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-11T23:09:11.220 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-11T23:09:11.220 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-11T23:09:11.221 INFO:teuthology.orchestra.run.smithi172.stdout:Install 4 Packages 2024-09-11T23:09:11.221 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-11T23:09:11.221 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 79 M 2024-09-11T23:09:11.221 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 126 M 2024-09-11T23:09:11.221 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-11T23:09:11.350 INFO:teuthology.orchestra.run.smithi172.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 222 kB/s | 23 kB 00:00 2024-09-11T23:09:11.725 INFO:teuthology.orchestra.run.smithi172.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 33 MB/s | 16 MB 00:00 2024-09-11T23:09:12.042 INFO:teuthology.orchestra.run.smithi172.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 41 MB/s | 29 MB 00:00 2024-09-11T23:09:12.106 INFO:teuthology.orchestra.run.smithi159.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-11T23:09:12.106 INFO:teuthology.orchestra.run.smithi159.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-11T23:09:12.185 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-09-11T23:09:12.191 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-11T23:09:12.191 INFO:teuthology.orchestra.run.smithi159.stdout: Package Architecture Version Repository Size 2024-09-11T23:09:12.191 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-11T23:09:12.191 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2024-09-11T23:09:12.191 INFO:teuthology.orchestra.run.smithi159.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-11T23:09:12.191 INFO:teuthology.orchestra.run.smithi159.stdout:Installing dependencies: 2024-09-11T23:09:12.191 INFO:teuthology.orchestra.run.smithi159.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-11T23:09:12.191 INFO:teuthology.orchestra.run.smithi159.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-11T23:09:12.192 INFO:teuthology.orchestra.run.smithi159.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-11T23:09:12.192 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-11T23:09:12.192 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2024-09-11T23:09:12.192 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-09-11T23:09:12.192 INFO:teuthology.orchestra.run.smithi159.stdout:Install 4 Packages 2024-09-11T23:09:12.192 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-11T23:09:12.192 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 79 M 2024-09-11T23:09:12.193 INFO:teuthology.orchestra.run.smithi159.stdout:Installed size: 126 M 2024-09-11T23:09:12.193 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2024-09-11T23:09:12.409 INFO:teuthology.orchestra.run.smithi159.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 230 kB/s | 23 kB 00:00 2024-09-11T23:09:12.517 INFO:teuthology.orchestra.run.smithi172.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 27 MB/s | 35 MB 00:01 2024-09-11T23:09:12.518 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-11T23:09:12.518 INFO:teuthology.orchestra.run.smithi172.stdout:Total 61 MB/s | 79 MB 00:01 2024-09-11T23:09:12.801 INFO:teuthology.orchestra.run.smithi159.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-09-11T23:09:13.005 INFO:teuthology.orchestra.run.smithi005.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-11T23:09:13.204 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-11T23:09:13.243 INFO:teuthology.orchestra.run.smithi159.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 37 MB/s | 35 MB 00:00 2024-09-11T23:09:13.502 INFO:teuthology.orchestra.run.smithi159.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 26 MB/s | 29 MB 00:01 2024-09-11T23:09:13.502 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2024-09-11T23:09:13.502 INFO:teuthology.orchestra.run.smithi159.stdout:Total 60 MB/s | 79 MB 00:01 2024-09-11T23:09:13.584 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-11T23:09:13.584 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-11T23:09:14.184 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2024-09-11T23:09:14.542 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-11T23:09:14.543 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-11T23:09:14.570 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2024-09-11T23:09:14.570 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2024-09-11T23:09:15.112 INFO:teuthology.orchestra.run.smithi005.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-11T23:09:15.113 INFO:teuthology.orchestra.run.smithi005.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-11T23:09:15.213 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-11T23:09:15.224 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-11T23:09:15.225 INFO:teuthology.orchestra.run.smithi005.stdout: Package Architecture Version Repository Size 2024-09-11T23:09:15.225 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-11T23:09:15.225 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-09-11T23:09:15.225 INFO:teuthology.orchestra.run.smithi005.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-11T23:09:15.225 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2024-09-11T23:09:15.225 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-11T23:09:15.226 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-11T23:09:15.226 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-11T23:09:15.226 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:09:15.226 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-09-11T23:09:15.226 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-11T23:09:15.226 INFO:teuthology.orchestra.run.smithi005.stdout:Install 4 Packages 2024-09-11T23:09:15.226 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:09:15.227 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 79 M 2024-09-11T23:09:15.228 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 126 M 2024-09-11T23:09:15.228 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-09-11T23:09:15.535 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2024-09-11T23:09:15.535 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2024-09-11T23:09:15.540 INFO:teuthology.orchestra.run.smithi005.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 78 kB/s | 23 kB 00:00 2024-09-11T23:09:17.003 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-11T23:09:17.659 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-11T23:09:17.751 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T23:09:17.983 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2024-09-11T23:09:18.686 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-11T23:09:18.769 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T23:09:20.560 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T23:09:20.697 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T23:09:21.256 INFO:teuthology.orchestra.run.smithi005.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 2.6 MB/s | 16 MB 00:06 2024-09-11T23:09:21.576 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T23:09:21.696 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T23:09:25.509 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T23:09:25.555 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:09:26.536 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T23:09:26.574 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:09:27.164 INFO:teuthology.orchestra.run.smithi005.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 2.9 MB/s | 35 MB 00:11 2024-09-11T23:09:30.401 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:09:31.512 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:09:31.530 INFO:teuthology.orchestra.run.smithi005.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 1.8 MB/s | 29 MB 00:15 2024-09-11T23:09:31.531 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-09-11T23:09:31.531 INFO:teuthology.orchestra.run.smithi005.stdout:Total 4.8 MB/s | 79 MB 00:16 2024-09-11T23:09:32.239 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-09-11T23:09:32.657 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-09-11T23:09:32.657 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-09-11T23:09:33.651 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-09-11T23:09:33.652 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-09-11T23:09:36.229 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-09-11T23:09:37.049 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-11T23:09:37.147 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T23:09:39.932 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T23:09:40.059 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T23:09:45.182 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T23:09:45.226 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:09:50.370 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:10:08.611 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:10:08.651 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:10:08.995 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:10:08.996 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-11T23:10:08.996 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T23:10:08.996 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T23:10:09.795 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:10:09.795 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-11T23:10:09.795 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-11T23:10:09.795 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-11T23:10:09.795 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-11T23:10:09.795 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-11T23:10:09.795 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-11T23:10:09.796 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-11T23:10:09.796 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-11T23:10:09.818 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:10:09.858 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:10:10.144 DEBUG:teuthology.orchestra.run.smithi172:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T23:10:10.202 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:10:10.202 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-11T23:10:10.202 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T23:10:10.202 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T23:10:10.237 INFO:teuthology.orchestra.run.smithi172.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T23:10:10.237 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T23:10:10.237 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-11T23:10:10.237 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T23:10:10.238 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T23:10:10.238 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2024-09-11T23:10:10.238 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi172.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T23:10:10.238 DEBUG:teuthology.orchestra.run.smithi172:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T23:10:10.297 INFO:teuthology.orchestra.run.smithi172.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T23:10:10.298 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T23:10:10.298 DEBUG:teuthology.orchestra.run.smithi172:> sudo rpm -qi grub2-tools 2024-09-11T23:10:10.338 INFO:teuthology.orchestra.run.smithi172.stdout:Name : grub2-tools 2024-09-11T23:10:10.339 INFO:teuthology.orchestra.run.smithi172.stdout:Epoch : 1 2024-09-11T23:10:10.339 INFO:teuthology.orchestra.run.smithi172.stdout:Version : 2.06 2024-09-11T23:10:10.339 INFO:teuthology.orchestra.run.smithi172.stdout:Release : 82.el9 2024-09-11T23:10:10.339 INFO:teuthology.orchestra.run.smithi172.stdout:Architecture: x86_64 2024-09-11T23:10:10.339 INFO:teuthology.orchestra.run.smithi172.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-11T23:10:10.339 INFO:teuthology.orchestra.run.smithi172.stdout:Group : Unspecified 2024-09-11T23:10:10.339 INFO:teuthology.orchestra.run.smithi172.stdout:Size : 8274670 2024-09-11T23:10:10.339 INFO:teuthology.orchestra.run.smithi172.stdout:License : GPLv3+ 2024-09-11T23:10:10.339 INFO:teuthology.orchestra.run.smithi172.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-11T23:10:10.339 INFO:teuthology.orchestra.run.smithi172.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-11T23:10:10.339 INFO:teuthology.orchestra.run.smithi172.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-11T23:10:10.339 INFO:teuthology.orchestra.run.smithi172.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-11T23:10:10.340 INFO:teuthology.orchestra.run.smithi172.stdout:Packager : builder@centos.org 2024-09-11T23:10:10.340 INFO:teuthology.orchestra.run.smithi172.stdout:Vendor : CentOS 2024-09-11T23:10:10.340 INFO:teuthology.orchestra.run.smithi172.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-11T23:10:10.340 INFO:teuthology.orchestra.run.smithi172.stdout:Summary : Support tools for GRUB. 2024-09-11T23:10:10.340 INFO:teuthology.orchestra.run.smithi172.stdout:Description : 2024-09-11T23:10:10.340 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-11T23:10:10.340 INFO:teuthology.orchestra.run.smithi172.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-11T23:10:10.340 INFO:teuthology.orchestra.run.smithi172.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-11T23:10:10.340 INFO:teuthology.orchestra.run.smithi172.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-11T23:10:10.340 INFO:teuthology.orchestra.run.smithi172.stdout:hardware devices. 2024-09-11T23:10:10.340 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-11T23:10:10.340 INFO:teuthology.orchestra.run.smithi172.stdout:This subpackage provides tools for support of all platforms. 2024-09-11T23:10:10.341 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-11T23:10:10.341 INFO:teuthology.task.kernel:Updating grub on smithi172 to boot 5.14.0-505.el9.x86_64 2024-09-11T23:10:10.341 DEBUG:teuthology.orchestra.run.smithi172:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-11T23:10:10.993 INFO:teuthology.orchestra.run.smithi172.stderr:Generating grub configuration file ... 2024-09-11T23:10:11.052 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:10:11.052 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-11T23:10:11.052 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2024-09-11T23:10:11.052 INFO:teuthology.orchestra.run.smithi159.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-11T23:10:11.053 INFO:teuthology.orchestra.run.smithi159.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-11T23:10:11.053 INFO:teuthology.orchestra.run.smithi159.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-11T23:10:11.053 INFO:teuthology.orchestra.run.smithi159.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-11T23:10:11.053 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-11T23:10:11.053 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-09-11T23:10:11.408 DEBUG:teuthology.orchestra.run.smithi159:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T23:10:11.503 INFO:teuthology.orchestra.run.smithi159.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T23:10:11.503 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T23:10:11.503 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-11T23:10:11.503 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T23:10:11.503 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T23:10:11.503 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-11T23:10:11.504 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi159.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T23:10:11.504 DEBUG:teuthology.orchestra.run.smithi159:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T23:10:11.563 INFO:teuthology.orchestra.run.smithi159.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T23:10:11.563 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T23:10:11.563 DEBUG:teuthology.orchestra.run.smithi159:> sudo rpm -qi grub2-tools 2024-09-11T23:10:11.596 INFO:teuthology.orchestra.run.smithi159.stdout:Name : grub2-tools 2024-09-11T23:10:11.596 INFO:teuthology.orchestra.run.smithi159.stdout:Epoch : 1 2024-09-11T23:10:11.596 INFO:teuthology.orchestra.run.smithi159.stdout:Version : 2.06 2024-09-11T23:10:11.596 INFO:teuthology.orchestra.run.smithi159.stdout:Release : 82.el9 2024-09-11T23:10:11.596 INFO:teuthology.orchestra.run.smithi159.stdout:Architecture: x86_64 2024-09-11T23:10:11.596 INFO:teuthology.orchestra.run.smithi159.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-11T23:10:11.596 INFO:teuthology.orchestra.run.smithi159.stdout:Group : Unspecified 2024-09-11T23:10:11.597 INFO:teuthology.orchestra.run.smithi159.stdout:Size : 8274670 2024-09-11T23:10:11.597 INFO:teuthology.orchestra.run.smithi159.stdout:License : GPLv3+ 2024-09-11T23:10:11.597 INFO:teuthology.orchestra.run.smithi159.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-11T23:10:11.597 INFO:teuthology.orchestra.run.smithi159.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-11T23:10:11.597 INFO:teuthology.orchestra.run.smithi159.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-11T23:10:11.597 INFO:teuthology.orchestra.run.smithi159.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-11T23:10:11.597 INFO:teuthology.orchestra.run.smithi159.stdout:Packager : builder@centos.org 2024-09-11T23:10:11.597 INFO:teuthology.orchestra.run.smithi159.stdout:Vendor : CentOS 2024-09-11T23:10:11.597 INFO:teuthology.orchestra.run.smithi159.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-11T23:10:11.597 INFO:teuthology.orchestra.run.smithi159.stdout:Summary : Support tools for GRUB. 2024-09-11T23:10:11.597 INFO:teuthology.orchestra.run.smithi159.stdout:Description : 2024-09-11T23:10:11.597 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-11T23:10:11.597 INFO:teuthology.orchestra.run.smithi159.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-11T23:10:11.597 INFO:teuthology.orchestra.run.smithi159.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-11T23:10:11.598 INFO:teuthology.orchestra.run.smithi159.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-11T23:10:11.598 INFO:teuthology.orchestra.run.smithi159.stdout:hardware devices. 2024-09-11T23:10:11.598 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-11T23:10:11.598 INFO:teuthology.orchestra.run.smithi159.stdout:This subpackage provides tools for support of all platforms. 2024-09-11T23:10:11.599 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-11T23:10:11.599 INFO:teuthology.task.kernel:Updating grub on smithi159 to boot 5.14.0-505.el9.x86_64 2024-09-11T23:10:11.599 DEBUG:teuthology.orchestra.run.smithi159:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-11T23:10:12.273 INFO:teuthology.orchestra.run.smithi159.stderr:Generating grub configuration file ... 2024-09-11T23:10:12.296 INFO:teuthology.orchestra.run.smithi172.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-11T23:10:12.332 INFO:teuthology.orchestra.run.smithi172.stderr:done 2024-09-11T23:10:12.333 DEBUG:teuthology.orchestra.run.smithi172:> mktemp 2024-09-11T23:10:12.349 INFO:teuthology.orchestra.run.smithi172.stdout:/tmp/tmp.96TYZQsFBy 2024-09-11T23:10:12.350 DEBUG:teuthology.orchestra.run.smithi172:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.96TYZQsFBy 2024-09-11T23:10:12.417 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 0666 /tmp/tmp.96TYZQsFBy 2024-09-11T23:10:12.555 DEBUG:teuthology.orchestra.remote:smithi172:/tmp/tmp.96TYZQsFBy is 6KB 2024-09-11T23:10:12.604 DEBUG:teuthology.orchestra.run.smithi172:> rm -fr /tmp/tmp.96TYZQsFBy 2024-09-11T23:10:12.620 DEBUG:teuthology.orchestra.run.smithi172:> sudo /bin/ls /boot/loader/entries || true 2024-09-11T23:10:12.682 INFO:teuthology.orchestra.run.smithi172.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-11T23:10:12.682 INFO:teuthology.orchestra.run.smithi172.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-11T23:10:12.682 INFO:teuthology.orchestra.run.smithi172.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-11T23:10:12.682 INFO:teuthology.orchestra.run.smithi172.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-11T23:10:12.684 DEBUG:teuthology.orchestra.run.smithi172:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-11T23:10:12.830 DEBUG:teuthology.orchestra.run.smithi172:> sudo shutdown -r now 2024-09-11T23:10:13.612 INFO:teuthology.orchestra.run.smithi159.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-11T23:10:13.648 INFO:teuthology.orchestra.run.smithi159.stderr:done 2024-09-11T23:10:13.650 DEBUG:teuthology.orchestra.run.smithi159:> mktemp 2024-09-11T23:10:13.666 INFO:teuthology.orchestra.run.smithi159.stdout:/tmp/tmp.pcyUD0BdQ9 2024-09-11T23:10:13.666 DEBUG:teuthology.orchestra.run.smithi159:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.pcyUD0BdQ9 2024-09-11T23:10:13.733 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 0666 /tmp/tmp.pcyUD0BdQ9 2024-09-11T23:10:13.878 DEBUG:teuthology.orchestra.remote:smithi159:/tmp/tmp.pcyUD0BdQ9 is 6KB 2024-09-11T23:10:13.928 DEBUG:teuthology.orchestra.run.smithi159:> rm -fr /tmp/tmp.pcyUD0BdQ9 2024-09-11T23:10:13.943 DEBUG:teuthology.orchestra.run.smithi159:> sudo /bin/ls /boot/loader/entries || true 2024-09-11T23:10:14.006 INFO:teuthology.orchestra.run.smithi159.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-11T23:10:14.006 INFO:teuthology.orchestra.run.smithi159.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-11T23:10:14.006 INFO:teuthology.orchestra.run.smithi159.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-11T23:10:14.006 INFO:teuthology.orchestra.run.smithi159.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-11T23:10:14.007 DEBUG:teuthology.orchestra.run.smithi159:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-11T23:10:14.142 DEBUG:teuthology.orchestra.run.smithi159:> sudo shutdown -r now 2024-09-11T23:10:29.188 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:10:29.229 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:10:29.715 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:10:29.715 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-11T23:10:29.715 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T23:10:29.715 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T23:10:30.561 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:10:30.561 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:10:30.561 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-09-11T23:10:30.561 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-11T23:10:30.561 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-11T23:10:30.562 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-11T23:10:30.562 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-11T23:10:30.562 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:10:30.562 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-11T23:10:30.904 DEBUG:teuthology.orchestra.run.smithi005:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T23:10:30.994 INFO:teuthology.orchestra.run.smithi005.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T23:10:30.994 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T23:10:30.994 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-11T23:10:30.994 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T23:10:30.995 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T23:10:30.995 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-11T23:10:30.995 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi005.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T23:10:30.995 DEBUG:teuthology.orchestra.run.smithi005:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T23:10:31.053 INFO:teuthology.orchestra.run.smithi005.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T23:10:31.053 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T23:10:31.053 DEBUG:teuthology.orchestra.run.smithi005:> sudo rpm -qi grub2-tools 2024-09-11T23:10:31.085 INFO:teuthology.orchestra.run.smithi005.stdout:Name : grub2-tools 2024-09-11T23:10:31.085 INFO:teuthology.orchestra.run.smithi005.stdout:Epoch : 1 2024-09-11T23:10:31.085 INFO:teuthology.orchestra.run.smithi005.stdout:Version : 2.06 2024-09-11T23:10:31.086 INFO:teuthology.orchestra.run.smithi005.stdout:Release : 82.el9 2024-09-11T23:10:31.086 INFO:teuthology.orchestra.run.smithi005.stdout:Architecture: x86_64 2024-09-11T23:10:31.086 INFO:teuthology.orchestra.run.smithi005.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-11T23:10:31.086 INFO:teuthology.orchestra.run.smithi005.stdout:Group : Unspecified 2024-09-11T23:10:31.086 INFO:teuthology.orchestra.run.smithi005.stdout:Size : 8274670 2024-09-11T23:10:31.086 INFO:teuthology.orchestra.run.smithi005.stdout:License : GPLv3+ 2024-09-11T23:10:31.086 INFO:teuthology.orchestra.run.smithi005.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-11T23:10:31.086 INFO:teuthology.orchestra.run.smithi005.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-11T23:10:31.086 INFO:teuthology.orchestra.run.smithi005.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-11T23:10:31.086 INFO:teuthology.orchestra.run.smithi005.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-11T23:10:31.086 INFO:teuthology.orchestra.run.smithi005.stdout:Packager : builder@centos.org 2024-09-11T23:10:31.087 INFO:teuthology.orchestra.run.smithi005.stdout:Vendor : CentOS 2024-09-11T23:10:31.087 INFO:teuthology.orchestra.run.smithi005.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-11T23:10:31.087 INFO:teuthology.orchestra.run.smithi005.stdout:Summary : Support tools for GRUB. 2024-09-11T23:10:31.087 INFO:teuthology.orchestra.run.smithi005.stdout:Description : 2024-09-11T23:10:31.087 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:10:31.087 INFO:teuthology.orchestra.run.smithi005.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-11T23:10:31.087 INFO:teuthology.orchestra.run.smithi005.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-11T23:10:31.087 INFO:teuthology.orchestra.run.smithi005.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-11T23:10:31.087 INFO:teuthology.orchestra.run.smithi005.stdout:hardware devices. 2024-09-11T23:10:31.087 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:10:31.087 INFO:teuthology.orchestra.run.smithi005.stdout:This subpackage provides tools for support of all platforms. 2024-09-11T23:10:31.088 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-11T23:10:31.088 INFO:teuthology.task.kernel:Updating grub on smithi005 to boot 5.14.0-505.el9.x86_64 2024-09-11T23:10:31.089 DEBUG:teuthology.orchestra.run.smithi005:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-11T23:10:31.837 INFO:teuthology.orchestra.run.smithi005.stderr:Generating grub configuration file ... 2024-09-11T23:10:33.132 INFO:teuthology.orchestra.run.smithi005.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-11T23:10:33.171 INFO:teuthology.orchestra.run.smithi005.stderr:done 2024-09-11T23:10:33.173 DEBUG:teuthology.orchestra.run.smithi005:> mktemp 2024-09-11T23:10:33.187 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/tmp.uWxwZ0AJOd 2024-09-11T23:10:33.188 DEBUG:teuthology.orchestra.run.smithi005:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.uWxwZ0AJOd 2024-09-11T23:10:33.253 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0666 /tmp/tmp.uWxwZ0AJOd 2024-09-11T23:10:33.401 DEBUG:teuthology.orchestra.remote:smithi005:/tmp/tmp.uWxwZ0AJOd is 6KB 2024-09-11T23:10:33.451 DEBUG:teuthology.orchestra.run.smithi005:> rm -fr /tmp/tmp.uWxwZ0AJOd 2024-09-11T23:10:33.465 DEBUG:teuthology.orchestra.run.smithi005:> sudo /bin/ls /boot/loader/entries || true 2024-09-11T23:10:33.535 INFO:teuthology.orchestra.run.smithi005.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-11T23:10:33.535 INFO:teuthology.orchestra.run.smithi005.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-11T23:10:33.536 INFO:teuthology.orchestra.run.smithi005.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-11T23:10:33.536 INFO:teuthology.orchestra.run.smithi005.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-11T23:10:33.537 DEBUG:teuthology.orchestra.run.smithi005:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-11T23:10:33.694 DEBUG:teuthology.orchestra.run.smithi005:> sudo shutdown -r now 2024-09-11T23:10:42.841 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2024-09-11T23:10:42.841 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-09-11T23:10:42.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:10:44.147 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-11T23:10:44.147 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-09-11T23:10:44.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:11:01.181 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-09-11T23:11:02.721 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.159 2024-09-11T23:11:03.698 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-11T23:11:03.699 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-09-11T23:11:03.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:11:10.189 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-09-11T23:11:10.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:11:11.723 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-09-11T23:11:11.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:11:13.277 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-09-11T23:11:14.817 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.159 2024-09-11T23:11:22.173 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.5 2024-09-11T23:11:25.281 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-09-11T23:11:25.281 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:11:26.819 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-09-11T23:11:26.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:11:31.178 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-09-11T23:11:31.179 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:11:45.213 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.159 2024-09-11T23:12:00.225 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-09-11T23:12:00.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:12:00.611 DEBUG:teuthology.orchestra.run.smithi159:> true 2024-09-11T23:12:01.003 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-09-11T23:12:01.003 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-505.el9.x86_64"... 2024-09-11T23:12:01.003 DEBUG:teuthology.orchestra.run.smithi159:> uname -r 2024-09-11T23:12:01.017 INFO:teuthology.orchestra.run.smithi159.stdout:5.14.0-505.el9.x86_64 2024-09-11T23:12:01.018 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-11T23:12:01.018 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T23:12:01.018 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-11T23:12:02.019 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-11T23:12:02.019 DEBUG:teuthology.orchestra.run.smithi159:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-11T23:12:02.113 INFO:teuthology.orchestra.run.smithi159.stdout:ttyS1 2024-09-11T23:12:02.136 DEBUG:teuthology.parallel:result is None 2024-09-11T23:12:25.292 DEBUG:teuthology.orchestra.remote:timed out 2024-09-11T23:12:31.189 DEBUG:teuthology.orchestra.remote:timed out 2024-09-11T23:12:40.293 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-09-11T23:12:40.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:12:40.911 DEBUG:teuthology.orchestra.run.smithi172:> true 2024-09-11T23:12:41.254 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-09-11T23:12:41.254 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-505.el9.x86_64"... 2024-09-11T23:12:41.254 DEBUG:teuthology.orchestra.run.smithi172:> uname -r 2024-09-11T23:12:41.270 INFO:teuthology.orchestra.run.smithi172.stdout:5.14.0-505.el9.x86_64 2024-09-11T23:12:41.270 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-11T23:12:41.270 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T23:12:41.271 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-11T23:12:42.271 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-09-11T23:12:42.271 DEBUG:teuthology.orchestra.run.smithi172:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-11T23:12:42.333 INFO:teuthology.orchestra.run.smithi172.stdout:ttyS1 2024-09-11T23:12:42.359 DEBUG:teuthology.parallel:result is None 2024-09-11T23:12:43.189 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-09-11T23:12:43.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:12:43.459 DEBUG:teuthology.orchestra.run.smithi005:> true 2024-09-11T23:12:43.808 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-09-11T23:12:43.808 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-11T23:12:43.808 DEBUG:teuthology.orchestra.run.smithi005:> uname -r 2024-09-11T23:12:43.825 INFO:teuthology.orchestra.run.smithi005.stdout:5.14.0-505.el9.x86_64 2024-09-11T23:12:43.825 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-11T23:12:43.825 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T23:12:43.825 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-11T23:12:44.826 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-11T23:12:44.827 DEBUG:teuthology.orchestra.run.smithi005:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-11T23:12:44.909 INFO:teuthology.orchestra.run.smithi005.stdout:ttyS1 2024-09-11T23:12:44.925 DEBUG:teuthology.parallel:result is None 2024-09-11T23:12:44.926 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-11T23:12:44.934 INFO:teuthology.task.internal:Creating test directory... 2024-09-11T23:12:44.935 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T23:12:44.937 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T23:12:44.940 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T23:12:44.959 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-11T23:12:44.977 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-11T23:12:45.010 INFO:teuthology.task.internal:Creating archive directory... 2024-09-11T23:12:45.011 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T23:12:45.013 DEBUG:teuthology.orchestra.run.smithi159:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T23:12:45.016 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T23:12:45.071 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-11T23:12:45.078 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-11T23:12:45.078 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T23:12:45.080 DEBUG:teuthology.orchestra.run.smithi159:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T23:12:45.083 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T23:12:45.109 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T23:12:45.119 INFO:teuthology.orchestra.run.smithi159.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T23:12:45.120 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T23:12:45.126 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T23:12:45.131 INFO:teuthology.orchestra.run.smithi159.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T23:12:45.138 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T23:12:45.140 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-11T23:12:45.147 INFO:teuthology.task.internal:Configuring sudo... 2024-09-11T23:12:45.148 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T23:12:45.165 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T23:12:45.175 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T23:12:45.208 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-11T23:12:45.217 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-11T23:12:45.217 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T23:12:45.232 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T23:12:45.245 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T23:12:45.266 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T23:12:45.339 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T23:12:45.377 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T23:12:45.467 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T23:12:45.500 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-11T23:12:45.500 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T23:12:45.566 DEBUG:teuthology.orchestra.run.smithi159:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T23:12:45.617 DEBUG:teuthology.orchestra.run.smithi159:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T23:12:45.657 DEBUG:teuthology.orchestra.run.smithi159:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T23:12:45.746 DEBUG:teuthology.orchestra.run.smithi159:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T23:12:45.783 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-11T23:12:45.783 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T23:12:45.849 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T23:12:45.901 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T23:12:45.957 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T23:12:46.005 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T23:12:46.044 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-11T23:12:46.045 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T23:12:46.111 DEBUG:teuthology.orchestra.run.smithi005:> sudo service rsyslog restart 2024-09-11T23:12:46.114 DEBUG:teuthology.orchestra.run.smithi159:> sudo service rsyslog restart 2024-09-11T23:12:46.116 DEBUG:teuthology.orchestra.run.smithi172:> sudo service rsyslog restart 2024-09-11T23:12:46.161 INFO:teuthology.orchestra.run.smithi005.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T23:12:46.168 INFO:teuthology.orchestra.run.smithi159.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T23:12:46.195 INFO:teuthology.orchestra.run.smithi172.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T23:12:46.665 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-11T23:12:46.675 INFO:teuthology.task.internal:Starting timer... 2024-09-11T23:12:46.675 INFO:teuthology.run_tasks:Running task pcp... 2024-09-11T23:12:46.706 INFO:teuthology.run_tasks:Running task selinux... 2024-09-11T23:12:46.737 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-11T23:12:46.737 DEBUG:teuthology.orchestra.run.smithi005:> sudo service auditd rotate 2024-09-11T23:12:46.785 INFO:teuthology.orchestra.run.smithi005.stdout:Rotating logs: 2024-09-11T23:12:46.787 DEBUG:teuthology.orchestra.run.smithi159:> sudo service auditd rotate 2024-09-11T23:12:46.859 INFO:teuthology.orchestra.run.smithi159.stdout:Rotating logs: 2024-09-11T23:12:46.860 DEBUG:teuthology.orchestra.run.smithi172:> sudo service auditd rotate 2024-09-11T23:12:46.926 INFO:teuthology.orchestra.run.smithi172.stdout:Rotating logs: 2024-09-11T23:12:46.929 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-11T23:12:46.930 DEBUG:teuthology.orchestra.run.smithi005:> /usr/sbin/getenforce 2024-09-11T23:12:46.955 INFO:teuthology.orchestra.run.smithi005.stdout:Permissive 2024-09-11T23:12:46.956 DEBUG:teuthology.orchestra.run.smithi159:> /usr/sbin/getenforce 2024-09-11T23:12:46.977 INFO:teuthology.orchestra.run.smithi159.stdout:Permissive 2024-09-11T23:12:46.978 DEBUG:teuthology.orchestra.run.smithi172:> /usr/sbin/getenforce 2024-09-11T23:12:47.012 INFO:teuthology.orchestra.run.smithi172.stdout:Permissive 2024-09-11T23:12:47.012 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi005.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi159.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi172.front.sepia.ceph.com': 'permissive'} 2024-09-11T23:12:47.012 DEBUG:teuthology.orchestra.run.smithi005:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T23:12:47.039 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:12:47.040 DEBUG:teuthology.orchestra.run.smithi159:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T23:12:47.068 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:12:47.068 DEBUG:teuthology.orchestra.run.smithi172:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T23:12:47.097 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:12:47.098 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-11T23:12:47.099 DEBUG:teuthology.orchestra.run.smithi005:> sudo /usr/sbin/setenforce permissive 2024-09-11T23:12:47.131 DEBUG:teuthology.orchestra.run.smithi159:> sudo /usr/sbin/setenforce permissive 2024-09-11T23:12:47.192 DEBUG:teuthology.orchestra.run.smithi172:> sudo /usr/sbin/setenforce permissive 2024-09-11T23:12:47.224 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-11T23:12:47.282 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-11T23:12:47.297 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-11T23:12:47.298 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi005.front.sepia.ceph.com,smithi159.front.sepia.ceph.com,smithi172.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-11T23:16:34.774 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi005.front.sepia.ceph.com'), Remote(name='ubuntu@smithi159.front.sepia.ceph.com'), Remote(name='ubuntu@smithi172.front.sepia.ceph.com')] 2024-09-11T23:16:34.776 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-09-11T23:16:34.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:16:34.863 DEBUG:teuthology.orchestra.run.smithi005:> true 2024-09-11T23:16:34.941 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-09-11T23:16:34.941 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-09-11T23:16:34.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:16:35.026 DEBUG:teuthology.orchestra.run.smithi159:> true 2024-09-11T23:16:35.106 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-09-11T23:16:35.107 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-09-11T23:16:35.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:16:35.192 DEBUG:teuthology.orchestra.run.smithi172:> true 2024-09-11T23:16:35.269 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-09-11T23:16:35.273 INFO:teuthology.run_tasks:Running task clock... 2024-09-11T23:16:35.285 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-11T23:16:35.286 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T23:16:35.286 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T23:16:35.289 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T23:16:35.289 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T23:16:35.291 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T23:16:35.291 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T23:16:35.319 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T23:16:35.322 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T23:16:35.335 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T23:16:35.339 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T23:16:35.339 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T23:16:35.354 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T23:16:35.362 INFO:teuthology.orchestra.run.smithi005.stderr:sudo: ntpd: command not found 2024-09-11T23:16:35.366 INFO:teuthology.orchestra.run.smithi159.stderr:sudo: ntpd: command not found 2024-09-11T23:16:35.374 INFO:teuthology.orchestra.run.smithi005.stdout:506 Cannot talk to daemon 2024-09-11T23:16:35.377 INFO:teuthology.orchestra.run.smithi159.stdout:506 Cannot talk to daemon 2024-09-11T23:16:35.379 INFO:teuthology.orchestra.run.smithi172.stderr:sudo: ntpd: command not found 2024-09-11T23:16:35.390 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T23:16:35.390 INFO:teuthology.orchestra.run.smithi172.stdout:506 Cannot talk to daemon 2024-09-11T23:16:35.393 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T23:16:35.404 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T23:16:35.405 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T23:16:35.407 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T23:16:35.419 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T23:16:35.469 INFO:teuthology.orchestra.run.smithi159.stderr:bash: line 1: ntpq: command not found 2024-09-11T23:16:35.470 INFO:teuthology.orchestra.run.smithi005.stderr:bash: line 1: ntpq: command not found 2024-09-11T23:16:35.473 INFO:teuthology.orchestra.run.smithi159.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T23:16:35.473 INFO:teuthology.orchestra.run.smithi159.stdout:=============================================================================== 2024-09-11T23:16:35.473 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:16:35.473 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:16:35.473 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:16:35.473 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:16:35.477 INFO:teuthology.orchestra.run.smithi005.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T23:16:35.477 INFO:teuthology.orchestra.run.smithi005.stdout:=============================================================================== 2024-09-11T23:16:35.477 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:16:35.477 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:16:35.477 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:16:35.478 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:16:35.478 INFO:teuthology.orchestra.run.smithi172.stderr:bash: line 1: ntpq: command not found 2024-09-11T23:16:35.479 INFO:teuthology.orchestra.run.smithi172.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T23:16:35.479 INFO:teuthology.orchestra.run.smithi172.stdout:=============================================================================== 2024-09-11T23:16:35.479 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:16:35.479 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:16:35.479 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:16:35.479 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:16:35.480 INFO:teuthology.run_tasks:Running task install... 2024-09-11T23:16:35.488 DEBUG:teuthology.task.install:project ceph 2024-09-11T23:16:35.488 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}} 2024-09-11T23:16:35.488 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'} 2024-09-11T23:16:35.489 INFO:teuthology.task.install:Using flavor: default 2024-09-11T23:16:35.494 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-11T23:16:35.494 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-11T23:16:35.495 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-11T23:16:35.497 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:16:35.499 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-11T23:16:35.499 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:16:35.500 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-11T23:16:35.500 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:16:35.658 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-11T23:16:35.658 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-11T23:16:35.670 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-11T23:16:35.670 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-11T23:16:35.699 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-11T23:16:35.699 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-11T23:16:35.776 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T23:16:35.777 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-11T23:16:35.777 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T23:16:35.793 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T23:16:35.794 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-11T23:16:35.794 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T23:16:35.807 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-11T23:16:35.807 DEBUG:teuthology.orchestra.run.smithi005:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T23:16:35.814 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T23:16:35.814 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-11T23:16:35.814 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T23:16:35.820 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-11T23:16:35.820 DEBUG:teuthology.orchestra.run.smithi159:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T23:16:35.841 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-11T23:16:35.841 DEBUG:teuthology.orchestra.run.smithi172:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T23:16:35.875 DEBUG:teuthology.orchestra.run.smithi005:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T23:16:35.885 DEBUG:teuthology.orchestra.run.smithi159:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T23:16:35.907 DEBUG:teuthology.orchestra.run.smithi172:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T23:16:35.952 DEBUG:teuthology.orchestra.run.smithi005:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T23:16:35.959 DEBUG:teuthology.orchestra.run.smithi159:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T23:16:35.983 DEBUG:teuthology.orchestra.run.smithi172:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T23:16:36.018 INFO:teuthology.orchestra.run.smithi005.stdout:check_obsoletes = 1 2024-09-11T23:16:36.020 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum clean all 2024-09-11T23:16:36.024 INFO:teuthology.orchestra.run.smithi159.stdout:check_obsoletes = 1 2024-09-11T23:16:36.025 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum clean all 2024-09-11T23:16:36.048 INFO:teuthology.orchestra.run.smithi172.stdout:check_obsoletes = 1 2024-09-11T23:16:36.050 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum clean all 2024-09-11T23:16:36.257 INFO:teuthology.orchestra.run.smithi005.stdout:45 files removed 2024-09-11T23:16:36.260 INFO:teuthology.orchestra.run.smithi159.stdout:45 files removed 2024-09-11T23:16:36.284 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-11T23:16:36.286 INFO:teuthology.orchestra.run.smithi172.stdout:45 files removed 2024-09-11T23:16:36.289 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-11T23:16:36.316 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-11T23:16:36.848 INFO:teuthology.orchestra.run.smithi159.stdout:ceph packages for x86_64 310 kB/s | 84 kB 00:00 2024-09-11T23:16:36.855 INFO:teuthology.orchestra.run.smithi005.stdout:ceph packages for x86_64 307 kB/s | 84 kB 00:00 2024-09-11T23:16:36.877 INFO:teuthology.orchestra.run.smithi172.stdout:ceph packages for x86_64 305 kB/s | 84 kB 00:00 2024-09-11T23:16:37.134 INFO:teuthology.orchestra.run.smithi159.stdout:ceph noarch packages 48 kB/s | 12 kB 00:00 2024-09-11T23:16:37.140 INFO:teuthology.orchestra.run.smithi005.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-11T23:16:37.152 INFO:teuthology.orchestra.run.smithi172.stdout:ceph noarch packages 50 kB/s | 12 kB 00:00 2024-09-11T23:16:37.409 INFO:teuthology.orchestra.run.smithi159.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-11T23:16:37.415 INFO:teuthology.orchestra.run.smithi005.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-11T23:16:37.419 INFO:teuthology.orchestra.run.smithi172.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-11T23:16:38.018 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.2 MB 00:00 2024-09-11T23:16:38.249 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.2 MB 00:00 2024-09-11T23:16:38.920 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - BaseOS 5.6 MB/s | 8.2 MB 00:01 2024-09-11T23:16:39.836 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-11T23:16:40.200 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - AppStream 25 MB/s | 20 MB 00:00 2024-09-11T23:16:41.845 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - AppStream 11 MB/s | 20 MB 00:01 2024-09-11T23:16:45.737 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - CRB 3.2 MB/s | 6.5 MB 00:02 2024-09-11T23:16:45.750 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 6.5 MB 00:01 2024-09-11T23:16:47.338 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.5 MB 00:01 2024-09-11T23:16:47.412 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 19 kB 00:00 2024-09-11T23:16:47.418 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - Extras packages 50 kB/s | 19 kB 00:00 2024-09-11T23:16:48.339 INFO:teuthology.orchestra.run.smithi005.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-11T23:16:48.341 INFO:teuthology.orchestra.run.smithi159.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-11T23:16:49.055 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 19 kB 00:00 2024-09-11T23:16:49.976 INFO:teuthology.orchestra.run.smithi172.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-11T23:16:53.798 INFO:teuthology.orchestra.run.smithi159.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-09-11T23:16:54.070 INFO:teuthology.orchestra.run.smithi005.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-11T23:16:55.416 INFO:teuthology.orchestra.run.smithi172.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-11T23:16:56.176 INFO:teuthology.orchestra.run.smithi159.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T23:16:56.177 INFO:teuthology.orchestra.run.smithi159.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T23:16:56.191 INFO:teuthology.orchestra.run.smithi159.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-11T23:16:56.192 INFO:teuthology.orchestra.run.smithi159.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-11T23:16:56.193 INFO:teuthology.orchestra.run.smithi159.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-11T23:16:56.193 INFO:teuthology.orchestra.run.smithi159.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-11T23:16:56.196 INFO:teuthology.orchestra.run.smithi159.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-11T23:16:56.198 INFO:teuthology.orchestra.run.smithi159.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-11T23:16:56.199 INFO:teuthology.orchestra.run.smithi159.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-11T23:16:56.263 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-09-11T23:16:56.290 INFO:teuthology.orchestra.run.smithi159.stdout:====================================================================================== 2024-09-11T23:16:56.290 INFO:teuthology.orchestra.run.smithi159.stdout: Package Arch Version Repository Size 2024-09-11T23:16:56.290 INFO:teuthology.orchestra.run.smithi159.stdout:====================================================================================== 2024-09-11T23:16:56.291 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2024-09-11T23:16:56.291 INFO:teuthology.orchestra.run.smithi159.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-11T23:16:56.291 INFO:teuthology.orchestra.run.smithi159.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-11T23:16:56.291 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-11T23:16:56.291 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-11T23:16:56.291 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-11T23:16:56.291 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-11T23:16:56.291 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-11T23:16:56.291 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-11T23:16:56.291 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-11T23:16:56.291 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-11T23:16:56.292 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-11T23:16:56.292 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-11T23:16:56.292 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-11T23:16:56.292 INFO:teuthology.orchestra.run.smithi159.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-11T23:16:56.292 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-11T23:16:56.292 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-11T23:16:56.292 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-11T23:16:56.292 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-11T23:16:56.292 INFO:teuthology.orchestra.run.smithi159.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-11T23:16:56.292 INFO:teuthology.orchestra.run.smithi159.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-11T23:16:56.293 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-11T23:16:56.293 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-11T23:16:56.293 INFO:teuthology.orchestra.run.smithi159.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-11T23:16:56.293 INFO:teuthology.orchestra.run.smithi159.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-11T23:16:56.293 INFO:teuthology.orchestra.run.smithi159.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-11T23:16:56.293 INFO:teuthology.orchestra.run.smithi159.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-11T23:16:56.293 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-11T23:16:56.293 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-11T23:16:56.293 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-11T23:16:56.293 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-11T23:16:56.294 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-11T23:16:56.294 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-11T23:16:56.294 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-11T23:16:56.294 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-11T23:16:56.294 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-11T23:16:56.294 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-11T23:16:56.294 INFO:teuthology.orchestra.run.smithi159.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-11T23:16:56.294 INFO:teuthology.orchestra.run.smithi159.stdout:Upgrading: 2024-09-11T23:16:56.294 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-11T23:16:56.294 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-11T23:16:56.294 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-11T23:16:56.294 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-11T23:16:56.295 INFO:teuthology.orchestra.run.smithi159.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-11T23:16:56.295 INFO:teuthology.orchestra.run.smithi159.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-11T23:16:56.295 INFO:teuthology.orchestra.run.smithi159.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-11T23:16:56.295 INFO:teuthology.orchestra.run.smithi159.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-11T23:16:56.295 INFO:teuthology.orchestra.run.smithi159.stdout:Installing dependencies: 2024-09-11T23:16:56.295 INFO:teuthology.orchestra.run.smithi159.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T23:16:56.295 INFO:teuthology.orchestra.run.smithi159.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-11T23:16:56.295 INFO:teuthology.orchestra.run.smithi159.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T23:16:56.295 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-11T23:16:56.295 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-11T23:16:56.295 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-11T23:16:56.295 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-11T23:16:56.296 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-11T23:16:56.296 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-11T23:16:56.296 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-11T23:16:56.296 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-11T23:16:56.296 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T23:16:56.296 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T23:16:56.297 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T23:16:56.297 INFO:teuthology.orchestra.run.smithi159.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T23:16:56.297 INFO:teuthology.orchestra.run.smithi159.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T23:16:56.297 INFO:teuthology.orchestra.run.smithi159.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T23:16:56.297 INFO:teuthology.orchestra.run.smithi159.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T23:16:56.297 INFO:teuthology.orchestra.run.smithi159.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T23:16:56.297 INFO:teuthology.orchestra.run.smithi159.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-11T23:16:56.298 INFO:teuthology.orchestra.run.smithi159.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T23:16:56.298 INFO:teuthology.orchestra.run.smithi159.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T23:16:56.298 INFO:teuthology.orchestra.run.smithi159.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T23:16:56.298 INFO:teuthology.orchestra.run.smithi159.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T23:16:56.298 INFO:teuthology.orchestra.run.smithi159.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T23:16:56.298 INFO:teuthology.orchestra.run.smithi159.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-11T23:16:56.298 INFO:teuthology.orchestra.run.smithi159.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T23:16:56.298 INFO:teuthology.orchestra.run.smithi159.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-11T23:16:56.298 INFO:teuthology.orchestra.run.smithi159.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T23:16:56.298 INFO:teuthology.orchestra.run.smithi159.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-11T23:16:56.298 INFO:teuthology.orchestra.run.smithi159.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T23:16:56.298 INFO:teuthology.orchestra.run.smithi159.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T23:16:56.298 INFO:teuthology.orchestra.run.smithi159.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T23:16:56.299 INFO:teuthology.orchestra.run.smithi159.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T23:16:56.299 INFO:teuthology.orchestra.run.smithi159.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T23:16:56.299 INFO:teuthology.orchestra.run.smithi159.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T23:16:56.299 INFO:teuthology.orchestra.run.smithi159.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T23:16:56.299 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-11T23:16:56.299 INFO:teuthology.orchestra.run.smithi159.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T23:16:56.299 INFO:teuthology.orchestra.run.smithi159.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T23:16:56.299 INFO:teuthology.orchestra.run.smithi159.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T23:16:56.299 INFO:teuthology.orchestra.run.smithi159.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-11T23:16:56.300 INFO:teuthology.orchestra.run.smithi159.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T23:16:56.300 INFO:teuthology.orchestra.run.smithi159.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T23:16:56.300 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T23:16:56.300 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-11T23:16:56.300 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-11T23:16:56.300 INFO:teuthology.orchestra.run.smithi159.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T23:16:56.300 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T23:16:56.300 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T23:16:56.300 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T23:16:56.300 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-11T23:16:56.300 INFO:teuthology.orchestra.run.smithi159.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-11T23:16:56.300 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T23:16:56.300 INFO:teuthology.orchestra.run.smithi159.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T23:16:56.301 INFO:teuthology.orchestra.run.smithi159.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T23:16:56.301 INFO:teuthology.orchestra.run.smithi159.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T23:16:56.301 INFO:teuthology.orchestra.run.smithi159.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T23:16:56.301 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T23:16:56.301 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T23:16:56.301 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-11T23:16:56.301 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T23:16:56.301 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T23:16:56.301 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T23:16:56.301 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T23:16:56.301 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T23:16:56.301 INFO:teuthology.orchestra.run.smithi159.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T23:16:56.302 INFO:teuthology.orchestra.run.smithi159.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T23:16:56.302 INFO:teuthology.orchestra.run.smithi159.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T23:16:56.302 INFO:teuthology.orchestra.run.smithi159.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T23:16:56.302 INFO:teuthology.orchestra.run.smithi159.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T23:16:56.302 INFO:teuthology.orchestra.run.smithi159.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T23:16:56.302 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T23:16:56.302 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T23:16:56.302 INFO:teuthology.orchestra.run.smithi159.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T23:16:56.302 INFO:teuthology.orchestra.run.smithi159.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T23:16:56.302 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T23:16:56.302 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T23:16:56.302 INFO:teuthology.orchestra.run.smithi159.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T23:16:56.302 INFO:teuthology.orchestra.run.smithi159.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T23:16:56.303 INFO:teuthology.orchestra.run.smithi159.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T23:16:56.303 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T23:16:56.303 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T23:16:56.303 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T23:16:56.303 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T23:16:56.303 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-11T23:16:56.303 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T23:16:56.303 INFO:teuthology.orchestra.run.smithi159.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T23:16:56.303 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T23:16:56.304 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T23:16:56.304 INFO:teuthology.orchestra.run.smithi159.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T23:16:56.304 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T23:16:56.304 INFO:teuthology.orchestra.run.smithi159.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T23:16:56.304 INFO:teuthology.orchestra.run.smithi159.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T23:16:56.304 INFO:teuthology.orchestra.run.smithi159.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T23:16:56.304 INFO:teuthology.orchestra.run.smithi159.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T23:16:56.304 INFO:teuthology.orchestra.run.smithi159.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T23:16:56.304 INFO:teuthology.orchestra.run.smithi159.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-11T23:16:56.304 INFO:teuthology.orchestra.run.smithi159.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T23:16:56.304 INFO:teuthology.orchestra.run.smithi159.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T23:16:56.304 INFO:teuthology.orchestra.run.smithi159.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T23:16:56.304 INFO:teuthology.orchestra.run.smithi159.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T23:16:56.305 INFO:teuthology.orchestra.run.smithi159.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T23:16:56.305 INFO:teuthology.orchestra.run.smithi159.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T23:16:56.305 INFO:teuthology.orchestra.run.smithi159.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T23:16:56.305 INFO:teuthology.orchestra.run.smithi159.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T23:16:56.305 INFO:teuthology.orchestra.run.smithi159.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T23:16:56.305 INFO:teuthology.orchestra.run.smithi159.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-11T23:16:56.305 INFO:teuthology.orchestra.run.smithi159.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T23:16:56.305 INFO:teuthology.orchestra.run.smithi159.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-11T23:16:56.305 INFO:teuthology.orchestra.run.smithi159.stdout:Installing weak dependencies: 2024-09-11T23:16:56.305 INFO:teuthology.orchestra.run.smithi159.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T23:16:56.305 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-11T23:16:56.305 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2024-09-11T23:16:56.305 INFO:teuthology.orchestra.run.smithi159.stdout:====================================================================================== 2024-09-11T23:16:56.306 INFO:teuthology.orchestra.run.smithi159.stdout:Install 148 Packages 2024-09-11T23:16:56.306 INFO:teuthology.orchestra.run.smithi159.stdout:Upgrade 8 Packages 2024-09-11T23:16:56.306 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-11T23:16:56.306 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 226 M 2024-09-11T23:16:56.306 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2024-09-11T23:16:56.481 INFO:teuthology.orchestra.run.smithi005.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T23:16:56.482 INFO:teuthology.orchestra.run.smithi005.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T23:16:56.493 INFO:teuthology.orchestra.run.smithi005.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-11T23:16:56.494 INFO:teuthology.orchestra.run.smithi005.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-11T23:16:56.495 INFO:teuthology.orchestra.run.smithi005.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-11T23:16:56.496 INFO:teuthology.orchestra.run.smithi005.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-11T23:16:56.498 INFO:teuthology.orchestra.run.smithi005.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-11T23:16:56.500 INFO:teuthology.orchestra.run.smithi005.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-11T23:16:56.501 INFO:teuthology.orchestra.run.smithi005.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-11T23:16:56.567 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-11T23:16:56.577 INFO:teuthology.orchestra.run.smithi005.stdout:====================================================================================== 2024-09-11T23:16:56.577 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2024-09-11T23:16:56.577 INFO:teuthology.orchestra.run.smithi005.stdout:====================================================================================== 2024-09-11T23:16:56.577 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-09-11T23:16:56.577 INFO:teuthology.orchestra.run.smithi005.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-11T23:16:56.577 INFO:teuthology.orchestra.run.smithi005.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-11T23:16:56.577 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-11T23:16:56.577 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-11T23:16:56.578 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-11T23:16:56.578 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-11T23:16:56.578 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-11T23:16:56.578 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-11T23:16:56.578 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-11T23:16:56.578 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-11T23:16:56.578 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-11T23:16:56.578 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-11T23:16:56.578 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-11T23:16:56.578 INFO:teuthology.orchestra.run.smithi005.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-11T23:16:56.578 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-11T23:16:56.578 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-11T23:16:56.579 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-11T23:16:56.579 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-11T23:16:56.579 INFO:teuthology.orchestra.run.smithi005.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-11T23:16:56.579 INFO:teuthology.orchestra.run.smithi005.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-11T23:16:56.579 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-11T23:16:56.579 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-11T23:16:56.579 INFO:teuthology.orchestra.run.smithi005.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-11T23:16:56.579 INFO:teuthology.orchestra.run.smithi005.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-11T23:16:56.579 INFO:teuthology.orchestra.run.smithi005.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-11T23:16:56.579 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-11T23:16:56.579 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-11T23:16:56.579 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-11T23:16:56.580 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-11T23:16:56.580 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-11T23:16:56.580 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-11T23:16:56.580 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-11T23:16:56.580 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-11T23:16:56.580 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-11T23:16:56.580 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-11T23:16:56.580 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-11T23:16:56.580 INFO:teuthology.orchestra.run.smithi005.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-11T23:16:56.580 INFO:teuthology.orchestra.run.smithi005.stdout:Upgrading: 2024-09-11T23:16:56.580 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-11T23:16:56.580 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-11T23:16:56.581 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-11T23:16:56.581 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-11T23:16:56.581 INFO:teuthology.orchestra.run.smithi005.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-11T23:16:56.581 INFO:teuthology.orchestra.run.smithi005.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-11T23:16:56.581 INFO:teuthology.orchestra.run.smithi005.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-11T23:16:56.581 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-11T23:16:56.581 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2024-09-11T23:16:56.581 INFO:teuthology.orchestra.run.smithi005.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T23:16:56.581 INFO:teuthology.orchestra.run.smithi005.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-11T23:16:56.581 INFO:teuthology.orchestra.run.smithi005.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T23:16:56.581 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-11T23:16:56.581 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-11T23:16:56.582 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-11T23:16:56.582 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-11T23:16:56.582 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-11T23:16:56.582 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-11T23:16:56.582 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-11T23:16:56.582 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-11T23:16:56.582 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T23:16:56.582 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T23:16:56.582 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T23:16:56.582 INFO:teuthology.orchestra.run.smithi005.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T23:16:56.582 INFO:teuthology.orchestra.run.smithi005.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T23:16:56.582 INFO:teuthology.orchestra.run.smithi005.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T23:16:56.582 INFO:teuthology.orchestra.run.smithi005.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T23:16:56.583 INFO:teuthology.orchestra.run.smithi005.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T23:16:56.583 INFO:teuthology.orchestra.run.smithi005.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-11T23:16:56.583 INFO:teuthology.orchestra.run.smithi005.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T23:16:56.583 INFO:teuthology.orchestra.run.smithi005.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T23:16:56.583 INFO:teuthology.orchestra.run.smithi005.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T23:16:56.583 INFO:teuthology.orchestra.run.smithi005.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T23:16:56.583 INFO:teuthology.orchestra.run.smithi005.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T23:16:56.583 INFO:teuthology.orchestra.run.smithi005.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-11T23:16:56.583 INFO:teuthology.orchestra.run.smithi005.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T23:16:56.583 INFO:teuthology.orchestra.run.smithi005.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-11T23:16:56.583 INFO:teuthology.orchestra.run.smithi005.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T23:16:56.584 INFO:teuthology.orchestra.run.smithi005.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-11T23:16:56.584 INFO:teuthology.orchestra.run.smithi005.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T23:16:56.584 INFO:teuthology.orchestra.run.smithi005.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T23:16:56.584 INFO:teuthology.orchestra.run.smithi005.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T23:16:56.584 INFO:teuthology.orchestra.run.smithi005.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T23:16:56.584 INFO:teuthology.orchestra.run.smithi005.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T23:16:56.584 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T23:16:56.584 INFO:teuthology.orchestra.run.smithi005.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T23:16:56.584 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-11T23:16:56.584 INFO:teuthology.orchestra.run.smithi005.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T23:16:56.584 INFO:teuthology.orchestra.run.smithi005.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T23:16:56.585 INFO:teuthology.orchestra.run.smithi005.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T23:16:56.585 INFO:teuthology.orchestra.run.smithi005.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-11T23:16:56.585 INFO:teuthology.orchestra.run.smithi005.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T23:16:56.585 INFO:teuthology.orchestra.run.smithi005.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T23:16:56.585 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T23:16:56.585 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-11T23:16:56.585 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-11T23:16:56.585 INFO:teuthology.orchestra.run.smithi005.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T23:16:56.585 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T23:16:56.585 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T23:16:56.585 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T23:16:56.585 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-11T23:16:56.586 INFO:teuthology.orchestra.run.smithi005.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-11T23:16:56.586 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T23:16:56.586 INFO:teuthology.orchestra.run.smithi005.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T23:16:56.586 INFO:teuthology.orchestra.run.smithi005.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T23:16:56.586 INFO:teuthology.orchestra.run.smithi005.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T23:16:56.586 INFO:teuthology.orchestra.run.smithi005.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T23:16:56.586 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T23:16:56.586 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T23:16:56.586 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-11T23:16:56.586 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T23:16:56.586 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T23:16:56.586 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T23:16:56.587 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T23:16:56.587 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T23:16:56.587 INFO:teuthology.orchestra.run.smithi005.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T23:16:56.587 INFO:teuthology.orchestra.run.smithi005.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T23:16:56.587 INFO:teuthology.orchestra.run.smithi005.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T23:16:56.587 INFO:teuthology.orchestra.run.smithi005.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T23:16:56.587 INFO:teuthology.orchestra.run.smithi005.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T23:16:56.587 INFO:teuthology.orchestra.run.smithi005.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T23:16:56.587 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T23:16:56.587 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T23:16:56.587 INFO:teuthology.orchestra.run.smithi005.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T23:16:56.587 INFO:teuthology.orchestra.run.smithi005.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T23:16:56.587 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T23:16:56.588 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T23:16:56.588 INFO:teuthology.orchestra.run.smithi005.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T23:16:56.588 INFO:teuthology.orchestra.run.smithi005.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T23:16:56.588 INFO:teuthology.orchestra.run.smithi005.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T23:16:56.588 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T23:16:56.588 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T23:16:56.588 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T23:16:56.588 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T23:16:56.588 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-11T23:16:56.588 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T23:16:56.588 INFO:teuthology.orchestra.run.smithi005.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T23:16:56.588 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T23:16:56.589 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T23:16:56.589 INFO:teuthology.orchestra.run.smithi005.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T23:16:56.589 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T23:16:56.589 INFO:teuthology.orchestra.run.smithi005.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T23:16:56.589 INFO:teuthology.orchestra.run.smithi005.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T23:16:56.589 INFO:teuthology.orchestra.run.smithi005.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T23:16:56.589 INFO:teuthology.orchestra.run.smithi005.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T23:16:56.589 INFO:teuthology.orchestra.run.smithi005.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T23:16:56.589 INFO:teuthology.orchestra.run.smithi005.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-11T23:16:56.589 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T23:16:56.589 INFO:teuthology.orchestra.run.smithi005.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T23:16:56.589 INFO:teuthology.orchestra.run.smithi005.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T23:16:56.589 INFO:teuthology.orchestra.run.smithi005.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T23:16:56.590 INFO:teuthology.orchestra.run.smithi005.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T23:16:56.590 INFO:teuthology.orchestra.run.smithi005.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T23:16:56.590 INFO:teuthology.orchestra.run.smithi005.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T23:16:56.590 INFO:teuthology.orchestra.run.smithi005.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T23:16:56.590 INFO:teuthology.orchestra.run.smithi005.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T23:16:56.590 INFO:teuthology.orchestra.run.smithi005.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-11T23:16:56.590 INFO:teuthology.orchestra.run.smithi005.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T23:16:56.590 INFO:teuthology.orchestra.run.smithi005.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-11T23:16:56.590 INFO:teuthology.orchestra.run.smithi005.stdout:Installing weak dependencies: 2024-09-11T23:16:56.590 INFO:teuthology.orchestra.run.smithi005.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T23:16:56.590 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:16:56.590 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-09-11T23:16:56.591 INFO:teuthology.orchestra.run.smithi005.stdout:====================================================================================== 2024-09-11T23:16:56.591 INFO:teuthology.orchestra.run.smithi005.stdout:Install 148 Packages 2024-09-11T23:16:56.591 INFO:teuthology.orchestra.run.smithi005.stdout:Upgrade 8 Packages 2024-09-11T23:16:56.591 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:16:56.591 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 226 M 2024-09-11T23:16:56.591 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-09-11T23:16:56.641 INFO:teuthology.orchestra.run.smithi159.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 45 kB/s | 6.5 kB 00:00 2024-09-11T23:16:56.908 INFO:teuthology.orchestra.run.smithi159.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 3.3 MB/s | 897 kB 00:00 2024-09-11T23:16:57.000 INFO:teuthology.orchestra.run.smithi159.stdout:(3/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 11 MB/s | 5.4 MB 00:00 2024-09-11T23:16:57.025 INFO:teuthology.orchestra.run.smithi159.stdout:(4/156): ceph-immutable-object-cache-19.1.1-298 1.2 MB/s | 145 kB 00:00 2024-09-11T23:16:57.133 INFO:teuthology.orchestra.run.smithi159.stdout:(5/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 18 MB/s | 2.4 MB 00:00 2024-09-11T23:16:57.238 INFO:teuthology.orchestra.run.smithi005.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 28 kB/s | 6.5 kB 00:00 2024-09-11T23:16:57.284 INFO:teuthology.orchestra.run.smithi159.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 5.9 MB/s | 1.5 MB 00:00 2024-09-11T23:16:57.426 INFO:teuthology.orchestra.run.smithi159.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 16 MB/s | 4.7 MB 00:00 2024-09-11T23:16:57.505 INFO:teuthology.orchestra.run.smithi005.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 3.3 MB/s | 897 kB 00:00 2024-09-11T23:16:57.555 INFO:teuthology.orchestra.run.smithi005.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 2.8 MB/s | 145 kB 00:00 2024-09-11T23:16:57.626 INFO:teuthology.orchestra.run.smithi159.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 19 MB/s | 21 MB 00:01 2024-09-11T23:16:57.685 INFO:teuthology.orchestra.run.smithi159.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 432 kB/s | 25 kB 00:00 2024-09-11T23:16:57.697 INFO:teuthology.orchestra.run.smithi005.stdout:(4/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 17 MB/s | 2.4 MB 00:00 2024-09-11T23:16:57.776 INFO:teuthology.orchestra.run.smithi172.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T23:16:57.777 INFO:teuthology.orchestra.run.smithi172.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T23:16:57.788 INFO:teuthology.orchestra.run.smithi172.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-11T23:16:57.789 INFO:teuthology.orchestra.run.smithi172.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-11T23:16:57.790 INFO:teuthology.orchestra.run.smithi172.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-11T23:16:57.791 INFO:teuthology.orchestra.run.smithi172.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-11T23:16:57.793 INFO:teuthology.orchestra.run.smithi172.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-11T23:16:57.795 INFO:teuthology.orchestra.run.smithi172.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-11T23:16:57.796 INFO:teuthology.orchestra.run.smithi172.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-11T23:16:57.860 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-11T23:16:57.872 INFO:teuthology.orchestra.run.smithi005.stdout:(5/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 8.7 MB/s | 1.5 MB 00:00 2024-09-11T23:16:57.882 INFO:teuthology.orchestra.run.smithi172.stdout:====================================================================================== 2024-09-11T23:16:57.882 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-09-11T23:16:57.882 INFO:teuthology.orchestra.run.smithi172.stdout:====================================================================================== 2024-09-11T23:16:57.882 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-11T23:16:57.883 INFO:teuthology.orchestra.run.smithi172.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-11T23:16:57.883 INFO:teuthology.orchestra.run.smithi172.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-11T23:16:57.883 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-11T23:16:57.883 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-11T23:16:57.883 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-11T23:16:57.883 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-11T23:16:57.883 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-11T23:16:57.883 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-11T23:16:57.883 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-11T23:16:57.883 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-11T23:16:57.883 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-11T23:16:57.883 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-11T23:16:57.883 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-11T23:16:57.884 INFO:teuthology.orchestra.run.smithi172.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-11T23:16:57.884 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-11T23:16:57.884 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-11T23:16:57.884 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-11T23:16:57.884 INFO:teuthology.orchestra.run.smithi172.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-11T23:16:57.884 INFO:teuthology.orchestra.run.smithi172.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-11T23:16:57.884 INFO:teuthology.orchestra.run.smithi172.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-11T23:16:57.884 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-11T23:16:57.884 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-11T23:16:57.884 INFO:teuthology.orchestra.run.smithi172.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-11T23:16:57.884 INFO:teuthology.orchestra.run.smithi172.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-11T23:16:57.884 INFO:teuthology.orchestra.run.smithi172.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-11T23:16:57.884 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-11T23:16:57.885 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-11T23:16:57.885 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-11T23:16:57.885 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-11T23:16:57.885 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-11T23:16:57.885 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-11T23:16:57.885 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-11T23:16:57.885 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-11T23:16:57.885 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-11T23:16:57.885 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-11T23:16:57.885 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-11T23:16:57.885 INFO:teuthology.orchestra.run.smithi172.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-11T23:16:57.885 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrading: 2024-09-11T23:16:57.886 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-11T23:16:57.886 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-11T23:16:57.886 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-11T23:16:57.886 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-11T23:16:57.886 INFO:teuthology.orchestra.run.smithi172.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-11T23:16:57.886 INFO:teuthology.orchestra.run.smithi172.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-11T23:16:57.886 INFO:teuthology.orchestra.run.smithi172.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-11T23:16:57.886 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-11T23:16:57.886 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-09-11T23:16:57.886 INFO:teuthology.orchestra.run.smithi172.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T23:16:57.886 INFO:teuthology.orchestra.run.smithi172.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-11T23:16:57.886 INFO:teuthology.orchestra.run.smithi172.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T23:16:57.887 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-11T23:16:57.887 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-11T23:16:57.887 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-11T23:16:57.887 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-11T23:16:57.887 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-11T23:16:57.887 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-11T23:16:57.887 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-11T23:16:57.887 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-11T23:16:57.887 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T23:16:57.887 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T23:16:57.887 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T23:16:57.887 INFO:teuthology.orchestra.run.smithi172.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T23:16:57.888 INFO:teuthology.orchestra.run.smithi172.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T23:16:57.888 INFO:teuthology.orchestra.run.smithi172.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T23:16:57.888 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T23:16:57.888 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T23:16:57.888 INFO:teuthology.orchestra.run.smithi172.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-11T23:16:57.888 INFO:teuthology.orchestra.run.smithi172.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T23:16:57.888 INFO:teuthology.orchestra.run.smithi172.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T23:16:57.888 INFO:teuthology.orchestra.run.smithi172.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T23:16:57.888 INFO:teuthology.orchestra.run.smithi172.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T23:16:57.888 INFO:teuthology.orchestra.run.smithi172.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T23:16:57.888 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-11T23:16:57.888 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T23:16:57.889 INFO:teuthology.orchestra.run.smithi172.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-11T23:16:57.889 INFO:teuthology.orchestra.run.smithi172.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T23:16:57.889 INFO:teuthology.orchestra.run.smithi172.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-11T23:16:57.889 INFO:teuthology.orchestra.run.smithi172.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T23:16:57.889 INFO:teuthology.orchestra.run.smithi172.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T23:16:57.889 INFO:teuthology.orchestra.run.smithi172.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T23:16:57.889 INFO:teuthology.orchestra.run.smithi172.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T23:16:57.889 INFO:teuthology.orchestra.run.smithi172.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T23:16:57.889 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T23:16:57.889 INFO:teuthology.orchestra.run.smithi172.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T23:16:57.889 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-11T23:16:57.889 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T23:16:57.889 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T23:16:57.890 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T23:16:57.890 INFO:teuthology.orchestra.run.smithi172.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-11T23:16:57.890 INFO:teuthology.orchestra.run.smithi172.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T23:16:57.890 INFO:teuthology.orchestra.run.smithi172.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T23:16:57.890 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T23:16:57.890 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-11T23:16:57.890 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-11T23:16:57.890 INFO:teuthology.orchestra.run.smithi172.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T23:16:57.890 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T23:16:57.890 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T23:16:57.890 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T23:16:57.890 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-11T23:16:57.890 INFO:teuthology.orchestra.run.smithi172.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-11T23:16:57.891 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T23:16:57.891 INFO:teuthology.orchestra.run.smithi172.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T23:16:57.891 INFO:teuthology.orchestra.run.smithi172.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T23:16:57.891 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T23:16:57.891 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T23:16:57.891 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T23:16:57.891 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T23:16:57.891 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-11T23:16:57.891 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T23:16:57.891 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T23:16:57.891 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T23:16:57.891 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T23:16:57.891 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T23:16:57.892 INFO:teuthology.orchestra.run.smithi172.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T23:16:57.892 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T23:16:57.892 INFO:teuthology.orchestra.run.smithi172.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T23:16:57.892 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T23:16:57.892 INFO:teuthology.orchestra.run.smithi172.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T23:16:57.892 INFO:teuthology.orchestra.run.smithi172.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T23:16:57.892 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T23:16:57.892 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T23:16:57.892 INFO:teuthology.orchestra.run.smithi172.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T23:16:57.892 INFO:teuthology.orchestra.run.smithi172.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T23:16:57.892 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T23:16:57.892 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T23:16:57.893 INFO:teuthology.orchestra.run.smithi172.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T23:16:57.893 INFO:teuthology.orchestra.run.smithi172.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T23:16:57.893 INFO:teuthology.orchestra.run.smithi172.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T23:16:57.893 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T23:16:57.893 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T23:16:57.893 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T23:16:57.893 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T23:16:57.893 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-11T23:16:57.893 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T23:16:57.893 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T23:16:57.893 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T23:16:57.893 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T23:16:57.893 INFO:teuthology.orchestra.run.smithi172.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T23:16:57.894 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T23:16:57.894 INFO:teuthology.orchestra.run.smithi172.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T23:16:57.894 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T23:16:57.894 INFO:teuthology.orchestra.run.smithi172.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T23:16:57.894 INFO:teuthology.orchestra.run.smithi172.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T23:16:57.894 INFO:teuthology.orchestra.run.smithi172.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T23:16:57.894 INFO:teuthology.orchestra.run.smithi172.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-11T23:16:57.894 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T23:16:57.894 INFO:teuthology.orchestra.run.smithi172.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T23:16:57.894 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T23:16:57.894 INFO:teuthology.orchestra.run.smithi172.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T23:16:57.894 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T23:16:57.894 INFO:teuthology.orchestra.run.smithi172.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T23:16:57.895 INFO:teuthology.orchestra.run.smithi172.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T23:16:57.895 INFO:teuthology.orchestra.run.smithi172.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T23:16:57.895 INFO:teuthology.orchestra.run.smithi172.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T23:16:57.895 INFO:teuthology.orchestra.run.smithi172.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-11T23:16:57.895 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T23:16:57.895 INFO:teuthology.orchestra.run.smithi172.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-11T23:16:57.895 INFO:teuthology.orchestra.run.smithi172.stdout:Installing weak dependencies: 2024-09-11T23:16:57.895 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T23:16:57.895 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-11T23:16:57.895 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-11T23:16:57.895 INFO:teuthology.orchestra.run.smithi172.stdout:====================================================================================== 2024-09-11T23:16:57.895 INFO:teuthology.orchestra.run.smithi172.stdout:Install 148 Packages 2024-09-11T23:16:57.895 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrade 8 Packages 2024-09-11T23:16:57.896 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-11T23:16:57.896 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 226 M 2024-09-11T23:16:57.897 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-11T23:16:58.185 INFO:teuthology.orchestra.run.smithi159.stdout:(10/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 14 MB/s | 11 MB 00:00 2024-09-11T23:16:58.231 INFO:teuthology.orchestra.run.smithi005.stdout:(6/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 13 MB/s | 4.7 MB 00:00 2024-09-11T23:16:58.243 INFO:teuthology.orchestra.run.smithi159.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 3.8 MB/s | 228 kB 00:00 2024-09-11T23:16:58.344 INFO:teuthology.orchestra.run.smithi159.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 270 kB/s | 27 kB 00:00 2024-09-11T23:16:58.444 INFO:teuthology.orchestra.run.smithi159.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 317 kB/s | 32 kB 00:00 2024-09-11T23:16:58.883 INFO:teuthology.orchestra.run.smithi172.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 28 kB/s | 6.5 kB 00:00 2024-09-11T23:16:58.894 INFO:teuthology.orchestra.run.smithi159.stdout:(14/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 10 MB/s | 17 MB 00:01 2024-09-11T23:16:58.961 INFO:teuthology.orchestra.run.smithi159.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 2.4 MB/s | 163 kB 00:00 2024-09-11T23:16:59.028 INFO:teuthology.orchestra.run.smithi159.stdout:(16/156): librados-devel-19.1.1-298.gb53b6d3e.e 1.9 MB/s | 127 kB 00:00 2024-09-11T23:16:59.112 INFO:teuthology.orchestra.run.smithi159.stdout:(17/156): libradosstriper1-19.1.1-298.gb53b6d3e 5.9 MB/s | 506 kB 00:00 2024-09-11T23:16:59.172 INFO:teuthology.orchestra.run.smithi005.stdout:(7/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86_ 18 MB/s | 17 MB 00:00 2024-09-11T23:16:59.454 INFO:teuthology.orchestra.run.smithi159.stdout:(18/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 745 kB/s | 752 kB 00:01 2024-09-11T23:16:59.500 INFO:teuthology.orchestra.run.smithi172.stdout:(2/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 6.3 MB/s | 5.4 MB 00:00 2024-09-11T23:16:59.525 INFO:teuthology.orchestra.run.smithi172.stdout:(3/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.4 MB/s | 897 kB 00:00 2024-09-11T23:16:59.546 INFO:teuthology.orchestra.run.smithi159.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 493 kB/s | 45 kB 00:00 2024-09-11T23:16:59.583 INFO:teuthology.orchestra.run.smithi172.stdout:(4/156): ceph-immutable-object-cache-19.1.1-298 1.7 MB/s | 145 kB 00:00 2024-09-11T23:16:59.637 INFO:teuthology.orchestra.run.smithi159.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 1.4 MB/s | 136 kB 00:00 2024-09-11T23:16:59.713 INFO:teuthology.orchestra.run.smithi159.stdout:(21/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 8.9 MB/s | 5.3 MB 00:00 2024-09-11T23:16:59.739 INFO:teuthology.orchestra.run.smithi159.stdout:(22/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 1.6 MB/s | 162 kB 00:00 2024-09-11T23:16:59.792 INFO:teuthology.orchestra.run.smithi172.stdout:(5/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 7.3 MB/s | 1.5 MB 00:00 2024-09-11T23:16:59.814 INFO:teuthology.orchestra.run.smithi159.stdout:(23/156): python3-rados-19.1.1-298.gb53b6d3e.el 3.1 MB/s | 321 kB 00:00 2024-09-11T23:16:59.839 INFO:teuthology.orchestra.run.smithi159.stdout:(24/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 2.9 MB/s | 301 kB 00:00 2024-09-11T23:16:59.906 INFO:teuthology.orchestra.run.smithi159.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.1 MB/s | 100 kB 00:00 2024-09-11T23:16:59.931 INFO:teuthology.orchestra.run.smithi159.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 928 kB/s | 85 kB 00:00 2024-09-11T23:17:00.015 INFO:teuthology.orchestra.run.smithi159.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 2.0 MB/s | 171 kB 00:00 2024-09-11T23:17:00.056 INFO:teuthology.orchestra.run.smithi005.stdout:(8/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9. 12 MB/s | 11 MB 00:00 2024-09-11T23:17:00.123 INFO:teuthology.orchestra.run.smithi005.stdout:(9/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 1.7 MB/s | 5.4 MB 00:03 2024-09-11T23:17:00.148 INFO:teuthology.orchestra.run.smithi005.stdout:(10/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9 275 kB/s | 25 kB 00:00 2024-09-11T23:17:00.198 INFO:teuthology.orchestra.run.smithi005.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 4.5 MB/s | 228 kB 00:00 2024-09-11T23:17:00.201 INFO:teuthology.orchestra.run.smithi172.stdout:(6/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 12 MB/s | 4.7 MB 00:00 2024-09-11T23:17:00.240 INFO:teuthology.orchestra.run.smithi005.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 648 kB/s | 27 kB 00:00 2024-09-11T23:17:00.274 INFO:teuthology.orchestra.run.smithi005.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 955 kB/s | 32 kB 00:00 2024-09-11T23:17:00.276 INFO:teuthology.orchestra.run.smithi172.stdout:(7/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 3.2 MB/s | 2.4 MB 00:00 2024-09-11T23:17:00.333 INFO:teuthology.orchestra.run.smithi005.stdout:(14/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 13 MB/s | 752 kB 00:00 2024-09-11T23:17:00.393 INFO:teuthology.orchestra.run.smithi005.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 2.6 MB/s | 163 kB 00:00 2024-09-11T23:17:00.452 INFO:teuthology.orchestra.run.smithi005.stdout:(16/156): librados-devel-19.1.1-298.gb53b6d3e.e 2.1 MB/s | 127 kB 00:00 2024-09-11T23:17:00.482 INFO:teuthology.orchestra.run.smithi159.stdout:(28/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 17 MB/s | 49 MB 00:02 2024-09-11T23:17:00.507 INFO:teuthology.orchestra.run.smithi159.stdout:(29/156): ceph-grafana-dashboards-19.1.1-298.gb 65 kB/s | 32 kB 00:00 2024-09-11T23:17:00.519 INFO:teuthology.orchestra.run.smithi005.stdout:(17/156): libradosstriper1-19.1.1-298.gb53b6d3e 7.4 MB/s | 506 kB 00:00 2024-09-11T23:17:00.566 INFO:teuthology.orchestra.run.smithi159.stdout:(30/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 4.7 MB/s | 3.1 MB 00:00 2024-09-11T23:17:00.591 INFO:teuthology.orchestra.run.smithi159.stdout:(31/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 1.3 MB/s | 146 kB 00:00 2024-09-11T23:17:00.683 INFO:teuthology.orchestra.run.smithi159.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 2.7 MB/s | 249 kB 00:00 2024-09-11T23:17:00.767 INFO:teuthology.orchestra.run.smithi159.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 592 kB/s | 49 kB 00:00 2024-09-11T23:17:00.850 INFO:teuthology.orchestra.run.smithi159.stdout:(34/156): ceph-prometheus-alerts-19.1.1-298.gb5 197 kB/s | 16 kB 00:00 2024-09-11T23:17:00.950 INFO:teuthology.orchestra.run.smithi159.stdout:(35/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 2.8 MB/s | 285 kB 00:00 2024-09-11T23:17:00.961 INFO:teuthology.orchestra.run.smithi005.stdout:(18/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 12 MB/s | 5.3 MB 00:00 2024-09-11T23:17:01.018 INFO:teuthology.orchestra.run.smithi159.stdout:(36/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 7.0 MB/s | 3.6 MB 00:00 2024-09-11T23:17:01.044 INFO:teuthology.orchestra.run.smithi005.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 544 kB/s | 45 kB 00:00 2024-09-11T23:17:01.093 INFO:teuthology.orchestra.run.smithi159.stdout:(37/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 5.3 MB/s | 765 kB 00:00 2024-09-11T23:17:01.118 INFO:teuthology.orchestra.run.smithi159.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 182 kB/s | 18 kB 00:00 2024-09-11T23:17:01.119 INFO:teuthology.orchestra.run.smithi005.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 1.8 MB/s | 136 kB 00:00 2024-09-11T23:17:01.186 INFO:teuthology.orchestra.run.smithi005.stdout:(21/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 2.4 MB/s | 162 kB 00:00 2024-09-11T23:17:01.245 INFO:teuthology.orchestra.run.smithi005.stdout:(22/156): python3-rados-19.1.1-298.gb53b6d3e.el 5.4 MB/s | 321 kB 00:00 2024-09-11T23:17:01.304 INFO:teuthology.orchestra.run.smithi005.stdout:(23/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 5.1 MB/s | 301 kB 00:00 2024-09-11T23:17:01.318 INFO:teuthology.orchestra.run.smithi172.stdout:(8/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86_ 15 MB/s | 17 MB 00:01 2024-09-11T23:17:01.319 INFO:teuthology.orchestra.run.smithi159.stdout:(39/156): ceph-mgr-diskprediction-local-19.1.1- 9.8 MB/s | 7.4 MB 00:00 2024-09-11T23:17:01.354 INFO:teuthology.orchestra.run.smithi005.stdout:(24/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.9 MB/s | 100 kB 00:00 2024-09-11T23:17:01.368 INFO:teuthology.orchestra.run.smithi172.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 506 kB/s | 25 kB 00:00 2024-09-11T23:17:01.369 INFO:teuthology.orchestra.run.smithi159.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 290 kB/s | 80 kB 00:00 2024-09-11T23:17:01.405 INFO:teuthology.orchestra.run.smithi005.stdout:(25/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-11T23:17:01.527 INFO:teuthology.orchestra.run.smithi172.stdout:(10/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 8.5 MB/s | 11 MB 00:01 2024-09-11T23:17:01.585 INFO:teuthology.orchestra.run.smithi172.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 3.8 MB/s | 228 kB 00:00 2024-09-11T23:17:01.635 INFO:teuthology.orchestra.run.smithi159.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 950 kB/s | 253 kB 00:00 2024-09-11T23:17:01.636 INFO:teuthology.orchestra.run.smithi172.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 543 kB/s | 27 kB 00:00 2024-09-11T23:17:01.678 INFO:teuthology.orchestra.run.smithi159.stdout:(42/156): libquadmath-11.5.0-2.el9.x86_64.rpm 533 kB/s | 191 kB 00:00 2024-09-11T23:17:01.686 INFO:teuthology.orchestra.run.smithi172.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 635 kB/s | 32 kB 00:00 2024-09-11T23:17:01.688 INFO:teuthology.orchestra.run.smithi005.stdout:(26/156): ceph-common-19.1.1-298.gb53b6d3e.el9. 4.5 MB/s | 21 MB 00:04 2024-09-11T23:17:01.747 INFO:teuthology.orchestra.run.smithi005.stdout:(27/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 9.1 MB/s | 3.1 MB 00:00 2024-09-11T23:17:01.753 INFO:teuthology.orchestra.run.smithi172.stdout:(14/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 11 MB/s | 752 kB 00:00 2024-09-11T23:17:01.772 INFO:teuthology.orchestra.run.smithi005.stdout:(28/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 2.0 MB/s | 171 kB 00:00 2024-09-11T23:17:01.797 INFO:teuthology.orchestra.run.smithi005.stdout:(29/156): ceph-grafana-dashboards-19.1.1-298.gb 634 kB/s | 32 kB 00:00 2024-09-11T23:17:01.802 INFO:teuthology.orchestra.run.smithi159.stdout:(43/156): libgfortran-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 801 kB 00:00 2024-09-11T23:17:01.811 INFO:teuthology.orchestra.run.smithi172.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 2.7 MB/s | 163 kB 00:00 2024-09-11T23:17:01.822 INFO:teuthology.orchestra.run.smithi005.stdout:(30/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 2.9 MB/s | 146 kB 00:00 2024-09-11T23:17:01.828 INFO:teuthology.orchestra.run.smithi159.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 709 kB/s | 106 kB 00:00 2024-09-11T23:17:01.870 INFO:teuthology.orchestra.run.smithi172.stdout:(16/156): librados-devel-19.1.1-298.gb53b6d3e.e 2.1 MB/s | 127 kB 00:00 2024-09-11T23:17:01.878 INFO:teuthology.orchestra.run.smithi159.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 135 kB 00:00 2024-09-11T23:17:01.946 INFO:teuthology.orchestra.run.smithi172.stdout:(17/156): libradosstriper1-19.1.1-298.gb53b6d3e 6.6 MB/s | 506 kB 00:00 2024-09-11T23:17:01.970 INFO:teuthology.orchestra.run.smithi159.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 880 kB/s | 125 kB 00:00 2024-09-11T23:17:01.995 INFO:teuthology.orchestra.run.smithi159.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-09-11T23:17:02.073 INFO:teuthology.orchestra.run.smithi005.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 13 MB/s | 3.6 MB 00:00 2024-09-11T23:17:02.104 INFO:teuthology.orchestra.run.smithi159.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 2.6 MB/s | 1.2 MB 00:00 2024-09-11T23:17:02.140 INFO:teuthology.orchestra.run.smithi005.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 3.7 MB/s | 249 kB 00:00 2024-09-11T23:17:02.179 INFO:teuthology.orchestra.run.smithi159.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 5.0 MB/s | 943 kB 00:00 2024-09-11T23:17:02.205 INFO:teuthology.orchestra.run.smithi159.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 2.9 MB/s | 689 kB 00:00 2024-09-11T23:17:02.207 INFO:teuthology.orchestra.run.smithi005.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 741 kB/s | 49 kB 00:00 2024-09-11T23:17:02.247 INFO:teuthology.orchestra.run.smithi159.stdout:(51/156): boost-program-options-1.75.0-8.el9.x8 751 kB/s | 107 kB 00:00 2024-09-11T23:17:02.257 INFO:teuthology.orchestra.run.smithi005.stdout:(34/156): ceph-prometheus-alerts-19.1.1-298.gb5 330 kB/s | 16 kB 00:00 2024-09-11T23:17:02.272 INFO:teuthology.orchestra.run.smithi159.stdout:(52/156): elfutils-libelf-devel-0.191-4.el9.x86 235 kB/s | 22 kB 00:00 2024-09-11T23:17:02.297 INFO:teuthology.orchestra.run.smithi159.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 3.3 MB/s | 313 kB 00:00 2024-09-11T23:17:02.307 INFO:teuthology.orchestra.run.smithi005.stdout:(35/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 5.6 MB/s | 285 kB 00:00 2024-09-11T23:17:02.312 INFO:teuthology.orchestra.run.smithi172.stdout:(18/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 15 MB/s | 5.3 MB 00:00 2024-09-11T23:17:02.339 INFO:teuthology.orchestra.run.smithi159.stdout:(54/156): flexiblas-3.0.4-8.el9.x86_64.rpm 355 kB/s | 33 kB 00:00 2024-09-11T23:17:02.373 INFO:teuthology.orchestra.run.smithi159.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 242 kB/s | 18 kB 00:00 2024-09-11T23:17:02.380 INFO:teuthology.orchestra.run.smithi172.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 678 kB/s | 45 kB 00:00 2024-09-11T23:17:02.391 INFO:teuthology.orchestra.run.smithi005.stdout:(36/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 9.0 MB/s | 765 kB 00:00 2024-09-11T23:17:02.423 INFO:teuthology.orchestra.run.smithi159.stdout:(56/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 20 MB/s | 3.0 MB 00:00 2024-09-11T23:17:02.438 INFO:teuthology.orchestra.run.smithi172.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 2.3 MB/s | 136 kB 00:00 2024-09-11T23:17:02.441 INFO:teuthology.orchestra.run.smithi005.stdout:(37/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 365 kB/s | 18 kB 00:00 2024-09-11T23:17:02.448 INFO:teuthology.orchestra.run.smithi159.stdout:(57/156): libaio-devel-0.3.111-13.el9.x86_64.rp 102 kB/s | 11 kB 00:00 2024-09-11T23:17:02.474 INFO:teuthology.orchestra.run.smithi159.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.6 MB/s | 160 kB 00:00 2024-09-11T23:17:02.497 INFO:teuthology.orchestra.run.smithi172.stdout:(21/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 2.7 MB/s | 162 kB 00:00 2024-09-11T23:17:02.499 INFO:teuthology.orchestra.run.smithi159.stdout:(59/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 599 kB/s | 45 kB 00:00 2024-09-11T23:17:02.558 INFO:teuthology.orchestra.run.smithi159.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 6.8 MB/s | 581 kB 00:00 2024-09-11T23:17:02.563 INFO:teuthology.orchestra.run.smithi172.stdout:(22/156): python3-rados-19.1.1-298.gb53b6d3e.el 4.7 MB/s | 321 kB 00:00 2024-09-11T23:17:02.566 INFO:teuthology.orchestra.run.smithi005.stdout:(38/156): fuse-2.9.9-16.el9.x86_64.rpm 639 kB/s | 80 kB 00:00 2024-09-11T23:17:02.583 INFO:teuthology.orchestra.run.smithi159.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 293 kB/s | 24 kB 00:00 2024-09-11T23:17:02.617 INFO:teuthology.orchestra.run.smithi159.stdout:(62/156): librdkafka-1.6.1-102.el9.x86_64.rpm 3.9 MB/s | 662 kB 00:00 2024-09-11T23:17:02.630 INFO:teuthology.orchestra.run.smithi172.stdout:(23/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 4.4 MB/s | 301 kB 00:00 2024-09-11T23:17:02.642 INFO:teuthology.orchestra.run.smithi159.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 565 kB/s | 47 kB 00:00 2024-09-11T23:17:02.667 INFO:teuthology.orchestra.run.smithi159.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-11T23:17:02.689 INFO:teuthology.orchestra.run.smithi172.stdout:(24/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.7 MB/s | 100 kB 00:00 2024-09-11T23:17:02.692 INFO:teuthology.orchestra.run.smithi005.stdout:(39/156): libgfortran-11.5.0-2.el9.x86_64.rpm 6.3 MB/s | 801 kB 00:00 2024-09-11T23:17:02.692 INFO:teuthology.orchestra.run.smithi159.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-09-11T23:17:02.709 INFO:teuthology.orchestra.run.smithi159.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 574 kB/s | 38 kB 00:00 2024-09-11T23:17:02.756 INFO:teuthology.orchestra.run.smithi172.stdout:(25/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.2 MB/s | 85 kB 00:00 2024-09-11T23:17:02.775 INFO:teuthology.orchestra.run.smithi005.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-11T23:17:02.810 INFO:teuthology.orchestra.run.smithi159.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-11T23:17:02.850 INFO:teuthology.orchestra.run.smithi005.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-09-11T23:17:02.885 INFO:teuthology.orchestra.run.smithi159.stdout:(68/156): openblas-openmp-0.3.26-2.el9.x86_64.r 23 MB/s | 4.9 MB 00:00 2024-09-11T23:17:02.927 INFO:teuthology.orchestra.run.smithi159.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 7.6 MB/s | 910 kB 00:00 2024-09-11T23:17:02.948 INFO:teuthology.orchestra.run.smithi172.stdout:(26/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 16 MB/s | 3.1 MB 00:00 2024-09-11T23:17:02.984 INFO:teuthology.orchestra.run.smithi005.stdout:(42/156): ceph-mgr-diskprediction-local-19.1.1- 6.4 MB/s | 7.4 MB 00:01 2024-09-11T23:17:02.985 INFO:teuthology.orchestra.run.smithi159.stdout:(70/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-09-11T23:17:02.999 INFO:teuthology.orchestra.run.smithi172.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 3.3 MB/s | 171 kB 00:00 2024-09-11T23:17:03.011 INFO:teuthology.orchestra.run.smithi159.stdout:(71/156): postgresql-private-libs-13.16-1.el9.x 1.1 MB/s | 137 kB 00:00 2024-09-11T23:17:03.035 INFO:teuthology.orchestra.run.smithi005.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 6.7 MB/s | 1.2 MB 00:00 2024-09-11T23:17:03.048 INFO:teuthology.orchestra.run.smithi172.stdout:(28/156): ceph-grafana-dashboards-19.1.1-298.gb 640 kB/s | 32 kB 00:00 2024-09-11T23:17:03.086 INFO:teuthology.orchestra.run.smithi159.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.1 MB/s | 87 kB 00:00 2024-09-11T23:17:03.107 INFO:teuthology.orchestra.run.smithi172.stdout:(29/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 2.5 MB/s | 146 kB 00:00 2024-09-11T23:17:03.118 INFO:teuthology.orchestra.run.smithi005.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-09-11T23:17:03.119 INFO:teuthology.orchestra.run.smithi159.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 7.5 MB/s | 1.0 MB 00:00 2024-09-11T23:17:03.160 INFO:teuthology.orchestra.run.smithi005.stdout:(45/156): python3-ply-3.11-14.el9.noarch.rpm 607 kB/s | 106 kB 00:00 2024-09-11T23:17:03.186 INFO:teuthology.orchestra.run.smithi005.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-09-11T23:17:03.228 INFO:teuthology.orchestra.run.smithi159.stdout:(74/156): postgresql-server-13.16-1.el9.x86_64. 19 MB/s | 5.8 MB 00:00 2024-09-11T23:17:03.253 INFO:teuthology.orchestra.run.smithi005.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-09-11T23:17:03.253 INFO:teuthology.orchestra.run.smithi159.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 458 kB/s | 61 kB 00:00 2024-09-11T23:17:03.299 INFO:teuthology.orchestra.run.smithi172.stdout:(30/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 19 MB/s | 3.6 MB 00:00 2024-09-11T23:17:03.337 INFO:teuthology.orchestra.run.smithi159.stdout:(76/156): python3-babel-2.9.1-2.el9.noarch.rpm 24 MB/s | 6.0 MB 00:00 2024-09-11T23:17:03.371 INFO:teuthology.orchestra.run.smithi159.stdout:(77/156): python3-devel-3.9.19-8.el9.x86_64.rpm 1.7 MB/s | 245 kB 00:00 2024-09-11T23:17:03.396 INFO:teuthology.orchestra.run.smithi159.stdout:(78/156): python3-jinja2-2.11.3-6.el9.noarch.rp 1.7 MB/s | 248 kB 00:00 2024-09-11T23:17:03.421 INFO:teuthology.orchestra.run.smithi159.stdout:(79/156): python3-jsonpatch-1.21-16.el9.noarch. 307 kB/s | 26 kB 00:00 2024-09-11T23:17:03.472 INFO:teuthology.orchestra.run.smithi159.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-11T23:17:03.497 INFO:teuthology.orchestra.run.smithi159.stdout:(81/156): python3-jsonpointer-2.0-4.el9.noarch. 191 kB/s | 19 kB 00:00 2024-09-11T23:17:03.519 INFO:teuthology.orchestra.run.smithi005.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 2.0 MB/s | 689 kB 00:00 2024-09-11T23:17:03.522 INFO:teuthology.orchestra.run.smithi159.stdout:(82/156): python3-markupsafe-1.1.1-12.el9.x86_6 345 kB/s | 35 kB 00:00 2024-09-11T23:17:03.570 INFO:teuthology.orchestra.run.smithi005.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-09-11T23:17:03.572 INFO:teuthology.orchestra.run.smithi159.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.2 MB/s | 250 kB 00:00 2024-09-11T23:17:03.598 INFO:teuthology.orchestra.run.smithi159.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.9 MB/s | 222 kB 00:00 2024-09-11T23:17:03.629 INFO:teuthology.orchestra.run.smithi005.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 373 kB/s | 22 kB 00:00 2024-09-11T23:17:03.665 INFO:teuthology.orchestra.run.smithi159.stdout:(85/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 26 MB/s | 5.1 MB 00:00 2024-09-11T23:17:03.690 INFO:teuthology.orchestra.run.smithi159.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 460 kB/s | 42 kB 00:00 2024-09-11T23:17:03.715 INFO:teuthology.orchestra.run.smithi159.stdout:(87/156): python3-packaging-20.9-5.el9.noarch.r 542 kB/s | 77 kB 00:00 2024-09-11T23:17:03.733 INFO:teuthology.orchestra.run.smithi172.stdout:(31/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 21 MB/s | 49 MB 00:02 2024-09-11T23:17:03.735 INFO:teuthology.orchestra.run.smithi005.stdout:(51/156): flex-2.6.4-9.el9.x86_64.rpm 2.9 MB/s | 313 kB 00:00 2024-09-11T23:17:03.766 INFO:teuthology.orchestra.run.smithi159.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 2.6 MB/s | 269 kB 00:00 2024-09-11T23:17:03.791 INFO:teuthology.orchestra.run.smithi159.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.5 MB/s | 159 kB 00:00 2024-09-11T23:17:03.796 INFO:teuthology.orchestra.run.smithi005.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 545 kB/s | 33 kB 00:00 2024-09-11T23:17:03.808 INFO:teuthology.orchestra.run.smithi172.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 3.3 MB/s | 249 kB 00:00 2024-09-11T23:17:03.829 INFO:teuthology.orchestra.run.smithi005.stdout:(53/156): bison-3.7.4-5.el9.x86_64.rpm 1.6 MB/s | 943 kB 00:00 2024-09-11T23:17:03.832 INFO:teuthology.orchestra.run.smithi159.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 279 kB 00:00 2024-09-11T23:17:03.850 INFO:teuthology.orchestra.run.smithi172.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 1.2 MB/s | 49 kB 00:00 2024-09-11T23:17:03.858 INFO:teuthology.orchestra.run.smithi159.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 553 kB/s | 51 kB 00:00 2024-09-11T23:17:03.883 INFO:teuthology.orchestra.run.smithi159.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 583 kB/s | 54 kB 00:00 2024-09-11T23:17:03.888 INFO:teuthology.orchestra.run.smithi005.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 313 kB/s | 18 kB 00:00 2024-09-11T23:17:03.933 INFO:teuthology.orchestra.run.smithi172.stdout:(34/156): ceph-mgr-diskprediction-local-19.1.1- 12 MB/s | 7.4 MB 00:00 2024-09-11T23:17:03.946 INFO:teuthology.orchestra.run.smithi005.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 191 kB/s | 11 kB 00:00 2024-09-11T23:17:03.951 INFO:teuthology.orchestra.run.smithi159.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 626 kB/s | 42 kB 00:00 2024-09-11T23:17:03.958 INFO:teuthology.orchestra.run.smithi172.stdout:(35/156): ceph-prometheus-alerts-19.1.1-298.gb5 152 kB/s | 16 kB 00:00 2024-09-11T23:17:03.975 INFO:teuthology.orchestra.run.smithi159.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 481 kB/s | 44 kB 00:00 2024-09-11T23:17:03.984 INFO:teuthology.orchestra.run.smithi172.stdout:(36/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 5.6 MB/s | 285 kB 00:00 2024-09-11T23:17:04.034 INFO:teuthology.orchestra.run.smithi172.stdout:(37/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 364 kB/s | 18 kB 00:00 2024-09-11T23:17:04.039 INFO:teuthology.orchestra.run.smithi005.stdout:(56/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2024-09-11T23:17:04.059 INFO:teuthology.orchestra.run.smithi172.stdout:(38/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 7.4 MB/s | 765 kB 00:00 2024-09-11T23:17:04.097 INFO:teuthology.orchestra.run.smithi005.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 776 kB/s | 45 kB 00:00 2024-09-11T23:17:04.184 INFO:teuthology.orchestra.run.smithi159.stdout:(95/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 46 MB/s | 16 MB 00:00 2024-09-11T23:17:04.209 INFO:teuthology.orchestra.run.smithi159.stdout:(96/156): qatlib-24.02.0-1.el9.x86_64.rpm 854 kB/s | 221 kB 00:00 2024-09-11T23:17:04.218 INFO:teuthology.orchestra.run.smithi172.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 435 kB/s | 80 kB 00:00 2024-09-11T23:17:04.235 INFO:teuthology.orchestra.run.smithi159.stdout:(97/156): qatlib-service-24.02.0-1.el9.x86_64.r 139 kB/s | 36 kB 00:00 2024-09-11T23:17:04.260 INFO:teuthology.orchestra.run.smithi159.stdout:(98/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 631 kB/s | 47 kB 00:00 2024-09-11T23:17:04.298 INFO:teuthology.orchestra.run.smithi005.stdout:(58/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 6.0 MB/s | 3.0 MB 00:00 2024-09-11T23:17:04.302 INFO:teuthology.orchestra.run.smithi172.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-11T23:17:04.302 INFO:teuthology.orchestra.run.smithi159.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 868 kB/s | 58 kB 00:00 2024-09-11T23:17:04.327 INFO:teuthology.orchestra.run.smithi159.stdout:(100/156): socat-1.7.4.1-6.el9.x86_64.rpm 3.2 MB/s | 304 kB 00:00 2024-09-11T23:17:04.335 INFO:teuthology.orchestra.run.smithi172.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 801 kB 00:00 2024-09-11T23:17:04.339 INFO:teuthology.orchestra.run.smithi005.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 2.7 MB/s | 662 kB 00:00 2024-09-11T23:17:04.352 INFO:teuthology.orchestra.run.smithi159.stdout:(101/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.0 MB/s | 96 kB 00:00 2024-09-11T23:17:04.360 INFO:teuthology.orchestra.run.smithi172.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-09-11T23:17:04.378 INFO:teuthology.orchestra.run.smithi159.stdout:(102/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 843 kB/s | 64 kB 00:00 2024-09-11T23:17:04.403 INFO:teuthology.orchestra.run.smithi159.stdout:(103/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 593 kB/s | 45 kB 00:00 2024-09-11T23:17:04.406 INFO:teuthology.orchestra.run.smithi005.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 368 kB/s | 24 kB 00:00 2024-09-11T23:17:04.419 INFO:teuthology.orchestra.run.smithi172.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-11T23:17:04.432 INFO:teuthology.orchestra.run.smithi005.stdout:(61/156): libtool-2.4.6-46.el9.x86_64.rpm 4.2 MB/s | 581 kB 00:00 2024-09-11T23:17:04.445 INFO:teuthology.orchestra.run.smithi159.stdout:(104/156): lua-devel-5.4.4-4.el9.x86_64.rpm 242 kB/s | 22 kB 00:00 2024-09-11T23:17:04.453 INFO:teuthology.orchestra.run.smithi172.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 10 MB/s | 1.2 MB 00:00 2024-09-11T23:17:04.465 INFO:teuthology.orchestra.run.smithi005.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 810 kB/s | 47 kB 00:00 2024-09-11T23:17:04.478 INFO:teuthology.orchestra.run.smithi172.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-11T23:17:04.491 INFO:teuthology.orchestra.run.smithi005.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-11T23:17:04.495 INFO:teuthology.orchestra.run.smithi159.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 5.8 MB/s | 548 kB 00:00 2024-09-11T23:17:04.504 INFO:teuthology.orchestra.run.smithi172.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-11T23:17:04.520 INFO:teuthology.orchestra.run.smithi159.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 784 kB/s | 19 kB 00:00 2024-09-11T23:17:04.537 INFO:teuthology.orchestra.run.smithi172.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-11T23:17:04.541 INFO:teuthology.orchestra.run.smithi005.stdout:(64/156): openblas-0.3.26-2.el9.x86_64.rpm 771 kB/s | 38 kB 00:00 2024-09-11T23:17:04.554 INFO:teuthology.orchestra.run.smithi159.stdout:(107/156): gperftools-libs-2.9.1-2.el9.x86_64.r 2.8 MB/s | 309 kB 00:00 2024-09-11T23:17:04.566 INFO:teuthology.orchestra.run.smithi005.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-09-11T23:17:04.579 INFO:teuthology.orchestra.run.smithi159.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-11T23:17:04.613 INFO:teuthology.orchestra.run.smithi159.stdout:(109/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.6 MB/s | 863 kB 00:00 2024-09-11T23:17:04.647 INFO:teuthology.orchestra.run.smithi159.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 724 kB/s | 49 kB 00:00 2024-09-11T23:17:04.689 INFO:teuthology.orchestra.run.smithi159.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-09-11T23:17:04.722 INFO:teuthology.orchestra.run.smithi159.stdout:(112/156): libunwind-1.6.2-1.el9.x86_64.rpm 618 kB/s | 67 kB 00:00 2024-09-11T23:17:04.754 INFO:teuthology.orchestra.run.smithi172.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 2.7 MB/s | 689 kB 00:00 2024-09-11T23:17:04.773 INFO:teuthology.orchestra.run.smithi159.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 10 MB/s | 839 kB 00:00 2024-09-11T23:17:04.798 INFO:teuthology.orchestra.run.smithi159.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-11T23:17:04.823 INFO:teuthology.orchestra.run.smithi159.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-11T23:17:04.848 INFO:teuthology.orchestra.run.smithi159.stdout:(116/156): python3-asyncssh-2.13.2-5.el9.noarch 4.3 MB/s | 548 kB 00:00 2024-09-11T23:17:04.874 INFO:teuthology.orchestra.run.smithi159.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 282 kB/s | 14 kB 00:00 2024-09-11T23:17:04.899 INFO:teuthology.orchestra.run.smithi159.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-11T23:17:04.933 INFO:teuthology.orchestra.run.smithi159.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-11T23:17:04.967 INFO:teuthology.orchestra.run.smithi159.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-09-11T23:17:04.967 INFO:teuthology.orchestra.run.smithi005.stdout:(66/156): openblas-openmp-0.3.26-2.el9.x86_64.r 12 MB/s | 4.9 MB 00:00 2024-09-11T23:17:04.980 INFO:teuthology.orchestra.run.smithi172.stdout:(49/156): ceph-common-19.1.1-298.gb53b6d3e.el9. 3.4 MB/s | 21 MB 00:06 2024-09-11T23:17:04.991 INFO:teuthology.orchestra.run.smithi159.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-11T23:17:05.004 INFO:teuthology.orchestra.run.smithi172.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 427 kB/s | 107 kB 00:00 2024-09-11T23:17:05.038 INFO:teuthology.orchestra.run.smithi172.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 1.8 MB/s | 943 kB 00:00 2024-09-11T23:17:05.058 INFO:teuthology.orchestra.run.smithi159.stdout:(122/156): libarrow-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 4.4 MB 00:00 2024-09-11T23:17:05.063 INFO:teuthology.orchestra.run.smithi172.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 313 kB 00:00 2024-09-11T23:17:05.084 INFO:teuthology.orchestra.run.smithi159.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 1.5 MB/s | 144 kB 00:00 2024-09-11T23:17:05.097 INFO:teuthology.orchestra.run.smithi172.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 560 kB/s | 33 kB 00:00 2024-09-11T23:17:05.100 INFO:teuthology.orchestra.run.smithi005.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-09-11T23:17:05.109 INFO:teuthology.orchestra.run.smithi159.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-09-11T23:17:05.114 INFO:teuthology.orchestra.run.smithi172.stdout:(54/156): elfutils-libelf-devel-0.191-4.el9.x86 162 kB/s | 22 kB 00:00 2024-09-11T23:17:05.134 INFO:teuthology.orchestra.run.smithi159.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-11T23:17:05.147 INFO:teuthology.orchestra.run.smithi172.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 362 kB/s | 18 kB 00:00 2024-09-11T23:17:05.159 INFO:teuthology.orchestra.run.smithi159.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-09-11T23:17:05.164 INFO:teuthology.orchestra.run.smithi172.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-11T23:17:05.193 INFO:teuthology.orchestra.run.smithi159.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 333 kB/s | 19 kB 00:00 2024-09-11T23:17:05.215 INFO:teuthology.orchestra.run.smithi172.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-09-11T23:17:05.218 INFO:teuthology.orchestra.run.smithi159.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 336 kB/s | 20 kB 00:00 2024-09-11T23:17:05.225 INFO:teuthology.orchestra.run.smithi005.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 7.1 MB/s | 910 kB 00:00 2024-09-11T23:17:05.244 INFO:teuthology.orchestra.run.smithi159.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-11T23:17:05.248 INFO:teuthology.orchestra.run.smithi172.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 543 kB/s | 45 kB 00:00 2024-09-11T23:17:05.277 INFO:teuthology.orchestra.run.smithi159.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-11T23:17:05.292 INFO:teuthology.orchestra.run.smithi005.stdout:(69/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 6.1 MB/s | 4.4 MB 00:00 2024-09-11T23:17:05.302 INFO:teuthology.orchestra.run.smithi159.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-11T23:17:05.318 INFO:teuthology.orchestra.run.smithi005.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.5 MB/s | 137 kB 00:00 2024-09-11T23:17:05.323 INFO:teuthology.orchestra.run.smithi172.stdout:(59/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 12 MB/s | 3.0 MB 00:00 2024-09-11T23:17:05.336 INFO:teuthology.orchestra.run.smithi159.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-09-11T23:17:05.349 INFO:teuthology.orchestra.run.smithi172.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 4.8 MB/s | 662 kB 00:00 2024-09-11T23:17:05.361 INFO:teuthology.orchestra.run.smithi159.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 4.5 MB/s | 272 kB 00:00 2024-09-11T23:17:05.382 INFO:teuthology.orchestra.run.smithi172.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 417 kB/s | 24 kB 00:00 2024-09-11T23:17:05.387 INFO:teuthology.orchestra.run.smithi159.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 328 kB/s | 16 kB 00:00 2024-09-11T23:17:05.407 INFO:teuthology.orchestra.run.smithi172.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 811 kB/s | 47 kB 00:00 2024-09-11T23:17:05.412 INFO:teuthology.orchestra.run.smithi159.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-11T23:17:05.418 INFO:teuthology.orchestra.run.smithi005.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2024-09-11T23:17:05.437 INFO:teuthology.orchestra.run.smithi159.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 563 kB/s | 28 kB 00:00 2024-09-11T23:17:05.441 INFO:teuthology.orchestra.run.smithi172.stdout:(63/156): libtool-2.4.6-46.el9.x86_64.rpm 2.9 MB/s | 581 kB 00:00 2024-09-11T23:17:05.462 INFO:teuthology.orchestra.run.smithi159.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-09-11T23:17:05.466 INFO:teuthology.orchestra.run.smithi172.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-09-11T23:17:05.477 INFO:teuthology.orchestra.run.smithi005.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-11T23:17:05.510 INFO:teuthology.orchestra.run.smithi172.stdout:(65/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-09-11T23:17:05.513 INFO:teuthology.orchestra.run.smithi159.stdout:(138/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.7 MB/s | 2.0 MB 00:00 2024-09-11T23:17:05.517 INFO:teuthology.orchestra.run.smithi172.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 509 kB/s | 38 kB 00:00 2024-09-11T23:17:05.539 INFO:teuthology.orchestra.run.smithi159.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 784 kB/s | 59 kB 00:00 2024-09-11T23:17:05.564 INFO:teuthology.orchestra.run.smithi159.stdout:(140/156): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-11T23:17:05.589 INFO:teuthology.orchestra.run.smithi159.stdout:(141/156): python3-tempora-5.0.0-2.el9.noarch.r 472 kB/s | 36 kB 00:00 2024-09-11T23:17:05.614 INFO:teuthology.orchestra.run.smithi159.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 988 kB/s | 74 kB 00:00 2024-09-11T23:17:05.639 INFO:teuthology.orchestra.run.smithi159.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-11T23:17:05.665 INFO:teuthology.orchestra.run.smithi159.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-11T23:17:05.690 INFO:teuthology.orchestra.run.smithi159.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2024-09-11T23:17:05.717 INFO:teuthology.orchestra.run.smithi172.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 7.9 MB/s | 1.6 MB 00:00 2024-09-11T23:17:05.732 INFO:teuthology.orchestra.run.smithi159.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-09-11T23:17:05.757 INFO:teuthology.orchestra.run.smithi159.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-09-11T23:17:05.808 INFO:teuthology.orchestra.run.smithi159.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-11T23:17:05.876 INFO:teuthology.orchestra.run.smithi172.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 5.6 MB/s | 910 kB 00:00 2024-09-11T23:17:05.934 INFO:teuthology.orchestra.run.smithi172.stdout:(69/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-09-11T23:17:05.960 INFO:teuthology.orchestra.run.smithi172.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.6 MB/s | 137 kB 00:00 2024-09-11T23:17:05.977 INFO:teuthology.orchestra.run.smithi005.stdout:(73/156): python3-babel-2.9.1-2.el9.noarch.rpm 12 MB/s | 6.0 MB 00:00 2024-09-11T23:17:06.027 INFO:teuthology.orchestra.run.smithi172.stdout:(71/156): openblas-openmp-0.3.26-2.el9.x86_64.r 8.8 MB/s | 4.9 MB 00:00 2024-09-11T23:17:06.041 INFO:teuthology.orchestra.run.smithi159.stdout:(149/156): librados2-19.1.1-298.gb53b6d3e.el9.x 11 MB/s | 3.4 MB 00:00 2024-09-11T23:17:06.052 INFO:teuthology.orchestra.run.smithi005.stdout:(74/156): postgresql-server-13.16-1.el9.x86_64. 7.6 MB/s | 5.8 MB 00:00 2024-09-11T23:17:06.078 INFO:teuthology.orchestra.run.smithi005.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 613 kB/s | 61 kB 00:00 2024-09-11T23:17:06.085 INFO:teuthology.orchestra.run.smithi172.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-11T23:17:06.111 INFO:teuthology.orchestra.run.smithi005.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 4.1 MB/s | 245 kB 00:00 2024-09-11T23:17:06.118 INFO:teuthology.orchestra.run.smithi172.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 6.4 MB/s | 1.0 MB 00:00 2024-09-11T23:17:06.136 INFO:teuthology.orchestra.run.smithi005.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.1 MB/s | 248 kB 00:00 2024-09-11T23:17:06.167 INFO:teuthology.orchestra.run.smithi159.stdout:(150/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 7.7 MB/s | 3.2 MB 00:00 2024-09-11T23:17:06.170 INFO:teuthology.orchestra.run.smithi005.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 437 kB/s | 26 kB 00:00 2024-09-11T23:17:06.177 INFO:teuthology.orchestra.run.smithi172.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-09-11T23:17:06.195 INFO:teuthology.orchestra.run.smithi005.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 326 kB/s | 19 kB 00:00 2024-09-11T23:17:06.229 INFO:teuthology.orchestra.run.smithi005.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-11T23:17:06.254 INFO:teuthology.orchestra.run.smithi005.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 593 kB/s | 35 kB 00:00 2024-09-11T23:17:06.294 INFO:teuthology.orchestra.run.smithi172.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 16 MB/s | 5.8 MB 00:00 2024-09-11T23:17:06.313 INFO:teuthology.orchestra.run.smithi005.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-09-11T23:17:06.319 INFO:teuthology.orchestra.run.smithi172.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 1.7 MB/s | 245 kB 00:00 2024-09-11T23:17:06.353 INFO:teuthology.orchestra.run.smithi172.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.1 MB/s | 248 kB 00:00 2024-09-11T23:17:06.371 INFO:teuthology.orchestra.run.smithi005.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-11T23:17:06.378 INFO:teuthology.orchestra.run.smithi172.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 435 kB/s | 26 kB 00:00 2024-09-11T23:17:06.391 INFO:teuthology.orchestra.run.smithi159.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 181 kB/s | 41 kB 00:00 2024-09-11T23:17:06.412 INFO:teuthology.orchestra.run.smithi172.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 326 kB/s | 19 kB 00:00 2024-09-11T23:17:06.430 INFO:teuthology.orchestra.run.smithi005.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-11T23:17:06.437 INFO:teuthology.orchestra.run.smithi172.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-11T23:17:06.489 INFO:teuthology.orchestra.run.smithi005.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 724 kB/s | 42 kB 00:00 2024-09-11T23:17:06.513 INFO:teuthology.orchestra.run.smithi172.stdout:(81/156): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 6.0 MB 00:00 2024-09-11T23:17:06.538 INFO:teuthology.orchestra.run.smithi172.stdout:(82/156): python3-markupsafe-1.1.1-12.el9.x86_6 277 kB/s | 35 kB 00:00 2024-09-11T23:17:06.547 INFO:teuthology.orchestra.run.smithi005.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-11T23:17:06.572 INFO:teuthology.orchestra.run.smithi172.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-09-11T23:17:06.597 INFO:teuthology.orchestra.run.smithi172.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-11T23:17:06.614 INFO:teuthology.orchestra.run.smithi005.stdout:(87/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 13 MB/s | 5.1 MB 00:00 2024-09-11T23:17:06.630 INFO:teuthology.orchestra.run.smithi172.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-11T23:17:06.639 INFO:teuthology.orchestra.run.smithi005.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 159 kB 00:00 2024-09-11T23:17:06.659 INFO:teuthology.orchestra.run.smithi159.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 933 kB/s | 249 kB 00:00 2024-09-11T23:17:06.682 INFO:teuthology.orchestra.run.smithi005.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-09-11T23:17:06.707 INFO:teuthology.orchestra.run.smithi005.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 760 kB/s | 51 kB 00:00 2024-09-11T23:17:06.726 INFO:teuthology.orchestra.run.smithi172.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 328 kB/s | 42 kB 00:00 2024-09-11T23:17:06.740 INFO:teuthology.orchestra.run.smithi005.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 918 kB/s | 54 kB 00:00 2024-09-11T23:17:06.773 INFO:teuthology.orchestra.run.smithi172.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 1.9 MB/s | 269 kB 00:00 2024-09-11T23:17:06.798 INFO:teuthology.orchestra.run.smithi172.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.2 MB/s | 159 kB 00:00 2024-09-11T23:17:06.799 INFO:teuthology.orchestra.run.smithi005.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 713 kB/s | 42 kB 00:00 2024-09-11T23:17:06.858 INFO:teuthology.orchestra.run.smithi005.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 759 kB/s | 44 kB 00:00 2024-09-11T23:17:06.873 INFO:teuthology.orchestra.run.smithi172.stdout:(89/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-11T23:17:06.898 INFO:teuthology.orchestra.run.smithi172.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 509 kB/s | 51 kB 00:00 2024-09-11T23:17:06.923 INFO:teuthology.orchestra.run.smithi172.stdout:(91/156): python3-pyasn1-modules-0.4.8-6.el9.no 1.8 MB/s | 279 kB 00:00 2024-09-11T23:17:06.925 INFO:teuthology.orchestra.run.smithi005.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-09-11T23:17:06.949 INFO:teuthology.orchestra.run.smithi172.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 711 kB/s | 54 kB 00:00 2024-09-11T23:17:06.982 INFO:teuthology.orchestra.run.smithi172.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 713 kB/s | 42 kB 00:00 2024-09-11T23:17:06.983 INFO:teuthology.orchestra.run.smithi005.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 616 kB/s | 36 kB 00:00 2024-09-11T23:17:07.001 INFO:teuthology.orchestra.run.smithi159.stdout:(153/156): NetworkManager-libnm-1.49.90-1.el9.x 1.9 MB/s | 1.8 MB 00:00 2024-09-11T23:17:07.008 INFO:teuthology.orchestra.run.smithi172.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 756 kB/s | 44 kB 00:00 2024-09-11T23:17:07.050 INFO:teuthology.orchestra.run.smithi172.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-09-11T23:17:07.051 INFO:teuthology.orchestra.run.smithi005.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 711 kB/s | 47 kB 00:00 2024-09-11T23:17:07.075 INFO:teuthology.orchestra.run.smithi172.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 537 kB/s | 36 kB 00:00 2024-09-11T23:17:07.117 INFO:teuthology.orchestra.run.smithi172.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 709 kB/s | 47 kB 00:00 2024-09-11T23:17:07.126 INFO:teuthology.orchestra.run.smithi005.stdout:(97/156): socat-1.7.4.1-6.el9.x86_64.rpm 4.0 MB/s | 304 kB 00:00 2024-09-11T23:17:07.151 INFO:teuthology.orchestra.run.smithi172.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 4.0 MB/s | 304 kB 00:00 2024-09-11T23:17:07.193 INFO:teuthology.orchestra.run.smithi172.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 767 kB/s | 58 kB 00:00 2024-09-11T23:17:07.226 INFO:teuthology.orchestra.run.smithi159.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 2.4 MB/s | 1.4 MB 00:00 2024-09-11T23:17:07.226 INFO:teuthology.orchestra.run.smithi005.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 577 kB/s | 58 kB 00:00 2024-09-11T23:17:07.236 INFO:teuthology.orchestra.run.smithi172.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.1 MB/s | 96 kB 00:00 2024-09-11T23:17:07.268 INFO:teuthology.orchestra.run.smithi172.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 847 kB/s | 64 kB 00:00 2024-09-11T23:17:07.310 INFO:teuthology.orchestra.run.smithi005.stdout:(99/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.1 MB/s | 96 kB 00:00 2024-09-11T23:17:07.318 INFO:teuthology.orchestra.run.smithi172.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 537 kB/s | 45 kB 00:00 2024-09-11T23:17:07.486 INFO:teuthology.orchestra.run.smithi005.stdout:(100/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 21 MB/s | 16 MB 00:00 2024-09-11T23:17:07.493 INFO:teuthology.orchestra.run.smithi159.stdout:(155/156): NetworkManager-1.49.90-1.el9.x86_64. 1.4 MB/s | 2.3 MB 00:01 2024-09-11T23:17:07.511 INFO:teuthology.orchestra.run.smithi005.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 318 kB/s | 64 kB 00:00 2024-09-11T23:17:07.544 INFO:teuthology.orchestra.run.smithi005.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 771 kB/s | 45 kB 00:00 2024-09-11T23:17:07.610 INFO:teuthology.orchestra.run.smithi172.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 23 MB/s | 16 MB 00:00 2024-09-11T23:17:07.611 INFO:teuthology.orchestra.run.smithi005.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 223 kB/s | 22 kB 00:00 2024-09-11T23:17:07.635 INFO:teuthology.orchestra.run.smithi172.stdout:(104/156): lua-devel-5.4.4-4.el9.x86_64.rpm 61 kB/s | 22 kB 00:00 2024-09-11T23:17:07.661 INFO:teuthology.orchestra.run.smithi005.stdout:(104/156): protobuf-compiler-3.14.0-13.el9.x86_ 7.2 MB/s | 863 kB 00:00 2024-09-11T23:17:07.702 INFO:teuthology.orchestra.run.smithi172.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 4.5 MB/s | 309 kB 00:00 2024-09-11T23:17:07.728 INFO:teuthology.orchestra.run.smithi005.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 4.6 MB/s | 548 kB 00:00 2024-09-11T23:17:07.736 INFO:teuthology.orchestra.run.smithi172.stdout:(106/156): abseil-cpp-20211102.0-3.el9.x86_64.r 4.3 MB/s | 548 kB 00:00 2024-09-11T23:17:07.753 INFO:teuthology.orchestra.run.smithi005.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 783 kB/s | 19 kB 00:00 2024-09-11T23:17:07.761 INFO:teuthology.orchestra.run.smithi172.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 332 kB/s | 19 kB 00:00 2024-09-11T23:17:07.779 INFO:teuthology.orchestra.run.smithi005.stdout:(107/156): gperftools-libs-2.9.1-2.el9.x86_64.r 2.6 MB/s | 309 kB 00:00 2024-09-11T23:17:07.787 INFO:teuthology.orchestra.run.smithi172.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-11T23:17:07.801 INFO:teuthology.orchestra.run.smithi159.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.0 MB/s | 2.4 MB 00:00 2024-09-11T23:17:07.804 INFO:teuthology.orchestra.run.smithi005.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-11T23:17:07.807 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2024-09-11T23:17:07.807 INFO:teuthology.orchestra.run.smithi159.stdout:Total 20 MB/s | 226 MB 00:11 2024-09-11T23:17:07.812 INFO:teuthology.orchestra.run.smithi172.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-11T23:17:07.829 INFO:teuthology.orchestra.run.smithi005.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-11T23:17:07.837 INFO:teuthology.orchestra.run.smithi172.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-11T23:17:07.855 INFO:teuthology.orchestra.run.smithi005.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-11T23:17:07.871 INFO:teuthology.orchestra.run.smithi172.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-11T23:17:07.888 INFO:teuthology.orchestra.run.smithi005.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-11T23:17:07.938 INFO:teuthology.orchestra.run.smithi172.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-09-11T23:17:07.972 INFO:teuthology.orchestra.run.smithi005.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.8 MB/s | 839 kB 00:00 2024-09-11T23:17:07.988 INFO:teuthology.orchestra.run.smithi172.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-09-11T23:17:08.047 INFO:teuthology.orchestra.run.smithi005.stdout:(113/156): libarrow-9.0.0-11.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-09-11T23:17:08.055 INFO:teuthology.orchestra.run.smithi172.stdout:(114/156): libarrow-9.0.0-11.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-09-11T23:17:08.064 INFO:teuthology.orchestra.run.smithi005.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.5 MB/s | 43 kB 00:00 2024-09-11T23:17:08.080 INFO:teuthology.orchestra.run.smithi172.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 472 kB/s | 43 kB 00:00 2024-09-11T23:17:08.081 INFO:teuthology.orchestra.run.smithi005.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-11T23:17:08.098 INFO:teuthology.orchestra.run.smithi005.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 859 kB/s | 14 kB 00:00 2024-09-11T23:17:08.105 INFO:teuthology.orchestra.run.smithi172.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 638 kB/s | 32 kB 00:00 2024-09-11T23:17:08.131 INFO:teuthology.orchestra.run.smithi172.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-11T23:17:08.132 INFO:teuthology.orchestra.run.smithi005.stdout:(117/156): python3-asyncssh-2.13.2-5.el9.noarch 3.4 MB/s | 548 kB 00:00 2024-09-11T23:17:08.156 INFO:teuthology.orchestra.run.smithi172.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-11T23:17:08.157 INFO:teuthology.orchestra.run.smithi005.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-11T23:17:08.181 INFO:teuthology.orchestra.run.smithi172.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-11T23:17:08.190 INFO:teuthology.orchestra.run.smithi005.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-11T23:17:08.215 INFO:teuthology.orchestra.run.smithi172.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-11T23:17:08.216 INFO:teuthology.orchestra.run.smithi005.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-11T23:17:08.257 INFO:teuthology.orchestra.run.smithi172.stdout:(121/156): protobuf-compiler-3.14.0-13.el9.x86_ 920 kB/s | 863 kB 00:00 2024-09-11T23:17:08.282 INFO:teuthology.orchestra.run.smithi172.stdout:(122/156): python3-google-auth-2.34.0-1.el9.noa 2.1 MB/s | 220 kB 00:00 2024-09-11T23:17:08.315 INFO:teuthology.orchestra.run.smithi172.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 409 kB/s | 11 kB 00:00 2024-09-11T23:17:08.341 INFO:teuthology.orchestra.run.smithi172.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 764 kB/s | 18 kB 00:00 2024-09-11T23:17:08.366 INFO:teuthology.orchestra.run.smithi172.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 925 kB/s | 23 kB 00:00 2024-09-11T23:17:08.391 INFO:teuthology.orchestra.run.smithi172.stdout:(126/156): python3-grpcio-tools-1.46.7-10.el9.x 1.0 MB/s | 144 kB 00:00 2024-09-11T23:17:08.417 INFO:teuthology.orchestra.run.smithi172.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-09-11T23:17:08.442 INFO:teuthology.orchestra.run.smithi172.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-09-11T23:17:08.467 INFO:teuthology.orchestra.run.smithi172.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-11T23:17:08.493 INFO:teuthology.orchestra.run.smithi172.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-11T23:17:08.526 INFO:teuthology.orchestra.run.smithi172.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 1.7 MB/s | 58 kB 00:00 2024-09-11T23:17:08.568 INFO:teuthology.orchestra.run.smithi172.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2024-09-11T23:17:08.618 INFO:teuthology.orchestra.run.smithi172.stdout:(133/156): python3-grpcio-1.46.7-10.el9.x86_64. 5.1 MB/s | 2.0 MB 00:00 2024-09-11T23:17:08.641 INFO:teuthology.orchestra.run.smithi005.stdout:(121/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x 5.7 MB/s | 49 MB 00:08 2024-09-11T23:17:08.643 INFO:teuthology.orchestra.run.smithi172.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 219 kB/s | 16 kB 00:00 2024-09-11T23:17:08.669 INFO:teuthology.orchestra.run.smithi172.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2024-09-11T23:17:08.675 INFO:teuthology.orchestra.run.smithi005.stdout:(122/156): python3-google-auth-2.34.0-1.el9.noa 455 kB/s | 220 kB 00:00 2024-09-11T23:17:08.694 INFO:teuthology.orchestra.run.smithi172.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 560 kB/s | 28 kB 00:00 2024-09-11T23:17:08.700 INFO:teuthology.orchestra.run.smithi005.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 467 kB/s | 11 kB 00:00 2024-09-11T23:17:08.719 INFO:teuthology.orchestra.run.smithi172.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 615 kB/s | 31 kB 00:00 2024-09-11T23:17:08.725 INFO:teuthology.orchestra.run.smithi005.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 709 kB/s | 18 kB 00:00 2024-09-11T23:17:08.745 INFO:teuthology.orchestra.run.smithi172.stdout:(138/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 712 kB/s | 90 kB 00:00 2024-09-11T23:17:08.750 INFO:teuthology.orchestra.run.smithi005.stdout:(125/156): python3-grpcio-tools-1.46.7-10.el9.x 1.3 MB/s | 144 kB 00:00 2024-09-11T23:17:08.762 INFO:teuthology.orchestra.run.smithi172.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2024-09-11T23:17:08.776 INFO:teuthology.orchestra.run.smithi005.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-09-11T23:17:08.779 INFO:teuthology.orchestra.run.smithi172.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 1.0 MB/s | 36 kB 00:00 2024-09-11T23:17:08.804 INFO:teuthology.orchestra.run.smithi172.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.7 MB/s | 74 kB 00:00 2024-09-11T23:17:08.809 INFO:teuthology.orchestra.run.smithi005.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 331 kB/s | 19 kB 00:00 2024-09-11T23:17:08.830 INFO:teuthology.orchestra.run.smithi172.stdout:(142/156): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-09-11T23:17:08.835 INFO:teuthology.orchestra.run.smithi005.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 335 kB/s | 20 kB 00:00 2024-09-11T23:17:08.846 INFO:teuthology.orchestra.run.smithi172.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 2.1 MB/s | 90 kB 00:00 2024-09-11T23:17:08.860 INFO:teuthology.orchestra.run.smithi005.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-11T23:17:08.872 INFO:teuthology.orchestra.run.smithi172.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-09-11T23:17:08.885 INFO:teuthology.orchestra.run.smithi005.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-11T23:17:08.897 INFO:teuthology.orchestra.run.smithi172.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-09-11T23:17:08.911 INFO:teuthology.orchestra.run.smithi005.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-11T23:17:08.922 INFO:teuthology.orchestra.run.smithi172.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-11T23:17:08.944 INFO:teuthology.orchestra.run.smithi005.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-11T23:17:08.947 INFO:teuthology.orchestra.run.smithi172.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.5 MB/s | 427 kB 00:00 2024-09-11T23:17:08.970 INFO:teuthology.orchestra.run.smithi005.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 657 kB/s | 16 kB 00:00 2024-09-11T23:17:08.992 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2024-09-11T23:17:08.998 INFO:teuthology.orchestra.run.smithi172.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-11T23:17:09.012 INFO:teuthology.orchestra.run.smithi005.stdout:(134/156): python3-kubernetes-26.1.0-2.el9.noar 5.1 MB/s | 1.0 MB 00:00 2024-09-11T23:17:09.037 INFO:teuthology.orchestra.run.smithi005.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-09-11T23:17:09.062 INFO:teuthology.orchestra.run.smithi005.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 562 kB/s | 28 kB 00:00 2024-09-11T23:17:09.088 INFO:teuthology.orchestra.run.smithi005.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-11T23:17:09.113 INFO:teuthology.orchestra.run.smithi005.stdout:(138/156): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2024-09-11T23:17:09.138 INFO:teuthology.orchestra.run.smithi005.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-11T23:17:09.146 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2024-09-11T23:17:09.146 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2024-09-11T23:17:09.164 INFO:teuthology.orchestra.run.smithi005.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-11T23:17:09.181 INFO:teuthology.orchestra.run.smithi172.stdout:(149/156): librados2-19.1.1-298.gb53b6d3e.el9.x 13 MB/s | 3.4 MB 00:00 2024-09-11T23:17:09.205 INFO:teuthology.orchestra.run.smithi005.stdout:(141/156): python3-grpcio-1.46.7-10.el9.x86_64. 2.1 MB/s | 2.0 MB 00:00 2024-09-11T23:17:09.231 INFO:teuthology.orchestra.run.smithi005.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 809 kB/s | 74 kB 00:00 2024-09-11T23:17:09.256 INFO:teuthology.orchestra.run.smithi005.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-11T23:17:09.281 INFO:teuthology.orchestra.run.smithi005.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-11T23:17:09.306 INFO:teuthology.orchestra.run.smithi005.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-11T23:17:09.332 INFO:teuthology.orchestra.run.smithi005.stdout:(146/156): python3-werkzeug-2.0.3-3.el9.1.noarc 4.2 MB/s | 427 kB 00:00 2024-09-11T23:17:09.357 INFO:teuthology.orchestra.run.smithi005.stdout:(147/156): re2-20211101-20.el9.x86_64.rpm 2.5 MB/s | 191 kB 00:00 2024-09-11T23:17:09.373 INFO:teuthology.orchestra.run.smithi172.stdout:(150/156): NetworkManager-1.49.90-1.el9.x86_64. 6.2 MB/s | 2.3 MB 00:00 2024-09-11T23:17:09.415 INFO:teuthology.orchestra.run.smithi005.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-11T23:17:09.432 INFO:teuthology.orchestra.run.smithi172.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 700 kB/s | 41 kB 00:00 2024-09-11T23:17:09.490 INFO:teuthology.orchestra.run.smithi172.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 4.2 MB/s | 249 kB 00:00 2024-09-11T23:17:09.524 INFO:teuthology.orchestra.run.smithi005.stdout:(149/156): NetworkManager-1.49.90-1.el9.x86_64. 21 MB/s | 2.3 MB 00:00 2024-09-11T23:17:09.557 INFO:teuthology.orchestra.run.smithi172.stdout:(153/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 5.2 MB/s | 3.2 MB 00:00 2024-09-11T23:17:09.607 INFO:teuthology.orchestra.run.smithi172.stdout:(154/156): NetworkManager-libnm-1.49.90-1.el9.x 4.2 MB/s | 1.8 MB 00:00 2024-09-11T23:17:09.624 INFO:teuthology.orchestra.run.smithi005.stdout:(150/156): NetworkManager-libnm-1.49.90-1.el9.x 18 MB/s | 1.8 MB 00:00 2024-09-11T23:17:09.641 INFO:teuthology.orchestra.run.smithi172.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 9.0 MB/s | 1.4 MB 00:00 2024-09-11T23:17:09.716 INFO:teuthology.orchestra.run.smithi005.stdout:(151/156): librados2-19.1.1-298.gb53b6d3e.el9.x 8.9 MB/s | 3.4 MB 00:00 2024-09-11T23:17:09.733 INFO:teuthology.orchestra.run.smithi005.stdout:(152/156): NetworkManager-team-1.49.90-1.el9.x8 375 kB/s | 41 kB 00:00 2024-09-11T23:17:09.792 INFO:teuthology.orchestra.run.smithi005.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 3.2 MB/s | 249 kB 00:00 2024-09-11T23:17:09.851 INFO:teuthology.orchestra.run.smithi005.stdout:(154/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 6.4 MB/s | 3.2 MB 00:00 2024-09-11T23:17:09.892 INFO:teuthology.orchestra.run.smithi005.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 8.5 MB/s | 1.4 MB 00:00 2024-09-11T23:17:09.943 INFO:teuthology.orchestra.run.smithi005.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 16 MB/s | 2.4 MB 00:00 2024-09-11T23:17:09.950 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-09-11T23:17:09.950 INFO:teuthology.orchestra.run.smithi005.stdout:Total 17 MB/s | 226 MB 00:13 2024-09-11T23:17:10.391 INFO:teuthology.orchestra.run.smithi172.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.9 MB/s | 2.4 MB 00:00 2024-09-11T23:17:10.398 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-11T23:17:10.398 INFO:teuthology.orchestra.run.smithi172.stdout:Total 18 MB/s | 226 MB 00:12 2024-09-11T23:17:11.193 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-09-11T23:17:11.363 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-09-11T23:17:11.363 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-09-11T23:17:11.416 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2024-09-11T23:17:11.416 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2024-09-11T23:17:11.629 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-11T23:17:11.782 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-11T23:17:11.782 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-11T23:17:13.662 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-09-11T23:17:13.663 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-09-11T23:17:14.036 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-11T23:17:14.037 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-11T23:17:18.013 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2024-09-11T23:17:18.139 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-11T23:17:18.196 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-11T23:17:18.257 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-11T23:17:18.290 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-11T23:17:18.316 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-11T23:17:18.371 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-11T23:17:18.718 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-11T23:17:18.825 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T23:17:18.932 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T23:17:18.960 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T23:17:19.035 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T23:17:19.064 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T23:17:19.241 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-11T23:17:19.294 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-11T23:17:19.322 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T23:17:19.426 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T23:17:19.448 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T23:17:19.516 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T23:17:19.541 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T23:17:19.562 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T23:17:19.744 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T23:17:19.952 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T23:17:20.074 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-09-11T23:17:20.081 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-11T23:17:20.189 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-11T23:17:20.210 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T23:17:20.228 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-11T23:17:20.282 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-11T23:17:20.291 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T23:17:20.314 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-11T23:17:20.340 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-11T23:17:20.389 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-11T23:17:20.445 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-11T23:17:20.533 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T23:17:20.553 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-11T23:17:20.595 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-11T23:17:20.651 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-11T23:17:20.660 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-11T23:17:20.695 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-11T23:17:20.721 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-11T23:17:20.743 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-11T23:17:20.771 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-11T23:17:20.790 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-11T23:17:20.806 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-11T23:17:20.879 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-11T23:17:20.920 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-11T23:17:20.923 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-11T23:17:20.955 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-11T23:17:20.977 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T23:17:21.007 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-11T23:17:21.048 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-11T23:17:21.076 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-11T23:17:21.102 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T23:17:21.128 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T23:17:21.134 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-11T23:17:21.145 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-11T23:17:21.198 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-11T23:17:21.221 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T23:17:21.230 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-11T23:17:21.247 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T23:17:21.249 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T23:17:21.273 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-11T23:17:21.350 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-11T23:17:21.370 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T23:17:21.383 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-11T23:17:21.397 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T23:17:21.416 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-11T23:17:21.426 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-11T23:17:21.464 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-11T23:17:21.471 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-11T23:17:21.489 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T23:17:21.499 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T23:17:21.519 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T23:17:21.533 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-11T23:17:21.578 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-11T23:17:21.605 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T23:17:21.633 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T23:17:21.653 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-11T23:17:21.678 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-11T23:17:21.705 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T23:17:21.732 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-11T23:17:21.734 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T23:17:21.762 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T23:17:21.768 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T23:17:21.787 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-11T23:17:21.847 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-11T23:17:21.856 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T23:17:21.886 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T23:17:21.931 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T23:17:21.949 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T23:17:21.979 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T23:17:22.003 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T23:17:22.080 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T23:17:22.223 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T23:17:22.235 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-11T23:17:22.354 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T23:17:22.368 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-11T23:17:22.402 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T23:17:22.434 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T23:17:22.451 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-11T23:17:22.489 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-11T23:17:22.540 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-11T23:17:22.544 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-11T23:17:22.578 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-11T23:17:22.620 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-11T23:17:22.655 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T23:17:22.657 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T23:17:22.745 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T23:17:22.760 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-11T23:17:22.779 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-11T23:17:22.839 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-11T23:17:22.856 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-11T23:17:22.890 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-11T23:17:22.894 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-11T23:17:22.925 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-11T23:17:22.967 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-11T23:17:22.996 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T23:17:22.999 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-11T23:17:22.999 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-11T23:17:23.043 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-11T23:17:23.052 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-11T23:17:23.091 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-11T23:17:23.098 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-11T23:17:23.105 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-11T23:17:23.134 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-11T23:17:23.135 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-11T23:17:23.168 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-11T23:17:23.177 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-11T23:17:23.195 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-11T23:17:23.198 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-11T23:17:23.219 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-11T23:17:23.234 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-11T23:17:23.266 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-11T23:17:23.269 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-11T23:17:23.319 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-11T23:17:23.342 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-11T23:17:23.356 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-11T23:17:23.361 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-11T23:17:23.386 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-11T23:17:23.396 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-11T23:17:23.400 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-11T23:17:23.435 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-11T23:17:23.437 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-11T23:17:23.478 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-11T23:17:23.479 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-11T23:17:23.511 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-11T23:17:23.528 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-11T23:17:23.538 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-11T23:17:23.549 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-11T23:17:23.572 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-11T23:17:23.589 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-11T23:17:23.599 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-11T23:17:23.608 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-11T23:17:23.629 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-11T23:17:23.661 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-11T23:17:23.661 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-11T23:17:23.672 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-11T23:17:23.686 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-11T23:17:23.692 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-11T23:17:23.715 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-11T23:17:23.736 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-11T23:17:23.785 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-11T23:17:23.792 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-11T23:17:23.819 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-11T23:17:23.863 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-11T23:17:23.906 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-11T23:17:23.915 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-11T23:17:23.934 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-11T23:17:23.936 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-11T23:17:23.952 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-11T23:17:23.994 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-11T23:17:24.004 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-11T23:17:24.014 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-11T23:17:24.049 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-11T23:17:24.051 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-11T23:17:24.098 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-11T23:17:24.124 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-11T23:17:24.130 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-11T23:17:24.160 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-11T23:17:24.262 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-11T23:17:24.326 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-11T23:17:24.439 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-11T23:17:24.543 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-11T23:17:24.554 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-11T23:17:24.597 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-11T23:17:24.630 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-11T23:17:24.631 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-11T23:17:24.667 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-11T23:17:24.710 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-11T23:17:24.730 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-11T23:17:24.748 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-11T23:17:24.787 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-11T23:17:24.790 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-11T23:17:24.816 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-11T23:17:24.858 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-11T23:17:24.921 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-11T23:17:24.939 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-11T23:17:24.943 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-11T23:17:24.968 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-11T23:17:24.975 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-11T23:17:24.993 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-11T23:17:25.019 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-11T23:17:25.049 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-11T23:17:25.057 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-11T23:17:25.099 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-11T23:17:25.123 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-11T23:17:25.161 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-11T23:17:25.197 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-11T23:17:25.244 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-11T23:17:25.271 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-11T23:17:25.279 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-11T23:17:25.323 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-11T23:17:25.335 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-11T23:17:25.365 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-11T23:17:25.390 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-11T23:17:25.464 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-11T23:17:25.495 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-11T23:17:25.516 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-11T23:17:25.530 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-11T23:17:25.558 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-11T23:17:25.577 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-11T23:17:25.600 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-11T23:17:25.613 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-11T23:17:25.656 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-11T23:17:25.703 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-11T23:17:25.705 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-11T23:17:25.707 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-11T23:17:25.747 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-11T23:17:25.751 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-11T23:17:25.781 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-11T23:17:25.791 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-11T23:17:25.824 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-11T23:17:25.843 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-11T23:17:25.848 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-11T23:17:25.882 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-11T23:17:25.892 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-11T23:17:25.934 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-11T23:17:25.936 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-11T23:17:25.942 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-11T23:17:25.981 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-11T23:17:26.036 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-11T23:17:26.067 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-11T23:17:26.068 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-11T23:17:26.072 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-11T23:17:26.108 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-11T23:17:26.114 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-11T23:17:26.117 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-11T23:17:26.305 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-11T23:17:26.334 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-11T23:17:26.340 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-11T23:17:26.378 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-11T23:17:26.405 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-11T23:17:26.426 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-11T23:17:26.443 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-11T23:17:26.482 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-11T23:17:26.508 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-11T23:17:26.511 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-11T23:17:26.546 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-11T23:17:26.579 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-11T23:17:26.619 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-11T23:17:26.625 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-11T23:17:26.659 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-11T23:17:26.747 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-11T23:17:26.752 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-11T23:17:26.784 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-11T23:17:26.798 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-11T23:17:26.813 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-11T23:17:26.828 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-11T23:17:26.849 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-11T23:17:26.886 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-11T23:17:26.917 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-11T23:17:26.936 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-11T23:17:26.947 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-11T23:17:26.982 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-11T23:17:26.997 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-11T23:17:27.023 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-11T23:17:27.065 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-11T23:17:27.093 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-11T23:17:27.099 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-11T23:17:27.185 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-11T23:17:27.207 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-11T23:17:27.229 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-11T23:17:27.261 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-11T23:17:27.363 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-11T23:17:27.411 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-11T23:17:27.749 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-11T23:17:27.793 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-11T23:17:27.827 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-11T23:17:27.928 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-11T23:17:27.975 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-11T23:17:28.019 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-11T23:17:28.109 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-11T23:17:28.137 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-11T23:17:28.146 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-11T23:17:28.183 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-11T23:17:28.217 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-11T23:17:28.333 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-11T23:17:28.354 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-11T23:17:28.394 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-11T23:17:28.397 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-11T23:17:28.441 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-11T23:17:28.458 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-11T23:17:28.474 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-11T23:17:28.529 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-11T23:17:28.554 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-11T23:17:28.569 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-11T23:17:28.581 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-11T23:17:28.615 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-11T23:17:28.754 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-11T23:17:28.792 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-11T23:17:28.873 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-11T23:17:28.926 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-11T23:17:28.969 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T23:17:29.060 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T23:17:29.091 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-11T23:17:29.127 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-11T23:17:29.150 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-11T23:17:29.290 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-11T23:17:29.514 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-11T23:17:29.608 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-11T23:17:29.624 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-11T23:17:29.648 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T23:17:29.718 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T23:17:29.757 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-11T23:17:30.614 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-11T23:17:30.701 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-11T23:17:30.729 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-11T23:17:30.763 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-11T23:17:30.873 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-11T23:17:30.964 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-11T23:17:30.992 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-11T23:17:31.025 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-11T23:17:31.089 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-11T23:17:31.133 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T23:17:31.234 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T23:17:31.264 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-11T23:17:31.306 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-11T23:17:31.337 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-11T23:17:31.379 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T23:17:31.470 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T23:17:31.501 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-11T23:17:31.546 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-11T23:17:31.806 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-11T23:17:31.828 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T23:17:31.899 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T23:17:31.929 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-11T23:17:32.002 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T23:17:32.027 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-11T23:17:32.057 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T23:17:32.065 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T23:17:32.120 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T23:17:32.142 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-11T23:17:32.615 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T23:17:32.657 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T23:17:32.731 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T23:17:32.732 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T23:17:32.732 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T23:17:32.732 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-11T23:17:32.784 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T23:17:34.463 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T23:17:34.497 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T23:17:34.702 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T23:17:34.735 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T23:17:35.056 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T23:17:35.100 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T23:17:35.193 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T23:17:35.193 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T23:17:35.193 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T23:17:35.193 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-11T23:17:35.227 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T23:17:35.319 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T23:17:35.355 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T23:17:35.433 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T23:17:35.433 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T23:17:35.433 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T23:17:35.433 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:17:35.473 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T23:17:44.782 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T23:17:44.782 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /sys 2024-09-11T23:17:44.783 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /proc 2024-09-11T23:17:44.783 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /mnt 2024-09-11T23:17:44.783 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /var/tmp 2024-09-11T23:17:44.783 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /home 2024-09-11T23:17:44.783 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /root 2024-09-11T23:17:44.783 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /tmp 2024-09-11T23:17:44.783 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-11T23:17:44.956 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T23:17:44.973 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T23:17:44.973 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:17:44.973 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T23:17:44.973 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-11T23:17:46.434 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T23:17:46.461 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T23:17:46.461 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:17:46.461 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T23:17:46.461 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T23:17:46.461 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T23:17:46.461 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-11T23:17:46.685 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T23:17:46.708 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T23:17:46.708 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:17:46.708 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T23:17:46.708 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T23:17:46.708 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T23:17:46.708 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-11T23:17:47.034 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T23:17:47.034 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /sys 2024-09-11T23:17:47.034 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /proc 2024-09-11T23:17:47.034 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /mnt 2024-09-11T23:17:47.034 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /var/tmp 2024-09-11T23:17:47.034 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /home 2024-09-11T23:17:47.035 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /root 2024-09-11T23:17:47.035 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /tmp 2024-09-11T23:17:47.035 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-11T23:17:47.144 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T23:17:47.167 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T23:17:47.167 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:17:47.167 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T23:17:47.167 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T23:17:47.167 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T23:17:47.168 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-11T23:17:47.212 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T23:17:47.228 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T23:17:47.228 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:17:47.228 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T23:17:47.228 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-11T23:17:47.274 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-11T23:17:47.330 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-11T23:17:47.386 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-11T23:17:47.573 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-11T23:17:47.628 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-11T23:17:47.714 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-11T23:17:47.811 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-11T23:17:47.951 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-11T23:17:48.006 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-11T23:17:48.043 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-11T23:17:48.071 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-11T23:17:48.168 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T23:17:48.168 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /sys 2024-09-11T23:17:48.168 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /proc 2024-09-11T23:17:48.169 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /mnt 2024-09-11T23:17:48.169 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /var/tmp 2024-09-11T23:17:48.169 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /home 2024-09-11T23:17:48.169 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /root 2024-09-11T23:17:48.169 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /tmp 2024-09-11T23:17:48.169 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:17:48.355 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T23:17:48.371 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T23:17:48.371 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:17:48.371 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T23:17:48.372 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:17:48.479 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T23:17:48.511 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T23:17:48.544 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-11T23:17:48.606 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-11T23:17:48.634 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T23:17:48.707 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T23:17:48.734 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T23:17:48.734 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:17:48.734 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T23:17:48.734 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T23:17:48.734 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T23:17:48.734 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-11T23:17:48.957 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T23:17:48.981 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T23:17:48.981 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:17:48.981 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T23:17:48.981 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T23:17:48.981 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T23:17:48.981 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-11T23:17:49.424 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T23:17:49.448 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T23:17:49.448 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:17:49.448 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T23:17:49.448 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T23:17:49.448 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T23:17:49.448 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-11T23:17:49.554 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-11T23:17:49.603 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-11T23:17:49.658 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-11T23:17:49.680 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T23:17:49.711 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T23:17:49.843 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-11T23:17:49.900 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-11T23:17:49.916 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T23:17:49.945 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T23:17:49.945 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:17:49.945 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T23:17:49.945 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T23:17:49.945 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T23:17:49.945 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:17:49.977 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-11T23:17:50.066 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-11T23:17:50.184 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T23:17:50.206 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-11T23:17:50.208 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T23:17:50.208 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:17:50.208 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T23:17:50.208 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T23:17:50.209 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T23:17:50.209 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:17:50.259 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-11T23:17:50.290 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-11T23:17:50.329 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-11T23:17:50.667 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T23:17:50.678 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T23:17:50.692 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T23:17:50.692 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:17:50.692 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T23:17:50.692 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T23:17:50.693 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T23:17:50.693 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:17:50.703 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T23:17:50.767 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T23:17:50.806 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T23:17:50.806 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T23:17:50.807 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-11T23:17:50.839 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-11T23:17:50.865 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-11T23:17:50.901 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-11T23:17:50.929 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-11T23:17:50.931 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T23:17:50.973 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-11T23:17:51.005 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T23:17:51.030 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T23:17:51.030 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:17:51.030 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T23:17:51.030 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T23:17:51.030 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T23:17:51.030 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-11T23:17:51.081 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T23:17:51.092 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T23:17:51.122 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-11T23:17:51.169 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-11T23:17:51.190 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-11T23:17:51.250 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-11T23:17:51.252 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-11T23:17:51.340 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-11T23:17:51.498 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-11T23:17:51.545 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-11T23:17:51.576 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-11T23:17:51.604 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-11T23:17:51.968 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T23:17:52.008 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T23:17:52.023 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T23:17:52.053 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T23:17:52.093 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-11T23:17:52.166 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-11T23:17:52.182 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-11T23:17:52.200 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T23:17:52.209 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T23:17:52.233 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T23:17:52.233 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:17:52.233 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T23:17:52.233 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T23:17:52.233 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T23:17:52.233 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-11T23:17:52.301 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T23:17:52.324 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T23:17:52.324 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:17:52.324 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T23:17:52.324 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-11T23:17:52.368 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T23:17:52.391 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T23:17:52.392 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:17:52.392 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-11T23:17:52.392 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T23:17:52.392 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T23:17:52.392 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-11T23:17:52.694 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T23:17:52.717 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T23:17:52.717 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:17:52.717 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T23:17:52.718 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T23:17:52.718 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T23:17:52.718 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-11T23:17:52.974 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T23:17:53.008 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T23:17:53.110 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T23:17:53.272 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-11T23:17:53.304 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T23:17:53.310 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T23:17:53.334 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T23:17:53.335 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:17:53.335 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T23:17:53.335 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T23:17:53.335 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T23:17:53.335 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-11T23:17:53.344 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T23:17:53.386 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T23:17:53.397 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T23:17:53.495 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-11T23:17:53.554 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-11T23:17:54.362 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T23:17:54.394 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T23:17:54.482 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-11T23:17:54.504 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T23:17:54.513 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T23:17:54.538 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T23:17:54.538 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:17:54.538 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T23:17:54.538 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T23:17:54.538 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T23:17:54.539 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-11T23:17:54.589 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T23:17:54.612 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T23:17:54.613 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:17:54.613 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T23:17:54.613 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-11T23:17:54.657 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T23:17:54.672 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-11T23:17:54.680 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T23:17:54.681 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:17:54.681 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-11T23:17:54.681 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T23:17:54.681 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T23:17:54.681 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-11T23:17:54.705 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T23:17:54.730 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T23:17:54.730 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:17:54.730 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T23:17:54.731 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T23:17:54.731 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T23:17:54.731 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:17:54.781 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T23:17:54.793 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T23:17:54.894 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-11T23:17:54.962 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-11T23:17:54.990 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T23:17:55.015 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T23:17:55.015 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:17:55.015 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T23:17:55.015 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T23:17:55.015 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T23:17:55.015 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-11T23:17:55.941 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-11T23:17:55.975 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T23:17:56.000 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T23:17:56.000 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:17:56.000 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T23:17:56.000 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T23:17:56.000 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T23:17:56.000 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:17:56.042 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T23:17:56.066 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T23:17:56.067 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:17:56.067 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T23:17:56.067 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:17:56.118 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T23:17:56.142 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T23:17:56.143 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:17:56.143 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-11T23:17:56.143 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T23:17:56.143 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T23:17:56.143 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:17:56.460 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T23:17:56.485 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T23:17:56.485 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:17:56.485 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T23:17:56.485 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T23:17:56.485 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T23:17:56.485 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:17:57.315 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-11T23:17:57.356 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-11T23:17:57.396 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-11T23:17:57.429 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-11T23:17:57.456 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-11T23:17:57.652 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-11T23:17:57.703 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-11T23:17:57.733 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-11T23:17:57.763 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-11T23:17:57.809 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-11T23:17:58.437 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T23:17:58.482 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T23:17:58.502 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T23:17:59.360 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-11T23:17:59.445 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-11T23:17:59.493 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-11T23:17:59.588 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-11T23:17:59.619 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-11T23:17:59.623 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-11T23:17:59.649 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-11T23:17:59.660 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-11T23:17:59.683 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-11T23:17:59.683 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T23:17:59.709 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-11T23:17:59.744 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-11T23:17:59.767 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T23:17:59.767 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T23:17:59.769 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-11T23:17:59.851 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T23:17:59.876 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-11T23:17:59.881 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T23:17:59.882 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T23:17:59.975 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-11T23:18:00.015 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-11T23:18:00.045 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-11T23:18:00.061 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T23:18:00.062 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T23:18:00.075 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-11T23:18:00.121 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-11T23:18:00.156 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T23:18:00.219 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T23:18:00.711 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T23:18:00.753 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T23:18:00.773 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T23:18:01.331 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-11T23:18:01.374 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-11T23:18:01.414 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-11T23:18:01.454 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-11T23:18:01.489 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-11T23:18:01.620 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-11T23:18:01.704 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-11T23:18:01.715 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-11T23:18:01.753 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-11T23:18:01.763 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-11T23:18:01.784 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-11T23:18:01.813 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-11T23:18:01.856 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-11T23:18:01.859 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-11T23:18:01.885 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-11T23:18:01.911 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-11T23:18:01.944 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-11T23:18:01.945 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T23:18:02.054 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T23:18:02.054 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T23:18:02.137 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T23:18:02.162 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-11T23:18:02.169 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T23:18:02.169 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T23:18:02.348 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T23:18:02.348 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T23:18:02.432 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T23:18:02.497 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T23:18:02.537 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T23:18:02.574 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T23:18:02.596 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T23:18:03.493 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-11T23:18:03.571 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-11T23:18:03.621 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-11T23:18:03.726 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-11T23:18:03.766 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-11T23:18:03.792 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-11T23:18:03.826 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-11T23:18:03.826 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T23:18:03.918 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T23:18:03.918 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T23:18:04.019 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T23:18:04.044 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-11T23:18:04.050 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T23:18:04.050 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T23:18:04.238 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T23:18:04.238 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T23:18:04.314 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T23:18:04.382 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T23:18:05.998 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T23:18:05.998 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-11T23:18:05.998 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-11T23:18:05.998 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-11T23:18:05.998 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-11T23:18:05.998 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-11T23:18:05.999 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-11T23:18:05.999 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-11T23:18:05.999 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T23:18:05.999 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T23:18:05.999 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T23:18:05.999 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-11T23:18:05.999 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-11T23:18:05.999 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T23:18:05.999 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-11T23:18:05.999 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-11T23:18:05.999 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-11T23:18:05.999 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-11T23:18:05.999 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-11T23:18:06.000 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-11T23:18:06.000 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-11T23:18:06.000 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-11T23:18:06.000 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-11T23:18:06.000 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-11T23:18:06.000 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-11T23:18:06.000 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-11T23:18:06.000 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-11T23:18:06.000 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-11T23:18:06.000 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-11T23:18:06.000 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-11T23:18:06.001 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-11T23:18:06.001 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-11T23:18:06.001 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-11T23:18:06.001 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-11T23:18:06.001 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-11T23:18:06.001 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-11T23:18:06.001 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-11T23:18:06.001 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-11T23:18:06.001 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-11T23:18:06.001 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-11T23:18:06.001 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-11T23:18:06.001 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-11T23:18:06.001 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-11T23:18:06.002 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-11T23:18:06.002 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-11T23:18:06.002 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-11T23:18:06.002 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-11T23:18:06.002 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-11T23:18:06.002 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-11T23:18:06.002 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-11T23:18:06.002 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-11T23:18:06.002 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-11T23:18:06.002 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-11T23:18:06.002 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-11T23:18:06.002 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-11T23:18:06.002 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-11T23:18:06.003 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-11T23:18:06.003 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-11T23:18:06.003 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-11T23:18:06.003 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-11T23:18:06.003 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-11T23:18:06.003 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-11T23:18:06.003 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-11T23:18:06.003 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-11T23:18:06.003 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-11T23:18:06.003 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-11T23:18:06.003 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-11T23:18:06.004 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-11T23:18:06.004 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-11T23:18:06.004 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-11T23:18:06.004 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-11T23:18:06.004 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-11T23:18:06.004 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-11T23:18:06.004 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-11T23:18:06.004 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-11T23:18:06.004 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-11T23:18:06.004 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-11T23:18:06.004 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-11T23:18:06.004 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-11T23:18:06.005 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-11T23:18:06.005 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-11T23:18:06.005 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-11T23:18:06.005 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-11T23:18:06.005 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-11T23:18:06.005 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-11T23:18:06.005 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-11T23:18:06.005 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-11T23:18:06.005 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-11T23:18:06.005 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-11T23:18:06.006 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-11T23:18:06.006 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-11T23:18:06.006 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-11T23:18:06.006 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-11T23:18:06.006 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-11T23:18:06.006 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-11T23:18:06.006 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-11T23:18:06.006 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-11T23:18:06.006 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-11T23:18:06.006 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-11T23:18:06.006 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-11T23:18:06.006 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-11T23:18:06.006 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-11T23:18:06.007 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-11T23:18:06.007 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-11T23:18:06.007 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-11T23:18:06.007 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-11T23:18:06.007 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-11T23:18:06.007 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-11T23:18:06.007 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-11T23:18:06.007 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-11T23:18:06.007 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-11T23:18:06.007 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-11T23:18:06.007 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-11T23:18:06.007 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-11T23:18:06.008 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-11T23:18:06.008 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-11T23:18:06.008 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-11T23:18:06.008 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-11T23:18:06.008 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-11T23:18:06.008 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-11T23:18:06.008 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-11T23:18:06.008 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-11T23:18:06.008 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-11T23:18:06.008 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-11T23:18:06.008 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-11T23:18:06.008 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-11T23:18:06.008 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-11T23:18:06.009 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-11T23:18:06.009 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-11T23:18:06.009 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-11T23:18:06.009 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-11T23:18:06.009 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-11T23:18:06.009 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-11T23:18:06.009 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-11T23:18:06.009 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-11T23:18:06.009 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-11T23:18:06.009 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-11T23:18:06.009 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-11T23:18:06.009 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-11T23:18:06.009 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-11T23:18:06.010 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-11T23:18:06.010 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-11T23:18:06.010 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-11T23:18:06.010 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-11T23:18:06.010 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-11T23:18:06.010 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-11T23:18:06.010 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-11T23:18:06.010 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-11T23:18:06.010 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-11T23:18:06.010 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-11T23:18:06.010 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-11T23:18:06.010 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-11T23:18:06.010 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-11T23:18:06.011 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-11T23:18:06.011 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-11T23:18:06.011 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-11T23:18:06.011 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-11T23:18:06.011 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-11T23:18:06.011 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-11T23:18:06.011 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-11T23:18:06.011 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-11T23:18:06.011 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-11T23:18:06.011 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-11T23:18:06.011 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-11T23:18:08.567 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T23:18:08.568 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-11T23:18:08.568 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-11T23:18:08.568 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-11T23:18:08.568 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-11T23:18:08.568 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-11T23:18:08.568 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-11T23:18:08.568 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-11T23:18:08.568 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T23:18:08.568 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T23:18:08.568 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T23:18:08.569 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-11T23:18:08.569 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-11T23:18:08.569 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T23:18:08.569 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-11T23:18:08.569 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-11T23:18:08.569 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-11T23:18:08.569 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-11T23:18:08.569 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-11T23:18:08.569 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-11T23:18:08.569 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-11T23:18:08.569 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-11T23:18:08.569 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-11T23:18:08.569 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-11T23:18:08.569 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-11T23:18:08.570 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-11T23:18:08.570 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-11T23:18:08.570 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-11T23:18:08.570 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-11T23:18:08.570 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-11T23:18:08.570 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-11T23:18:08.570 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-11T23:18:08.570 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-11T23:18:08.570 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-11T23:18:08.570 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-11T23:18:08.570 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-11T23:18:08.571 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-11T23:18:08.571 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-11T23:18:08.571 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-11T23:18:08.571 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-11T23:18:08.571 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-11T23:18:08.571 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-11T23:18:08.571 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-11T23:18:08.572 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-11T23:18:08.572 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-11T23:18:08.572 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-11T23:18:08.572 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-11T23:18:08.572 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-11T23:18:08.572 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-11T23:18:08.572 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-11T23:18:08.573 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-11T23:18:08.573 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-11T23:18:08.573 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-11T23:18:08.573 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-11T23:18:08.573 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-11T23:18:08.573 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-11T23:18:08.573 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-11T23:18:08.573 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-11T23:18:08.573 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-11T23:18:08.573 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-11T23:18:08.573 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-11T23:18:08.573 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-11T23:18:08.574 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-11T23:18:08.574 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-11T23:18:08.574 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-11T23:18:08.574 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-11T23:18:08.574 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-11T23:18:08.574 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-11T23:18:08.574 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-11T23:18:08.574 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-11T23:18:08.574 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-11T23:18:08.574 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-11T23:18:08.574 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-11T23:18:08.574 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-11T23:18:08.574 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-11T23:18:08.574 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-11T23:18:08.575 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-11T23:18:08.575 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-11T23:18:08.575 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-11T23:18:08.575 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-11T23:18:08.575 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-11T23:18:08.575 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-11T23:18:08.575 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-11T23:18:08.575 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-11T23:18:08.575 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-11T23:18:08.575 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-11T23:18:08.575 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-11T23:18:08.575 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-11T23:18:08.575 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-11T23:18:08.576 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-11T23:18:08.576 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-11T23:18:08.576 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-11T23:18:08.576 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-11T23:18:08.576 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-11T23:18:08.576 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-11T23:18:08.576 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-11T23:18:08.576 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-11T23:18:08.576 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-11T23:18:08.576 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-11T23:18:08.576 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-11T23:18:08.576 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-11T23:18:08.577 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-11T23:18:08.577 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-11T23:18:08.577 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-11T23:18:08.577 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-11T23:18:08.577 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-11T23:18:08.577 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-11T23:18:08.577 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-11T23:18:08.577 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-11T23:18:08.577 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-11T23:18:08.577 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-11T23:18:08.577 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-11T23:18:08.577 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-11T23:18:08.578 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-11T23:18:08.578 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-11T23:18:08.578 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-11T23:18:08.578 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-11T23:18:08.578 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-11T23:18:08.578 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-11T23:18:08.578 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-11T23:18:08.578 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-11T23:18:08.578 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-11T23:18:08.578 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-11T23:18:08.578 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-11T23:18:08.578 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-11T23:18:08.578 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-11T23:18:08.579 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-11T23:18:08.579 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-11T23:18:08.579 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-11T23:18:08.579 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-11T23:18:08.579 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-11T23:18:08.579 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-11T23:18:08.579 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-11T23:18:08.579 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-11T23:18:08.579 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-11T23:18:08.579 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-11T23:18:08.580 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-11T23:18:08.580 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-11T23:18:08.580 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-11T23:18:08.580 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-11T23:18:08.580 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-11T23:18:08.580 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-11T23:18:08.580 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-11T23:18:08.580 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-11T23:18:08.580 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-11T23:18:08.580 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-11T23:18:08.580 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-11T23:18:08.580 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-11T23:18:08.581 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-11T23:18:08.581 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-11T23:18:08.581 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-11T23:18:08.581 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-11T23:18:08.581 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-11T23:18:08.581 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-11T23:18:08.581 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-11T23:18:08.581 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-11T23:18:08.581 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-11T23:18:08.581 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-11T23:18:08.581 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-11T23:18:08.581 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-11T23:18:08.581 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-11T23:18:08.581 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-11T23:18:08.582 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-11T23:18:08.582 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-11T23:18:08.821 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T23:18:08.822 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-11T23:18:08.822 INFO:teuthology.orchestra.run.smithi159.stdout:Upgraded: 2024-09-11T23:18:08.822 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-11T23:18:08.822 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-11T23:18:08.822 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-11T23:18:08.822 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-11T23:18:08.822 INFO:teuthology.orchestra.run.smithi159.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:08.822 INFO:teuthology.orchestra.run.smithi159.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:08.822 INFO:teuthology.orchestra.run.smithi159.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-11T23:18:08.822 INFO:teuthology.orchestra.run.smithi159.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-11T23:18:08.822 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2024-09-11T23:18:08.823 INFO:teuthology.orchestra.run.smithi159.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T23:18:08.823 INFO:teuthology.orchestra.run.smithi159.stdout: automake-1.16.2-8.el9.noarch 2024-09-11T23:18:08.823 INFO:teuthology.orchestra.run.smithi159.stdout: bison-3.7.4-5.el9.x86_64 2024-09-11T23:18:08.823 INFO:teuthology.orchestra.run.smithi159.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T23:18:08.823 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:08.823 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:08.824 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:08.824 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:08.824 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:18:08.824 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:08.824 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:08.824 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:08.824 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:18:08.824 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:18:08.825 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:18:08.825 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:18:08.825 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:18:08.825 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:08.825 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:08.825 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:18:08.825 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:08.825 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:08.825 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:08.825 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:18:08.825 INFO:teuthology.orchestra.run.smithi159.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:18:08.825 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:08.826 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:08.826 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:18:08.826 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-11T23:18:08.826 INFO:teuthology.orchestra.run.smithi159.stdout: flex-2.6.4-9.el9.x86_64 2024-09-11T23:18:08.826 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T23:18:08.826 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T23:18:08.826 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T23:18:08.826 INFO:teuthology.orchestra.run.smithi159.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-11T23:18:08.826 INFO:teuthology.orchestra.run.smithi159.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T23:18:08.826 INFO:teuthology.orchestra.run.smithi159.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T23:18:08.826 INFO:teuthology.orchestra.run.smithi159.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-11T23:18:08.827 INFO:teuthology.orchestra.run.smithi159.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T23:18:08.827 INFO:teuthology.orchestra.run.smithi159.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T23:18:08.827 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:08.827 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:08.827 INFO:teuthology.orchestra.run.smithi159.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:08.827 INFO:teuthology.orchestra.run.smithi159.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T23:18:08.827 INFO:teuthology.orchestra.run.smithi159.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T23:18:08.827 INFO:teuthology.orchestra.run.smithi159.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T23:18:08.827 INFO:teuthology.orchestra.run.smithi159.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T23:18:08.827 INFO:teuthology.orchestra.run.smithi159.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T23:18:08.827 INFO:teuthology.orchestra.run.smithi159.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:08.827 INFO:teuthology.orchestra.run.smithi159.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:08.828 INFO:teuthology.orchestra.run.smithi159.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T23:18:08.828 INFO:teuthology.orchestra.run.smithi159.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:08.828 INFO:teuthology.orchestra.run.smithi159.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-11T23:18:08.828 INFO:teuthology.orchestra.run.smithi159.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T23:18:08.828 INFO:teuthology.orchestra.run.smithi159.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-11T23:18:08.828 INFO:teuthology.orchestra.run.smithi159.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-11T23:18:08.828 INFO:teuthology.orchestra.run.smithi159.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T23:18:08.828 INFO:teuthology.orchestra.run.smithi159.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T23:18:08.828 INFO:teuthology.orchestra.run.smithi159.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T23:18:08.829 INFO:teuthology.orchestra.run.smithi159.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T23:18:08.829 INFO:teuthology.orchestra.run.smithi159.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T23:18:08.829 INFO:teuthology.orchestra.run.smithi159.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T23:18:08.829 INFO:teuthology.orchestra.run.smithi159.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-11T23:18:08.829 INFO:teuthology.orchestra.run.smithi159.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T23:18:08.829 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-13.16-1.el9.x86_64 2024-09-11T23:18:08.829 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-11T23:18:08.829 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-11T23:18:08.829 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-11T23:18:08.829 INFO:teuthology.orchestra.run.smithi159.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T23:18:08.829 INFO:teuthology.orchestra.run.smithi159.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T23:18:08.829 INFO:teuthology.orchestra.run.smithi159.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T23:18:08.830 INFO:teuthology.orchestra.run.smithi159.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-11T23:18:08.830 INFO:teuthology.orchestra.run.smithi159.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T23:18:08.830 INFO:teuthology.orchestra.run.smithi159.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T23:18:08.830 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T23:18:08.830 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:08.830 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:08.830 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:08.830 INFO:teuthology.orchestra.run.smithi159.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T23:18:08.830 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T23:18:08.830 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T23:18:08.830 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T23:18:08.830 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-11T23:18:08.831 INFO:teuthology.orchestra.run.smithi159.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-11T23:18:08.831 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T23:18:08.831 INFO:teuthology.orchestra.run.smithi159.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T23:18:08.831 INFO:teuthology.orchestra.run.smithi159.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T23:18:08.831 INFO:teuthology.orchestra.run.smithi159.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T23:18:08.831 INFO:teuthology.orchestra.run.smithi159.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T23:18:08.831 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T23:18:08.831 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T23:18:08.831 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T23:18:08.831 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T23:18:08.831 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T23:18:08.831 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T23:18:08.832 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T23:18:08.832 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T23:18:08.832 INFO:teuthology.orchestra.run.smithi159.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T23:18:08.832 INFO:teuthology.orchestra.run.smithi159.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T23:18:08.832 INFO:teuthology.orchestra.run.smithi159.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T23:18:08.832 INFO:teuthology.orchestra.run.smithi159.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T23:18:08.832 INFO:teuthology.orchestra.run.smithi159.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T23:18:08.832 INFO:teuthology.orchestra.run.smithi159.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T23:18:08.832 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T23:18:08.832 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T23:18:08.832 INFO:teuthology.orchestra.run.smithi159.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T23:18:08.832 INFO:teuthology.orchestra.run.smithi159.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T23:18:08.833 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T23:18:08.833 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T23:18:08.833 INFO:teuthology.orchestra.run.smithi159.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T23:18:08.833 INFO:teuthology.orchestra.run.smithi159.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T23:18:08.833 INFO:teuthology.orchestra.run.smithi159.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T23:18:08.833 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T23:18:08.833 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T23:18:08.833 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T23:18:08.833 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T23:18:08.833 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-11T23:18:08.833 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T23:18:08.834 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:08.834 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:08.834 INFO:teuthology.orchestra.run.smithi159.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T23:18:08.834 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T23:18:08.834 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T23:18:08.834 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:08.834 INFO:teuthology.orchestra.run.smithi159.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T23:18:08.834 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T23:18:08.834 INFO:teuthology.orchestra.run.smithi159.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T23:18:08.834 INFO:teuthology.orchestra.run.smithi159.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T23:18:08.835 INFO:teuthology.orchestra.run.smithi159.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T23:18:08.835 INFO:teuthology.orchestra.run.smithi159.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T23:18:08.835 INFO:teuthology.orchestra.run.smithi159.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T23:18:08.835 INFO:teuthology.orchestra.run.smithi159.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-11T23:18:08.835 INFO:teuthology.orchestra.run.smithi159.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T23:18:08.835 INFO:teuthology.orchestra.run.smithi159.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T23:18:08.835 INFO:teuthology.orchestra.run.smithi159.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T23:18:08.835 INFO:teuthology.orchestra.run.smithi159.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T23:18:08.835 INFO:teuthology.orchestra.run.smithi159.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T23:18:08.835 INFO:teuthology.orchestra.run.smithi159.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T23:18:08.835 INFO:teuthology.orchestra.run.smithi159.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T23:18:08.836 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:08.836 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:08.836 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:08.836 INFO:teuthology.orchestra.run.smithi159.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T23:18:08.836 INFO:teuthology.orchestra.run.smithi159.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T23:18:08.836 INFO:teuthology.orchestra.run.smithi159.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T23:18:08.836 INFO:teuthology.orchestra.run.smithi159.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-11T23:18:08.836 INFO:teuthology.orchestra.run.smithi159.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-11T23:18:08.836 INFO:teuthology.orchestra.run.smithi159.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T23:18:08.837 INFO:teuthology.orchestra.run.smithi159.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-11T23:18:08.837 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-11T23:18:08.837 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-09-11T23:18:09.275 DEBUG:teuthology.parallel:result is None 2024-09-11T23:18:09.945 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T23:18:09.946 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-11T23:18:09.946 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-11T23:18:09.946 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-11T23:18:09.946 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-11T23:18:09.946 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-11T23:18:09.946 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-11T23:18:09.946 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-11T23:18:09.946 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T23:18:09.946 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T23:18:09.946 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T23:18:09.947 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-11T23:18:09.947 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-11T23:18:09.947 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T23:18:09.947 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-11T23:18:09.947 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-11T23:18:09.947 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-11T23:18:09.947 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-11T23:18:09.947 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-11T23:18:09.947 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-11T23:18:09.947 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-11T23:18:09.948 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-11T23:18:09.948 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-11T23:18:09.948 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-11T23:18:09.948 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-11T23:18:09.948 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-11T23:18:09.948 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-11T23:18:09.948 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-11T23:18:09.948 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-11T23:18:09.948 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-11T23:18:09.948 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-11T23:18:09.948 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-11T23:18:09.948 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-11T23:18:09.949 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-11T23:18:09.949 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-11T23:18:09.949 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-11T23:18:09.949 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-11T23:18:09.949 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-11T23:18:09.949 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-11T23:18:09.949 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-11T23:18:09.949 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-11T23:18:09.949 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-11T23:18:09.949 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-11T23:18:09.949 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-11T23:18:09.949 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-11T23:18:09.950 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-11T23:18:09.950 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-11T23:18:09.950 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-11T23:18:09.950 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-11T23:18:09.950 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-11T23:18:09.950 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-11T23:18:09.950 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-11T23:18:09.950 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-11T23:18:09.950 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-11T23:18:09.950 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-11T23:18:09.950 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-11T23:18:09.950 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-11T23:18:09.950 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-11T23:18:09.951 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-11T23:18:09.951 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-11T23:18:09.951 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-11T23:18:09.951 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-11T23:18:09.951 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-11T23:18:09.951 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-11T23:18:09.951 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-11T23:18:09.951 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-11T23:18:09.951 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-11T23:18:09.951 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-11T23:18:09.951 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-11T23:18:09.951 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-11T23:18:09.951 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-11T23:18:09.952 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-11T23:18:09.952 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-11T23:18:09.952 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-11T23:18:09.952 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-11T23:18:09.952 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-11T23:18:09.952 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-11T23:18:09.952 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-11T23:18:09.952 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-11T23:18:09.952 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-11T23:18:09.952 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-11T23:18:09.952 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-11T23:18:09.952 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-11T23:18:09.953 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-11T23:18:09.953 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-11T23:18:09.953 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-11T23:18:09.953 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-11T23:18:09.953 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-11T23:18:09.953 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-11T23:18:09.953 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-11T23:18:09.953 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-11T23:18:09.953 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-11T23:18:09.953 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-11T23:18:09.953 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-11T23:18:09.953 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-11T23:18:09.953 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-11T23:18:09.954 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-11T23:18:09.954 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-11T23:18:09.954 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-11T23:18:09.954 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-11T23:18:09.954 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-11T23:18:09.954 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-11T23:18:09.954 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-11T23:18:09.954 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-11T23:18:09.954 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-11T23:18:09.954 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-11T23:18:09.954 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-11T23:18:09.954 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-11T23:18:09.954 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-11T23:18:09.955 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-11T23:18:09.955 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-11T23:18:09.955 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-11T23:18:09.955 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-11T23:18:09.955 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-11T23:18:09.955 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-11T23:18:09.955 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-11T23:18:09.955 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-11T23:18:09.955 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-11T23:18:09.955 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-11T23:18:09.955 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-11T23:18:09.955 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-11T23:18:09.955 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-11T23:18:09.956 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-11T23:18:09.956 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-11T23:18:09.956 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-11T23:18:09.956 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-11T23:18:09.956 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-11T23:18:09.956 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-11T23:18:09.956 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-11T23:18:09.956 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-11T23:18:09.956 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-11T23:18:09.956 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-11T23:18:09.956 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-11T23:18:09.956 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-11T23:18:09.956 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-11T23:18:09.957 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-11T23:18:09.957 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-11T23:18:09.957 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-11T23:18:09.957 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-11T23:18:09.957 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-11T23:18:09.957 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-11T23:18:09.957 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-11T23:18:09.957 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-11T23:18:09.957 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-11T23:18:09.957 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-11T23:18:09.957 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-11T23:18:09.957 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-11T23:18:09.957 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-11T23:18:09.958 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-11T23:18:09.958 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-11T23:18:09.958 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-11T23:18:09.958 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-11T23:18:09.958 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-11T23:18:09.958 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-11T23:18:09.958 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-11T23:18:09.958 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-11T23:18:09.958 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-11T23:18:09.958 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-11T23:18:09.958 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-11T23:18:09.958 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-11T23:18:09.958 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-11T23:18:09.959 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-11T23:18:09.959 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-11T23:18:09.959 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-11T23:18:11.111 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T23:18:11.111 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-11T23:18:11.111 INFO:teuthology.orchestra.run.smithi172.stdout:Upgraded: 2024-09-11T23:18:11.111 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-11T23:18:11.111 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-11T23:18:11.111 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-11T23:18:11.111 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-11T23:18:11.112 INFO:teuthology.orchestra.run.smithi172.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:11.112 INFO:teuthology.orchestra.run.smithi172.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:11.112 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-11T23:18:11.112 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-11T23:18:11.112 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-11T23:18:11.112 INFO:teuthology.orchestra.run.smithi172.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T23:18:11.112 INFO:teuthology.orchestra.run.smithi172.stdout: automake-1.16.2-8.el9.noarch 2024-09-11T23:18:11.112 INFO:teuthology.orchestra.run.smithi172.stdout: bison-3.7.4-5.el9.x86_64 2024-09-11T23:18:11.112 INFO:teuthology.orchestra.run.smithi172.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T23:18:11.112 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:11.112 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:11.112 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:11.113 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:11.113 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:18:11.113 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:11.113 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:11.113 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:11.113 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:18:11.113 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:18:11.113 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:18:11.113 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:18:11.113 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:18:11.113 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:11.113 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:11.114 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:18:11.114 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:11.114 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:11.114 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:11.114 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:18:11.114 INFO:teuthology.orchestra.run.smithi172.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:18:11.114 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:11.114 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:11.114 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:18:11.114 INFO:teuthology.orchestra.run.smithi172.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-11T23:18:11.114 INFO:teuthology.orchestra.run.smithi172.stdout: flex-2.6.4-9.el9.x86_64 2024-09-11T23:18:11.114 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T23:18:11.115 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T23:18:11.115 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T23:18:11.115 INFO:teuthology.orchestra.run.smithi172.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-11T23:18:11.115 INFO:teuthology.orchestra.run.smithi172.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T23:18:11.115 INFO:teuthology.orchestra.run.smithi172.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T23:18:11.115 INFO:teuthology.orchestra.run.smithi172.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-11T23:18:11.115 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T23:18:11.115 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T23:18:11.115 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:11.115 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:11.115 INFO:teuthology.orchestra.run.smithi172.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:11.115 INFO:teuthology.orchestra.run.smithi172.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T23:18:11.116 INFO:teuthology.orchestra.run.smithi172.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T23:18:11.116 INFO:teuthology.orchestra.run.smithi172.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T23:18:11.116 INFO:teuthology.orchestra.run.smithi172.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T23:18:11.116 INFO:teuthology.orchestra.run.smithi172.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T23:18:11.116 INFO:teuthology.orchestra.run.smithi172.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:11.116 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:11.116 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T23:18:11.116 INFO:teuthology.orchestra.run.smithi172.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:11.116 INFO:teuthology.orchestra.run.smithi172.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-11T23:18:11.116 INFO:teuthology.orchestra.run.smithi172.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T23:18:11.116 INFO:teuthology.orchestra.run.smithi172.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-11T23:18:11.116 INFO:teuthology.orchestra.run.smithi172.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-11T23:18:11.116 INFO:teuthology.orchestra.run.smithi172.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T23:18:11.117 INFO:teuthology.orchestra.run.smithi172.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T23:18:11.117 INFO:teuthology.orchestra.run.smithi172.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T23:18:11.117 INFO:teuthology.orchestra.run.smithi172.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T23:18:11.117 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T23:18:11.117 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T23:18:11.117 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-11T23:18:11.117 INFO:teuthology.orchestra.run.smithi172.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T23:18:11.117 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-13.16-1.el9.x86_64 2024-09-11T23:18:11.117 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-11T23:18:11.117 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-11T23:18:11.117 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-11T23:18:11.117 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T23:18:11.118 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T23:18:11.118 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T23:18:11.118 INFO:teuthology.orchestra.run.smithi172.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-11T23:18:11.118 INFO:teuthology.orchestra.run.smithi172.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T23:18:11.118 INFO:teuthology.orchestra.run.smithi172.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T23:18:11.118 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T23:18:11.118 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:11.118 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:11.118 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:11.118 INFO:teuthology.orchestra.run.smithi172.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T23:18:11.118 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T23:18:11.118 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T23:18:11.118 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T23:18:11.118 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-11T23:18:11.119 INFO:teuthology.orchestra.run.smithi172.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-11T23:18:11.119 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T23:18:11.119 INFO:teuthology.orchestra.run.smithi172.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T23:18:11.119 INFO:teuthology.orchestra.run.smithi172.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T23:18:11.119 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T23:18:11.119 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T23:18:11.119 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T23:18:11.119 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T23:18:11.119 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T23:18:11.119 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T23:18:11.119 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T23:18:11.119 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T23:18:11.120 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T23:18:11.120 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T23:18:11.120 INFO:teuthology.orchestra.run.smithi172.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T23:18:11.120 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T23:18:11.120 INFO:teuthology.orchestra.run.smithi172.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T23:18:11.120 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T23:18:11.120 INFO:teuthology.orchestra.run.smithi172.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T23:18:11.120 INFO:teuthology.orchestra.run.smithi172.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T23:18:11.120 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T23:18:11.120 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T23:18:11.120 INFO:teuthology.orchestra.run.smithi172.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T23:18:11.120 INFO:teuthology.orchestra.run.smithi172.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T23:18:11.120 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T23:18:11.121 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T23:18:11.121 INFO:teuthology.orchestra.run.smithi172.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T23:18:11.121 INFO:teuthology.orchestra.run.smithi172.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T23:18:11.121 INFO:teuthology.orchestra.run.smithi172.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T23:18:11.121 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T23:18:11.121 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T23:18:11.121 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T23:18:11.121 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T23:18:11.121 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-11T23:18:11.121 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T23:18:11.121 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:11.121 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:11.122 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T23:18:11.122 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T23:18:11.122 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T23:18:11.122 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:11.122 INFO:teuthology.orchestra.run.smithi172.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T23:18:11.122 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T23:18:11.122 INFO:teuthology.orchestra.run.smithi172.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T23:18:11.122 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T23:18:11.122 INFO:teuthology.orchestra.run.smithi172.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T23:18:11.122 INFO:teuthology.orchestra.run.smithi172.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T23:18:11.122 INFO:teuthology.orchestra.run.smithi172.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T23:18:11.122 INFO:teuthology.orchestra.run.smithi172.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-11T23:18:11.122 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T23:18:11.123 INFO:teuthology.orchestra.run.smithi172.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T23:18:11.123 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T23:18:11.123 INFO:teuthology.orchestra.run.smithi172.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T23:18:11.123 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T23:18:11.123 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T23:18:11.123 INFO:teuthology.orchestra.run.smithi172.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T23:18:11.123 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:11.123 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:11.123 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:11.123 INFO:teuthology.orchestra.run.smithi172.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T23:18:11.123 INFO:teuthology.orchestra.run.smithi172.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T23:18:11.123 INFO:teuthology.orchestra.run.smithi172.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T23:18:11.123 INFO:teuthology.orchestra.run.smithi172.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-11T23:18:11.124 INFO:teuthology.orchestra.run.smithi172.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-11T23:18:11.124 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T23:18:11.124 INFO:teuthology.orchestra.run.smithi172.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-11T23:18:11.124 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-11T23:18:11.124 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-11T23:18:11.588 DEBUG:teuthology.parallel:result is None 2024-09-11T23:18:12.318 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T23:18:12.318 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:18:12.318 INFO:teuthology.orchestra.run.smithi005.stdout:Upgraded: 2024-09-11T23:18:12.318 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-11T23:18:12.318 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-11T23:18:12.318 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-11T23:18:12.318 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-11T23:18:12.318 INFO:teuthology.orchestra.run.smithi005.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:12.319 INFO:teuthology.orchestra.run.smithi005.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:12.319 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-11T23:18:12.319 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-11T23:18:12.319 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-09-11T23:18:12.319 INFO:teuthology.orchestra.run.smithi005.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T23:18:12.319 INFO:teuthology.orchestra.run.smithi005.stdout: automake-1.16.2-8.el9.noarch 2024-09-11T23:18:12.319 INFO:teuthology.orchestra.run.smithi005.stdout: bison-3.7.4-5.el9.x86_64 2024-09-11T23:18:12.319 INFO:teuthology.orchestra.run.smithi005.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T23:18:12.319 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:12.319 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:12.319 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:12.319 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:12.319 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:18:12.320 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:12.320 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:12.320 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:12.320 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:18:12.320 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:18:12.320 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:18:12.320 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:18:12.320 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:18:12.320 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:12.320 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:12.320 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:18:12.320 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:12.320 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:12.321 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:12.321 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:18:12.321 INFO:teuthology.orchestra.run.smithi005.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:18:12.321 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:12.321 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:12.321 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:18:12.321 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-11T23:18:12.321 INFO:teuthology.orchestra.run.smithi005.stdout: flex-2.6.4-9.el9.x86_64 2024-09-11T23:18:12.321 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T23:18:12.321 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T23:18:12.321 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T23:18:12.321 INFO:teuthology.orchestra.run.smithi005.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-11T23:18:12.321 INFO:teuthology.orchestra.run.smithi005.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T23:18:12.322 INFO:teuthology.orchestra.run.smithi005.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T23:18:12.322 INFO:teuthology.orchestra.run.smithi005.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-11T23:18:12.322 INFO:teuthology.orchestra.run.smithi005.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T23:18:12.322 INFO:teuthology.orchestra.run.smithi005.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T23:18:12.322 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:12.322 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:12.322 INFO:teuthology.orchestra.run.smithi005.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:12.322 INFO:teuthology.orchestra.run.smithi005.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T23:18:12.322 INFO:teuthology.orchestra.run.smithi005.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T23:18:12.322 INFO:teuthology.orchestra.run.smithi005.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T23:18:12.322 INFO:teuthology.orchestra.run.smithi005.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T23:18:12.322 INFO:teuthology.orchestra.run.smithi005.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T23:18:12.322 INFO:teuthology.orchestra.run.smithi005.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:12.323 INFO:teuthology.orchestra.run.smithi005.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:12.323 INFO:teuthology.orchestra.run.smithi005.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T23:18:12.323 INFO:teuthology.orchestra.run.smithi005.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:12.323 INFO:teuthology.orchestra.run.smithi005.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-11T23:18:12.323 INFO:teuthology.orchestra.run.smithi005.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T23:18:12.323 INFO:teuthology.orchestra.run.smithi005.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-11T23:18:12.323 INFO:teuthology.orchestra.run.smithi005.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-11T23:18:12.323 INFO:teuthology.orchestra.run.smithi005.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T23:18:12.323 INFO:teuthology.orchestra.run.smithi005.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T23:18:12.323 INFO:teuthology.orchestra.run.smithi005.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T23:18:12.323 INFO:teuthology.orchestra.run.smithi005.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T23:18:12.323 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T23:18:12.323 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T23:18:12.324 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-11T23:18:12.324 INFO:teuthology.orchestra.run.smithi005.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T23:18:12.324 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-13.16-1.el9.x86_64 2024-09-11T23:18:12.324 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-11T23:18:12.324 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-11T23:18:12.324 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-11T23:18:12.324 INFO:teuthology.orchestra.run.smithi005.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T23:18:12.324 INFO:teuthology.orchestra.run.smithi005.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T23:18:12.324 INFO:teuthology.orchestra.run.smithi005.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T23:18:12.324 INFO:teuthology.orchestra.run.smithi005.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-11T23:18:12.324 INFO:teuthology.orchestra.run.smithi005.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T23:18:12.324 INFO:teuthology.orchestra.run.smithi005.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T23:18:12.325 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T23:18:12.325 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:12.325 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:12.325 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:12.325 INFO:teuthology.orchestra.run.smithi005.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T23:18:12.325 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T23:18:12.325 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T23:18:12.325 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T23:18:12.325 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-11T23:18:12.325 INFO:teuthology.orchestra.run.smithi005.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-11T23:18:12.325 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T23:18:12.325 INFO:teuthology.orchestra.run.smithi005.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T23:18:12.325 INFO:teuthology.orchestra.run.smithi005.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T23:18:12.325 INFO:teuthology.orchestra.run.smithi005.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T23:18:12.326 INFO:teuthology.orchestra.run.smithi005.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T23:18:12.326 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T23:18:12.326 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T23:18:12.326 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T23:18:12.326 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T23:18:12.326 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T23:18:12.326 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T23:18:12.326 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T23:18:12.326 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T23:18:12.326 INFO:teuthology.orchestra.run.smithi005.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T23:18:12.326 INFO:teuthology.orchestra.run.smithi005.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T23:18:12.326 INFO:teuthology.orchestra.run.smithi005.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T23:18:12.326 INFO:teuthology.orchestra.run.smithi005.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T23:18:12.327 INFO:teuthology.orchestra.run.smithi005.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T23:18:12.327 INFO:teuthology.orchestra.run.smithi005.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T23:18:12.327 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T23:18:12.327 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T23:18:12.327 INFO:teuthology.orchestra.run.smithi005.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T23:18:12.327 INFO:teuthology.orchestra.run.smithi005.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T23:18:12.327 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T23:18:12.327 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T23:18:12.327 INFO:teuthology.orchestra.run.smithi005.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T23:18:12.327 INFO:teuthology.orchestra.run.smithi005.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T23:18:12.327 INFO:teuthology.orchestra.run.smithi005.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T23:18:12.327 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T23:18:12.327 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T23:18:12.328 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T23:18:12.328 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T23:18:12.328 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-11T23:18:12.328 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T23:18:12.328 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:12.328 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:12.328 INFO:teuthology.orchestra.run.smithi005.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T23:18:12.328 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T23:18:12.328 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T23:18:12.328 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:12.328 INFO:teuthology.orchestra.run.smithi005.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T23:18:12.328 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T23:18:12.328 INFO:teuthology.orchestra.run.smithi005.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T23:18:12.329 INFO:teuthology.orchestra.run.smithi005.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T23:18:12.329 INFO:teuthology.orchestra.run.smithi005.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T23:18:12.329 INFO:teuthology.orchestra.run.smithi005.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T23:18:12.329 INFO:teuthology.orchestra.run.smithi005.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T23:18:12.329 INFO:teuthology.orchestra.run.smithi005.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-11T23:18:12.329 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T23:18:12.329 INFO:teuthology.orchestra.run.smithi005.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T23:18:12.329 INFO:teuthology.orchestra.run.smithi005.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T23:18:12.329 INFO:teuthology.orchestra.run.smithi005.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T23:18:12.329 INFO:teuthology.orchestra.run.smithi005.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T23:18:12.329 INFO:teuthology.orchestra.run.smithi005.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T23:18:12.329 INFO:teuthology.orchestra.run.smithi005.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T23:18:12.330 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:12.330 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:12.330 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:18:12.330 INFO:teuthology.orchestra.run.smithi005.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T23:18:12.330 INFO:teuthology.orchestra.run.smithi005.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T23:18:12.330 INFO:teuthology.orchestra.run.smithi005.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T23:18:12.330 INFO:teuthology.orchestra.run.smithi005.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-11T23:18:12.330 INFO:teuthology.orchestra.run.smithi005.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-11T23:18:12.330 INFO:teuthology.orchestra.run.smithi005.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T23:18:12.331 INFO:teuthology.orchestra.run.smithi005.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-11T23:18:12.331 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:18:12.331 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-11T23:18:12.854 DEBUG:teuthology.parallel:result is None 2024-09-11T23:18:12.855 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:18:13.006 DEBUG:teuthology.orchestra.run.smithi005:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T23:18:13.033 INFO:teuthology.orchestra.run.smithi005.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-11T23:18:13.034 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-11T23:18:13.034 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-11T23:18:13.036 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:18:13.190 DEBUG:teuthology.orchestra.run.smithi159:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T23:18:13.217 INFO:teuthology.orchestra.run.smithi159.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-11T23:18:13.217 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-11T23:18:13.217 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-11T23:18:13.219 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:18:13.369 DEBUG:teuthology.orchestra.run.smithi172:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T23:18:13.395 INFO:teuthology.orchestra.run.smithi172.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-11T23:18:13.395 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-11T23:18:13.395 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-11T23:18:13.397 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-11T23:18:13.397 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-11T23:18:13.397 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T23:18:13.429 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-11T23:18:13.429 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T23:18:13.461 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-11T23:18:13.462 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T23:18:13.494 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-11T23:18:13.494 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-11T23:18:13.494 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T23:18:13.524 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T23:18:13.593 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-11T23:18:13.593 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T23:18:13.623 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T23:18:13.692 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-11T23:18:13.693 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T23:18:13.723 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T23:18:13.792 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-11T23:18:13.793 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-11T23:18:13.793 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T23:18:13.824 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T23:18:13.894 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-11T23:18:13.895 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T23:18:13.924 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T23:18:13.994 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-11T23:18:13.994 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T23:18:14.025 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T23:18:14.094 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-11T23:18:14.094 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-11T23:18:14.094 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T23:18:14.125 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T23:18:14.196 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-11T23:18:14.197 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T23:18:14.227 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T23:18:14.298 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-11T23:18:14.298 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T23:18:14.327 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T23:18:14.396 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-11T23:18:15.474 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-11T23:18:15.474 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:18:15.474 INFO:tasks.cephadm:Cluster fsid is 1f5284d2-7094-11ef-bcea-c7b262605968 2024-09-11T23:18:15.474 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-11T23:18:15.475 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.5', 'mon.b': '172.21.15.159', 'mon.c': '172.21.15.172'} 2024-09-11T23:18:15.475 INFO:tasks.cephadm:First mon is mon.a on smithi005 2024-09-11T23:18:15.475 INFO:tasks.cephadm:First mgr is x 2024-09-11T23:18:15.475 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-11T23:18:15.475 DEBUG:teuthology.orchestra.run.smithi005:> sudo hostname $(hostname -s) 2024-09-11T23:18:15.508 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname $(hostname -s) 2024-09-11T23:18:15.539 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname $(hostname -s) 2024-09-11T23:18:15.571 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-11T23:18:15.571 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:18:15.728 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56038/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-298-gb53b6d3e', 'node_name': '172.21.5.36+adami06', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-298.gb53b6d3e'}, 'url': 'https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-09 17:24:58.599585', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-11T23:18:15.881 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref squid, sha1 b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:18:15.883 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm 2024-09-11T23:18:15.883 INFO:tasks.cephadm:Downloading cephadm from url: https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm 2024-09-11T23:18:15.883 DEBUG:teuthology.orchestra.run.smithi005:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-11T23:18:16.284 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 11 23:18 /home/ubuntu/cephtest/cephadm 2024-09-11T23:18:16.284 DEBUG:teuthology.orchestra.run.smithi159:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-11T23:18:16.660 INFO:teuthology.orchestra.run.smithi159.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 11 23:18 /home/ubuntu/cephtest/cephadm 2024-09-11T23:18:16.660 DEBUG:teuthology.orchestra.run.smithi172:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-11T23:18:17.030 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 11 23:18 /home/ubuntu/cephtest/cephadm 2024-09-11T23:18:17.031 DEBUG:teuthology.orchestra.run.smithi005:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-11T23:18:17.051 DEBUG:teuthology.orchestra.run.smithi159:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-11T23:18:17.071 DEBUG:teuthology.orchestra.run.smithi172:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-11T23:18:17.107 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc on all hosts... 2024-09-11T23:18:17.108 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-11T23:18:17.113 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-11T23:18:17.116 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-11T23:18:18.627 INFO:teuthology.orchestra.run.smithi005.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-11T23:18:18.761 INFO:teuthology.orchestra.run.smithi159.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-11T23:18:18.834 INFO:teuthology.orchestra.run.smithi172.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-11T23:18:45.735 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-11T23:18:45.735 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T23:18:45.735 INFO:teuthology.orchestra.run.smithi159.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-11T23:18:45.735 INFO:teuthology.orchestra.run.smithi159.stdout: "repo_digests": [ 2024-09-11T23:18:45.735 INFO:teuthology.orchestra.run.smithi159.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-11T23:18:45.735 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-11T23:18:45.736 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-11T23:18:49.634 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-11T23:18:49.634 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T23:18:49.634 INFO:teuthology.orchestra.run.smithi005.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-11T23:18:49.634 INFO:teuthology.orchestra.run.smithi005.stdout: "repo_digests": [ 2024-09-11T23:18:49.634 INFO:teuthology.orchestra.run.smithi005.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-11T23:18:49.634 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-11T23:18:49.635 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-11T23:18:50.971 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-11T23:18:50.971 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T23:18:50.971 INFO:teuthology.orchestra.run.smithi172.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-11T23:18:50.971 INFO:teuthology.orchestra.run.smithi172.stdout: "repo_digests": [ 2024-09-11T23:18:50.971 INFO:teuthology.orchestra.run.smithi172.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-11T23:18:50.971 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-11T23:18:50.971 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-11T23:18:50.996 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /etc/ceph 2024-09-11T23:18:51.032 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /etc/ceph 2024-09-11T23:18:51.066 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /etc/ceph 2024-09-11T23:18:51.093 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 777 /etc/ceph 2024-09-11T23:18:51.122 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 777 /etc/ceph 2024-09-11T23:18:51.150 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 777 /etc/ceph 2024-09-11T23:18:51.175 INFO:tasks.cephadm:Writing seed config... 2024-09-11T23:18:51.176 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-11T23:18:51.176 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-11T23:18:51.176 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-11T23:18:51.177 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-11T23:18:51.177 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-11T23:18:51.177 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-11T23:18:51.177 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-11T23:18:51.177 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-11T23:18:51.177 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-11T23:18:51.177 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-11T23:18:51.177 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-11T23:18:51.177 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-11T23:18:51.177 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-11T23:18:51.178 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-11T23:18:51.178 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-11T23:18:51.178 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-11T23:18:51.178 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-11T23:18:51.178 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-11T23:18:51.178 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-11T23:18:51.178 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-11T23:18:51.178 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-11T23:18:51.178 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-11T23:18:51.179 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-11T23:18:51.179 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-11T23:18:51.179 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-11T23:18:51.179 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-11T23:18:51.179 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-11T23:18:51.179 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-11T23:18:51.179 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-11T23:18:51.179 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-11T23:18:51.179 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-11T23:18:51.179 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-11T23:18:51.179 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-11T23:18:51.179 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-11T23:18:51.180 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-11T23:18:51.180 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-11T23:18:51.180 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-11T23:18:51.180 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-11T23:18:51.180 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-11T23:18:51.180 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-11T23:18:51.180 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-11T23:18:51.180 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-11T23:18:51.180 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-11T23:18:51.180 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-11T23:18:51.180 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-11T23:18:51.181 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-11T23:18:51.181 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-11T23:18:51.200 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 1f5284d2-7094-11ef-bcea-c7b262605968 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-11T23:18:51.200 DEBUG:teuthology.orchestra.run.smithi005:mon.a> sudo journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mon.a.service 2024-09-11T23:18:51.242 DEBUG:teuthology.orchestra.run.smithi005:mgr.x> sudo journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mgr.x.service 2024-09-11T23:18:51.285 INFO:tasks.cephadm:Bootstrapping... 2024-09-11T23:18:51.285 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc -v bootstrap --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.5 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-11T23:18:51.500 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-09-11T23:18:51.500 INFO:teuthology.orchestra.run.smithi005.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', '-v', 'bootstrap', '--fsid', '1f5284d2-7094-11ef-bcea-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.5', '--skip-admin-label'] 2024-09-11T23:18:51.501 INFO:teuthology.orchestra.run.smithi005.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-11T23:18:51.501 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying podman|docker is present... 2024-09-11T23:18:51.525 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stdout 5.2.2 2024-09-11T23:18:51.525 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying lvm2 is present... 2024-09-11T23:18:51.525 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying time synchronization is in place... 2024-09-11T23:18:51.533 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-11T23:18:51.533 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-11T23:18:51.539 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-11T23:18:51.539 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2024-09-11T23:18:51.546 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout enabled 2024-09-11T23:18:51.553 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout active 2024-09-11T23:18:51.553 INFO:teuthology.orchestra.run.smithi005.stdout:Unit chronyd.service is enabled and running 2024-09-11T23:18:51.553 INFO:teuthology.orchestra.run.smithi005.stdout:Repeating the final host check... 2024-09-11T23:18:51.577 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stdout 5.2.2 2024-09-11T23:18:51.577 INFO:teuthology.orchestra.run.smithi005.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-11T23:18:51.577 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl is present 2024-09-11T23:18:51.577 INFO:teuthology.orchestra.run.smithi005.stdout:lvcreate is present 2024-09-11T23:18:51.583 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-11T23:18:51.584 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-11T23:18:51.590 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-11T23:18:51.590 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2024-09-11T23:18:51.597 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout enabled 2024-09-11T23:18:51.604 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout active 2024-09-11T23:18:51.604 INFO:teuthology.orchestra.run.smithi005.stdout:Unit chronyd.service is enabled and running 2024-09-11T23:18:51.604 INFO:teuthology.orchestra.run.smithi005.stdout:Host looks OK 2024-09-11T23:18:51.605 INFO:teuthology.orchestra.run.smithi005.stdout:Cluster fsid: 1f5284d2-7094-11ef-bcea-c7b262605968 2024-09-11T23:18:51.605 INFO:teuthology.orchestra.run.smithi005.stdout:Acquiring lock 139813480780800 on /run/cephadm/1f5284d2-7094-11ef-bcea-c7b262605968.lock 2024-09-11T23:18:51.605 INFO:teuthology.orchestra.run.smithi005.stdout:Lock 139813480780800 acquired on /run/cephadm/1f5284d2-7094-11ef-bcea-c7b262605968.lock 2024-09-11T23:18:51.605 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying IP 172.21.15.5 port 3300 ... 2024-09-11T23:18:51.605 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying IP 172.21.15.5 port 6789 ... 2024-09-11T23:18:51.605 INFO:teuthology.orchestra.run.smithi005.stdout:Base mon IP(s) is [172.21.15.5:3300, 172.21.15.5:6789], mon addrv is [v2:172.21.15.5:3300,v1:172.21.15.5:6789] 2024-09-11T23:18:51.608 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.5 metric 100 2024-09-11T23:18:51.608 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.5 metric 100 2024-09-11T23:18:51.611 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-11T23:18:51.611 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-11T23:18:51.611 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1696sec hoplimit 64 pref medium 2024-09-11T23:18:51.614 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-11T23:18:51.614 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-11T23:18:51.614 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-11T23:18:51.614 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-11T23:18:51.614 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1442/64 scope link 2024-09-11T23:18:51.614 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-11T23:18:51.615 INFO:teuthology.orchestra.run.smithi005.stdout:Mon IP `172.21.15.5` is in CIDR network `172.21.0.0/20` 2024-09-11T23:18:51.615 INFO:teuthology.orchestra.run.smithi005.stdout:Mon IP `172.21.15.5` is in CIDR network `172.21.0.0/20` 2024-09-11T23:18:51.615 INFO:teuthology.orchestra.run.smithi005.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-11T23:18:51.615 INFO:teuthology.orchestra.run.smithi005.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-11T23:18:51.616 INFO:teuthology.orchestra.run.smithi005.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-11T23:18:52.027 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stdout 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 2024-09-11T23:18:52.028 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-11T23:18:52.028 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stderr Getting image source signatures 2024-09-11T23:18:52.028 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stderr Copying blob sha256:60180723200353b4e13b39fd162aecaf1bc097c859c7c6537324229e97c78567 2024-09-11T23:18:52.028 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-11T23:18:52.028 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stderr Copying config sha256:54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 2024-09-11T23:18:52.028 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-11T23:18:52.924 INFO:teuthology.orchestra.run.smithi005.stdout:ceph: stdout ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-11T23:18:52.924 INFO:teuthology.orchestra.run.smithi005.stdout:Ceph version: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-11T23:18:52.924 INFO:teuthology.orchestra.run.smithi005.stdout:Extracting ceph user uid/gid from container image... 2024-09-11T23:18:53.914 INFO:teuthology.orchestra.run.smithi005.stdout:stat: stdout 167 167 2024-09-11T23:18:53.914 INFO:teuthology.orchestra.run.smithi005.stdout:Creating initial keys... 2024-09-11T23:18:54.944 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-authtool: stdout AQBeJeJmXPTNEBAAFXcmphUKwlJ9BR/Cr7t7yA== 2024-09-11T23:18:55.883 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-authtool: stdout AQBfJeJmz+8TERAAjPEjCggFd0DWt2HY6Z1VWg== 2024-09-11T23:18:56.814 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-authtool: stdout AQBgJeJmvv1sCxAAe60tXJD4HMDgXuiAe9xkkA== 2024-09-11T23:18:56.815 INFO:teuthology.orchestra.run.smithi005.stdout:Creating initial monmap... 2024-09-11T23:18:57.678 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-11T23:18:57.679 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-11T23:18:57.679 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 1f5284d2-7094-11ef-bcea-c7b262605968 2024-09-11T23:18:57.679 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-11T23:18:57.679 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool for a [v2:172.21.15.5:3300,v1:172.21.15.5:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-11T23:18:57.679 INFO:teuthology.orchestra.run.smithi005.stdout:setting min_mon_release = quincy 2024-09-11T23:18:57.679 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/monmaptool: set fsid to 1f5284d2-7094-11ef-bcea-c7b262605968 2024-09-11T23:18:57.679 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-11T23:18:57.679 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:18:57.679 INFO:teuthology.orchestra.run.smithi005.stdout:Creating mon... 2024-09-11T23:18:58.575 INFO:teuthology.orchestra.run.smithi005.stdout:create mon.a on 2024-09-11T23:18:58.808 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-11T23:18:58.961 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-11T23:18:59.132 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-1f5284d2-7094-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-1f5284d2-7094-11ef-bcea-c7b262605968.target. 2024-09-11T23:18:59.133 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-1f5284d2-7094-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-1f5284d2-7094-11ef-bcea-c7b262605968.target. 2024-09-11T23:18:59.383 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mon.a 2024-09-11T23:18:59.384 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Failed to reset failed state of unit ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mon.a.service: Unit ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mon.a.service not loaded. 2024-09-11T23:18:59.563 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-1f5284d2-7094-11ef-bcea-c7b262605968.target.wants/ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mon.a.service → /etc/systemd/system/ceph-1f5284d2-7094-11ef-bcea-c7b262605968@.service. 2024-09-11T23:18:59.817 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:18:59 smithi005 podman[30817]: 2024-09-11 23:18:59.71290876 +0000 UTC m=+0.020171364 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:18:59.817 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:18:59 smithi005 podman[30817]: 2024-09-11 23:18:59.817434033 +0000 UTC m=+0.124696627 container create 6c5b893a0e6edb3b85a49042fd2dc93158a2686300c35d8507d996b25c3458ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mon-a, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-11T23:19:00.085 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:00 smithi005 podman[30817]: 2024-09-11 23:19:00.011341668 +0000 UTC m=+0.318604263 container init 6c5b893a0e6edb3b85a49042fd2dc93158a2686300c35d8507d996b25c3458ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-11T23:19:00.086 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:00 smithi005 podman[30817]: 2024-09-11 23:19:00.014664287 +0000 UTC m=+0.321926881 container start 6c5b893a0e6edb3b85a49042fd2dc93158a2686300c35d8507d996b25c3458ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux ) 2024-09-11T23:19:00.086 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:00 smithi005 ceph-mon[30837]: mkfs 1f5284d2-7094-11ef-bcea-c7b262605968 2024-09-11T23:19:00.086 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:00 smithi005 ceph-mon[30837]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-11T23:19:00.086 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:00 smithi005 bash[30817]: 6c5b893a0e6edb3b85a49042fd2dc93158a2686300c35d8507d996b25c3458ef 2024-09-11T23:19:00.101 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-11T23:19:00.101 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout disabled 2024-09-11T23:19:00.109 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-11T23:19:00.110 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2024-09-11T23:19:00.110 INFO:teuthology.orchestra.run.smithi005.stdout:firewalld.service is not enabled 2024-09-11T23:19:00.110 INFO:teuthology.orchestra.run.smithi005.stdout:Not possible to enable service . firewalld.service is not available 2024-09-11T23:19:00.110 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for mon to start... 2024-09-11T23:19:00.110 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for mon... 2024-09-11T23:19:00.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:00 smithi005 systemd[1]: Started Ceph mon.a for 1f5284d2-7094-11ef-bcea-c7b262605968. 2024-09-11T23:19:01.075 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout cluster: 2024-09-11T23:19:01.076 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout id: 1f5284d2-7094-11ef-bcea-c7b262605968 2024-09-11T23:19:01.076 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-11T23:19:01.076 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-09-11T23:19:01.076 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout services: 2024-09-11T23:19:01.076 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.481665s) 2024-09-11T23:19:01.076 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-11T23:19:01.076 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-11T23:19:01.076 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-09-11T23:19:01.076 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout data: 2024-09-11T23:19:01.076 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-11T23:19:01.076 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-11T23:19:01.076 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-11T23:19:01.077 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout pgs: 2024-09-11T23:19:01.077 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-09-11T23:19:01.077 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:00.461+0000 7f468c46c640 1 Processor -- start 2024-09-11T23:19:01.077 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:00.461+0000 7f468c46c640 1 -- start start 2024-09-11T23:19:01.077 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:00.461+0000 7f468c46c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4684107420 0x7f4684107820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:01.077 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:00.461+0000 7f468c46c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4684107df0 con 0x7f4684107420 2024-09-11T23:19:01.077 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:00.462+0000 7f468a208640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4684107420 0x7f4684107820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:01.077 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:00.462+0000 7f468a208640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4684107420 0x7f4684107820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52538/0 (socket says 172.21.15.5:52538) 2024-09-11T23:19:01.077 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:00.462+0000 7f468a208640 1 -- 172.21.15.5:0/1812088112 learned_addr learned my addr 172.21.15.5:0/1812088112 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:01.077 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:00.462+0000 7f468a208640 1 -- 172.21.15.5:0/1812088112 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4684108620 con 0x7f4684107420 2024-09-11T23:19:01.077 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:00.464+0000 7f468a208640 1 --2- 172.21.15.5:0/1812088112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4684107420 0x7f4684107820 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4680009820 tx=0x7f468002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81fcfdac08f2a899 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:01.078 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:00.464+0000 7f4689206640 1 -- 172.21.15.5:0/1812088112 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4680037070 con 0x7f4684107420 2024-09-11T23:19:01.078 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:00.464+0000 7f4689206640 1 -- 172.21.15.5:0/1812088112 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4680032440 con 0x7f4684107420 2024-09-11T23:19:01.078 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:00.464+0000 7f4689206640 1 -- 172.21.15.5:0/1812088112 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4680032740 con 0x7f4684107420 2024-09-11T23:19:01.078 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:00.465+0000 7f468c46c640 1 -- 172.21.15.5:0/1812088112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4684107420 msgr2=0x7f4684107820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:01.078 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:00.465+0000 7f468c46c640 1 --2- 172.21.15.5:0/1812088112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4684107420 0x7f4684107820 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4680009820 tx=0x7f468002a270 comp rx=0 tx=0).stop 2024-09-11T23:19:01.078 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:00.465+0000 7f468c46c640 1 -- 172.21.15.5:0/1812088112 shutdown_connections 2024-09-11T23:19:01.078 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:00.465+0000 7f468c46c640 1 --2- 172.21.15.5:0/1812088112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4684107420 0x7f4684107820 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:01.078 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:00.465+0000 7f468c46c640 1 -- 172.21.15.5:0/1812088112 >> 172.21.15.5:0/1812088112 conn(0x7f4684102bb0 msgr2=0x7f4684104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:01.078 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:00.465+0000 7f468c46c640 1 -- 172.21.15.5:0/1812088112 shutdown_connections 2024-09-11T23:19:01.078 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:00.465+0000 7f468c46c640 1 -- 172.21.15.5:0/1812088112 wait complete. 2024-09-11T23:19:01.078 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:00.466+0000 7f468c46c640 1 Processor -- start 2024-09-11T23:19:01.078 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:00.466+0000 7f468c46c640 1 -- start start 2024-09-11T23:19:01.078 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:00.466+0000 7f468c46c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4684107420 0x7f468419abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:01.079 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:00.466+0000 7f468c46c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4684108bc0 con 0x7f4684107420 2024-09-11T23:19:01.079 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:00.466+0000 7f468a208640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4684107420 0x7f468419abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:01.079 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:00.466+0000 7f468a208640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4684107420 0x7f468419abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52552/0 (socket says 172.21.15.5:52552) 2024-09-11T23:19:01.079 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:00.466+0000 7f468a208640 1 -- 172.21.15.5:0/434519296 learned_addr learned my addr 172.21.15.5:0/434519296 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:01.079 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:00.466+0000 7f468a208640 1 -- 172.21.15.5:0/434519296 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f468419b100 con 0x7f4684107420 2024-09-11T23:19:01.079 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:00.467+0000 7f468a208640 1 --2- 172.21.15.5:0/434519296 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4684107420 0x7f468419abc0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f46800090b0 tx=0x7f46800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:01.079 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:00.467+0000 7f467b7fe640 1 -- 172.21.15.5:0/434519296 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4680041070 con 0x7f4684107420 2024-09-11T23:19:01.079 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:00.467+0000 7f467b7fe640 1 -- 172.21.15.5:0/434519296 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f468003c7a0 con 0x7f4684107420 2024-09-11T23:19:01.079 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:00.467+0000 7f468c46c640 1 -- 172.21.15.5:0/434519296 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f468419b390 con 0x7f4684107420 2024-09-11T23:19:01.079 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:00.467+0000 7f467b7fe640 1 -- 172.21.15.5:0/434519296 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4680037040 con 0x7f4684107420 2024-09-11T23:19:01.079 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:00.467+0000 7f468c46c640 1 -- 172.21.15.5:0/434519296 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f468419e080 con 0x7f4684107420 2024-09-11T23:19:01.079 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:00.467+0000 7f467b7fe640 1 -- 172.21.15.5:0/434519296 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4680044070 con 0x7f4684107420 2024-09-11T23:19:01.080 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:00.467+0000 7f467b7fe640 1 -- 172.21.15.5:0/434519296 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f468003d3f0 con 0x7f4684107420 2024-09-11T23:19:01.080 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:00.468+0000 7f468c46c640 1 -- 172.21.15.5:0/434519296 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4684109210 con 0x7f4684107420 2024-09-11T23:19:01.080 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:00.470+0000 7f467b7fe640 1 -- 172.21.15.5:0/434519296 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f4680046450 con 0x7f4684107420 2024-09-11T23:19:01.080 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:00.532+0000 7f468c46c640 1 -- 172.21.15.5:0/434519296 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f468419e5e0 con 0x7f4684107420 2024-09-11T23:19:01.080 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:00.532+0000 7f467b7fe640 1 -- 172.21.15.5:0/434519296 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f4680046630 con 0x7f4684107420 2024-09-11T23:19:01.080 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:00.533+0000 7f468c46c640 1 -- 172.21.15.5:0/434519296 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4684107420 msgr2=0x7f468419abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:01.080 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:00.533+0000 7f468c46c640 1 --2- 172.21.15.5:0/434519296 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4684107420 0x7f468419abc0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f46800090b0 tx=0x7f46800046c0 comp rx=0 tx=0).stop 2024-09-11T23:19:01.080 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:00.533+0000 7f468c46c640 1 -- 172.21.15.5:0/434519296 shutdown_connections 2024-09-11T23:19:01.080 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:00.533+0000 7f468c46c640 1 --2- 172.21.15.5:0/434519296 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4684107420 0x7f468419abc0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:01.080 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:00.533+0000 7f468c46c640 1 -- 172.21.15.5:0/434519296 >> 172.21.15.5:0/434519296 conn(0x7f4684102bb0 msgr2=0x7f468418eeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:01.080 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:00.533+0000 7f468c46c640 1 -- 172.21.15.5:0/434519296 shutdown_connections 2024-09-11T23:19:01.080 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:00.533+0000 7f468c46c640 1 -- 172.21.15.5:0/434519296 wait complete. 2024-09-11T23:19:01.080 INFO:teuthology.orchestra.run.smithi005.stdout:mon is available 2024-09-11T23:19:01.081 INFO:teuthology.orchestra.run.smithi005.stdout:Assimilating anything we can from ceph.conf... 2024-09-11T23:19:01.204 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:01 smithi005 ceph-mon[30837]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-11T23:19:01.204 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:01 smithi005 ceph-mon[30837]: monmap epoch 1 2024-09-11T23:19:01.204 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:01 smithi005 ceph-mon[30837]: fsid 1f5284d2-7094-11ef-bcea-c7b262605968 2024-09-11T23:19:01.204 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:01 smithi005 ceph-mon[30837]: last_changed 2024-09-11T23:18:57.103876+0000 2024-09-11T23:19:01.204 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:01 smithi005 ceph-mon[30837]: created 2024-09-11T23:18:57.103876+0000 2024-09-11T23:19:01.205 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:01 smithi005 ceph-mon[30837]: min_mon_release 19 (squid) 2024-09-11T23:19:01.205 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:01 smithi005 ceph-mon[30837]: election_strategy: 1 2024-09-11T23:19:01.205 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:01 smithi005 ceph-mon[30837]: 0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-09-11T23:19:01.205 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:01 smithi005 ceph-mon[30837]: fsmap 2024-09-11T23:19:01.205 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:01 smithi005 ceph-mon[30837]: osdmap e1: 0 total, 0 up, 0 in 2024-09-11T23:19:01.205 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:01 smithi005 ceph-mon[30837]: mgrmap e1: no daemons active 2024-09-11T23:19:01.205 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:01 smithi005 ceph-mon[30837]: from='client.? 172.21.15.5:0/434519296' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-11T23:19:02.207 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:02 smithi005 ceph-mon[30837]: from='client.? 172.21.15.5:0/2058041100' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-11T23:19:02.207 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:02 smithi005 ceph-mon[30837]: from='client.? 172.21.15.5:0/2058041100' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-11T23:19:02.215 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-09-11T23:19:02.215 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout [global] 2024-09-11T23:19:02.215 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout fsid = 1f5284d2-7094-11ef-bcea-c7b262605968 2024-09-11T23:19:02.215 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.5:3300,v1:172.21.15.5:6789] 2024-09-11T23:19:02.215 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-11T23:19:02.216 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-11T23:19:02.216 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-11T23:19:02.216 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-11T23:19:02.216 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-09-11T23:19:02.216 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-11T23:19:02.216 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-11T23:19:02.216 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-09-11T23:19:02.216 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout [osd] 2024-09-11T23:19:02.216 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-11T23:19:02.216 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-11T23:19:02.216 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-11T23:19:02.216 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-11T23:19:02.217 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-11T23:19:02.217 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:01.517+0000 7f6b6585f640 1 Processor -- start 2024-09-11T23:19:02.217 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:01.517+0000 7f6b6585f640 1 -- start start 2024-09-11T23:19:02.217 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:01.517+0000 7f6b6585f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b60107410 0x7f6b60107810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:02.217 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:01.517+0000 7f6b6585f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6b60107de0 con 0x7f6b60107410 2024-09-11T23:19:02.217 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:01.518+0000 7f6b5effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b60107410 0x7f6b60107810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:02.217 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:01.518+0000 7f6b5effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b60107410 0x7f6b60107810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52564/0 (socket says 172.21.15.5:52564) 2024-09-11T23:19:02.217 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:01.518+0000 7f6b5effd640 1 -- 172.21.15.5:0/2277880753 learned_addr learned my addr 172.21.15.5:0/2277880753 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:02.217 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:01.518+0000 7f6b5effd640 1 -- 172.21.15.5:0/2277880753 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b60108610 con 0x7f6b60107410 2024-09-11T23:19:02.217 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:01.519+0000 7f6b5effd640 1 --2- 172.21.15.5:0/2277880753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b60107410 0x7f6b60107810 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f6b50009820 tx=0x7f6b5002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62e86196011da50f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:02.217 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:01.519+0000 7f6b5dffb640 1 -- 172.21.15.5:0/2277880753 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b50037070 con 0x7f6b60107410 2024-09-11T23:19:02.217 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:01.519+0000 7f6b5dffb640 1 -- 172.21.15.5:0/2277880753 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b50032440 con 0x7f6b60107410 2024-09-11T23:19:02.218 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:01.519+0000 7f6b5dffb640 1 -- 172.21.15.5:0/2277880753 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b50032740 con 0x7f6b60107410 2024-09-11T23:19:02.218 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:01.519+0000 7f6b6585f640 1 -- 172.21.15.5:0/2277880753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b60107410 msgr2=0x7f6b60107810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:02.218 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:01.519+0000 7f6b6585f640 1 --2- 172.21.15.5:0/2277880753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b60107410 0x7f6b60107810 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f6b50009820 tx=0x7f6b5002a270 comp rx=0 tx=0).stop 2024-09-11T23:19:02.218 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:01.520+0000 7f6b6585f640 1 -- 172.21.15.5:0/2277880753 shutdown_connections 2024-09-11T23:19:02.218 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:01.520+0000 7f6b6585f640 1 --2- 172.21.15.5:0/2277880753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b60107410 0x7f6b60107810 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:02.218 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:01.520+0000 7f6b6585f640 1 -- 172.21.15.5:0/2277880753 >> 172.21.15.5:0/2277880753 conn(0x7f6b60102bc0 msgr2=0x7f6b60104fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:02.218 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:01.520+0000 7f6b6585f640 1 -- 172.21.15.5:0/2277880753 shutdown_connections 2024-09-11T23:19:02.218 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:01.520+0000 7f6b6585f640 1 -- 172.21.15.5:0/2277880753 wait complete. 2024-09-11T23:19:02.218 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:01.520+0000 7f6b6585f640 1 Processor -- start 2024-09-11T23:19:02.218 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:01.520+0000 7f6b6585f640 1 -- start start 2024-09-11T23:19:02.218 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:01.521+0000 7f6b6585f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b60107410 0x7f6b6019ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:02.218 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:01.521+0000 7f6b6585f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6b60108bb0 con 0x7f6b60107410 2024-09-11T23:19:02.219 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:01.521+0000 7f6b5effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b60107410 0x7f6b6019ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:02.219 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:01.521+0000 7f6b5effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b60107410 0x7f6b6019ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52572/0 (socket says 172.21.15.5:52572) 2024-09-11T23:19:02.219 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:01.521+0000 7f6b5effd640 1 -- 172.21.15.5:0/2058041100 learned_addr learned my addr 172.21.15.5:0/2058041100 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:02.219 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:01.521+0000 7f6b5effd640 1 -- 172.21.15.5:0/2058041100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b6019b0c0 con 0x7f6b60107410 2024-09-11T23:19:02.219 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:01.521+0000 7f6b5effd640 1 --2- 172.21.15.5:0/2058041100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b60107410 0x7f6b6019ab80 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f6b500090b0 tx=0x7f6b500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:02.219 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:01.521+0000 7f6b6485d640 1 -- 172.21.15.5:0/2058041100 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b50041070 con 0x7f6b60107410 2024-09-11T23:19:02.219 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:01.521+0000 7f6b6485d640 1 -- 172.21.15.5:0/2058041100 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b5003c7a0 con 0x7f6b60107410 2024-09-11T23:19:02.219 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:01.521+0000 7f6b6485d640 1 -- 172.21.15.5:0/2058041100 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b50037040 con 0x7f6b60107410 2024-09-11T23:19:02.219 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:01.521+0000 7f6b6585f640 1 -- 172.21.15.5:0/2058041100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b6019b350 con 0x7f6b60107410 2024-09-11T23:19:02.219 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:01.521+0000 7f6b6585f640 1 -- 172.21.15.5:0/2058041100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b6019e040 con 0x7f6b60107410 2024-09-11T23:19:02.219 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:01.522+0000 7f6b6485d640 1 -- 172.21.15.5:0/2058041100 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6b50044070 con 0x7f6b60107410 2024-09-11T23:19:02.220 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:01.522+0000 7f6b6485d640 1 -- 172.21.15.5:0/2058041100 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6b5003d3f0 con 0x7f6b60107410 2024-09-11T23:19:02.220 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:01.522+0000 7f6b6585f640 1 -- 172.21.15.5:0/2058041100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b60109200 con 0x7f6b60107410 2024-09-11T23:19:02.220 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:01.525+0000 7f6b6485d640 1 -- 172.21.15.5:0/2058041100 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f6b50046450 con 0x7f6b60107410 2024-09-11T23:19:02.220 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:01.584+0000 7f6b6585f640 1 -- 172.21.15.5:0/2058041100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f6b6019f710 con 0x7f6b60107410 2024-09-11T23:19:02.220 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:01.587+0000 7f6b6485d640 1 -- 172.21.15.5:0/2058041100 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+427 (secure 0 0 0) 0x7f6b50046630 con 0x7f6b60107410 2024-09-11T23:19:02.220 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:01.588+0000 7f6b6485d640 1 -- 172.21.15.5:0/2058041100 <== mon.0 v2:172.21.15.5:3300/0 8 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f6b50056070 con 0x7f6b60107410 2024-09-11T23:19:02.220 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:01.589+0000 7f6b6585f640 1 -- 172.21.15.5:0/2058041100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b60107410 msgr2=0x7f6b6019ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:02.220 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:01.589+0000 7f6b6585f640 1 --2- 172.21.15.5:0/2058041100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b60107410 0x7f6b6019ab80 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f6b500090b0 tx=0x7f6b500046c0 comp rx=0 tx=0).stop 2024-09-11T23:19:02.220 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:01.589+0000 7f6b6585f640 1 -- 172.21.15.5:0/2058041100 shutdown_connections 2024-09-11T23:19:02.220 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:01.589+0000 7f6b6585f640 1 --2- 172.21.15.5:0/2058041100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b60107410 0x7f6b6019ab80 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:02.220 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:01.589+0000 7f6b6585f640 1 -- 172.21.15.5:0/2058041100 >> 172.21.15.5:0/2058041100 conn(0x7f6b60102bc0 msgr2=0x7f6b6018eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:02.220 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:01.589+0000 7f6b6585f640 1 -- 172.21.15.5:0/2058041100 shutdown_connections 2024-09-11T23:19:02.221 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:01.589+0000 7f6b6585f640 1 -- 172.21.15.5:0/2058041100 wait complete. 2024-09-11T23:19:02.221 INFO:teuthology.orchestra.run.smithi005.stdout:Generating new minimal ceph.conf... 2024-09-11T23:19:03.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:03 smithi005 ceph-mon[30837]: from='client.? 172.21.15.5:0/4085873272' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:19:03.237 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:02.623+0000 7fd2ba776640 1 Processor -- start 2024-09-11T23:19:03.238 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:02.623+0000 7fd2ba776640 1 -- start start 2024-09-11T23:19:03.238 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:02.623+0000 7fd2ba776640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2b4107420 0x7fd2b4107820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:03.238 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:02.623+0000 7fd2ba776640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b4107df0 con 0x7fd2b4107420 2024-09-11T23:19:03.238 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:02.623+0000 7fd2b3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2b4107420 0x7fd2b4107820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:03.238 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:02.623+0000 7fd2b3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2b4107420 0x7fd2b4107820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52582/0 (socket says 172.21.15.5:52582) 2024-09-11T23:19:03.238 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:02.623+0000 7fd2b3fff640 1 -- 172.21.15.5:0/3616226425 learned_addr learned my addr 172.21.15.5:0/3616226425 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:03.238 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:02.624+0000 7fd2b3fff640 1 -- 172.21.15.5:0/3616226425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2b4108620 con 0x7fd2b4107420 2024-09-11T23:19:03.238 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:02.624+0000 7fd2b3fff640 1 --2- 172.21.15.5:0/3616226425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2b4107420 0x7fd2b4107820 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4009820 tx=0x7fd2a402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bfcb292a66e9eeb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:03.238 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:02.624+0000 7fd2b2ffd640 1 -- 172.21.15.5:0/3616226425 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2a4037070 con 0x7fd2b4107420 2024-09-11T23:19:03.238 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:02.624+0000 7fd2b2ffd640 1 -- 172.21.15.5:0/3616226425 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fd2a40328d0 con 0x7fd2b4107420 2024-09-11T23:19:03.238 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:02.624+0000 7fd2b2ffd640 1 -- 172.21.15.5:0/3616226425 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2a40307d0 con 0x7fd2b4107420 2024-09-11T23:19:03.238 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:02.625+0000 7fd2ba776640 1 -- 172.21.15.5:0/3616226425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2b4107420 msgr2=0x7fd2b4107820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:03.239 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:02.625+0000 7fd2ba776640 1 --2- 172.21.15.5:0/3616226425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2b4107420 0x7fd2b4107820 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4009820 tx=0x7fd2a402a270 comp rx=0 tx=0).stop 2024-09-11T23:19:03.239 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:02.625+0000 7fd2ba776640 1 -- 172.21.15.5:0/3616226425 shutdown_connections 2024-09-11T23:19:03.239 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:02.625+0000 7fd2ba776640 1 --2- 172.21.15.5:0/3616226425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2b4107420 0x7fd2b4107820 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:03.239 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:02.625+0000 7fd2ba776640 1 -- 172.21.15.5:0/3616226425 >> 172.21.15.5:0/3616226425 conn(0x7fd2b4102bb0 msgr2=0x7fd2b4104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:03.239 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:02.625+0000 7fd2ba776640 1 -- 172.21.15.5:0/3616226425 shutdown_connections 2024-09-11T23:19:03.239 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:02.625+0000 7fd2ba776640 1 -- 172.21.15.5:0/3616226425 wait complete. 2024-09-11T23:19:03.239 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:02.626+0000 7fd2ba776640 1 Processor -- start 2024-09-11T23:19:03.239 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:02.626+0000 7fd2ba776640 1 -- start start 2024-09-11T23:19:03.239 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:02.626+0000 7fd2ba776640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2b4107420 0x7fd2b419b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:03.239 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:02.626+0000 7fd2ba776640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b410b9d0 con 0x7fd2b4107420 2024-09-11T23:19:03.239 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:02.626+0000 7fd2b3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2b4107420 0x7fd2b419b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:03.240 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:02.626+0000 7fd2b3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2b4107420 0x7fd2b419b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52590/0 (socket says 172.21.15.5:52590) 2024-09-11T23:19:03.240 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:02.626+0000 7fd2b3fff640 1 -- 172.21.15.5:0/4085873272 learned_addr learned my addr 172.21.15.5:0/4085873272 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:03.240 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:02.627+0000 7fd2b3fff640 1 -- 172.21.15.5:0/4085873272 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2b419b8d0 con 0x7fd2b4107420 2024-09-11T23:19:03.240 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:02.627+0000 7fd2b3fff640 1 --2- 172.21.15.5:0/4085873272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2b4107420 0x7fd2b419b390 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd2a40097f0 tx=0x7fd2a4030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:03.240 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:02.627+0000 7fd2b17fa640 1 -- 172.21.15.5:0/4085873272 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2a4037040 con 0x7fd2b4107420 2024-09-11T23:19:03.240 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:02.627+0000 7fd2b17fa640 1 -- 172.21.15.5:0/4085873272 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fd2a4032bb0 con 0x7fd2b4107420 2024-09-11T23:19:03.240 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:02.627+0000 7fd2ba776640 1 -- 172.21.15.5:0/4085873272 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2b419bb60 con 0x7fd2b4107420 2024-09-11T23:19:03.240 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:02.627+0000 7fd2b17fa640 1 -- 172.21.15.5:0/4085873272 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2a403a390 con 0x7fd2b4107420 2024-09-11T23:19:03.240 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:02.627+0000 7fd2ba776640 1 -- 172.21.15.5:0/4085873272 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2b419e850 con 0x7fd2b4107420 2024-09-11T23:19:03.240 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:02.627+0000 7fd2b17fa640 1 -- 172.21.15.5:0/4085873272 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd2a403a5d0 con 0x7fd2b4107420 2024-09-11T23:19:03.240 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:02.627+0000 7fd2b17fa640 1 -- 172.21.15.5:0/4085873272 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd2a4044ba0 con 0x7fd2b4107420 2024-09-11T23:19:03.240 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:02.628+0000 7fd2ba776640 1 -- 172.21.15.5:0/4085873272 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2b410bb50 con 0x7fd2b4107420 2024-09-11T23:19:03.241 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:02.630+0000 7fd2b17fa640 1 -- 172.21.15.5:0/4085873272 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fd2a4044400 con 0x7fd2b4107420 2024-09-11T23:19:03.241 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:02.691+0000 7fd2ba776640 1 -- 172.21.15.5:0/4085873272 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fd2b41078a0 con 0x7fd2b4107420 2024-09-11T23:19:03.241 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:02.691+0000 7fd2b17fa640 1 -- 172.21.15.5:0/4085873272 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+173 (secure 0 0 0) 0x7fd2b41078a0 con 0x7fd2b4107420 2024-09-11T23:19:03.241 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:02.692+0000 7fd2ba776640 1 -- 172.21.15.5:0/4085873272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2b4107420 msgr2=0x7fd2b419b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:03.241 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:02.692+0000 7fd2ba776640 1 --2- 172.21.15.5:0/4085873272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2b4107420 0x7fd2b419b390 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd2a40097f0 tx=0x7fd2a4030d00 comp rx=0 tx=0).stop 2024-09-11T23:19:03.241 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:02.692+0000 7fd2ba776640 1 -- 172.21.15.5:0/4085873272 shutdown_connections 2024-09-11T23:19:03.241 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:02.692+0000 7fd2ba776640 1 --2- 172.21.15.5:0/4085873272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2b4107420 0x7fd2b419b390 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:03.241 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:02.692+0000 7fd2ba776640 1 -- 172.21.15.5:0/4085873272 >> 172.21.15.5:0/4085873272 conn(0x7fd2b4102bb0 msgr2=0x7fd2b41036a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:03.241 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:02.692+0000 7fd2ba776640 1 -- 172.21.15.5:0/4085873272 shutdown_connections 2024-09-11T23:19:03.241 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:02.692+0000 7fd2ba776640 1 -- 172.21.15.5:0/4085873272 wait complete. 2024-09-11T23:19:03.241 INFO:teuthology.orchestra.run.smithi005.stdout:Restarting the monitor... 2024-09-11T23:19:03.492 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:03 smithi005 systemd[1]: Stopping Ceph mon.a for 1f5284d2-7094-11ef-bcea-c7b262605968... 2024-09-11T23:19:03.748 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:03 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mon-a[30833]: 2024-09-11T23:19:03.492+0000 7f80a3c03640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:19:03.748 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:03 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mon-a[30833]: 2024-09-11T23:19:03.492+0000 7f80a3c03640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-11T23:19:04.016 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:03 smithi005 podman[31080]: 2024-09-11 23:19:03.748700763 +0000 UTC m=+0.343851206 container died 6c5b893a0e6edb3b85a49042fd2dc93158a2686300c35d8507d996b25c3458ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mon-a, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-11T23:19:04.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 podman[31080]: 2024-09-11 23:19:04.116878649 +0000 UTC m=+0.712029100 container cleanup 6c5b893a0e6edb3b85a49042fd2dc93158a2686300c35d8507d996b25c3458ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mon-a, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-b53b6d3) 2024-09-11T23:19:04.359 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 bash[31080]: ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mon-a 2024-09-11T23:19:04.701 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 podman[31092]: 2024-09-11 23:19:04.359498817 +0000 UTC m=+0.608360135 container remove 6c5b893a0e6edb3b85a49042fd2dc93158a2686300c35d8507d996b25c3458ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T23:19:04.702 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 systemd[1]: ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-11T23:19:04.702 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 systemd[1]: Stopped Ceph mon.a for 1f5284d2-7094-11ef-bcea-c7b262605968. 2024-09-11T23:19:04.702 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 systemd[1]: Starting Ceph mon.a for 1f5284d2-7094-11ef-bcea-c7b262605968... 2024-09-11T23:19:04.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 podman[31182]: 2024-09-11 23:19:04.701865869 +0000 UTC m=+0.109543791 container create f8f83307d57dcb8f61652927b80317f09ac50c2f2331f53e220e6a2d4b5248ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_CLEAN=True) 2024-09-11T23:19:04.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 podman[31182]: 2024-09-11 23:19:04.608564082 +0000 UTC m=+0.016242019 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:19:04.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 podman[31182]: 2024-09-11 23:19:04.88751603 +0000 UTC m=+0.295193952 container init f8f83307d57dcb8f61652927b80317f09ac50c2f2331f53e220e6a2d4b5248ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-11T23:19:04.976 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 podman[31182]: 2024-09-11 23:19:04.890605004 +0000 UTC m=+0.298282939 container start f8f83307d57dcb8f61652927b80317f09ac50c2f2331f53e220e6a2d4b5248ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mon-a, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-11T23:19:04.976 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: set uid:gid to 167:167 (ceph:ceph) 2024-09-11T23:19:04.976 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable), process ceph-mon, pid 2 2024-09-11T23:19:04.976 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: pidfile_write: ignore empty --pid-file 2024-09-11T23:19:04.976 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: load: jerasure load: lrc 2024-09-11T23:19:04.976 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: RocksDB version: 7.9.2 2024-09-11T23:19:04.976 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Git sha 0 2024-09-11T23:19:04.976 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Compile date 2024-09-09 16:23:28 2024-09-11T23:19:04.976 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: DB SUMMARY 2024-09-11T23:19:04.977 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: DB Session ID: EUB9FTVKCZUMK4SR32O8 2024-09-11T23:19:04.977 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: CURRENT file: CURRENT 2024-09-11T23:19:04.977 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: IDENTITY file: IDENTITY 2024-09-11T23:19:04.977 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-11T23:19:04.977 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-11T23:19:04.977 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 104226 ; 2024-09-11T23:19:04.977 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.error_if_exists: 0 2024-09-11T23:19:04.978 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.create_if_missing: 0 2024-09-11T23:19:04.979 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.paranoid_checks: 1 2024-09-11T23:19:04.979 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-11T23:19:04.979 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-11T23:19:04.979 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-11T23:19:04.979 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.env: 0x5590d1bf7940 2024-09-11T23:19:04.979 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.fs: PosixFileSystem 2024-09-11T23:19:04.979 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.info_log: 0x5590d2b896e0 2024-09-11T23:19:04.979 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.max_file_opening_threads: 16 2024-09-11T23:19:04.979 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.statistics: (nil) 2024-09-11T23:19:04.979 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.use_fsync: 0 2024-09-11T23:19:04.979 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.max_log_file_size: 0 2024-09-11T23:19:04.979 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-11T23:19:04.980 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-11T23:19:04.980 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.keep_log_file_num: 1000 2024-09-11T23:19:04.980 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.recycle_log_file_num: 0 2024-09-11T23:19:04.980 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.allow_fallocate: 1 2024-09-11T23:19:04.980 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.allow_mmap_reads: 0 2024-09-11T23:19:04.980 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.allow_mmap_writes: 0 2024-09-11T23:19:04.980 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.use_direct_reads: 0 2024-09-11T23:19:04.980 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-11T23:19:04.980 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.create_missing_column_families: 0 2024-09-11T23:19:04.980 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.db_log_dir: 2024-09-11T23:19:04.980 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.wal_dir: 2024-09-11T23:19:04.980 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-11T23:19:04.980 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-11T23:19:04.981 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-11T23:19:04.981 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-11T23:19:04.981 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-11T23:19:04.981 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-11T23:19:04.981 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.advise_random_on_open: 1 2024-09-11T23:19:04.981 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.db_write_buffer_size: 0 2024-09-11T23:19:04.981 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.write_buffer_manager: 0x5590d2b98dc0 2024-09-11T23:19:04.981 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-11T23:19:04.981 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-11T23:19:04.981 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-11T23:19:04.981 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.rate_limiter: (nil) 2024-09-11T23:19:04.981 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-11T23:19:04.981 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.wal_recovery_mode: 2 2024-09-11T23:19:04.982 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.enable_thread_tracking: 0 2024-09-11T23:19:04.982 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.enable_pipelined_write: 0 2024-09-11T23:19:04.982 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.unordered_write: 0 2024-09-11T23:19:04.982 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-11T23:19:04.982 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-11T23:19:04.982 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-11T23:19:04.982 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-11T23:19:04.982 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.row_cache: None 2024-09-11T23:19:04.982 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.wal_filter: None 2024-09-11T23:19:04.982 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-11T23:19:04.982 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.allow_ingest_behind: 0 2024-09-11T23:19:04.982 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.two_write_queues: 0 2024-09-11T23:19:04.982 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.manual_wal_flush: 0 2024-09-11T23:19:04.982 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.wal_compression: 0 2024-09-11T23:19:04.983 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.atomic_flush: 0 2024-09-11T23:19:04.983 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-11T23:19:04.983 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-11T23:19:04.983 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-11T23:19:04.983 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.log_readahead_size: 0 2024-09-11T23:19:04.983 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-11T23:19:04.983 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.best_efforts_recovery: 0 2024-09-11T23:19:04.983 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-11T23:19:04.983 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-11T23:19:04.983 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.allow_data_in_errors: 0 2024-09-11T23:19:04.983 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.db_host_id: __hostname__ 2024-09-11T23:19:04.983 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-11T23:19:04.983 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.max_background_jobs: 2 2024-09-11T23:19:04.984 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.max_background_compactions: -1 2024-09-11T23:19:04.984 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.max_subcompactions: 1 2024-09-11T23:19:04.984 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-11T23:19:04.984 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-11T23:19:04.984 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-11T23:19:04.984 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.max_total_wal_size: 0 2024-09-11T23:19:04.984 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-11T23:19:04.984 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-11T23:19:04.984 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-11T23:19:04.984 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-11T23:19:04.984 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.max_open_files: -1 2024-09-11T23:19:04.984 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.bytes_per_sync: 0 2024-09-11T23:19:04.984 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-11T23:19:04.985 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-11T23:19:04.985 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.compaction_readahead_size: 0 2024-09-11T23:19:04.985 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.max_background_flushes: -1 2024-09-11T23:19:04.985 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Compression algorithms supported: 2024-09-11T23:19:04.985 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: kZSTD supported: 0 2024-09-11T23:19:04.985 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: kXpressCompression supported: 0 2024-09-11T23:19:04.985 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: kBZip2Compression supported: 0 2024-09-11T23:19:04.985 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-11T23:19:04.985 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: kLZ4Compression supported: 1 2024-09-11T23:19:04.985 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: kZlibCompression supported: 1 2024-09-11T23:19:04.985 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: kLZ4HCCompression supported: 1 2024-09-11T23:19:04.985 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: kSnappyCompression supported: 1 2024-09-11T23:19:04.985 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-11T23:19:04.985 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-11T23:19:04.986 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-11T23:19:04.986 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-11T23:19:04.986 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-11T23:19:04.986 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.merge_operator: 2024-09-11T23:19:04.986 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.compaction_filter: None 2024-09-11T23:19:04.986 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.compaction_filter_factory: None 2024-09-11T23:19:04.986 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.sst_partitioner_factory: None 2024-09-11T23:19:04.986 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-11T23:19:04.986 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-11T23:19:04.986 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5590d2b89320) 2024-09-11T23:19:04.986 INFO:journalctl@ceph.mon.a.smithi005.stdout: cache_index_and_filter_blocks: 1 2024-09-11T23:19:04.986 INFO:journalctl@ceph.mon.a.smithi005.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-11T23:19:04.986 INFO:journalctl@ceph.mon.a.smithi005.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-11T23:19:04.987 INFO:journalctl@ceph.mon.a.smithi005.stdout: pin_top_level_index_and_filter: 1 2024-09-11T23:19:04.987 INFO:journalctl@ceph.mon.a.smithi005.stdout: index_type: 0 2024-09-11T23:19:04.987 INFO:journalctl@ceph.mon.a.smithi005.stdout: data_block_index_type: 0 2024-09-11T23:19:04.987 INFO:journalctl@ceph.mon.a.smithi005.stdout: index_shortening: 1 2024-09-11T23:19:04.987 INFO:journalctl@ceph.mon.a.smithi005.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-11T23:19:04.987 INFO:journalctl@ceph.mon.a.smithi005.stdout: checksum: 4 2024-09-11T23:19:04.987 INFO:journalctl@ceph.mon.a.smithi005.stdout: no_block_cache: 0 2024-09-11T23:19:04.987 INFO:journalctl@ceph.mon.a.smithi005.stdout: block_cache: 0x5590d2b7d1f0 2024-09-11T23:19:04.987 INFO:journalctl@ceph.mon.a.smithi005.stdout: block_cache_name: BinnedLRUCache 2024-09-11T23:19:04.987 INFO:journalctl@ceph.mon.a.smithi005.stdout: block_cache_options: 2024-09-11T23:19:04.987 INFO:journalctl@ceph.mon.a.smithi005.stdout: capacity : 536870912 2024-09-11T23:19:04.987 INFO:journalctl@ceph.mon.a.smithi005.stdout: num_shard_bits : 4 2024-09-11T23:19:04.987 INFO:journalctl@ceph.mon.a.smithi005.stdout: strict_capacity_limit : 0 2024-09-11T23:19:04.988 INFO:journalctl@ceph.mon.a.smithi005.stdout: high_pri_pool_ratio: 0.000 2024-09-11T23:19:04.988 INFO:journalctl@ceph.mon.a.smithi005.stdout: block_cache_compressed: (nil) 2024-09-11T23:19:04.988 INFO:journalctl@ceph.mon.a.smithi005.stdout: persistent_cache: (nil) 2024-09-11T23:19:04.988 INFO:journalctl@ceph.mon.a.smithi005.stdout: block_size: 4096 2024-09-11T23:19:04.988 INFO:journalctl@ceph.mon.a.smithi005.stdout: block_size_deviation: 10 2024-09-11T23:19:04.988 INFO:journalctl@ceph.mon.a.smithi005.stdout: block_restart_interval: 16 2024-09-11T23:19:04.988 INFO:journalctl@ceph.mon.a.smithi005.stdout: index_block_restart_interval: 1 2024-09-11T23:19:04.988 INFO:journalctl@ceph.mon.a.smithi005.stdout: metadata_block_size: 4096 2024-09-11T23:19:04.988 INFO:journalctl@ceph.mon.a.smithi005.stdout: partition_filters: 0 2024-09-11T23:19:04.988 INFO:journalctl@ceph.mon.a.smithi005.stdout: use_delta_encoding: 1 2024-09-11T23:19:04.988 INFO:journalctl@ceph.mon.a.smithi005.stdout: filter_policy: bloomfilter 2024-09-11T23:19:04.988 INFO:journalctl@ceph.mon.a.smithi005.stdout: whole_key_filtering: 1 2024-09-11T23:19:04.988 INFO:journalctl@ceph.mon.a.smithi005.stdout: verify_compression: 0 2024-09-11T23:19:04.988 INFO:journalctl@ceph.mon.a.smithi005.stdout: read_amp_bytes_per_bit: 0 2024-09-11T23:19:04.989 INFO:journalctl@ceph.mon.a.smithi005.stdout: format_version: 5 2024-09-11T23:19:04.989 INFO:journalctl@ceph.mon.a.smithi005.stdout: enable_index_compression: 1 2024-09-11T23:19:04.989 INFO:journalctl@ceph.mon.a.smithi005.stdout: block_align: 0 2024-09-11T23:19:04.989 INFO:journalctl@ceph.mon.a.smithi005.stdout: max_auto_readahead_size: 262144 2024-09-11T23:19:04.989 INFO:journalctl@ceph.mon.a.smithi005.stdout: prepopulate_block_cache: 0 2024-09-11T23:19:04.989 INFO:journalctl@ceph.mon.a.smithi005.stdout: initial_auto_readahead_size: 8192 2024-09-11T23:19:04.989 INFO:journalctl@ceph.mon.a.smithi005.stdout: num_file_reads_for_auto_readahead: 2 2024-09-11T23:19:04.989 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.write_buffer_size: 33554432 2024-09-11T23:19:04.989 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.max_write_buffer_number: 2 2024-09-11T23:19:04.989 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.compression: NoCompression 2024-09-11T23:19:04.989 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.bottommost_compression: Disabled 2024-09-11T23:19:04.989 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.prefix_extractor: nullptr 2024-09-11T23:19:04.989 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-11T23:19:04.989 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.num_levels: 7 2024-09-11T23:19:04.990 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-11T23:19:04.990 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-11T23:19:04.990 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-11T23:19:04.990 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-11T23:19:04.990 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-11T23:19:04.990 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-11T23:19:04.990 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-11T23:19:04.990 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-11T23:19:04.990 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-11T23:19:04.990 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-11T23:19:04.990 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-11T23:19:04.990 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-11T23:19:04.990 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-11T23:19:04.991 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.compression_opts.level: 32767 2024-09-11T23:19:04.991 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.compression_opts.strategy: 0 2024-09-11T23:19:04.991 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-11T23:19:04.991 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-11T23:19:04.991 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-11T23:19:04.991 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-11T23:19:04.991 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.compression_opts.enabled: false 2024-09-11T23:19:04.991 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-11T23:19:04.992 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-11T23:19:04.992 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-11T23:19:04.992 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-11T23:19:04.992 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.target_file_size_base: 67108864 2024-09-11T23:19:04.992 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-11T23:19:04.992 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-11T23:19:04.992 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-11T23:19:04.992 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-11T23:19:04.992 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-11T23:19:04.992 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-11T23:19:04.992 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-11T23:19:04.992 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-11T23:19:04.992 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-11T23:19:04.993 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-11T23:19:04.993 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-11T23:19:04.993 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-11T23:19:04.993 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-11T23:19:04.993 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-11T23:19:04.993 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.arena_block_size: 1048576 2024-09-11T23:19:04.993 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-11T23:19:04.993 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-11T23:19:04.993 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.disable_auto_compactions: 0 2024-09-11T23:19:04.993 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-11T23:19:04.993 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-11T23:19:04.993 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-11T23:19:04.993 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-11T23:19:04.994 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-11T23:19:04.994 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-11T23:19:04.994 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-11T23:19:04.994 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-11T23:19:04.994 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-11T23:19:04.994 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-11T23:19:04.994 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-11T23:19:04.994 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.inplace_update_support: 0 2024-09-11T23:19:04.994 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-11T23:19:04.994 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-11T23:19:04.994 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-11T23:19:04.994 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-11T23:19:04.994 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.bloom_locality: 0 2024-09-11T23:19:04.995 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.max_successive_merges: 0 2024-09-11T23:19:04.995 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-11T23:19:04.995 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.paranoid_file_checks: 0 2024-09-11T23:19:04.995 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.force_consistency_checks: 1 2024-09-11T23:19:04.995 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.report_bg_io_stats: 0 2024-09-11T23:19:04.995 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.ttl: 2592000 2024-09-11T23:19:04.995 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-11T23:19:04.995 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-11T23:19:04.995 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-11T23:19:04.995 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.enable_blob_files: false 2024-09-11T23:19:04.995 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.min_blob_size: 0 2024-09-11T23:19:04.995 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.blob_file_size: 268435456 2024-09-11T23:19:04.996 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-11T23:19:04.996 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-11T23:19:04.996 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-11T23:19:04.996 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-11T23:19:04.996 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-11T23:19:04.996 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.blob_file_starting_level: 0 2024-09-11T23:19:04.996 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-11T23:19:04.996 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-11T23:19:04.996 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-11T23:19:04.996 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: cd898a64-2b90-4098-ae0c-f8a0faf7ed8f 2024-09-11T23:19:04.996 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726096744918158, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-11T23:19:04.996 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-11T23:19:04.996 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726096744919252, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 99462, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 324, "table_properties": {"data_size": 97356, "index_size": 298, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14044, "raw_average_key_size": 49, "raw_value_size": 89677, "raw_average_value_size": 316, "num_data_blocks": 12, "num_entries": 283, "num_filter_entries": 283, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726096744, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "cd898a64-2b90-4098-ae0c-f8a0faf7ed8f", "db_session_id": "EUB9FTVKCZUMK4SR32O8", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-11T23:19:04.997 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726096744919352, "job": 1, "event": "recovery_finished"} 2024-09-11T23:19:04.997 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-11T23:19:04.997 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-11T23:19:04.997 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5590d2baae00 2024-09-11T23:19:04.997 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: DB pointer 0x5590d2ca6000 2024-09-11T23:19:04.997 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-11T23:19:04.997 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-11T23:19:04.997 INFO:journalctl@ceph.mon.a.smithi005.stdout: ** DB Stats ** 2024-09-11T23:19:04.997 INFO:journalctl@ceph.mon.a.smithi005.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-11T23:19:04.997 INFO:journalctl@ceph.mon.a.smithi005.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-11T23:19:04.997 INFO:journalctl@ceph.mon.a.smithi005.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-11T23:19:04.998 INFO:journalctl@ceph.mon.a.smithi005.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-11T23:19:04.998 INFO:journalctl@ceph.mon.a.smithi005.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-11T23:19:04.998 INFO:journalctl@ceph.mon.a.smithi005.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-11T23:19:04.998 INFO:journalctl@ceph.mon.a.smithi005.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-11T23:19:04.998 INFO:journalctl@ceph.mon.a.smithi005.stdout: 2024-09-11T23:19:04.998 INFO:journalctl@ceph.mon.a.smithi005.stdout: ** Compaction Stats [default] ** 2024-09-11T23:19:04.998 INFO:journalctl@ceph.mon.a.smithi005.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-11T23:19:04.998 INFO:journalctl@ceph.mon.a.smithi005.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-11T23:19:04.998 INFO:journalctl@ceph.mon.a.smithi005.stdout: L0 2/0 98.99 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 137.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-11T23:19:04.998 INFO:journalctl@ceph.mon.a.smithi005.stdout: Sum 2/0 98.99 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 137.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-11T23:19:04.998 INFO:journalctl@ceph.mon.a.smithi005.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 137.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-11T23:19:04.999 INFO:journalctl@ceph.mon.a.smithi005.stdout: 2024-09-11T23:19:04.999 INFO:journalctl@ceph.mon.a.smithi005.stdout: ** Compaction Stats [default] ** 2024-09-11T23:19:04.999 INFO:journalctl@ceph.mon.a.smithi005.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-11T23:19:04.999 INFO:journalctl@ceph.mon.a.smithi005.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-11T23:19:04.999 INFO:journalctl@ceph.mon.a.smithi005.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 137.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-11T23:19:04.999 INFO:journalctl@ceph.mon.a.smithi005.stdout: 2024-09-11T23:19:04.999 INFO:journalctl@ceph.mon.a.smithi005.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-11T23:19:04.999 INFO:journalctl@ceph.mon.a.smithi005.stdout: 2024-09-11T23:19:04.999 INFO:journalctl@ceph.mon.a.smithi005.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-11T23:19:04.999 INFO:journalctl@ceph.mon.a.smithi005.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-11T23:19:04.999 INFO:journalctl@ceph.mon.a.smithi005.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-11T23:19:04.999 INFO:journalctl@ceph.mon.a.smithi005.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-11T23:19:05.000 INFO:journalctl@ceph.mon.a.smithi005.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-11T23:19:05.000 INFO:journalctl@ceph.mon.a.smithi005.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-11T23:19:05.000 INFO:journalctl@ceph.mon.a.smithi005.stdout: Cumulative compaction: 0.00 GB write, 27.12 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-11T23:19:05.000 INFO:journalctl@ceph.mon.a.smithi005.stdout: Interval compaction: 0.00 GB write, 27.12 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-11T23:19:05.000 INFO:journalctl@ceph.mon.a.smithi005.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-11T23:19:05.000 INFO:journalctl@ceph.mon.a.smithi005.stdout: Block cache BinnedLRUCache@0x5590d2b7d1f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-11T23:19:05.000 INFO:journalctl@ceph.mon.a.smithi005.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-11T23:19:05.000 INFO:journalctl@ceph.mon.a.smithi005.stdout: 2024-09-11T23:19:05.000 INFO:journalctl@ceph.mon.a.smithi005.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-11T23:19:05.001 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: starting mon.a rank 0 at public addrs [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] at bind addrs [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 1f5284d2-7094-11ef-bcea-c7b262605968 2024-09-11T23:19:05.001 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: mon.a@-1(???) e1 preinit fsid 1f5284d2-7094-11ef-bcea-c7b262605968 2024-09-11T23:19:05.001 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: mon.a@-1(???).mds e1 new map 2024-09-11T23:19:05.001 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: mon.a@-1(???).mds e1 print_map 2024-09-11T23:19:05.001 INFO:journalctl@ceph.mon.a.smithi005.stdout: e1 2024-09-11T23:19:05.001 INFO:journalctl@ceph.mon.a.smithi005.stdout: btime 2024-09-11T23:19:00:051658+0000 2024-09-11T23:19:05.001 INFO:journalctl@ceph.mon.a.smithi005.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-11T23:19:05.001 INFO:journalctl@ceph.mon.a.smithi005.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-11T23:19:05.001 INFO:journalctl@ceph.mon.a.smithi005.stdout: legacy client fscid: -1 2024-09-11T23:19:05.001 INFO:journalctl@ceph.mon.a.smithi005.stdout: 2024-09-11T23:19:05.001 INFO:journalctl@ceph.mon.a.smithi005.stdout: No filesystems configured 2024-09-11T23:19:05.001 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-11T23:19:05.001 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T23:19:05.002 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T23:19:05.002 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T23:19:05.002 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-11T23:19:05.002 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-11T23:19:05.002 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: monmap epoch 1 2024-09-11T23:19:05.002 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: fsid 1f5284d2-7094-11ef-bcea-c7b262605968 2024-09-11T23:19:05.002 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: last_changed 2024-09-11T23:18:57.103876+0000 2024-09-11T23:19:05.002 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: created 2024-09-11T23:18:57.103876+0000 2024-09-11T23:19:05.002 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: min_mon_release 19 (squid) 2024-09-11T23:19:05.003 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: election_strategy: 1 2024-09-11T23:19:05.003 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: 0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-09-11T23:19:05.003 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: fsmap 2024-09-11T23:19:05.003 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: osdmap e1: 0 total, 0 up, 0 in 2024-09-11T23:19:05.003 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 ceph-mon[31201]: mgrmap e1: no daemons active 2024-09-11T23:19:05.003 INFO:teuthology.orchestra.run.smithi005.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-11T23:19:05.257 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 bash[31182]: f8f83307d57dcb8f61652927b80317f09ac50c2f2331f53e220e6a2d4b5248ca 2024-09-11T23:19:05.257 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:04 smithi005 systemd[1]: Started Ceph mon.a for 1f5284d2-7094-11ef-bcea-c7b262605968. 2024-09-11T23:19:06.001 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:05.341+0000 7fa879ded640 1 Processor -- start 2024-09-11T23:19:06.001 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:05.341+0000 7fa879ded640 1 -- start start 2024-09-11T23:19:06.001 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:05.341+0000 7fa879ded640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa874107e90 0x7fa87410a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:06.001 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:05.342+0000 7fa879ded640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa874075880 con 0x7fa874107e90 2024-09-11T23:19:06.002 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:05.342+0000 7fa8737fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa874107e90 0x7fa87410a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:06.002 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:05.342+0000 7fa8737fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa874107e90 0x7fa87410a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47480/0 (socket says 172.21.15.5:47480) 2024-09-11T23:19:06.002 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:05.342+0000 7fa8737fe640 1 -- 172.21.15.5:0/2506307336 learned_addr learned my addr 172.21.15.5:0/2506307336 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:06.002 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:05.342+0000 7fa8737fe640 1 -- 172.21.15.5:0/2506307336 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa87410a7c0 con 0x7fa874107e90 2024-09-11T23:19:06.002 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:05.344+0000 7fa8737fe640 1 --2- 172.21.15.5:0/2506307336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa874107e90 0x7fa87410a280 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa864009e80 tx=0x7fa86402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79b72f9cec52df7a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:06.002 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:05.344+0000 7fa8727fc640 1 -- 172.21.15.5:0/2506307336 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa864036070 con 0x7fa874107e90 2024-09-11T23:19:06.002 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:05.344+0000 7fa8727fc640 1 -- 172.21.15.5:0/2506307336 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fa864031890 con 0x7fa874107e90 2024-09-11T23:19:06.002 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:05.344+0000 7fa8727fc640 1 -- 172.21.15.5:0/2506307336 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa864007980 con 0x7fa874107e90 2024-09-11T23:19:06.002 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:05.345+0000 7fa879ded640 1 -- 172.21.15.5:0/2506307336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa874107e90 msgr2=0x7fa87410a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:06.002 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:05.345+0000 7fa879ded640 1 --2- 172.21.15.5:0/2506307336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa874107e90 0x7fa87410a280 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa864009e80 tx=0x7fa86402a7a0 comp rx=0 tx=0).stop 2024-09-11T23:19:06.002 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:05.345+0000 7fa879ded640 1 -- 172.21.15.5:0/2506307336 shutdown_connections 2024-09-11T23:19:06.002 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:05.345+0000 7fa879ded640 1 --2- 172.21.15.5:0/2506307336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa874107e90 0x7fa87410a280 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:06.003 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:05.345+0000 7fa879ded640 1 -- 172.21.15.5:0/2506307336 >> 172.21.15.5:0/2506307336 conn(0x7fa874101a90 msgr2=0x7fa874103ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:06.003 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:05.345+0000 7fa879ded640 1 -- 172.21.15.5:0/2506307336 shutdown_connections 2024-09-11T23:19:06.003 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:05.345+0000 7fa879ded640 1 -- 172.21.15.5:0/2506307336 wait complete. 2024-09-11T23:19:06.003 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:05.346+0000 7fa879ded640 1 Processor -- start 2024-09-11T23:19:06.003 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:05.346+0000 7fa879ded640 1 -- start start 2024-09-11T23:19:06.003 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:05.346+0000 7fa879ded640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa874107e90 0x7fa87419b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:06.003 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:05.346+0000 7fa879ded640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa87410b800 con 0x7fa874107e90 2024-09-11T23:19:06.003 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:05.346+0000 7fa8737fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa874107e90 0x7fa87419b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:06.003 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:05.346+0000 7fa8737fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa874107e90 0x7fa87419b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47494/0 (socket says 172.21.15.5:47494) 2024-09-11T23:19:06.003 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:05.346+0000 7fa8737fe640 1 -- 172.21.15.5:0/4018456098 learned_addr learned my addr 172.21.15.5:0/4018456098 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:06.003 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:05.346+0000 7fa8737fe640 1 -- 172.21.15.5:0/4018456098 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa87419b8a0 con 0x7fa874107e90 2024-09-11T23:19:06.003 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:05.347+0000 7fa8737fe640 1 --2- 172.21.15.5:0/4018456098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa874107e90 0x7fa87419b360 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fa864009680 tx=0x7fa864031c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:06.003 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:05.347+0000 7fa870ff9640 1 -- 172.21.15.5:0/4018456098 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa864041020 con 0x7fa874107e90 2024-09-11T23:19:06.003 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:05.347+0000 7fa870ff9640 1 -- 172.21.15.5:0/4018456098 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fa86403c900 con 0x7fa874107e90 2024-09-11T23:19:06.004 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:05.347+0000 7fa879ded640 1 -- 172.21.15.5:0/4018456098 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa87419bb30 con 0x7fa874107e90 2024-09-11T23:19:06.004 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:05.347+0000 7fa870ff9640 1 -- 172.21.15.5:0/4018456098 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa864036040 con 0x7fa874107e90 2024-09-11T23:19:06.004 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:05.347+0000 7fa879ded640 1 -- 172.21.15.5:0/4018456098 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa87419e820 con 0x7fa874107e90 2024-09-11T23:19:06.004 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:05.347+0000 7fa870ff9640 1 -- 172.21.15.5:0/4018456098 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa864044020 con 0x7fa874107e90 2024-09-11T23:19:06.004 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:05.347+0000 7fa870ff9640 1 -- 172.21.15.5:0/4018456098 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa864046930 con 0x7fa874107e90 2024-09-11T23:19:06.004 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:05.348+0000 7fa879ded640 1 -- 172.21.15.5:0/4018456098 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8741082f0 con 0x7fa874107e90 2024-09-11T23:19:06.004 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:05.350+0000 7fa870ff9640 1 -- 172.21.15.5:0/4018456098 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fa86404b020 con 0x7fa874107e90 2024-09-11T23:19:06.004 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:05.410+0000 7fa879ded640 1 -- 172.21.15.5:0/4018456098 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7fa87419ee30 con 0x7fa874107e90 2024-09-11T23:19:06.004 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:05.411+0000 7fa870ff9640 1 -- 172.21.15.5:0/4018456098 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7fa864046400 con 0x7fa874107e90 2024-09-11T23:19:06.004 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:05.412+0000 7fa879ded640 1 -- 172.21.15.5:0/4018456098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa874107e90 msgr2=0x7fa87419b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:06.004 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:05.412+0000 7fa879ded640 1 --2- 172.21.15.5:0/4018456098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa874107e90 0x7fa87419b360 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fa864009680 tx=0x7fa864031c70 comp rx=0 tx=0).stop 2024-09-11T23:19:06.004 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:05.412+0000 7fa879ded640 1 -- 172.21.15.5:0/4018456098 shutdown_connections 2024-09-11T23:19:06.005 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:05.412+0000 7fa879ded640 1 --2- 172.21.15.5:0/4018456098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa874107e90 0x7fa87419b360 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:06.005 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:05.412+0000 7fa879ded640 1 -- 172.21.15.5:0/4018456098 >> 172.21.15.5:0/4018456098 conn(0x7fa874101a90 msgr2=0x7fa8741025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:06.005 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:05.412+0000 7fa879ded640 1 -- 172.21.15.5:0/4018456098 shutdown_connections 2024-09-11T23:19:06.005 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:05.412+0000 7fa879ded640 1 -- 172.21.15.5:0/4018456098 wait complete. 2024-09-11T23:19:06.005 INFO:teuthology.orchestra.run.smithi005.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-11T23:19:06.027 INFO:teuthology.orchestra.run.smithi005.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-11T23:19:06.027 INFO:teuthology.orchestra.run.smithi005.stdout:Creating mgr... 2024-09-11T23:19:06.028 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-11T23:19:06.028 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-11T23:19:06.288 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mgr.x 2024-09-11T23:19:06.288 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Failed to reset failed state of unit ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mgr.x.service: Unit ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mgr.x.service not loaded. 2024-09-11T23:19:06.454 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-1f5284d2-7094-11ef-bcea-c7b262605968.target.wants/ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-1f5284d2-7094-11ef-bcea-c7b262605968@.service. 2024-09-11T23:19:06.680 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:06 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/4018456098' entity='client.admin' 2024-09-11T23:19:06.680 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:06 smithi005 systemd[1]: Starting Ceph mgr.x for 1f5284d2-7094-11ef-bcea-c7b262605968... 2024-09-11T23:19:06.929 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-11T23:19:06.930 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout disabled 2024-09-11T23:19:06.937 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-11T23:19:06.937 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2024-09-11T23:19:06.938 INFO:teuthology.orchestra.run.smithi005.stdout:firewalld.service is not enabled 2024-09-11T23:19:06.938 INFO:teuthology.orchestra.run.smithi005.stdout:Not possible to enable service . firewalld.service is not available 2024-09-11T23:19:06.946 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-11T23:19:06.947 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout disabled 2024-09-11T23:19:06.954 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-11T23:19:06.954 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2024-09-11T23:19:06.954 INFO:teuthology.orchestra.run.smithi005.stdout:firewalld.service is not enabled 2024-09-11T23:19:06.955 INFO:teuthology.orchestra.run.smithi005.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-11T23:19:06.955 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for mgr to start... 2024-09-11T23:19:06.955 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for mgr... 2024-09-11T23:19:06.974 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:06 smithi005 podman[31413]: 2024-09-11 23:19:06.680287111 +0000 UTC m=+0.100480457 container create f1f3982d8ecf61e3b84562188cee6073757ba396815981e6b339a6957f9b19c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T23:19:06.975 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:06 smithi005 podman[31413]: 2024-09-11 23:19:06.59607291 +0000 UTC m=+0.016266271 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:19:06.975 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:06 smithi005 podman[31413]: 2024-09-11 23:19:06.849277879 +0000 UTC m=+0.269471226 container init f1f3982d8ecf61e3b84562188cee6073757ba396815981e6b339a6957f9b19c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-11T23:19:06.975 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:06 smithi005 podman[31413]: 2024-09-11 23:19:06.852115912 +0000 UTC m=+0.272309261 container start f1f3982d8ecf61e3b84562188cee6073757ba396815981e6b339a6957f9b19c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-11T23:19:06.975 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:06 smithi005 bash[31413]: f1f3982d8ecf61e3b84562188cee6073757ba396815981e6b339a6957f9b19c0 2024-09-11T23:19:06.975 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:06 smithi005 systemd[1]: Started Ceph mgr.x for 1f5284d2-7094-11ef-bcea-c7b262605968. 2024-09-11T23:19:07.273 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:06 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:06.980+0000 7f29314ef040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T23:19:07.273 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:07 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:07.044+0000 7f29314ef040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T23:19:07.273 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:07 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:07.203+0000 7f29314ef040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T23:19:07.273 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:07 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:07.273+0000 7f29314ef040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T23:19:07.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:07 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/599804149' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-11T23:19:07.583 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:07 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:07.432+0000 7f29314ef040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:19:07.583 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:07 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:07.583+0000 7f29314ef040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T23:19:08.078 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-09-11T23:19:08.078 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2024-09-11T23:19:08.078 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "fsid": "1f5284d2-7094-11ef-bcea-c7b262605968", 2024-09-11T23:19:08.078 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "health": { 2024-09-11T23:19:08.078 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-11T23:19:08.078 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-11T23:19:08.078 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-11T23:19:08.079 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:19:08.079 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-11T23:19:08.079 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-11T23:19:08.079 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 0 2024-09-11T23:19:08.079 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-09-11T23:19:08.079 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-11T23:19:08.079 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "a" 2024-09-11T23:19:08.079 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-09-11T23:19:08.079 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-11T23:19:08.079 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-11T23:19:08.079 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T23:19:08.079 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-11T23:19:08.079 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-11T23:19:08.079 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:19:08.080 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-11T23:19:08.080 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T23:19:08.080 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-11T23:19:08.080 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-11T23:19:08.080 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-11T23:19:08.080 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-11T23:19:08.080 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-11T23:19:08.080 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-11T23:19:08.080 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:19:08.087 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-11T23:19:08.087 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-11T23:19:08.088 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-11T23:19:08.088 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-11T23:19:08.088 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-11T23:19:08.088 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-11T23:19:08.088 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-11T23:19:08.088 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-11T23:19:08.088 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-11T23:19:08.088 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:19:08.089 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-11T23:19:08.089 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T23:19:08.089 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "btime": "2024-09-11T23:19:00:051658+0000", 2024-09-11T23:19:08.089 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-11T23:19:08.089 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-11T23:19:08.089 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:19:08.089 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-11T23:19:08.089 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-11T23:19:08.089 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-11T23:19:08.089 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-11T23:19:08.089 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-11T23:19:08.089 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-11T23:19:08.089 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "restful" 2024-09-11T23:19:08.090 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-09-11T23:19:08.090 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T23:19:08.090 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:19:08.090 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-11T23:19:08.090 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T23:19:08.090 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "modified": "2024-09-11T23:19:00.052277+0000", 2024-09-11T23:19:08.090 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T23:19:08.090 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:19:08.090 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-11T23:19:08.090 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2024-09-11T23:19:08.090 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:07.378+0000 7fcb0803c640 1 Processor -- start 2024-09-11T23:19:08.090 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:07.378+0000 7fcb0803c640 1 -- start start 2024-09-11T23:19:08.091 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:07.378+0000 7fcb0803c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb00107e90 0x7fcb0010a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:08.091 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:07.378+0000 7fcb0803c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcb00075880 con 0x7fcb00107e90 2024-09-11T23:19:08.091 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:07.379+0000 7fcb05dd8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb00107e90 0x7fcb0010a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:08.091 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:07.379+0000 7fcb05dd8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb00107e90 0x7fcb0010a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47520/0 (socket says 172.21.15.5:47520) 2024-09-11T23:19:08.091 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:07.379+0000 7fcb05dd8640 1 -- 172.21.15.5:0/744550347 learned_addr learned my addr 172.21.15.5:0/744550347 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:08.091 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:07.379+0000 7fcb05dd8640 1 -- 172.21.15.5:0/744550347 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb0010a7c0 con 0x7fcb00107e90 2024-09-11T23:19:08.091 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:07.380+0000 7fcb05dd8640 1 --2- 172.21.15.5:0/744550347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb00107e90 0x7fcb0010a280 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fcafc009820 tx=0x7fcafc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab34d2f28539ce67 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:08.091 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:07.380+0000 7fcb04dd6640 1 -- 172.21.15.5:0/744550347 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcafc037070 con 0x7fcb00107e90 2024-09-11T23:19:08.091 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:07.380+0000 7fcb04dd6640 1 -- 172.21.15.5:0/744550347 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fcafc0328d0 con 0x7fcb00107e90 2024-09-11T23:19:08.091 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:07.380+0000 7fcb04dd6640 1 -- 172.21.15.5:0/744550347 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcafc0307d0 con 0x7fcb00107e90 2024-09-11T23:19:08.091 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:07.381+0000 7fcb0803c640 1 -- 172.21.15.5:0/744550347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb00107e90 msgr2=0x7fcb0010a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:08.091 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:07.381+0000 7fcb0803c640 1 --2- 172.21.15.5:0/744550347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb00107e90 0x7fcb0010a280 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fcafc009820 tx=0x7fcafc02a270 comp rx=0 tx=0).stop 2024-09-11T23:19:08.091 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:07.381+0000 7fcb0803c640 1 -- 172.21.15.5:0/744550347 shutdown_connections 2024-09-11T23:19:08.092 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:07.381+0000 7fcb0803c640 1 --2- 172.21.15.5:0/744550347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb00107e90 0x7fcb0010a280 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:08.092 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:07.381+0000 7fcb0803c640 1 -- 172.21.15.5:0/744550347 >> 172.21.15.5:0/744550347 conn(0x7fcb00101a90 msgr2=0x7fcb00103ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:08.092 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:07.381+0000 7fcb0803c640 1 -- 172.21.15.5:0/744550347 shutdown_connections 2024-09-11T23:19:08.092 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:07.381+0000 7fcb0803c640 1 -- 172.21.15.5:0/744550347 wait complete. 2024-09-11T23:19:08.092 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:07.381+0000 7fcb0803c640 1 Processor -- start 2024-09-11T23:19:08.092 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:07.382+0000 7fcb0803c640 1 -- start start 2024-09-11T23:19:08.092 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:07.382+0000 7fcb0803c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb00107e90 0x7fcb0019b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:08.092 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:07.382+0000 7fcb0803c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcb0010b800 con 0x7fcb00107e90 2024-09-11T23:19:08.092 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:07.382+0000 7fcb05dd8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb00107e90 0x7fcb0019b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:08.092 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:07.382+0000 7fcb05dd8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb00107e90 0x7fcb0019b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47524/0 (socket says 172.21.15.5:47524) 2024-09-11T23:19:08.092 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:07.382+0000 7fcb05dd8640 1 -- 172.21.15.5:0/599804149 learned_addr learned my addr 172.21.15.5:0/599804149 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:08.092 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:07.382+0000 7fcb05dd8640 1 -- 172.21.15.5:0/599804149 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb0019b8a0 con 0x7fcb00107e90 2024-09-11T23:19:08.093 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:07.382+0000 7fcb05dd8640 1 --2- 172.21.15.5:0/599804149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb00107e90 0x7fcb0019b360 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fcafc0097f0 tx=0x7fcafc030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:08.093 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:07.382+0000 7fcaf6ffd640 1 -- 172.21.15.5:0/599804149 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcafc037040 con 0x7fcb00107e90 2024-09-11T23:19:08.093 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:07.383+0000 7fcaf6ffd640 1 -- 172.21.15.5:0/599804149 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fcafc032bb0 con 0x7fcb00107e90 2024-09-11T23:19:08.093 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:07.383+0000 7fcb0803c640 1 -- 172.21.15.5:0/599804149 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb0019bb30 con 0x7fcb00107e90 2024-09-11T23:19:08.093 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:07.383+0000 7fcaf6ffd640 1 -- 172.21.15.5:0/599804149 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcafc03a390 con 0x7fcb00107e90 2024-09-11T23:19:08.093 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:07.383+0000 7fcb0803c640 1 -- 172.21.15.5:0/599804149 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb0019e820 con 0x7fcb00107e90 2024-09-11T23:19:08.093 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:07.383+0000 7fcaf6ffd640 1 -- 172.21.15.5:0/599804149 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcafc03a630 con 0x7fcb00107e90 2024-09-11T23:19:08.093 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:07.383+0000 7fcaf6ffd640 1 -- 172.21.15.5:0/599804149 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fcafc044c40 con 0x7fcb00107e90 2024-09-11T23:19:08.093 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:07.384+0000 7fcb0803c640 1 -- 172.21.15.5:0/599804149 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb001082f0 con 0x7fcb00107e90 2024-09-11T23:19:08.093 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:07.386+0000 7fcaf6ffd640 1 -- 172.21.15.5:0/599804149 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fcafc032d60 con 0x7fcb00107e90 2024-09-11T23:19:08.093 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:07.448+0000 7fcb0803c640 1 -- 172.21.15.5:0/599804149 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fcb0019e9f0 con 0x7fcb00107e90 2024-09-11T23:19:08.093 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:07.449+0000 7fcaf6ffd640 1 -- 172.21.15.5:0/599804149 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fcafc044400 con 0x7fcb00107e90 2024-09-11T23:19:08.093 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:07.450+0000 7fcb0803c640 1 -- 172.21.15.5:0/599804149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb00107e90 msgr2=0x7fcb0019b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:08.094 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:07.450+0000 7fcb0803c640 1 --2- 172.21.15.5:0/599804149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb00107e90 0x7fcb0019b360 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fcafc0097f0 tx=0x7fcafc030d00 comp rx=0 tx=0).stop 2024-09-11T23:19:08.094 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:07.450+0000 7fcb0803c640 1 -- 172.21.15.5:0/599804149 shutdown_connections 2024-09-11T23:19:08.094 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:07.450+0000 7fcb0803c640 1 --2- 172.21.15.5:0/599804149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb00107e90 0x7fcb0019b360 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:08.094 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:07.450+0000 7fcb0803c640 1 -- 172.21.15.5:0/599804149 >> 172.21.15.5:0/599804149 conn(0x7fcb00101a90 msgr2=0x7fcb001025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:08.094 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:07.450+0000 7fcb0803c640 1 -- 172.21.15.5:0/599804149 shutdown_connections 2024-09-11T23:19:08.094 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:07.450+0000 7fcb0803c640 1 -- 172.21.15.5:0/599804149 wait complete. 2024-09-11T23:19:08.094 INFO:teuthology.orchestra.run.smithi005.stdout:mgr not available, waiting (1/15)... 2024-09-11T23:19:08.175 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:07 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:07.917+0000 7f29314ef040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T23:19:08.176 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:07 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:07.981+0000 7f29314ef040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T23:19:08.176 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:08 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:08.175+0000 7f29314ef040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T23:19:09.474 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:09 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:09.099+0000 7f29314ef040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T23:19:09.474 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:09 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:09.169+0000 7f29314ef040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T23:19:10.204 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:09 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:09.928+0000 7f29314ef040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T23:19:10.204 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:10 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:10.050+0000 7f29314ef040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T23:19:10.474 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:10 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:10.203+0000 7f29314ef040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:19:10.474 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:10 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:10.269+0000 7f29314ef040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T23:19:10.474 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:10 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:10.427+0000 7f29314ef040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T23:19:10.813 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:10 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:10.499+0000 7f29314ef040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T23:19:10.813 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:10 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:10.569+0000 7f29314ef040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T23:19:10.813 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:10 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:10.744+0000 7f29314ef040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T23:19:10.813 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:10 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:10.812+0000 7f29314ef040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T23:19:11.097 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:10 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:10.883+0000 7f29314ef040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T23:19:11.097 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:10 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:10.970+0000 7f29314ef040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T23:19:11.097 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:11 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:11.034+0000 7f29314ef040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T23:19:11.097 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:11 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:11.096+0000 7f29314ef040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T23:19:12.224 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:11 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:11.937+0000 7f29314ef040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T23:19:12.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:11 smithi005 ceph-mon[31201]: Activating manager daemon x 2024-09-11T23:19:12.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:11 smithi005 ceph-mon[31201]: mgrmap e2: x(active, starting, since 0.00299057s) 2024-09-11T23:19:12.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:11 smithi005 ceph-mon[31201]: from='mgr.14100 172.21.15.5:0/3416242367' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-11T23:19:12.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:11 smithi005 ceph-mon[31201]: from='mgr.14100 172.21.15.5:0/3416242367' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-11T23:19:12.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:11 smithi005 ceph-mon[31201]: from='mgr.14100 172.21.15.5:0/3416242367' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-11T23:19:12.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:11 smithi005 ceph-mon[31201]: from='mgr.14100 172.21.15.5:0/3416242367' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:19:12.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:11 smithi005 ceph-mon[31201]: from='mgr.14100 172.21.15.5:0/3416242367' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-11T23:19:12.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:11 smithi005 ceph-mon[31201]: Manager daemon x is now available 2024-09-11T23:19:12.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:11 smithi005 ceph-mon[31201]: from='mgr.14100 172.21.15.5:0/3416242367' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-11T23:19:12.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:11 smithi005 ceph-mon[31201]: from='mgr.14100 172.21.15.5:0/3416242367' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-11T23:19:12.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:11 smithi005 ceph-mon[31201]: from='mgr.14100 172.21.15.5:0/3416242367' entity='mgr.x' 2024-09-11T23:19:12.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:11 smithi005 ceph-mon[31201]: from='mgr.14100 172.21.15.5:0/3416242367' entity='mgr.x' 2024-09-11T23:19:12.226 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:11 smithi005 ceph-mon[31201]: from='mgr.14100 172.21.15.5:0/3416242367' entity='mgr.x' 2024-09-11T23:19:14.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:13 smithi005 ceph-mon[31201]: mgrmap e3: x(active, since 1.00736s) 2024-09-11T23:19:14.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:13 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/3880665184' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-11T23:19:15.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:14 smithi005 ceph-mon[31201]: mgrmap e4: x(active, since 2s) 2024-09-11T23:19:19.296 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-09-11T23:19:19.296 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2024-09-11T23:19:19.296 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "fsid": "1f5284d2-7094-11ef-bcea-c7b262605968", 2024-09-11T23:19:19.296 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "health": { 2024-09-11T23:19:19.296 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-11T23:19:19.296 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-11T23:19:19.296 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-11T23:19:19.296 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:19:19.297 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-11T23:19:19.297 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-11T23:19:19.297 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 0 2024-09-11T23:19:19.297 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-09-11T23:19:19.297 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-11T23:19:19.297 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "a" 2024-09-11T23:19:19.297 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-09-11T23:19:19.297 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-09-11T23:19:19.297 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-11T23:19:19.297 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T23:19:19.297 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-11T23:19:19.297 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-11T23:19:19.298 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:19:19.298 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-11T23:19:19.298 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T23:19:19.298 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-11T23:19:19.298 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-11T23:19:19.298 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-11T23:19:19.298 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-11T23:19:19.298 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-11T23:19:19.298 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-11T23:19:19.298 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:19:19.298 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-11T23:19:19.298 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-11T23:19:19.298 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-11T23:19:19.298 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-11T23:19:19.299 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-11T23:19:19.299 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-11T23:19:19.299 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-11T23:19:19.299 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-11T23:19:19.299 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-11T23:19:19.299 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:19:19.299 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-11T23:19:19.299 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T23:19:19.299 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "btime": "2024-09-11T23:19:00:051658+0000", 2024-09-11T23:19:19.299 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-11T23:19:19.299 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-11T23:19:19.299 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:19:19.300 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-11T23:19:19.300 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-11T23:19:19.300 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-11T23:19:19.300 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-11T23:19:19.300 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-11T23:19:19.300 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-11T23:19:19.300 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "restful" 2024-09-11T23:19:19.300 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-09-11T23:19:19.300 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T23:19:19.300 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:19:19.300 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-11T23:19:19.300 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T23:19:19.301 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "modified": "2024-09-11T23:19:00.052277+0000", 2024-09-11T23:19:19.301 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T23:19:19.301 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:19:19.301 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-11T23:19:19.301 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2024-09-11T23:19:19.301 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.016+0000 7efd767cc640 1 Processor -- start 2024-09-11T23:19:19.301 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.016+0000 7efd767cc640 1 -- start start 2024-09-11T23:19:19.301 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.016+0000 7efd767cc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd70107ee0 0x7efd7010a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:19.301 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.016+0000 7efd767cc640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7efd7007bdf0 con 0x7efd70107ee0 2024-09-11T23:19:19.301 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.016+0000 7efd6ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd70107ee0 0x7efd7010a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:19.301 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.016+0000 7efd6ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd70107ee0 0x7efd7010a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47616/0 (socket says 172.21.15.5:47616) 2024-09-11T23:19:19.301 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.017+0000 7efd6ffff640 1 -- 172.21.15.5:0/467952368 learned_addr learned my addr 172.21.15.5:0/467952368 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:19.301 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.017+0000 7efd6ffff640 1 -- 172.21.15.5:0/467952368 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd7010a810 con 0x7efd70107ee0 2024-09-11T23:19:19.302 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.017+0000 7efd6ffff640 1 --2- 172.21.15.5:0/467952368 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd70107ee0 0x7efd7010a2d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7efd60009820 tx=0x7efd6002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13c28740c171b1b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:19.302 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.018+0000 7efd6effd640 1 -- 172.21.15.5:0/467952368 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd60037070 con 0x7efd70107ee0 2024-09-11T23:19:19.302 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.018+0000 7efd6effd640 1 -- 172.21.15.5:0/467952368 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7efd600328d0 con 0x7efd70107ee0 2024-09-11T23:19:19.302 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.018+0000 7efd6effd640 1 -- 172.21.15.5:0/467952368 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd600307d0 con 0x7efd70107ee0 2024-09-11T23:19:19.302 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.018+0000 7efd767cc640 1 -- 172.21.15.5:0/467952368 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd70107ee0 msgr2=0x7efd7010a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:19.302 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.018+0000 7efd767cc640 1 --2- 172.21.15.5:0/467952368 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd70107ee0 0x7efd7010a2d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7efd60009820 tx=0x7efd6002a270 comp rx=0 tx=0).stop 2024-09-11T23:19:19.302 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.018+0000 7efd767cc640 1 -- 172.21.15.5:0/467952368 shutdown_connections 2024-09-11T23:19:19.302 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.018+0000 7efd767cc640 1 --2- 172.21.15.5:0/467952368 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd70107ee0 0x7efd7010a2d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:19.302 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.018+0000 7efd767cc640 1 -- 172.21.15.5:0/467952368 >> 172.21.15.5:0/467952368 conn(0x7efd70101ae0 msgr2=0x7efd70103f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:19.302 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.018+0000 7efd767cc640 1 -- 172.21.15.5:0/467952368 shutdown_connections 2024-09-11T23:19:19.302 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.018+0000 7efd767cc640 1 -- 172.21.15.5:0/467952368 wait complete. 2024-09-11T23:19:19.302 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.019+0000 7efd767cc640 1 Processor -- start 2024-09-11T23:19:19.302 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.019+0000 7efd767cc640 1 -- start start 2024-09-11T23:19:19.303 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.019+0000 7efd767cc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd70107ee0 0x7efd7019b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:19.303 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.019+0000 7efd767cc640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7efd7010b7f0 con 0x7efd70107ee0 2024-09-11T23:19:19.303 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.020+0000 7efd6ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd70107ee0 0x7efd7019b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:19.303 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.020+0000 7efd6ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd70107ee0 0x7efd7019b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47618/0 (socket says 172.21.15.5:47618) 2024-09-11T23:19:19.303 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.020+0000 7efd6ffff640 1 -- 172.21.15.5:0/3880665184 learned_addr learned my addr 172.21.15.5:0/3880665184 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:19.303 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.020+0000 7efd6ffff640 1 -- 172.21.15.5:0/3880665184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd7019b890 con 0x7efd70107ee0 2024-09-11T23:19:19.303 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.020+0000 7efd6ffff640 1 --2- 172.21.15.5:0/3880665184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd70107ee0 0x7efd7019b350 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7efd600097f0 tx=0x7efd60030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:19.303 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.020+0000 7efd6d7fa640 1 -- 172.21.15.5:0/3880665184 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd60037040 con 0x7efd70107ee0 2024-09-11T23:19:19.303 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.020+0000 7efd6d7fa640 1 -- 172.21.15.5:0/3880665184 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7efd60032bb0 con 0x7efd70107ee0 2024-09-11T23:19:19.303 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.020+0000 7efd767cc640 1 -- 172.21.15.5:0/3880665184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd7019bb20 con 0x7efd70107ee0 2024-09-11T23:19:19.303 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.020+0000 7efd6d7fa640 1 -- 172.21.15.5:0/3880665184 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd6003a390 con 0x7efd70107ee0 2024-09-11T23:19:19.303 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.020+0000 7efd767cc640 1 -- 172.21.15.5:0/3880665184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd7019e810 con 0x7efd70107ee0 2024-09-11T23:19:19.303 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.021+0000 7efd6d7fa640 1 -- 172.21.15.5:0/3880665184 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 3) ==== 46170+0+0 (secure 0 0 0) 0x7efd6003a580 con 0x7efd70107ee0 2024-09-11T23:19:19.304 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.021+0000 7efd6d7fa640 1 --2- 172.21.15.5:0/3880665184 >> [v2:172.21.15.5:6800/1358356358,v1:172.21.15.5:6801/1358356358] conn(0x7efd58038e60 0x7efd5803b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:19.304 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.021+0000 7efd6d7fa640 1 -- 172.21.15.5:0/3880665184 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7efd6006bf60 con 0x7efd70107ee0 2024-09-11T23:19:19.304 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.021+0000 7efd767cc640 1 -- 172.21.15.5:0/3880665184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd70108340 con 0x7efd70107ee0 2024-09-11T23:19:19.304 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.021+0000 7efd6f7fe640 1 --2- 172.21.15.5:0/3880665184 >> [v2:172.21.15.5:6800/1358356358,v1:172.21.15.5:6801/1358356358] conn(0x7efd58038e60 0x7efd5803b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:19.304 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.022+0000 7efd6f7fe640 1 --2- 172.21.15.5:0/3880665184 >> [v2:172.21.15.5:6800/1358356358,v1:172.21.15.5:6801/1358356358] conn(0x7efd58038e60 0x7efd5803b320 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7efd640098c0 tx=0x7efd64006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:19.304 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.027+0000 7efd6d7fa640 1 -- 172.21.15.5:0/3880665184 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efd60040210 con 0x7efd70107ee0 2024-09-11T23:19:19.304 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.270+0000 7efd767cc640 1 -- 172.21.15.5:0/3880665184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7efd7019e9e0 con 0x7efd70107ee0 2024-09-11T23:19:19.304 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.271+0000 7efd6d7fa640 1 -- 172.21.15.5:0/3880665184 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7efd60031560 con 0x7efd70107ee0 2024-09-11T23:19:19.304 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.273+0000 7efd767cc640 1 -- 172.21.15.5:0/3880665184 >> [v2:172.21.15.5:6800/1358356358,v1:172.21.15.5:6801/1358356358] conn(0x7efd58038e60 msgr2=0x7efd5803b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:19.304 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.273+0000 7efd767cc640 1 --2- 172.21.15.5:0/3880665184 >> [v2:172.21.15.5:6800/1358356358,v1:172.21.15.5:6801/1358356358] conn(0x7efd58038e60 0x7efd5803b320 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7efd640098c0 tx=0x7efd64006db0 comp rx=0 tx=0).stop 2024-09-11T23:19:19.304 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.273+0000 7efd767cc640 1 -- 172.21.15.5:0/3880665184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd70107ee0 msgr2=0x7efd7019b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:19.305 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.273+0000 7efd767cc640 1 --2- 172.21.15.5:0/3880665184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd70107ee0 0x7efd7019b350 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7efd600097f0 tx=0x7efd60030d00 comp rx=0 tx=0).stop 2024-09-11T23:19:19.305 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.273+0000 7efd767cc640 1 -- 172.21.15.5:0/3880665184 shutdown_connections 2024-09-11T23:19:19.305 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.273+0000 7efd767cc640 1 --2- 172.21.15.5:0/3880665184 >> [v2:172.21.15.5:6800/1358356358,v1:172.21.15.5:6801/1358356358] conn(0x7efd58038e60 0x7efd5803b320 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:19.305 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.273+0000 7efd767cc640 1 --2- 172.21.15.5:0/3880665184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd70107ee0 0x7efd7019b350 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:19.305 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.273+0000 7efd767cc640 1 -- 172.21.15.5:0/3880665184 >> 172.21.15.5:0/3880665184 conn(0x7efd70101ae0 msgr2=0x7efd701025e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:19.305 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.273+0000 7efd767cc640 1 -- 172.21.15.5:0/3880665184 shutdown_connections 2024-09-11T23:19:19.305 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:13.273+0000 7efd767cc640 1 -- 172.21.15.5:0/3880665184 wait complete. 2024-09-11T23:19:19.305 INFO:teuthology.orchestra.run.smithi005.stdout:mgr is available 2024-09-11T23:19:20.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:19 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/133670796' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-11T23:19:20.408 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-09-11T23:19:20.408 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout [global] 2024-09-11T23:19:20.408 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout fsid = 1f5284d2-7094-11ef-bcea-c7b262605968 2024-09-11T23:19:20.408 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.5:3300,v1:172.21.15.5:6789] 2024-09-11T23:19:20.408 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-11T23:19:20.408 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-11T23:19:20.408 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-11T23:19:20.408 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-11T23:19:20.409 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-09-11T23:19:20.409 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-11T23:19:20.409 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-11T23:19:20.409 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-09-11T23:19:20.409 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout [osd] 2024-09-11T23:19:20.409 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-11T23:19:20.409 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-11T23:19:20.409 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-11T23:19:20.409 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-11T23:19:20.410 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-11T23:19:20.410 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.663+0000 7fee3c11a640 1 Processor -- start 2024-09-11T23:19:20.410 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.664+0000 7fee3c11a640 1 -- start start 2024-09-11T23:19:20.410 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.664+0000 7fee3c11a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee34107420 0x7fee34107820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:20.410 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.664+0000 7fee3c11a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fee34107df0 con 0x7fee34107420 2024-09-11T23:19:20.410 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.664+0000 7fee39eb6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee34107420 0x7fee34107820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:20.410 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.664+0000 7fee39eb6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee34107420 0x7fee34107820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49382/0 (socket says 172.21.15.5:49382) 2024-09-11T23:19:20.410 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.664+0000 7fee39eb6640 1 -- 172.21.15.5:0/1916817214 learned_addr learned my addr 172.21.15.5:0/1916817214 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:20.410 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.664+0000 7fee39eb6640 1 -- 172.21.15.5:0/1916817214 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee34108620 con 0x7fee34107420 2024-09-11T23:19:20.410 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.665+0000 7fee39eb6640 1 --2- 172.21.15.5:0/1916817214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee34107420 0x7fee34107820 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fee24009e80 tx=0x7fee2402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f4dc95c3a87a089 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:20.410 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.665+0000 7fee38eb4640 1 -- 172.21.15.5:0/1916817214 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee24036070 con 0x7fee34107420 2024-09-11T23:19:20.410 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.665+0000 7fee38eb4640 1 -- 172.21.15.5:0/1916817214 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fee24031890 con 0x7fee34107420 2024-09-11T23:19:20.410 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.665+0000 7fee38eb4640 1 -- 172.21.15.5:0/1916817214 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee24007980 con 0x7fee34107420 2024-09-11T23:19:20.410 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.666+0000 7fee3c11a640 1 -- 172.21.15.5:0/1916817214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee34107420 msgr2=0x7fee34107820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:20.411 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.666+0000 7fee3c11a640 1 --2- 172.21.15.5:0/1916817214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee34107420 0x7fee34107820 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fee24009e80 tx=0x7fee2402a7a0 comp rx=0 tx=0).stop 2024-09-11T23:19:20.411 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.666+0000 7fee3c11a640 1 -- 172.21.15.5:0/1916817214 shutdown_connections 2024-09-11T23:19:20.411 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.666+0000 7fee3c11a640 1 --2- 172.21.15.5:0/1916817214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee34107420 0x7fee34107820 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:20.411 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.666+0000 7fee3c11a640 1 -- 172.21.15.5:0/1916817214 >> 172.21.15.5:0/1916817214 conn(0x7fee34102bb0 msgr2=0x7fee34104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:20.411 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.666+0000 7fee3c11a640 1 -- 172.21.15.5:0/1916817214 shutdown_connections 2024-09-11T23:19:20.411 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.666+0000 7fee3c11a640 1 -- 172.21.15.5:0/1916817214 wait complete. 2024-09-11T23:19:20.411 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.667+0000 7fee3c11a640 1 Processor -- start 2024-09-11T23:19:20.411 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.667+0000 7fee3c11a640 1 -- start start 2024-09-11T23:19:20.411 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.667+0000 7fee3c11a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee34107420 0x7fee3419b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:20.411 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.667+0000 7fee3c11a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fee3410b9d0 con 0x7fee34107420 2024-09-11T23:19:20.411 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.667+0000 7fee39eb6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee34107420 0x7fee3419b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:20.411 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.667+0000 7fee39eb6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee34107420 0x7fee3419b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49398/0 (socket says 172.21.15.5:49398) 2024-09-11T23:19:20.412 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.667+0000 7fee39eb6640 1 -- 172.21.15.5:0/133670796 learned_addr learned my addr 172.21.15.5:0/133670796 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:20.412 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.667+0000 7fee39eb6640 1 -- 172.21.15.5:0/133670796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee3419b8d0 con 0x7fee34107420 2024-09-11T23:19:20.412 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.668+0000 7fee39eb6640 1 --2- 172.21.15.5:0/133670796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee34107420 0x7fee3419b390 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fee24007bb0 tx=0x7fee24031c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:20.412 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.668+0000 7fee32ffd640 1 -- 172.21.15.5:0/133670796 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee24041020 con 0x7fee34107420 2024-09-11T23:19:20.412 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.668+0000 7fee32ffd640 1 -- 172.21.15.5:0/133670796 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fee2403c900 con 0x7fee34107420 2024-09-11T23:19:20.412 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.668+0000 7fee32ffd640 1 -- 172.21.15.5:0/133670796 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee24036040 con 0x7fee34107420 2024-09-11T23:19:20.412 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.668+0000 7fee3c11a640 1 -- 172.21.15.5:0/133670796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee3419bb60 con 0x7fee34107420 2024-09-11T23:19:20.412 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.668+0000 7fee3c11a640 1 -- 172.21.15.5:0/133670796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee3419e850 con 0x7fee34107420 2024-09-11T23:19:20.412 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.669+0000 7fee32ffd640 1 -- 172.21.15.5:0/133670796 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7fee24044020 con 0x7fee34107420 2024-09-11T23:19:20.412 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.669+0000 7fee3c11a640 1 -- 172.21.15.5:0/133670796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee3410bb50 con 0x7fee34107420 2024-09-11T23:19:20.412 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.669+0000 7fee32ffd640 1 --2- 172.21.15.5:0/133670796 >> [v2:172.21.15.5:6800/1358356358,v1:172.21.15.5:6801/1358356358] conn(0x7fee1c038f70 0x7fee1c03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:20.412 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.669+0000 7fee32ffd640 1 -- 172.21.15.5:0/133670796 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fee2406d1d0 con 0x7fee34107420 2024-09-11T23:19:20.413 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.669+0000 7fee396b5640 1 --2- 172.21.15.5:0/133670796 >> [v2:172.21.15.5:6800/1358356358,v1:172.21.15.5:6801/1358356358] conn(0x7fee1c038f70 0x7fee1c03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:20.413 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.670+0000 7fee396b5640 1 --2- 172.21.15.5:0/133670796 >> [v2:172.21.15.5:6800/1358356358,v1:172.21.15.5:6801/1358356358] conn(0x7fee1c038f70 0x7fee1c03b430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fee280098c0 tx=0x7fee28006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:20.413 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.674+0000 7fee32ffd640 1 -- 172.21.15.5:0/133670796 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fee2404b020 con 0x7fee34107420 2024-09-11T23:19:20.413 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.849+0000 7fee3c11a640 1 -- 172.21.15.5:0/133670796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fee341078a0 con 0x7fee34107420 2024-09-11T23:19:20.413 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.850+0000 7fee32ffd640 1 -- 172.21.15.5:0/133670796 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+427 (secure 0 0 0) 0x7fee341078a0 con 0x7fee34107420 2024-09-11T23:19:20.413 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.852+0000 7fee3c11a640 1 -- 172.21.15.5:0/133670796 >> [v2:172.21.15.5:6800/1358356358,v1:172.21.15.5:6801/1358356358] conn(0x7fee1c038f70 msgr2=0x7fee1c03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:20.413 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.852+0000 7fee3c11a640 1 --2- 172.21.15.5:0/133670796 >> [v2:172.21.15.5:6800/1358356358,v1:172.21.15.5:6801/1358356358] conn(0x7fee1c038f70 0x7fee1c03b430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fee280098c0 tx=0x7fee28006db0 comp rx=0 tx=0).stop 2024-09-11T23:19:20.413 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.852+0000 7fee3c11a640 1 -- 172.21.15.5:0/133670796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee34107420 msgr2=0x7fee3419b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:20.413 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.852+0000 7fee3c11a640 1 --2- 172.21.15.5:0/133670796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee34107420 0x7fee3419b390 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fee24007bb0 tx=0x7fee24031c70 comp rx=0 tx=0).stop 2024-09-11T23:19:20.413 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.852+0000 7fee3c11a640 1 -- 172.21.15.5:0/133670796 shutdown_connections 2024-09-11T23:19:20.413 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.852+0000 7fee3c11a640 1 --2- 172.21.15.5:0/133670796 >> [v2:172.21.15.5:6800/1358356358,v1:172.21.15.5:6801/1358356358] conn(0x7fee1c038f70 0x7fee1c03b430 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:20.413 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.852+0000 7fee3c11a640 1 --2- 172.21.15.5:0/133670796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee34107420 0x7fee3419b390 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:20.413 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.852+0000 7fee3c11a640 1 -- 172.21.15.5:0/133670796 >> 172.21.15.5:0/133670796 conn(0x7fee34102bb0 msgr2=0x7fee341036a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:20.414 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.852+0000 7fee3c11a640 1 -- 172.21.15.5:0/133670796 shutdown_connections 2024-09-11T23:19:20.414 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:19.852+0000 7fee3c11a640 1 -- 172.21.15.5:0/133670796 wait complete. 2024-09-11T23:19:20.414 INFO:teuthology.orchestra.run.smithi005.stdout:Enabling cephadm module... 2024-09-11T23:19:21.277 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:21 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/2890373221' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-11T23:19:21.277 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:21 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: ignoring --setuser ceph since I am not root 2024-09-11T23:19:21.278 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:21 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: ignoring --setgroup ceph since I am not root 2024-09-11T23:19:21.278 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:21 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:21.216+0000 7fbfe27a5040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T23:19:21.278 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:21 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:21.276+0000 7fbfe27a5040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T23:19:21.612 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:21 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:21.431+0000 7fbfe27a5040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T23:19:21.612 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:21 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:21.500+0000 7fbfe27a5040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T23:19:21.619 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:20.792+0000 7f7a4008e640 1 Processor -- start 2024-09-11T23:19:21.619 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:20.792+0000 7f7a4008e640 1 -- start start 2024-09-11T23:19:21.619 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:20.792+0000 7f7a4008e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a3807de20 0x7f7a3807c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:21.619 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:20.792+0000 7f7a4008e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7a3807c850 con 0x7f7a3807de20 2024-09-11T23:19:21.619 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:20.792+0000 7f7a3de2a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a3807de20 0x7f7a3807c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:21.619 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:20.792+0000 7f7a3de2a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a3807de20 0x7f7a3807c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49406/0 (socket says 172.21.15.5:49406) 2024-09-11T23:19:21.619 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:20.792+0000 7f7a3de2a640 1 -- 172.21.15.5:0/3454570578 learned_addr learned my addr 172.21.15.5:0/3454570578 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:21.619 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:20.793+0000 7f7a3de2a640 1 -- 172.21.15.5:0/3454570578 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a3807c9d0 con 0x7f7a3807de20 2024-09-11T23:19:21.620 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:20.793+0000 7f7a3de2a640 1 --2- 172.21.15.5:0/3454570578 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a3807de20 0x7f7a3807c280 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7a34009820 tx=0x7f7a3402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42afad6c2c87b038 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:21.620 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:20.793+0000 7f7a3ce28640 1 -- 172.21.15.5:0/3454570578 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a34037070 con 0x7f7a3807de20 2024-09-11T23:19:21.620 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:20.794+0000 7f7a3ce28640 1 -- 172.21.15.5:0/3454570578 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f7a340328d0 con 0x7f7a3807de20 2024-09-11T23:19:21.620 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:20.794+0000 7f7a3ce28640 1 -- 172.21.15.5:0/3454570578 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a340307d0 con 0x7f7a3807de20 2024-09-11T23:19:21.620 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:20.794+0000 7f7a4008e640 1 -- 172.21.15.5:0/3454570578 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a3807de20 msgr2=0x7f7a3807c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:21.620 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:20.794+0000 7f7a4008e640 1 --2- 172.21.15.5:0/3454570578 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a3807de20 0x7f7a3807c280 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7a34009820 tx=0x7f7a3402a270 comp rx=0 tx=0).stop 2024-09-11T23:19:21.620 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:20.794+0000 7f7a4008e640 1 -- 172.21.15.5:0/3454570578 shutdown_connections 2024-09-11T23:19:21.620 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:20.794+0000 7f7a4008e640 1 --2- 172.21.15.5:0/3454570578 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a3807de20 0x7f7a3807c280 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:21.620 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:20.794+0000 7f7a4008e640 1 -- 172.21.15.5:0/3454570578 >> 172.21.15.5:0/3454570578 conn(0x7f7a38102bb0 msgr2=0x7f7a38104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:21.620 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:20.794+0000 7f7a4008e640 1 -- 172.21.15.5:0/3454570578 shutdown_connections 2024-09-11T23:19:21.620 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:20.794+0000 7f7a4008e640 1 -- 172.21.15.5:0/3454570578 wait complete. 2024-09-11T23:19:21.620 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:20.795+0000 7f7a4008e640 1 Processor -- start 2024-09-11T23:19:21.621 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:20.795+0000 7f7a4008e640 1 -- start start 2024-09-11T23:19:21.621 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:20.795+0000 7f7a4008e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a3807de20 0x7f7a3819d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:21.621 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:20.795+0000 7f7a4008e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7a3810d9f0 con 0x7f7a3807de20 2024-09-11T23:19:21.621 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:20.795+0000 7f7a3de2a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a3807de20 0x7f7a3819d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:21.621 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:20.795+0000 7f7a3de2a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a3807de20 0x7f7a3819d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49412/0 (socket says 172.21.15.5:49412) 2024-09-11T23:19:21.621 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:20.795+0000 7f7a3de2a640 1 -- 172.21.15.5:0/2890373221 learned_addr learned my addr 172.21.15.5:0/2890373221 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:21.621 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:20.795+0000 7f7a3de2a640 1 -- 172.21.15.5:0/2890373221 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a3819da90 con 0x7f7a3807de20 2024-09-11T23:19:21.621 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:20.796+0000 7f7a3de2a640 1 --2- 172.21.15.5:0/2890373221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a3807de20 0x7f7a3819d550 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7a34032e10 tx=0x7f7a34032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:21.621 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:20.796+0000 7f7a2effd640 1 -- 172.21.15.5:0/2890373221 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a34042070 con 0x7f7a3807de20 2024-09-11T23:19:21.621 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:20.796+0000 7f7a2effd640 1 -- 172.21.15.5:0/2890373221 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f7a34030c80 con 0x7f7a3807de20 2024-09-11T23:19:21.621 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:20.796+0000 7f7a4008e640 1 -- 172.21.15.5:0/2890373221 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a3819dd20 con 0x7f7a3807de20 2024-09-11T23:19:21.621 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:20.796+0000 7f7a2effd640 1 -- 172.21.15.5:0/2890373221 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a34037040 con 0x7f7a3807de20 2024-09-11T23:19:21.621 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:20.796+0000 7f7a4008e640 1 -- 172.21.15.5:0/2890373221 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a381a0a10 con 0x7f7a3807de20 2024-09-11T23:19:21.622 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:20.797+0000 7f7a2effd640 1 -- 172.21.15.5:0/2890373221 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f7a34045070 con 0x7f7a3807de20 2024-09-11T23:19:21.622 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:20.797+0000 7f7a2effd640 1 --2- 172.21.15.5:0/2890373221 >> [v2:172.21.15.5:6800/1358356358,v1:172.21.15.5:6801/1358356358] conn(0x7f7a24038f70 0x7f7a2403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:21.622 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:20.797+0000 7f7a4008e640 1 -- 172.21.15.5:0/2890373221 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a3807c300 con 0x7f7a3807de20 2024-09-11T23:19:21.622 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:20.797+0000 7f7a2effd640 1 -- 172.21.15.5:0/2890373221 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7a3406bf90 con 0x7f7a3807de20 2024-09-11T23:19:21.622 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:20.797+0000 7f7a3d629640 1 --2- 172.21.15.5:0/2890373221 >> [v2:172.21.15.5:6800/1358356358,v1:172.21.15.5:6801/1358356358] conn(0x7f7a24038f70 0x7f7a2403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:21.622 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:20.798+0000 7f7a3d629640 1 --2- 172.21.15.5:0/2890373221 >> [v2:172.21.15.5:6800/1358356358,v1:172.21.15.5:6801/1358356358] conn(0x7f7a24038f70 0x7f7a2403b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7a280098c0 tx=0x7f7a28006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:21.622 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:20.802+0000 7f7a2effd640 1 -- 172.21.15.5:0/2890373221 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7a34046e00 con 0x7f7a3807de20 2024-09-11T23:19:21.622 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:21.023+0000 7f7a4008e640 1 -- 172.21.15.5:0/2890373221 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f7a381a1090 con 0x7f7a3807de20 2024-09-11T23:19:21.622 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:21.074+0000 7f7a2effd640 1 -- 172.21.15.5:0/2890373221 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f7a3406b9b0 con 0x7f7a3807de20 2024-09-11T23:19:21.622 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:21.076+0000 7f7a2effd640 1 -- 172.21.15.5:0/2890373221 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f7a3403cae0 con 0x7f7a3807de20 2024-09-11T23:19:21.622 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:21.077+0000 7f7a4008e640 1 -- 172.21.15.5:0/2890373221 >> [v2:172.21.15.5:6800/1358356358,v1:172.21.15.5:6801/1358356358] conn(0x7f7a24038f70 msgr2=0x7f7a2403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:21.622 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:21.077+0000 7f7a4008e640 1 --2- 172.21.15.5:0/2890373221 >> [v2:172.21.15.5:6800/1358356358,v1:172.21.15.5:6801/1358356358] conn(0x7f7a24038f70 0x7f7a2403b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7a280098c0 tx=0x7f7a28006db0 comp rx=0 tx=0).stop 2024-09-11T23:19:21.622 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:21.077+0000 7f7a4008e640 1 -- 172.21.15.5:0/2890373221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a3807de20 msgr2=0x7f7a3819d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:21.623 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:21.077+0000 7f7a4008e640 1 --2- 172.21.15.5:0/2890373221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a3807de20 0x7f7a3819d550 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7a34032e10 tx=0x7f7a34032e40 comp rx=0 tx=0).stop 2024-09-11T23:19:21.623 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:21.077+0000 7f7a4008e640 1 -- 172.21.15.5:0/2890373221 shutdown_connections 2024-09-11T23:19:21.623 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:21.077+0000 7f7a4008e640 1 --2- 172.21.15.5:0/2890373221 >> [v2:172.21.15.5:6800/1358356358,v1:172.21.15.5:6801/1358356358] conn(0x7f7a24038f70 0x7f7a2403b430 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:21.623 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:21.077+0000 7f7a4008e640 1 --2- 172.21.15.5:0/2890373221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a3807de20 0x7f7a3819d550 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:21.623 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:21.077+0000 7f7a4008e640 1 -- 172.21.15.5:0/2890373221 >> 172.21.15.5:0/2890373221 conn(0x7f7a38102bb0 msgr2=0x7f7a381036f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:21.623 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:21.077+0000 7f7a4008e640 1 -- 172.21.15.5:0/2890373221 shutdown_connections 2024-09-11T23:19:21.623 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:21.077+0000 7f7a4008e640 1 -- 172.21.15.5:0/2890373221 wait complete. 2024-09-11T23:19:21.882 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:21 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:21.657+0000 7fbfe27a5040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:19:21.883 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:21 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:21.804+0000 7fbfe27a5040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T23:19:22.139 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:22 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/2890373221' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-11T23:19:22.139 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:22 smithi005 ceph-mon[31201]: mgrmap e5: x(active, since 9s) 2024-09-11T23:19:22.399 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:22 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:22.138+0000 7fbfe27a5040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T23:19:22.399 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:22 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:22.202+0000 7fbfe27a5040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T23:19:22.399 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:22 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:22.398+0000 7fbfe27a5040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T23:19:23.144 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2024-09-11T23:19:23.144 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-11T23:19:23.144 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-11T23:19:23.144 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-11T23:19:23.145 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-11T23:19:23.145 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2024-09-11T23:19:23.145 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.059+0000 7f0b59b1f640 1 Processor -- start 2024-09-11T23:19:23.145 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.060+0000 7f0b59b1f640 1 -- start start 2024-09-11T23:19:23.145 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.060+0000 7f0b59b1f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b54106320 0x7f0b54106720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:23.145 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.060+0000 7f0b59b1f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0b54106cf0 con 0x7f0b54106320 2024-09-11T23:19:23.145 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.060+0000 7f0b537fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b54106320 0x7f0b54106720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:23.145 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.060+0000 7f0b537fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b54106320 0x7f0b54106720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49446/0 (socket says 172.21.15.5:49446) 2024-09-11T23:19:23.145 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.060+0000 7f0b537fe640 1 -- 172.21.15.5:0/3936536089 learned_addr learned my addr 172.21.15.5:0/3936536089 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:23.145 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.060+0000 7f0b537fe640 1 -- 172.21.15.5:0/3936536089 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b54107520 con 0x7f0b54106320 2024-09-11T23:19:23.145 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.061+0000 7f0b537fe640 1 --2- 172.21.15.5:0/3936536089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b54106320 0x7f0b54106720 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0b44009820 tx=0x7f0b4402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0b3a77ec2a7ce47 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:23.145 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.061+0000 7f0b527fc640 1 -- 172.21.15.5:0/3936536089 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b44037070 con 0x7f0b54106320 2024-09-11T23:19:23.146 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.061+0000 7f0b527fc640 1 -- 172.21.15.5:0/3936536089 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f0b440328d0 con 0x7f0b54106320 2024-09-11T23:19:23.146 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.061+0000 7f0b527fc640 1 -- 172.21.15.5:0/3936536089 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b440307d0 con 0x7f0b54106320 2024-09-11T23:19:23.146 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.062+0000 7f0b59b1f640 1 -- 172.21.15.5:0/3936536089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b54106320 msgr2=0x7f0b54106720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:23.146 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.062+0000 7f0b59b1f640 1 --2- 172.21.15.5:0/3936536089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b54106320 0x7f0b54106720 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0b44009820 tx=0x7f0b4402a270 comp rx=0 tx=0).stop 2024-09-11T23:19:23.146 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.062+0000 7f0b59b1f640 1 -- 172.21.15.5:0/3936536089 shutdown_connections 2024-09-11T23:19:23.146 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.062+0000 7f0b59b1f640 1 --2- 172.21.15.5:0/3936536089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b54106320 0x7f0b54106720 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.146 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.062+0000 7f0b59b1f640 1 -- 172.21.15.5:0/3936536089 >> 172.21.15.5:0/3936536089 conn(0x7f0b54101a90 msgr2=0x7f0b54103ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:23.146 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.062+0000 7f0b59b1f640 1 -- 172.21.15.5:0/3936536089 shutdown_connections 2024-09-11T23:19:23.146 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.062+0000 7f0b59b1f640 1 -- 172.21.15.5:0/3936536089 wait complete. 2024-09-11T23:19:23.146 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.062+0000 7f0b59b1f640 1 Processor -- start 2024-09-11T23:19:23.146 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.063+0000 7f0b59b1f640 1 -- start start 2024-09-11T23:19:23.146 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.063+0000 7f0b59b1f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b54106320 0x7f0b54075420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:23.147 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.063+0000 7f0b59b1f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5410a8d0 con 0x7f0b54106320 2024-09-11T23:19:23.147 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.063+0000 7f0b537fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b54106320 0x7f0b54075420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:23.147 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.063+0000 7f0b537fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b54106320 0x7f0b54075420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49458/0 (socket says 172.21.15.5:49458) 2024-09-11T23:19:23.147 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.063+0000 7f0b537fe640 1 -- 172.21.15.5:0/1656860607 learned_addr learned my addr 172.21.15.5:0/1656860607 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:23.147 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.063+0000 7f0b537fe640 1 -- 172.21.15.5:0/1656860607 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b5419e0e0 con 0x7f0b54106320 2024-09-11T23:19:23.147 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.063+0000 7f0b537fe640 1 --2- 172.21.15.5:0/1656860607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b54106320 0x7f0b54075420 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0b440097f0 tx=0x7f0b44030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:23.147 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.064+0000 7f0b50ff9640 1 -- 172.21.15.5:0/1656860607 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b44037040 con 0x7f0b54106320 2024-09-11T23:19:23.147 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.064+0000 7f0b50ff9640 1 -- 172.21.15.5:0/1656860607 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f0b44032bb0 con 0x7f0b54106320 2024-09-11T23:19:23.147 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.064+0000 7f0b59b1f640 1 -- 172.21.15.5:0/1656860607 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b5419e2b0 con 0x7f0b54106320 2024-09-11T23:19:23.147 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.064+0000 7f0b50ff9640 1 -- 172.21.15.5:0/1656860607 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b4403a390 con 0x7f0b54106320 2024-09-11T23:19:23.147 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.064+0000 7f0b59b1f640 1 -- 172.21.15.5:0/1656860607 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b5419e650 con 0x7f0b54106320 2024-09-11T23:19:23.147 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.065+0000 7f0b50ff9640 1 -- 172.21.15.5:0/1656860607 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f0b4403a530 con 0x7f0b54106320 2024-09-11T23:19:23.147 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.065+0000 7f0b50ff9640 1 --2- 172.21.15.5:0/1656860607 >> [v2:172.21.15.5:6800/1358356358,v1:172.21.15.5:6801/1358356358] conn(0x7f0b3c038fc0 0x7f0b3c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:23.147 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.065+0000 7f0b50ff9640 1 -- 172.21.15.5:0/1656860607 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0b4406c110 con 0x7f0b54106320 2024-09-11T23:19:23.147 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.065+0000 7f0b59b1f640 1 -- 172.21.15.5:0/1656860607 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b5410aa50 con 0x7f0b54106320 2024-09-11T23:19:23.148 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.065+0000 7f0b52ffd640 1 -- 172.21.15.5:0/1656860607 >> [v2:172.21.15.5:6800/1358356358,v1:172.21.15.5:6801/1358356358] conn(0x7f0b3c038fc0 msgr2=0x7f0b3c03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/1358356358 2024-09-11T23:19:23.148 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.065+0000 7f0b52ffd640 1 --2- 172.21.15.5:0/1656860607 >> [v2:172.21.15.5:6800/1358356358,v1:172.21.15.5:6801/1358356358] conn(0x7f0b3c038fc0 0x7f0b3c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:19:23.148 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.070+0000 7f0b50ff9640 1 -- 172.21.15.5:0/1656860607 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0b44040210 con 0x7f0b54106320 2024-09-11T23:19:23.148 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.266+0000 7f0b52ffd640 1 -- 172.21.15.5:0/1656860607 >> [v2:172.21.15.5:6800/1358356358,v1:172.21.15.5:6801/1358356358] conn(0x7f0b3c038fc0 msgr2=0x7f0b3c03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/1358356358 2024-09-11T23:19:23.148 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.266+0000 7f0b52ffd640 1 --2- 172.21.15.5:0/1656860607 >> [v2:172.21.15.5:6800/1358356358,v1:172.21.15.5:6801/1358356358] conn(0x7f0b3c038fc0 0x7f0b3c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T23:19:23.148 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.293+0000 7f0b59b1f640 1 -- 172.21.15.5:0/1656860607 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f0b5419ee80 con 0x7f0b54106320 2024-09-11T23:19:23.148 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.294+0000 7f0b50ff9640 1 -- 172.21.15.5:0/1656860607 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f0b44031560 con 0x7f0b54106320 2024-09-11T23:19:23.148 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.296+0000 7f0b59b1f640 1 -- 172.21.15.5:0/1656860607 >> [v2:172.21.15.5:6800/1358356358,v1:172.21.15.5:6801/1358356358] conn(0x7f0b3c038fc0 msgr2=0x7f0b3c03b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:19:23.148 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.296+0000 7f0b59b1f640 1 --2- 172.21.15.5:0/1656860607 >> [v2:172.21.15.5:6800/1358356358,v1:172.21.15.5:6801/1358356358] conn(0x7f0b3c038fc0 0x7f0b3c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.148 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.296+0000 7f0b59b1f640 1 -- 172.21.15.5:0/1656860607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b54106320 msgr2=0x7f0b54075420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:23.148 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.296+0000 7f0b59b1f640 1 --2- 172.21.15.5:0/1656860607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b54106320 0x7f0b54075420 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0b440097f0 tx=0x7f0b44030d00 comp rx=0 tx=0).stop 2024-09-11T23:19:23.148 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.296+0000 7f0b59b1f640 1 -- 172.21.15.5:0/1656860607 shutdown_connections 2024-09-11T23:19:23.149 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.296+0000 7f0b59b1f640 1 --2- 172.21.15.5:0/1656860607 >> [v2:172.21.15.5:6800/1358356358,v1:172.21.15.5:6801/1358356358] conn(0x7f0b3c038fc0 0x7f0b3c03b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.149 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.296+0000 7f0b59b1f640 1 --2- 172.21.15.5:0/1656860607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b54106320 0x7f0b54075420 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.149 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.297+0000 7f0b59b1f640 1 -- 172.21.15.5:0/1656860607 >> 172.21.15.5:0/1656860607 conn(0x7f0b54101a90 msgr2=0x7f0b541025b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:23.149 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.297+0000 7f0b59b1f640 1 -- 172.21.15.5:0/1656860607 shutdown_connections 2024-09-11T23:19:23.149 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:22.297+0000 7f0b59b1f640 1 -- 172.21.15.5:0/1656860607 wait complete. 2024-09-11T23:19:23.149 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for the mgr to restart... 2024-09-11T23:19:23.149 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for mgr epoch 5... 2024-09-11T23:19:23.338 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:23 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/1656860607' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-11T23:19:23.725 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:23 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:23.336+0000 7fbfe27a5040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T23:19:23.725 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:23 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:23.407+0000 7fbfe27a5040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T23:19:24.427 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:24 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:24.156+0000 7fbfe27a5040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T23:19:24.427 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:24 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:24.276+0000 7fbfe27a5040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T23:19:24.710 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:24 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:24.426+0000 7fbfe27a5040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:19:24.711 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:24 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:24.492+0000 7fbfe27a5040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T23:19:24.711 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:24 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:24.651+0000 7fbfe27a5040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T23:19:24.962 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:24 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:24.725+0000 7fbfe27a5040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T23:19:24.963 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:24 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:24.789+0000 7fbfe27a5040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T23:19:24.963 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:24 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:24.961+0000 7fbfe27a5040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T23:19:25.224 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:25 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:25.031+0000 7fbfe27a5040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T23:19:25.224 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:25 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:25.103+0000 7fbfe27a5040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T23:19:25.224 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:25 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:25.193+0000 7fbfe27a5040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T23:19:25.717 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:25 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:25.255+0000 7fbfe27a5040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T23:19:25.717 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:25 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:25.317+0000 7fbfe27a5040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T23:19:26.474 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:26 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:26.146+0000 7fbfe27a5040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T23:19:26.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:26 smithi005 ceph-mon[31201]: Active manager daemon x restarted 2024-09-11T23:19:26.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:26 smithi005 ceph-mon[31201]: Activating manager daemon x 2024-09-11T23:19:26.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:26 smithi005 ceph-mon[31201]: osdmap e2: 0 total, 0 up, 0 in 2024-09-11T23:19:26.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:26 smithi005 ceph-mon[31201]: mgrmap e6: x(active, starting, since 0.00314278s) 2024-09-11T23:19:26.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:26 smithi005 ceph-mon[31201]: from='mgr.14116 172.21.15.5:0/2286605363' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:19:26.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:26 smithi005 ceph-mon[31201]: from='mgr.14116 172.21.15.5:0/2286605363' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-11T23:19:26.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:26 smithi005 ceph-mon[31201]: from='mgr.14116 172.21.15.5:0/2286605363' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-11T23:19:26.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:26 smithi005 ceph-mon[31201]: from='mgr.14116 172.21.15.5:0/2286605363' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-11T23:19:26.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:26 smithi005 ceph-mon[31201]: from='mgr.14116 172.21.15.5:0/2286605363' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-11T23:19:26.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:26 smithi005 ceph-mon[31201]: Manager daemon x is now available 2024-09-11T23:19:26.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:26 smithi005 ceph-mon[31201]: from='mgr.14116 172.21.15.5:0/2286605363' entity='mgr.x' 2024-09-11T23:19:26.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:26 smithi005 ceph-mon[31201]: from='mgr.14116 172.21.15.5:0/2286605363' entity='mgr.x' 2024-09-11T23:19:26.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:26 smithi005 ceph-mon[31201]: from='mgr.14116 172.21.15.5:0/2286605363' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:19:26.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:26 smithi005 ceph-mon[31201]: from='mgr.14116 172.21.15.5:0/2286605363' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:19:26.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:26 smithi005 ceph-mon[31201]: from='mgr.14116 172.21.15.5:0/2286605363' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-11T23:19:26.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:26 smithi005 ceph-mon[31201]: from='mgr.14116 172.21.15.5:0/2286605363' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-11T23:19:27.454 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:27 smithi005 ceph-mon[31201]: Found migration_current of "None". Setting to last migration. 2024-09-11T23:19:27.454 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:27 smithi005 ceph-mon[31201]: mgrmap e7: x(active, since 1.00519s) 2024-09-11T23:19:27.697 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2024-09-11T23:19:27.697 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-11T23:19:27.697 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-11T23:19:27.698 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2024-09-11T23:19:27.698 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:23.517+0000 7fafb923c640 1 Processor -- start 2024-09-11T23:19:27.698 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:23.518+0000 7fafb923c640 1 -- start start 2024-09-11T23:19:27.698 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:23.518+0000 7fafb923c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafb4107ec0 0x7fafb410a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:27.698 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:23.518+0000 7fafb923c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fafb4075840 con 0x7fafb4107ec0 2024-09-11T23:19:27.698 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:23.518+0000 7fafb2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafb4107ec0 0x7fafb410a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:27.698 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:23.518+0000 7fafb2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafb4107ec0 0x7fafb410a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53448/0 (socket says 172.21.15.5:53448) 2024-09-11T23:19:27.698 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:23.518+0000 7fafb2d9d640 1 -- 172.21.15.5:0/479809055 learned_addr learned my addr 172.21.15.5:0/479809055 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:27.698 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:23.518+0000 7fafb2d9d640 1 -- 172.21.15.5:0/479809055 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb410a7f0 con 0x7fafb4107ec0 2024-09-11T23:19:27.698 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:23.519+0000 7fafb2d9d640 1 --2- 172.21.15.5:0/479809055 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafb4107ec0 0x7fafb410a2b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fafa4009820 tx=0x7fafa402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee60be55e960cd83 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:27.698 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:23.520+0000 7fafb1d9b640 1 -- 172.21.15.5:0/479809055 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafa4037070 con 0x7fafb4107ec0 2024-09-11T23:19:27.698 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:23.520+0000 7fafb1d9b640 1 -- 172.21.15.5:0/479809055 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fafa40328d0 con 0x7fafb4107ec0 2024-09-11T23:19:27.699 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:23.520+0000 7fafb1d9b640 1 -- 172.21.15.5:0/479809055 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafa40307d0 con 0x7fafb4107ec0 2024-09-11T23:19:27.699 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:23.520+0000 7fafb923c640 1 -- 172.21.15.5:0/479809055 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafb4107ec0 msgr2=0x7fafb410a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:27.699 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:23.520+0000 7fafb923c640 1 --2- 172.21.15.5:0/479809055 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafb4107ec0 0x7fafb410a2b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fafa4009820 tx=0x7fafa402a270 comp rx=0 tx=0).stop 2024-09-11T23:19:27.699 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:23.520+0000 7fafb923c640 1 -- 172.21.15.5:0/479809055 shutdown_connections 2024-09-11T23:19:27.699 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:23.520+0000 7fafb923c640 1 --2- 172.21.15.5:0/479809055 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafb4107ec0 0x7fafb410a2b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:27.699 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:23.520+0000 7fafb923c640 1 -- 172.21.15.5:0/479809055 >> 172.21.15.5:0/479809055 conn(0x7fafb4101ac0 msgr2=0x7fafb4103ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:27.699 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:23.520+0000 7fafb923c640 1 -- 172.21.15.5:0/479809055 shutdown_connections 2024-09-11T23:19:27.699 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:23.520+0000 7fafb923c640 1 -- 172.21.15.5:0/479809055 wait complete. 2024-09-11T23:19:27.699 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:23.521+0000 7fafb923c640 1 Processor -- start 2024-09-11T23:19:27.699 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:23.522+0000 7fafb923c640 1 -- start start 2024-09-11T23:19:27.699 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:23.522+0000 7fafb923c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafb4107ec0 0x7fafb419b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:27.699 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:23.522+0000 7fafb923c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fafb410b7d0 con 0x7fafb4107ec0 2024-09-11T23:19:27.700 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:23.522+0000 7fafb2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafb4107ec0 0x7fafb419b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:27.700 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:23.522+0000 7fafb2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafb4107ec0 0x7fafb419b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53452/0 (socket says 172.21.15.5:53452) 2024-09-11T23:19:27.700 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:23.522+0000 7fafb2d9d640 1 -- 172.21.15.5:0/3854564613 learned_addr learned my addr 172.21.15.5:0/3854564613 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:27.700 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:23.522+0000 7fafb2d9d640 1 -- 172.21.15.5:0/3854564613 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb419b8b0 con 0x7fafb4107ec0 2024-09-11T23:19:27.700 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:23.523+0000 7fafb2d9d640 1 --2- 172.21.15.5:0/3854564613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafb4107ec0 0x7fafb419b370 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fafa4032e10 tx=0x7fafa4032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:27.700 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:23.523+0000 7faf9bfff640 1 -- 172.21.15.5:0/3854564613 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafa4042070 con 0x7fafb4107ec0 2024-09-11T23:19:27.700 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:23.523+0000 7faf9bfff640 1 -- 172.21.15.5:0/3854564613 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fafa4030c80 con 0x7fafb4107ec0 2024-09-11T23:19:27.700 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:23.523+0000 7fafb923c640 1 -- 172.21.15.5:0/3854564613 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafb419bb40 con 0x7fafb4107ec0 2024-09-11T23:19:27.700 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:23.523+0000 7fafb923c640 1 -- 172.21.15.5:0/3854564613 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafb419e830 con 0x7fafb4107ec0 2024-09-11T23:19:27.700 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:23.523+0000 7faf9bfff640 1 -- 172.21.15.5:0/3854564613 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafa4037040 con 0x7fafb4107ec0 2024-09-11T23:19:27.700 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:23.524+0000 7faf9bfff640 1 -- 172.21.15.5:0/3854564613 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7fafa4045070 con 0x7fafb4107ec0 2024-09-11T23:19:27.700 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:23.524+0000 7faf9bfff640 1 --2- 172.21.15.5:0/3854564613 >> [v2:172.21.15.5:6800/1358356358,v1:172.21.15.5:6801/1358356358] conn(0x7faf9c038f70 0x7faf9c03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:27.701 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:23.524+0000 7faf9bfff640 1 -- 172.21.15.5:0/3854564613 --> [v2:172.21.15.5:6800/1358356358,v1:172.21.15.5:6801/1358356358] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7faf9c03bb40 con 0x7faf9c038f70 2024-09-11T23:19:27.701 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:23.524+0000 7faf9bfff640 1 -- 172.21.15.5:0/3854564613 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fafa406bed0 con 0x7fafb4107ec0 2024-09-11T23:19:27.701 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:23.524+0000 7fafb259c640 1 -- 172.21.15.5:0/3854564613 >> [v2:172.21.15.5:6800/1358356358,v1:172.21.15.5:6801/1358356358] conn(0x7faf9c038f70 msgr2=0x7faf9c03b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/1358356358 2024-09-11T23:19:27.701 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:23.524+0000 7fafb259c640 1 --2- 172.21.15.5:0/3854564613 >> [v2:172.21.15.5:6800/1358356358,v1:172.21.15.5:6801/1358356358] conn(0x7faf9c038f70 0x7faf9c03b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:19:27.701 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:23.725+0000 7fafb259c640 1 -- 172.21.15.5:0/3854564613 >> [v2:172.21.15.5:6800/1358356358,v1:172.21.15.5:6801/1358356358] conn(0x7faf9c038f70 msgr2=0x7faf9c03b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/1358356358 2024-09-11T23:19:27.701 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:23.725+0000 7fafb259c640 1 --2- 172.21.15.5:0/3854564613 >> [v2:172.21.15.5:6800/1358356358,v1:172.21.15.5:6801/1358356358] conn(0x7faf9c038f70 0x7faf9c03b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T23:19:27.701 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:24.126+0000 7fafb259c640 1 -- 172.21.15.5:0/3854564613 >> [v2:172.21.15.5:6800/1358356358,v1:172.21.15.5:6801/1358356358] conn(0x7faf9c038f70 msgr2=0x7faf9c03b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/1358356358 2024-09-11T23:19:27.701 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:24.126+0000 7fafb259c640 1 --2- 172.21.15.5:0/3854564613 >> [v2:172.21.15.5:6800/1358356358,v1:172.21.15.5:6801/1358356358] conn(0x7faf9c038f70 0x7faf9c03b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T23:19:27.701 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:24.927+0000 7fafb259c640 1 -- 172.21.15.5:0/3854564613 >> [v2:172.21.15.5:6800/1358356358,v1:172.21.15.5:6801/1358356358] conn(0x7faf9c038f70 msgr2=0x7faf9c03b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/1358356358 2024-09-11T23:19:27.701 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:24.927+0000 7fafb259c640 1 --2- 172.21.15.5:0/3854564613 >> [v2:172.21.15.5:6800/1358356358,v1:172.21.15.5:6801/1358356358] conn(0x7faf9c038f70 0x7faf9c03b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T23:19:27.701 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:26.149+0000 7faf9bfff640 1 -- 172.21.15.5:0/3854564613 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mgrmap(e 6) ==== 46054+0+0 (secure 0 0 0) 0x7fafa406a990 con 0x7fafb4107ec0 2024-09-11T23:19:27.701 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:26.149+0000 7faf9bfff640 1 -- 172.21.15.5:0/3854564613 >> [v2:172.21.15.5:6800/1358356358,v1:172.21.15.5:6801/1358356358] conn(0x7faf9c038f70 msgr2=0x7faf9c03b430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:19:27.702 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:26.149+0000 7faf9bfff640 1 --2- 172.21.15.5:0/3854564613 >> [v2:172.21.15.5:6800/1358356358,v1:172.21.15.5:6801/1358356358] conn(0x7faf9c038f70 0x7faf9c03b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:27.702 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:27.150+0000 7faf9bfff640 1 -- 172.21.15.5:0/3854564613 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7fafa403b330 con 0x7fafb4107ec0 2024-09-11T23:19:27.702 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:27.150+0000 7faf9bfff640 1 --2- 172.21.15.5:0/3854564613 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7faf9c03c8a0 0x7faf9c03ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:27.702 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:27.150+0000 7faf9bfff640 1 -- 172.21.15.5:0/3854564613 --> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7faf9c03bb40 con 0x7faf9c03c8a0 2024-09-11T23:19:27.702 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:27.151+0000 7fafb259c640 1 --2- 172.21.15.5:0/3854564613 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7faf9c03c8a0 0x7faf9c03ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:27.702 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:27.152+0000 7fafb259c640 1 --2- 172.21.15.5:0/3854564613 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7faf9c03c8a0 0x7faf9c03ec90 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fafa8003d00 tx=0x7fafa8009290 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:27.702 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:27.152+0000 7faf9bfff640 1 -- 172.21.15.5:0/3854564613 <== mgr.14116 v2:172.21.15.5:6800/1790126649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7faf9c03bb40 con 0x7faf9c03c8a0 2024-09-11T23:19:27.702 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:27.159+0000 7fafb923c640 1 -- 172.21.15.5:0/3854564613 --> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fafa00025a0 con 0x7faf9c03c8a0 2024-09-11T23:19:27.702 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:27.160+0000 7faf9bfff640 1 -- 172.21.15.5:0/3854564613 <== mgr.14116 v2:172.21.15.5:6800/1790126649 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7fafa00025a0 con 0x7faf9c03c8a0 2024-09-11T23:19:27.702 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:27.160+0000 7fafb923c640 1 -- 172.21.15.5:0/3854564613 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7faf9c03c8a0 msgr2=0x7faf9c03ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:27.702 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:27.160+0000 7fafb923c640 1 --2- 172.21.15.5:0/3854564613 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7faf9c03c8a0 0x7faf9c03ec90 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fafa8003d00 tx=0x7fafa8009290 comp rx=0 tx=0).stop 2024-09-11T23:19:27.702 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:27.160+0000 7fafb923c640 1 -- 172.21.15.5:0/3854564613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafb4107ec0 msgr2=0x7fafb419b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:27.702 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:27.160+0000 7fafb923c640 1 --2- 172.21.15.5:0/3854564613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafb4107ec0 0x7fafb419b370 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fafa4032e10 tx=0x7fafa4032e40 comp rx=0 tx=0).stop 2024-09-11T23:19:27.703 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:27.160+0000 7fafb923c640 1 -- 172.21.15.5:0/3854564613 shutdown_connections 2024-09-11T23:19:27.703 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:27.160+0000 7fafb923c640 1 --2- 172.21.15.5:0/3854564613 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7faf9c03c8a0 0x7faf9c03ec90 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:27.703 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:27.160+0000 7fafb923c640 1 --2- 172.21.15.5:0/3854564613 >> [v2:172.21.15.5:6800/1358356358,v1:172.21.15.5:6801/1358356358] conn(0x7faf9c038f70 0x7faf9c03b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:27.703 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:27.160+0000 7fafb923c640 1 --2- 172.21.15.5:0/3854564613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafb4107ec0 0x7fafb419b370 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:27.703 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:27.160+0000 7fafb923c640 1 -- 172.21.15.5:0/3854564613 >> 172.21.15.5:0/3854564613 conn(0x7fafb4101ac0 msgr2=0x7fafb4102600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:27.703 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:27.160+0000 7fafb923c640 1 -- 172.21.15.5:0/3854564613 shutdown_connections 2024-09-11T23:19:27.703 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:27.160+0000 7fafb923c640 1 -- 172.21.15.5:0/3854564613 wait complete. 2024-09-11T23:19:27.703 INFO:teuthology.orchestra.run.smithi005.stdout:mgr epoch 5 is available 2024-09-11T23:19:27.703 INFO:teuthology.orchestra.run.smithi005.stdout:Setting orchestrator backend to cephadm... 2024-09-11T23:19:28.441 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:28 smithi005 ceph-mon[31201]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-11T23:19:28.445 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:28 smithi005 ceph-mon[31201]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-11T23:19:28.445 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:28 smithi005 ceph-mon[31201]: from='mgr.14116 172.21.15.5:0/2286605363' entity='mgr.x' 2024-09-11T23:19:28.445 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:28 smithi005 ceph-mon[31201]: from='mgr.14116 172.21.15.5:0/2286605363' entity='mgr.x' 2024-09-11T23:19:28.725 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:28 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:28.652+0000 7fbf4f2ca640 -1 log_channel(cephadm) log [ERR] : [11/Sep/2024:23:19:28] ENGINE Error in HTTPServer.serve 2024-09-11T23:19:28.725 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:28 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: Traceback (most recent call last): 2024-09-11T23:19:28.725 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:28 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T23:19:28.725 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:28 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: self._connections.run(self.expiration_interval) 2024-09-11T23:19:28.725 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:28 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T23:19:28.725 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:28 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: self._run(expiration_interval) 2024-09-11T23:19:28.726 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:28 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T23:19:28.726 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:28 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T23:19:28.726 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:28 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T23:19:28.726 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:28 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T23:19:28.726 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:28 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T23:19:28.726 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:28 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: s = self.context.wrap_socket( 2024-09-11T23:19:28.726 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:28 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T23:19:28.726 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:28 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: return self.sslsocket_class._create( 2024-09-11T23:19:28.726 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:28 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T23:19:28.726 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:28 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: self.do_handshake() 2024-09-11T23:19:28.727 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:28 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T23:19:28.727 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:28 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: self._sslobj.do_handshake() 2024-09-11T23:19:28.727 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:28 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T23:19:28.727 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:28 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:29.005 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.254+0000 7fb02ed75640 1 Processor -- start 2024-09-11T23:19:29.010 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.254+0000 7fb02ed75640 1 -- start start 2024-09-11T23:19:29.010 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.254+0000 7fb02ed75640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb028107e90 0x7fb02810a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:29.011 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.254+0000 7fb02ed75640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb028075880 con 0x7fb028107e90 2024-09-11T23:19:29.011 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.254+0000 7fb02cb11640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb028107e90 0x7fb02810a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:29.011 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.254+0000 7fb02cb11640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb028107e90 0x7fb02810a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53510/0 (socket says 172.21.15.5:53510) 2024-09-11T23:19:29.011 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.254+0000 7fb02cb11640 1 -- 172.21.15.5:0/3777406097 learned_addr learned my addr 172.21.15.5:0/3777406097 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:29.011 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.255+0000 7fb02cb11640 1 -- 172.21.15.5:0/3777406097 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb02810a7c0 con 0x7fb028107e90 2024-09-11T23:19:29.011 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.255+0000 7fb02cb11640 1 --2- 172.21.15.5:0/3777406097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb028107e90 0x7fb02810a280 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb01c009820 tx=0x7fb01c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a82a64e14de305b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:29.011 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.256+0000 7fb0277fe640 1 -- 172.21.15.5:0/3777406097 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb01c037070 con 0x7fb028107e90 2024-09-11T23:19:29.011 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.256+0000 7fb0277fe640 1 -- 172.21.15.5:0/3777406097 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fb01c0328d0 con 0x7fb028107e90 2024-09-11T23:19:29.011 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.256+0000 7fb0277fe640 1 -- 172.21.15.5:0/3777406097 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb01c0307d0 con 0x7fb028107e90 2024-09-11T23:19:29.011 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.256+0000 7fb02ed75640 1 -- 172.21.15.5:0/3777406097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb028107e90 msgr2=0x7fb02810a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:29.011 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.256+0000 7fb02ed75640 1 --2- 172.21.15.5:0/3777406097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb028107e90 0x7fb02810a280 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb01c009820 tx=0x7fb01c02a270 comp rx=0 tx=0).stop 2024-09-11T23:19:29.011 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.256+0000 7fb02ed75640 1 -- 172.21.15.5:0/3777406097 shutdown_connections 2024-09-11T23:19:29.012 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.256+0000 7fb02ed75640 1 --2- 172.21.15.5:0/3777406097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb028107e90 0x7fb02810a280 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:29.012 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.256+0000 7fb02ed75640 1 -- 172.21.15.5:0/3777406097 >> 172.21.15.5:0/3777406097 conn(0x7fb028101a90 msgr2=0x7fb028103ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:29.012 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.256+0000 7fb02ed75640 1 -- 172.21.15.5:0/3777406097 shutdown_connections 2024-09-11T23:19:29.012 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.256+0000 7fb02ed75640 1 -- 172.21.15.5:0/3777406097 wait complete. 2024-09-11T23:19:29.012 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.257+0000 7fb02ed75640 1 Processor -- start 2024-09-11T23:19:29.012 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.257+0000 7fb02ed75640 1 -- start start 2024-09-11T23:19:29.012 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.257+0000 7fb02ed75640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb028107e90 0x7fb02819b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:29.012 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.257+0000 7fb02ed75640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb02810b800 con 0x7fb028107e90 2024-09-11T23:19:29.012 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.257+0000 7fb02cb11640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb028107e90 0x7fb02819b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:29.012 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.257+0000 7fb02cb11640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb028107e90 0x7fb02819b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53516/0 (socket says 172.21.15.5:53516) 2024-09-11T23:19:29.012 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.257+0000 7fb02cb11640 1 -- 172.21.15.5:0/1446350414 learned_addr learned my addr 172.21.15.5:0/1446350414 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:29.013 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.257+0000 7fb02cb11640 1 -- 172.21.15.5:0/1446350414 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb02819b8a0 con 0x7fb028107e90 2024-09-11T23:19:29.013 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.258+0000 7fb02cb11640 1 --2- 172.21.15.5:0/1446350414 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb028107e90 0x7fb02819b360 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb01c032e10 tx=0x7fb01c032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:29.013 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.258+0000 7fb025ffb640 1 -- 172.21.15.5:0/1446350414 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb01c042070 con 0x7fb028107e90 2024-09-11T23:19:29.013 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.258+0000 7fb025ffb640 1 -- 172.21.15.5:0/1446350414 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fb01c030c80 con 0x7fb028107e90 2024-09-11T23:19:29.013 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.258+0000 7fb02ed75640 1 -- 172.21.15.5:0/1446350414 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb02819bb30 con 0x7fb028107e90 2024-09-11T23:19:29.013 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.258+0000 7fb025ffb640 1 -- 172.21.15.5:0/1446350414 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb01c037040 con 0x7fb028107e90 2024-09-11T23:19:29.013 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.258+0000 7fb02ed75640 1 -- 172.21.15.5:0/1446350414 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb02819e820 con 0x7fb028107e90 2024-09-11T23:19:29.013 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.259+0000 7fb025ffb640 1 -- 172.21.15.5:0/1446350414 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7fb01c045070 con 0x7fb028107e90 2024-09-11T23:19:29.013 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.259+0000 7fb02ed75640 1 -- 172.21.15.5:0/1446350414 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0281082f0 con 0x7fb028107e90 2024-09-11T23:19:29.013 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.259+0000 7fb025ffb640 1 --2- 172.21.15.5:0/1446350414 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7fb018038e60 0x7fb01803b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:29.013 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.259+0000 7fb025ffb640 1 -- 172.21.15.5:0/1446350414 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb01c06bfd0 con 0x7fb028107e90 2024-09-11T23:19:29.013 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.259+0000 7fb027fff640 1 --2- 172.21.15.5:0/1446350414 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7fb018038e60 0x7fb01803b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:29.014 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.260+0000 7fb027fff640 1 --2- 172.21.15.5:0/1446350414 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7fb018038e60 0x7fb01803b320 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb0140098c0 tx=0x7fb014006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:29.014 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.264+0000 7fb025ffb640 1 -- 172.21.15.5:0/1446350414 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb01c045360 con 0x7fb028107e90 2024-09-11T23:19:29.014 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.271+0000 7fb025ffb640 1 -- 172.21.15.5:0/1446350414 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fb01c03c700 con 0x7fb028107e90 2024-09-11T23:19:29.014 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.454+0000 7fb02ed75640 1 -- 172.21.15.5:0/1446350414 --> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7fb028102cd0 con 0x7fb018038e60 2024-09-11T23:19:29.014 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.459+0000 7fb025ffb640 1 -- 172.21.15.5:0/1446350414 <== mgr.14116 v2:172.21.15.5:6800/1790126649 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb028102cd0 con 0x7fb018038e60 2024-09-11T23:19:29.014 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.461+0000 7fb02ed75640 1 -- 172.21.15.5:0/1446350414 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7fb018038e60 msgr2=0x7fb01803b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:29.014 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.461+0000 7fb02ed75640 1 --2- 172.21.15.5:0/1446350414 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7fb018038e60 0x7fb01803b320 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb0140098c0 tx=0x7fb014006db0 comp rx=0 tx=0).stop 2024-09-11T23:19:29.014 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.461+0000 7fb02ed75640 1 -- 172.21.15.5:0/1446350414 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb028107e90 msgr2=0x7fb02819b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:29.014 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.461+0000 7fb02ed75640 1 --2- 172.21.15.5:0/1446350414 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb028107e90 0x7fb02819b360 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb01c032e10 tx=0x7fb01c032e40 comp rx=0 tx=0).stop 2024-09-11T23:19:29.014 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.461+0000 7fb02ed75640 1 -- 172.21.15.5:0/1446350414 shutdown_connections 2024-09-11T23:19:29.014 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.461+0000 7fb02ed75640 1 --2- 172.21.15.5:0/1446350414 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7fb018038e60 0x7fb01803b320 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:29.014 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.461+0000 7fb02ed75640 1 --2- 172.21.15.5:0/1446350414 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb028107e90 0x7fb02819b360 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:29.014 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.461+0000 7fb02ed75640 1 -- 172.21.15.5:0/1446350414 >> 172.21.15.5:0/1446350414 conn(0x7fb028101a90 msgr2=0x7fb0281025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:29.015 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.462+0000 7fb02ed75640 1 -- 172.21.15.5:0/1446350414 shutdown_connections 2024-09-11T23:19:29.015 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:28.462+0000 7fb02ed75640 1 -- 172.21.15.5:0/1446350414 wait complete. 2024-09-11T23:19:29.402 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:29 smithi005 ceph-mon[31201]: mgrmap e8: x(active, since 2s) 2024-09-11T23:19:29.402 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:29 smithi005 ceph-mon[31201]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:19:29.402 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:29 smithi005 ceph-mon[31201]: from='mgr.14116 172.21.15.5:0/2286605363' entity='mgr.x' 2024-09-11T23:19:29.402 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:29 smithi005 ceph-mon[31201]: from='mgr.14116 172.21.15.5:0/2286605363' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:19:29.402 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:29 smithi005 ceph-mon[31201]: [11/Sep/2024:23:19:28] ENGINE Bus STARTING 2024-09-11T23:19:29.402 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:29 smithi005 ceph-mon[31201]: [11/Sep/2024:23:19:28] ENGINE Serving on https://172.21.15.5:7150 2024-09-11T23:19:29.402 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:29 smithi005 ceph-mon[31201]: [11/Sep/2024:23:19:28] ENGINE Error in HTTPServer.serve 2024-09-11T23:19:29.402 INFO:journalctl@ceph.mon.a.smithi005.stdout: Traceback (most recent call last): 2024-09-11T23:19:29.403 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T23:19:29.403 INFO:journalctl@ceph.mon.a.smithi005.stdout: self._connections.run(self.expiration_interval) 2024-09-11T23:19:29.403 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T23:19:29.403 INFO:journalctl@ceph.mon.a.smithi005.stdout: self._run(expiration_interval) 2024-09-11T23:19:29.403 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T23:19:29.403 INFO:journalctl@ceph.mon.a.smithi005.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T23:19:29.403 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T23:19:29.403 INFO:journalctl@ceph.mon.a.smithi005.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T23:19:29.403 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T23:19:29.403 INFO:journalctl@ceph.mon.a.smithi005.stdout: s = self.context.wrap_socket( 2024-09-11T23:19:29.403 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T23:19:29.403 INFO:journalctl@ceph.mon.a.smithi005.stdout: return self.sslsocket_class._create( 2024-09-11T23:19:29.403 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T23:19:29.403 INFO:journalctl@ceph.mon.a.smithi005.stdout: self.do_handshake() 2024-09-11T23:19:29.403 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T23:19:29.404 INFO:journalctl@ceph.mon.a.smithi005.stdout: self._sslobj.do_handshake() 2024-09-11T23:19:29.404 INFO:journalctl@ceph.mon.a.smithi005.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T23:19:29.404 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:29 smithi005 ceph-mon[31201]: [11/Sep/2024:23:19:28] ENGINE Serving on http://172.21.15.5:8765 2024-09-11T23:19:29.404 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:29 smithi005 ceph-mon[31201]: [11/Sep/2024:23:19:28] ENGINE Bus STARTED 2024-09-11T23:19:29.404 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:29 smithi005 ceph-mon[31201]: from='mgr.14116 172.21.15.5:0/2286605363' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:19:30.218 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-11T23:19:30.219 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.401+0000 7f49f362b640 1 Processor -- start 2024-09-11T23:19:30.219 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.401+0000 7f49f362b640 1 -- start start 2024-09-11T23:19:30.219 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.401+0000 7f49f362b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49ec107400 0x7f49ec107800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:30.220 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.401+0000 7f49f362b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f49ec107dd0 con 0x7f49ec107400 2024-09-11T23:19:30.220 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.402+0000 7f49f13c7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49ec107400 0x7f49ec107800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:30.220 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.402+0000 7f49f13c7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49ec107400 0x7f49ec107800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53518/0 (socket says 172.21.15.5:53518) 2024-09-11T23:19:30.220 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.402+0000 7f49f13c7640 1 -- 172.21.15.5:0/4219306823 learned_addr learned my addr 172.21.15.5:0/4219306823 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:30.221 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.402+0000 7f49f13c7640 1 -- 172.21.15.5:0/4219306823 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49ec108600 con 0x7f49ec107400 2024-09-11T23:19:30.221 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.403+0000 7f49f13c7640 1 --2- 172.21.15.5:0/4219306823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49ec107400 0x7f49ec107800 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f49e8009820 tx=0x7f49e802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac1565a6b1365355 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:30.221 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.403+0000 7f49e3fff640 1 -- 172.21.15.5:0/4219306823 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49e8037070 con 0x7f49ec107400 2024-09-11T23:19:30.221 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.403+0000 7f49e3fff640 1 -- 172.21.15.5:0/4219306823 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f49e80328d0 con 0x7f49ec107400 2024-09-11T23:19:30.222 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.403+0000 7f49e3fff640 1 -- 172.21.15.5:0/4219306823 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49e80307d0 con 0x7f49ec107400 2024-09-11T23:19:30.222 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.403+0000 7f49f362b640 1 -- 172.21.15.5:0/4219306823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49ec107400 msgr2=0x7f49ec107800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:30.222 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.403+0000 7f49f362b640 1 --2- 172.21.15.5:0/4219306823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49ec107400 0x7f49ec107800 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f49e8009820 tx=0x7f49e802a270 comp rx=0 tx=0).stop 2024-09-11T23:19:30.222 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.403+0000 7f49f362b640 1 -- 172.21.15.5:0/4219306823 shutdown_connections 2024-09-11T23:19:30.222 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.403+0000 7f49f362b640 1 --2- 172.21.15.5:0/4219306823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49ec107400 0x7f49ec107800 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:30.223 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.403+0000 7f49f362b640 1 -- 172.21.15.5:0/4219306823 >> 172.21.15.5:0/4219306823 conn(0x7f49ec102b70 msgr2=0x7f49ec104fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:30.223 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.404+0000 7f49f362b640 1 -- 172.21.15.5:0/4219306823 shutdown_connections 2024-09-11T23:19:30.223 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.404+0000 7f49f362b640 1 -- 172.21.15.5:0/4219306823 wait complete. 2024-09-11T23:19:30.223 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.404+0000 7f49f362b640 1 Processor -- start 2024-09-11T23:19:30.223 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.404+0000 7f49f362b640 1 -- start start 2024-09-11T23:19:30.224 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.404+0000 7f49f362b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49ec107400 0x7f49ec19b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:30.224 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.404+0000 7f49f362b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f49ec10b9b0 con 0x7f49ec107400 2024-09-11T23:19:30.224 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.404+0000 7f49f13c7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49ec107400 0x7f49ec19b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:30.224 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.404+0000 7f49f13c7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49ec107400 0x7f49ec19b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53524/0 (socket says 172.21.15.5:53524) 2024-09-11T23:19:30.224 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.405+0000 7f49f13c7640 1 -- 172.21.15.5:0/2359090685 learned_addr learned my addr 172.21.15.5:0/2359090685 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:30.225 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.405+0000 7f49f13c7640 1 -- 172.21.15.5:0/2359090685 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49ec19b8b0 con 0x7f49ec107400 2024-09-11T23:19:30.225 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.405+0000 7f49f13c7640 1 --2- 172.21.15.5:0/2359090685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49ec107400 0x7f49ec19b370 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f49e8009940 tx=0x7f49e8032e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:30.225 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.405+0000 7f49e27fc640 1 -- 172.21.15.5:0/2359090685 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49e8042070 con 0x7f49ec107400 2024-09-11T23:19:30.225 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.405+0000 7f49e27fc640 1 -- 172.21.15.5:0/2359090685 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f49e8030c80 con 0x7f49ec107400 2024-09-11T23:19:30.225 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.405+0000 7f49f362b640 1 -- 172.21.15.5:0/2359090685 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49ec19bb40 con 0x7f49ec107400 2024-09-11T23:19:30.226 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.405+0000 7f49e27fc640 1 -- 172.21.15.5:0/2359090685 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49e8037040 con 0x7f49ec107400 2024-09-11T23:19:30.226 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.405+0000 7f49f362b640 1 -- 172.21.15.5:0/2359090685 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49ec19e830 con 0x7f49ec107400 2024-09-11T23:19:30.226 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.406+0000 7f49e27fc640 1 -- 172.21.15.5:0/2359090685 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f49e8045070 con 0x7f49ec107400 2024-09-11T23:19:30.226 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.406+0000 7f49f362b640 1 -- 172.21.15.5:0/2359090685 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49ec10bb30 con 0x7f49ec107400 2024-09-11T23:19:30.226 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.407+0000 7f49e27fc640 1 --2- 172.21.15.5:0/2359090685 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7f49d8038f70 0x7f49d803b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:30.227 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.407+0000 7f49e27fc640 1 -- 172.21.15.5:0/2359090685 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f49e806bf50 con 0x7f49ec107400 2024-09-11T23:19:30.227 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.407+0000 7f49f0bc6640 1 --2- 172.21.15.5:0/2359090685 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7f49d8038f70 0x7f49d803b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:30.227 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.407+0000 7f49f0bc6640 1 --2- 172.21.15.5:0/2359090685 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7f49d8038f70 0x7f49d803b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f49dc0098c0 tx=0x7f49dc006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:30.227 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.412+0000 7f49e27fc640 1 -- 172.21.15.5:0/2359090685 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f49e8045360 con 0x7f49ec107400 2024-09-11T23:19:30.227 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.589+0000 7f49f362b640 1 -- 172.21.15.5:0/2359090685 --> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f49ec103dd0 con 0x7f49d8038f70 2024-09-11T23:19:30.228 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.590+0000 7f49e27fc640 1 -- 172.21.15.5:0/2359090685 <== mgr.14116 v2:172.21.15.5:6800/1790126649 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f49ec103dd0 con 0x7f49d8038f70 2024-09-11T23:19:30.228 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.592+0000 7f49f362b640 1 -- 172.21.15.5:0/2359090685 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7f49d8038f70 msgr2=0x7f49d803b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:30.228 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.592+0000 7f49f362b640 1 --2- 172.21.15.5:0/2359090685 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7f49d8038f70 0x7f49d803b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f49dc0098c0 tx=0x7f49dc006db0 comp rx=0 tx=0).stop 2024-09-11T23:19:30.228 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.592+0000 7f49f362b640 1 -- 172.21.15.5:0/2359090685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49ec107400 msgr2=0x7f49ec19b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:30.228 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.592+0000 7f49f362b640 1 --2- 172.21.15.5:0/2359090685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49ec107400 0x7f49ec19b370 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f49e8009940 tx=0x7f49e8032e10 comp rx=0 tx=0).stop 2024-09-11T23:19:30.229 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.592+0000 7f49f362b640 1 -- 172.21.15.5:0/2359090685 shutdown_connections 2024-09-11T23:19:30.229 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.592+0000 7f49f362b640 1 --2- 172.21.15.5:0/2359090685 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7f49d8038f70 0x7f49d803b430 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:30.229 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.592+0000 7f49f362b640 1 --2- 172.21.15.5:0/2359090685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49ec107400 0x7f49ec19b370 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:30.229 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.592+0000 7f49f362b640 1 -- 172.21.15.5:0/2359090685 >> 172.21.15.5:0/2359090685 conn(0x7f49ec102b70 msgr2=0x7f49ec1036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:30.229 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.592+0000 7f49f362b640 1 -- 172.21.15.5:0/2359090685 shutdown_connections 2024-09-11T23:19:30.230 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:29.592+0000 7f49f362b640 1 -- 172.21.15.5:0/2359090685 wait complete. 2024-09-11T23:19:30.230 INFO:teuthology.orchestra.run.smithi005.stdout:Generating ssh key... 2024-09-11T23:19:30.464 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:30 smithi005 ceph-mon[31201]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:19:31.224 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:30 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: Generating public/private rsa key pair. 2024-09-11T23:19:31.225 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:30 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: Your identification has been saved in /tmp/tmpnn8kp7xm/key 2024-09-11T23:19:31.225 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:30 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: Your public key has been saved in /tmp/tmpnn8kp7xm/key.pub 2024-09-11T23:19:31.225 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:30 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: The key fingerprint is: 2024-09-11T23:19:31.225 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:30 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: SHA256:WIJSlVzcpFLcWrBXhy6wRyXMRTYrZ9Uw1WOV994g6mY ceph-1f5284d2-7094-11ef-bcea-c7b262605968 2024-09-11T23:19:31.225 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:30 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: The key's randomart image is: 2024-09-11T23:19:31.225 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:30 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: +---[RSA 3072]----+ 2024-09-11T23:19:31.225 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:30 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: | .o.=+Bo+B.=+*| 2024-09-11T23:19:31.225 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:30 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: | . .o.+oB+.= =+| 2024-09-11T23:19:31.226 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:30 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: | . . o +*o.+ . +| 2024-09-11T23:19:31.226 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:30 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: | . =o.o+o . .| 2024-09-11T23:19:31.226 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:30 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: | . S. o . o.| 2024-09-11T23:19:31.226 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:30 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: | . o| 2024-09-11T23:19:31.226 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:30 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: | . | 2024-09-11T23:19:31.227 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:30 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: | E | 2024-09-11T23:19:31.227 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:30 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: | o | 2024-09-11T23:19:31.227 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:30 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: +----[SHA256]-----+ 2024-09-11T23:19:31.482 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.651+0000 7fd102db1640 1 Processor -- start 2024-09-11T23:19:31.482 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.651+0000 7fd102db1640 1 -- start start 2024-09-11T23:19:31.482 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.651+0000 7fd102db1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0fc107420 0x7fd0fc107820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:31.482 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.651+0000 7fd102db1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd0fc107df0 con 0x7fd0fc107420 2024-09-11T23:19:31.482 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.652+0000 7fd100b4d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0fc107420 0x7fd0fc107820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:31.482 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.652+0000 7fd100b4d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0fc107420 0x7fd0fc107820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53540/0 (socket says 172.21.15.5:53540) 2024-09-11T23:19:31.482 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.652+0000 7fd100b4d640 1 -- 172.21.15.5:0/502461895 learned_addr learned my addr 172.21.15.5:0/502461895 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:31.482 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.652+0000 7fd100b4d640 1 -- 172.21.15.5:0/502461895 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0fc108620 con 0x7fd0fc107420 2024-09-11T23:19:31.483 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.653+0000 7fd100b4d640 1 --2- 172.21.15.5:0/502461895 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0fc107420 0x7fd0fc107820 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec009820 tx=0x7fd0ec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2df74fd6d77fc63 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:31.483 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.653+0000 7fd0fb7fe640 1 -- 172.21.15.5:0/502461895 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0ec037070 con 0x7fd0fc107420 2024-09-11T23:19:31.483 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.653+0000 7fd0fb7fe640 1 -- 172.21.15.5:0/502461895 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fd0ec0328d0 con 0x7fd0fc107420 2024-09-11T23:19:31.483 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.653+0000 7fd0fb7fe640 1 -- 172.21.15.5:0/502461895 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0ec0307d0 con 0x7fd0fc107420 2024-09-11T23:19:31.483 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.653+0000 7fd102db1640 1 -- 172.21.15.5:0/502461895 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0fc107420 msgr2=0x7fd0fc107820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:31.483 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.653+0000 7fd102db1640 1 --2- 172.21.15.5:0/502461895 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0fc107420 0x7fd0fc107820 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec009820 tx=0x7fd0ec02a270 comp rx=0 tx=0).stop 2024-09-11T23:19:31.483 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.654+0000 7fd102db1640 1 -- 172.21.15.5:0/502461895 shutdown_connections 2024-09-11T23:19:31.483 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.654+0000 7fd102db1640 1 --2- 172.21.15.5:0/502461895 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0fc107420 0x7fd0fc107820 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:31.483 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.654+0000 7fd102db1640 1 -- 172.21.15.5:0/502461895 >> 172.21.15.5:0/502461895 conn(0x7fd0fc102bb0 msgr2=0x7fd0fc104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:31.483 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.654+0000 7fd102db1640 1 -- 172.21.15.5:0/502461895 shutdown_connections 2024-09-11T23:19:31.483 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.654+0000 7fd102db1640 1 -- 172.21.15.5:0/502461895 wait complete. 2024-09-11T23:19:31.483 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.654+0000 7fd102db1640 1 Processor -- start 2024-09-11T23:19:31.483 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.654+0000 7fd102db1640 1 -- start start 2024-09-11T23:19:31.484 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.654+0000 7fd102db1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0fc107420 0x7fd0fc07db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:31.484 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.654+0000 7fd102db1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd0fc10b9d0 con 0x7fd0fc107420 2024-09-11T23:19:31.484 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.655+0000 7fd100b4d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0fc107420 0x7fd0fc07db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:31.484 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.655+0000 7fd100b4d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0fc107420 0x7fd0fc07db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53556/0 (socket says 172.21.15.5:53556) 2024-09-11T23:19:31.484 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.655+0000 7fd100b4d640 1 -- 172.21.15.5:0/3237181319 learned_addr learned my addr 172.21.15.5:0/3237181319 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:31.484 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.655+0000 7fd100b4d640 1 -- 172.21.15.5:0/3237181319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0fc07e050 con 0x7fd0fc107420 2024-09-11T23:19:31.484 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.655+0000 7fd100b4d640 1 --2- 172.21.15.5:0/3237181319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0fc107420 0x7fd0fc07db10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec0097f0 tx=0x7fd0ec030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:31.484 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.655+0000 7fd0f9ffb640 1 -- 172.21.15.5:0/3237181319 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0ec037040 con 0x7fd0fc107420 2024-09-11T23:19:31.484 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.655+0000 7fd0f9ffb640 1 -- 172.21.15.5:0/3237181319 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fd0ec032bb0 con 0x7fd0fc107420 2024-09-11T23:19:31.484 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.655+0000 7fd102db1640 1 -- 172.21.15.5:0/3237181319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0fc07c240 con 0x7fd0fc107420 2024-09-11T23:19:31.484 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.655+0000 7fd0f9ffb640 1 -- 172.21.15.5:0/3237181319 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0ec03a390 con 0x7fd0fc107420 2024-09-11T23:19:31.485 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.656+0000 7fd102db1640 1 -- 172.21.15.5:0/3237181319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0fc07c780 con 0x7fd0fc107420 2024-09-11T23:19:31.485 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.657+0000 7fd0f9ffb640 1 -- 172.21.15.5:0/3237181319 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fd0ec03a580 con 0x7fd0fc107420 2024-09-11T23:19:31.485 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.657+0000 7fd102db1640 1 -- 172.21.15.5:0/3237181319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0fc10bb50 con 0x7fd0fc107420 2024-09-11T23:19:31.485 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.657+0000 7fd0f9ffb640 1 --2- 172.21.15.5:0/3237181319 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7fd0e4038fc0 0x7fd0e403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:31.485 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.657+0000 7fd0f9ffb640 1 -- 172.21.15.5:0/3237181319 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd0ec06c3e0 con 0x7fd0fc107420 2024-09-11T23:19:31.485 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.657+0000 7fd0fbfff640 1 --2- 172.21.15.5:0/3237181319 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7fd0e4038fc0 0x7fd0e403b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:31.485 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.658+0000 7fd0fbfff640 1 --2- 172.21.15.5:0/3237181319 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7fd0e4038fc0 0x7fd0e403b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd0f00098c0 tx=0x7fd0f0006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:31.485 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.662+0000 7fd0f9ffb640 1 -- 172.21.15.5:0/3237181319 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd0ec031560 con 0x7fd0fc107420 2024-09-11T23:19:31.485 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.840+0000 7fd102db1640 1 -- 172.21.15.5:0/3237181319 --> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7fd0fc07d010 con 0x7fd0e4038fc0 2024-09-11T23:19:31.485 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.950+0000 7fd0f9ffb640 1 -- 172.21.15.5:0/3237181319 <== mgr.14116 v2:172.21.15.5:6800/1790126649 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd0fc07d010 con 0x7fd0e4038fc0 2024-09-11T23:19:31.485 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.952+0000 7fd102db1640 1 -- 172.21.15.5:0/3237181319 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7fd0e4038fc0 msgr2=0x7fd0e403b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:31.485 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.952+0000 7fd102db1640 1 --2- 172.21.15.5:0/3237181319 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7fd0e4038fc0 0x7fd0e403b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd0f00098c0 tx=0x7fd0f0006db0 comp rx=0 tx=0).stop 2024-09-11T23:19:31.486 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.952+0000 7fd102db1640 1 -- 172.21.15.5:0/3237181319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0fc107420 msgr2=0x7fd0fc07db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:31.486 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.952+0000 7fd102db1640 1 --2- 172.21.15.5:0/3237181319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0fc107420 0x7fd0fc07db10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec0097f0 tx=0x7fd0ec030d00 comp rx=0 tx=0).stop 2024-09-11T23:19:31.486 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.952+0000 7fd102db1640 1 -- 172.21.15.5:0/3237181319 shutdown_connections 2024-09-11T23:19:31.486 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.952+0000 7fd102db1640 1 --2- 172.21.15.5:0/3237181319 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7fd0e4038fc0 0x7fd0e403b480 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:31.486 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.952+0000 7fd102db1640 1 --2- 172.21.15.5:0/3237181319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0fc107420 0x7fd0fc07db10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:31.486 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.952+0000 7fd102db1640 1 -- 172.21.15.5:0/3237181319 >> 172.21.15.5:0/3237181319 conn(0x7fd0fc102bb0 msgr2=0x7fd0fc1036a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:31.486 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.952+0000 7fd102db1640 1 -- 172.21.15.5:0/3237181319 shutdown_connections 2024-09-11T23:19:31.486 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:30.952+0000 7fd102db1640 1 -- 172.21.15.5:0/3237181319 wait complete. 2024-09-11T23:19:32.020 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:31 smithi005 ceph-mon[31201]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:19:32.020 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:31 smithi005 ceph-mon[31201]: Generating ssh key... 2024-09-11T23:19:32.020 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:31 smithi005 ceph-mon[31201]: from='mgr.14116 172.21.15.5:0/2286605363' entity='mgr.x' 2024-09-11T23:19:32.020 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:31 smithi005 ceph-mon[31201]: from='mgr.14116 172.21.15.5:0/2286605363' entity='mgr.x' 2024-09-11T23:19:32.538 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCtAHVVOdjEMBULa+HOO2sWwtJdW05tyfOVK01iiDTjp1r0JHgCbLAQQc79KPePtCP0BOYUJxJ0rp9RlEu5tJHv7b2vcU7CiuZv59BnfogBSUcNqIt2w6+9eSzSQSyXH8M+oz6rynAQn0VQvx9tbf/478JDQyyRvjdbEQdAdLoIwRTxh8SIIsqyKBYfgW6uc71IHlXfdNNnVbvuYtbOLbXXWw3+Yi82GLd0b8G7+SYJz+Qe5ZussXvq22vfZ7DmAnum53Pm/e4g0Otv6Y2+9OqUr19Y9YJREbsN+p2TB106WwI5aMu6/3fhcL/pPJ80w3sPsyndD+F4BYHNxty7xOkVpp0+IgfVPxapJX6H1zitLRDXnCrD2Wi/kt8SpRmuXATnueSbjqfWmM/zmo8jp5MAIHElAe/580K57oAbPSHJLanJU3B1Yd9tCb2dt9Qrx1htHhm9aZiCJvCQlM6CuZ8wln6Y8p8H/RRqkK7OaQ3Jp3lq8Zi/MPDrZVlHJo1hJA8= ceph-1f5284d2-7094-11ef-bcea-c7b262605968 2024-09-11T23:19:32.539 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:31.833+0000 7fbf1f17e640 1 Processor -- start 2024-09-11T23:19:32.539 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:31.833+0000 7fbf1f17e640 1 -- start start 2024-09-11T23:19:32.539 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:31.833+0000 7fbf1f17e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf18107e90 0x7fbf1810a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:32.539 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:31.833+0000 7fbf1f17e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbf18075880 con 0x7fbf18107e90 2024-09-11T23:19:32.539 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:31.833+0000 7fbf1cf1a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf18107e90 0x7fbf1810a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:32.539 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:31.833+0000 7fbf1cf1a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf18107e90 0x7fbf1810a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53570/0 (socket says 172.21.15.5:53570) 2024-09-11T23:19:32.539 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:31.833+0000 7fbf1cf1a640 1 -- 172.21.15.5:0/1498652269 learned_addr learned my addr 172.21.15.5:0/1498652269 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:32.539 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:31.833+0000 7fbf1cf1a640 1 -- 172.21.15.5:0/1498652269 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf1810a7c0 con 0x7fbf18107e90 2024-09-11T23:19:32.539 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:31.835+0000 7fbf1cf1a640 1 --2- 172.21.15.5:0/1498652269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf18107e90 0x7fbf1810a280 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c009820 tx=0x7fbf0c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e85237a03a3eb4b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:32.539 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:31.835+0000 7fbf177fe640 1 -- 172.21.15.5:0/1498652269 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf0c037070 con 0x7fbf18107e90 2024-09-11T23:19:32.539 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:31.835+0000 7fbf177fe640 1 -- 172.21.15.5:0/1498652269 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fbf0c0328d0 con 0x7fbf18107e90 2024-09-11T23:19:32.539 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:31.835+0000 7fbf177fe640 1 -- 172.21.15.5:0/1498652269 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf0c0307d0 con 0x7fbf18107e90 2024-09-11T23:19:32.540 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:31.835+0000 7fbf1f17e640 1 -- 172.21.15.5:0/1498652269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf18107e90 msgr2=0x7fbf1810a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:32.540 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:31.835+0000 7fbf1f17e640 1 --2- 172.21.15.5:0/1498652269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf18107e90 0x7fbf1810a280 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c009820 tx=0x7fbf0c02a270 comp rx=0 tx=0).stop 2024-09-11T23:19:32.540 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:31.835+0000 7fbf1f17e640 1 -- 172.21.15.5:0/1498652269 shutdown_connections 2024-09-11T23:19:32.540 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:31.835+0000 7fbf1f17e640 1 --2- 172.21.15.5:0/1498652269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf18107e90 0x7fbf1810a280 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:32.540 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:31.835+0000 7fbf1f17e640 1 -- 172.21.15.5:0/1498652269 >> 172.21.15.5:0/1498652269 conn(0x7fbf18101a90 msgr2=0x7fbf18103ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:32.540 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:31.835+0000 7fbf1f17e640 1 -- 172.21.15.5:0/1498652269 shutdown_connections 2024-09-11T23:19:32.540 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:31.835+0000 7fbf1f17e640 1 -- 172.21.15.5:0/1498652269 wait complete. 2024-09-11T23:19:32.540 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:31.835+0000 7fbf1f17e640 1 Processor -- start 2024-09-11T23:19:32.540 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:31.835+0000 7fbf1f17e640 1 -- start start 2024-09-11T23:19:32.540 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:31.835+0000 7fbf1f17e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf18107e90 0x7fbf1819b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:32.540 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:31.835+0000 7fbf1f17e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbf1810b800 con 0x7fbf18107e90 2024-09-11T23:19:32.540 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:31.835+0000 7fbf1cf1a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf18107e90 0x7fbf1819b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:32.540 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:31.835+0000 7fbf1cf1a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf18107e90 0x7fbf1819b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53576/0 (socket says 172.21.15.5:53576) 2024-09-11T23:19:32.541 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:31.835+0000 7fbf1cf1a640 1 -- 172.21.15.5:0/2238602835 learned_addr learned my addr 172.21.15.5:0/2238602835 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:32.541 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:31.836+0000 7fbf1cf1a640 1 -- 172.21.15.5:0/2238602835 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf1819b8a0 con 0x7fbf18107e90 2024-09-11T23:19:32.541 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:31.836+0000 7fbf1cf1a640 1 --2- 172.21.15.5:0/2238602835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf18107e90 0x7fbf1819b360 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c032e10 tx=0x7fbf0c032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:32.541 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:31.836+0000 7fbf15ffb640 1 -- 172.21.15.5:0/2238602835 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf0c042070 con 0x7fbf18107e90 2024-09-11T23:19:32.541 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:31.836+0000 7fbf15ffb640 1 -- 172.21.15.5:0/2238602835 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fbf0c030c80 con 0x7fbf18107e90 2024-09-11T23:19:32.541 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:31.836+0000 7fbf1f17e640 1 -- 172.21.15.5:0/2238602835 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf1819bb30 con 0x7fbf18107e90 2024-09-11T23:19:32.541 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:31.836+0000 7fbf15ffb640 1 -- 172.21.15.5:0/2238602835 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf0c037040 con 0x7fbf18107e90 2024-09-11T23:19:32.541 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:31.836+0000 7fbf1f17e640 1 -- 172.21.15.5:0/2238602835 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf1819e820 con 0x7fbf18107e90 2024-09-11T23:19:32.541 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:31.837+0000 7fbf15ffb640 1 -- 172.21.15.5:0/2238602835 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fbf0c045070 con 0x7fbf18107e90 2024-09-11T23:19:32.541 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:31.837+0000 7fbf15ffb640 1 --2- 172.21.15.5:0/2238602835 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7fbf08038fc0 0x7fbf0803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:32.541 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:31.837+0000 7fbf15ffb640 1 -- 172.21.15.5:0/2238602835 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fbf0c06bf10 con 0x7fbf18107e90 2024-09-11T23:19:32.541 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:31.837+0000 7fbf17fff640 1 --2- 172.21.15.5:0/2238602835 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7fbf08038fc0 0x7fbf0803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:32.542 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:31.837+0000 7fbf1f17e640 1 -- 172.21.15.5:0/2238602835 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf181082f0 con 0x7fbf18107e90 2024-09-11T23:19:32.542 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:31.838+0000 7fbf17fff640 1 --2- 172.21.15.5:0/2238602835 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7fbf08038fc0 0x7fbf0803b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbf040098c0 tx=0x7fbf04006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:32.542 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:31.842+0000 7fbf15ffb640 1 -- 172.21.15.5:0/2238602835 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbf0c045360 con 0x7fbf18107e90 2024-09-11T23:19:32.542 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.019+0000 7fbf1f17e640 1 -- 172.21.15.5:0/2238602835 --> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7fbf18102cd0 con 0x7fbf08038fc0 2024-09-11T23:19:32.542 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.019+0000 7fbf15ffb640 1 -- 172.21.15.5:0/2238602835 <== mgr.14116 v2:172.21.15.5:6800/1790126649 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7fbf18102cd0 con 0x7fbf08038fc0 2024-09-11T23:19:32.542 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.021+0000 7fbf1f17e640 1 -- 172.21.15.5:0/2238602835 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7fbf08038fc0 msgr2=0x7fbf0803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:32.542 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.021+0000 7fbf1f17e640 1 --2- 172.21.15.5:0/2238602835 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7fbf08038fc0 0x7fbf0803b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbf040098c0 tx=0x7fbf04006db0 comp rx=0 tx=0).stop 2024-09-11T23:19:32.542 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.021+0000 7fbf1f17e640 1 -- 172.21.15.5:0/2238602835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf18107e90 msgr2=0x7fbf1819b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:32.542 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.021+0000 7fbf1f17e640 1 --2- 172.21.15.5:0/2238602835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf18107e90 0x7fbf1819b360 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c032e10 tx=0x7fbf0c032e40 comp rx=0 tx=0).stop 2024-09-11T23:19:32.542 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.022+0000 7fbf1f17e640 1 -- 172.21.15.5:0/2238602835 shutdown_connections 2024-09-11T23:19:32.542 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.022+0000 7fbf1f17e640 1 --2- 172.21.15.5:0/2238602835 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7fbf08038fc0 0x7fbf0803b480 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:32.542 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.022+0000 7fbf1f17e640 1 --2- 172.21.15.5:0/2238602835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf18107e90 0x7fbf1819b360 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:32.542 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.022+0000 7fbf1f17e640 1 -- 172.21.15.5:0/2238602835 >> 172.21.15.5:0/2238602835 conn(0x7fbf18101a90 msgr2=0x7fbf181025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:32.543 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.022+0000 7fbf1f17e640 1 -- 172.21.15.5:0/2238602835 shutdown_connections 2024-09-11T23:19:32.543 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.022+0000 7fbf1f17e640 1 -- 172.21.15.5:0/2238602835 wait complete. 2024-09-11T23:19:32.543 INFO:teuthology.orchestra.run.smithi005.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-11T23:19:32.543 INFO:teuthology.orchestra.run.smithi005.stdout:Adding key to root@localhost authorized_keys... 2024-09-11T23:19:32.543 INFO:teuthology.orchestra.run.smithi005.stdout:Adding host smithi005... 2024-09-11T23:19:33.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:32 smithi005 ceph-mon[31201]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:19:34.150 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:33 smithi005 ceph-mon[31201]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi005", "addr": "172.21.15.5", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:19:35.373 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:35 smithi005 ceph-mon[31201]: Deploying cephadm binary to smithi005 2024-09-11T23:19:37.679 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout Added host 'smithi005' with addr '172.21.15.5' 2024-09-11T23:19:37.680 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.896+0000 7f396c5e3640 1 Processor -- start 2024-09-11T23:19:37.680 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.896+0000 7f396c5e3640 1 -- start start 2024-09-11T23:19:37.680 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.897+0000 7f396c5e3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f396407de60 0x7f396407c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:37.680 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.897+0000 7f396c5e3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f396407c890 con 0x7f396407de60 2024-09-11T23:19:37.680 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.897+0000 7f396a37f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f396407de60 0x7f396407c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:37.680 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.897+0000 7f396a37f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f396407de60 0x7f396407c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53580/0 (socket says 172.21.15.5:53580) 2024-09-11T23:19:37.680 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.897+0000 7f396a37f640 1 -- 172.21.15.5:0/3651890296 learned_addr learned my addr 172.21.15.5:0/3651890296 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:37.680 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.897+0000 7f396a37f640 1 -- 172.21.15.5:0/3651890296 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f396407ca10 con 0x7f396407de60 2024-09-11T23:19:37.680 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.898+0000 7f396a37f640 1 --2- 172.21.15.5:0/3651890296 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f396407de60 0x7f396407c2c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3960009820 tx=0x7f396002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b2bddbfad297227 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:37.680 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.898+0000 7f396937d640 1 -- 172.21.15.5:0/3651890296 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3960037070 con 0x7f396407de60 2024-09-11T23:19:37.681 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.898+0000 7f396937d640 1 -- 172.21.15.5:0/3651890296 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f39600328d0 con 0x7f396407de60 2024-09-11T23:19:37.681 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.898+0000 7f396937d640 1 -- 172.21.15.5:0/3651890296 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39600307d0 con 0x7f396407de60 2024-09-11T23:19:37.681 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.899+0000 7f396c5e3640 1 -- 172.21.15.5:0/3651890296 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f396407de60 msgr2=0x7f396407c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:37.681 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.899+0000 7f396c5e3640 1 --2- 172.21.15.5:0/3651890296 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f396407de60 0x7f396407c2c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3960009820 tx=0x7f396002a270 comp rx=0 tx=0).stop 2024-09-11T23:19:37.681 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.899+0000 7f396c5e3640 1 -- 172.21.15.5:0/3651890296 shutdown_connections 2024-09-11T23:19:37.681 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.899+0000 7f396c5e3640 1 --2- 172.21.15.5:0/3651890296 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f396407de60 0x7f396407c2c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:37.681 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.899+0000 7f396c5e3640 1 -- 172.21.15.5:0/3651890296 >> 172.21.15.5:0/3651890296 conn(0x7f3964102bb0 msgr2=0x7f3964104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:37.681 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.899+0000 7f396c5e3640 1 -- 172.21.15.5:0/3651890296 shutdown_connections 2024-09-11T23:19:37.681 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.899+0000 7f396c5e3640 1 -- 172.21.15.5:0/3651890296 wait complete. 2024-09-11T23:19:37.681 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.900+0000 7f396c5e3640 1 Processor -- start 2024-09-11T23:19:37.681 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.900+0000 7f396c5e3640 1 -- start start 2024-09-11T23:19:37.681 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.900+0000 7f396c5e3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f396407de60 0x7f396419d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:37.682 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.900+0000 7f396c5e3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f396410da10 con 0x7f396407de60 2024-09-11T23:19:37.682 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.900+0000 7f396a37f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f396407de60 0x7f396419d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:37.682 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.900+0000 7f396a37f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f396407de60 0x7f396419d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53596/0 (socket says 172.21.15.5:53596) 2024-09-11T23:19:37.682 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.900+0000 7f396a37f640 1 -- 172.21.15.5:0/1375055485 learned_addr learned my addr 172.21.15.5:0/1375055485 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:37.682 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.900+0000 7f396a37f640 1 -- 172.21.15.5:0/1375055485 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f396419dae0 con 0x7f396407de60 2024-09-11T23:19:37.682 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.900+0000 7f396a37f640 1 --2- 172.21.15.5:0/1375055485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f396407de60 0x7f396419d5a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f39600097f0 tx=0x7f3960030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:37.682 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.901+0000 7f395b7fe640 1 -- 172.21.15.5:0/1375055485 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3960037040 con 0x7f396407de60 2024-09-11T23:19:37.682 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.901+0000 7f395b7fe640 1 -- 172.21.15.5:0/1375055485 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f3960032bb0 con 0x7f396407de60 2024-09-11T23:19:37.682 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.901+0000 7f396c5e3640 1 -- 172.21.15.5:0/1375055485 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f396419dd70 con 0x7f396407de60 2024-09-11T23:19:37.682 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.901+0000 7f395b7fe640 1 -- 172.21.15.5:0/1375055485 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f396003a390 con 0x7f396407de60 2024-09-11T23:19:37.682 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.901+0000 7f396c5e3640 1 -- 172.21.15.5:0/1375055485 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39641a0a60 con 0x7f396407de60 2024-09-11T23:19:37.682 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.902+0000 7f395b7fe640 1 -- 172.21.15.5:0/1375055485 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f396003b3f0 con 0x7f396407de60 2024-09-11T23:19:37.683 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.902+0000 7f396c5e3640 1 -- 172.21.15.5:0/1375055485 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f396407c340 con 0x7f396407de60 2024-09-11T23:19:37.683 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.902+0000 7f395b7fe640 1 --2- 172.21.15.5:0/1375055485 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7f3950038fc0 0x7f395003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:37.683 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.902+0000 7f395b7fe640 1 -- 172.21.15.5:0/1375055485 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f396006c150 con 0x7f396407de60 2024-09-11T23:19:37.683 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.902+0000 7f3969b7e640 1 --2- 172.21.15.5:0/1375055485 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7f3950038fc0 0x7f395003b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:37.683 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.902+0000 7f3969b7e640 1 --2- 172.21.15.5:0/1375055485 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7f3950038fc0 0x7f395003b480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f39540098c0 tx=0x7f3954006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:37.683 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:32.907+0000 7f395b7fe640 1 -- 172.21.15.5:0/1375055485 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3960040210 con 0x7f396407de60 2024-09-11T23:19:37.683 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:33.090+0000 7f396c5e3640 1 -- 172.21.15.5:0/1375055485 --> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi005", "addr": "172.21.15.5", "target": ["mon-mgr", ""]}) -- 0x7f3964103e00 con 0x7f3950038fc0 2024-09-11T23:19:37.683 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:37.022+0000 7f395b7fe640 1 -- 172.21.15.5:0/1375055485 <== mgr.14116 v2:172.21.15.5:6800/1790126649 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7f3964103e00 con 0x7f3950038fc0 2024-09-11T23:19:37.683 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:37.025+0000 7f396c5e3640 1 -- 172.21.15.5:0/1375055485 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7f3950038fc0 msgr2=0x7f395003b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:37.683 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:37.025+0000 7f396c5e3640 1 --2- 172.21.15.5:0/1375055485 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7f3950038fc0 0x7f395003b480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f39540098c0 tx=0x7f3954006db0 comp rx=0 tx=0).stop 2024-09-11T23:19:37.683 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:37.025+0000 7f396c5e3640 1 -- 172.21.15.5:0/1375055485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f396407de60 msgr2=0x7f396419d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:37.683 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:37.025+0000 7f396c5e3640 1 --2- 172.21.15.5:0/1375055485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f396407de60 0x7f396419d5a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f39600097f0 tx=0x7f3960030d00 comp rx=0 tx=0).stop 2024-09-11T23:19:37.684 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:37.025+0000 7f396c5e3640 1 -- 172.21.15.5:0/1375055485 shutdown_connections 2024-09-11T23:19:37.684 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:37.025+0000 7f396c5e3640 1 --2- 172.21.15.5:0/1375055485 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7f3950038fc0 0x7f395003b480 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:37.684 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:37.025+0000 7f396c5e3640 1 --2- 172.21.15.5:0/1375055485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f396407de60 0x7f396419d5a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:37.684 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:37.025+0000 7f396c5e3640 1 -- 172.21.15.5:0/1375055485 >> 172.21.15.5:0/1375055485 conn(0x7f3964102bb0 msgr2=0x7f39641036f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:37.684 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:37.025+0000 7f396c5e3640 1 -- 172.21.15.5:0/1375055485 shutdown_connections 2024-09-11T23:19:37.684 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:37.025+0000 7f396c5e3640 1 -- 172.21.15.5:0/1375055485 wait complete. 2024-09-11T23:19:37.684 INFO:teuthology.orchestra.run.smithi005.stdout:Deploying unmanaged mon service... 2024-09-11T23:19:38.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:38 smithi005 ceph-mon[31201]: from='mgr.14116 172.21.15.5:0/2286605363' entity='mgr.x' 2024-09-11T23:19:38.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:38 smithi005 ceph-mon[31201]: Added host smithi005 2024-09-11T23:19:38.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:38 smithi005 ceph-mon[31201]: from='mgr.14116 172.21.15.5:0/2286605363' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:19:39.029 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-11T23:19:39.030 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.042+0000 7fb8902a0640 1 Processor -- start 2024-09-11T23:19:39.030 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.042+0000 7fb8902a0640 1 -- start start 2024-09-11T23:19:39.030 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.042+0000 7fb8902a0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb888107e90 0x7fb88810a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:39.030 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.042+0000 7fb8902a0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb888075880 con 0x7fb888107e90 2024-09-11T23:19:39.030 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.043+0000 7fb88e03c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb888107e90 0x7fb88810a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:39.030 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.043+0000 7fb88e03c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb888107e90 0x7fb88810a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58444/0 (socket says 172.21.15.5:58444) 2024-09-11T23:19:39.030 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.043+0000 7fb88e03c640 1 -- 172.21.15.5:0/207677894 learned_addr learned my addr 172.21.15.5:0/207677894 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:39.030 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.043+0000 7fb88e03c640 1 -- 172.21.15.5:0/207677894 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb88810a7c0 con 0x7fb888107e90 2024-09-11T23:19:39.030 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.044+0000 7fb88e03c640 1 --2- 172.21.15.5:0/207677894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb888107e90 0x7fb88810a280 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb884009e80 tx=0x7fb88402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48ceb6d2d34fe1a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:39.030 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.044+0000 7fb88d03a640 1 -- 172.21.15.5:0/207677894 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb884036070 con 0x7fb888107e90 2024-09-11T23:19:39.030 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.044+0000 7fb88d03a640 1 -- 172.21.15.5:0/207677894 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fb884031890 con 0x7fb888107e90 2024-09-11T23:19:39.031 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.044+0000 7fb88d03a640 1 -- 172.21.15.5:0/207677894 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb884007980 con 0x7fb888107e90 2024-09-11T23:19:39.031 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.044+0000 7fb8902a0640 1 -- 172.21.15.5:0/207677894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb888107e90 msgr2=0x7fb88810a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:39.031 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.044+0000 7fb8902a0640 1 --2- 172.21.15.5:0/207677894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb888107e90 0x7fb88810a280 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb884009e80 tx=0x7fb88402a7a0 comp rx=0 tx=0).stop 2024-09-11T23:19:39.031 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.045+0000 7fb8902a0640 1 -- 172.21.15.5:0/207677894 shutdown_connections 2024-09-11T23:19:39.031 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.045+0000 7fb8902a0640 1 --2- 172.21.15.5:0/207677894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb888107e90 0x7fb88810a280 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:39.031 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.045+0000 7fb8902a0640 1 -- 172.21.15.5:0/207677894 >> 172.21.15.5:0/207677894 conn(0x7fb888101a90 msgr2=0x7fb888103ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:39.031 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.045+0000 7fb8902a0640 1 -- 172.21.15.5:0/207677894 shutdown_connections 2024-09-11T23:19:39.031 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.045+0000 7fb8902a0640 1 -- 172.21.15.5:0/207677894 wait complete. 2024-09-11T23:19:39.031 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.045+0000 7fb8902a0640 1 Processor -- start 2024-09-11T23:19:39.031 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.045+0000 7fb8902a0640 1 -- start start 2024-09-11T23:19:39.031 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.045+0000 7fb8902a0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb888107e90 0x7fb88819b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:39.031 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.045+0000 7fb8902a0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb88810b800 con 0x7fb888107e90 2024-09-11T23:19:39.031 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.046+0000 7fb88e03c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb888107e90 0x7fb88819b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:39.031 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.046+0000 7fb88e03c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb888107e90 0x7fb88819b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58446/0 (socket says 172.21.15.5:58446) 2024-09-11T23:19:39.032 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.046+0000 7fb88e03c640 1 -- 172.21.15.5:0/416871946 learned_addr learned my addr 172.21.15.5:0/416871946 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:39.032 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.046+0000 7fb88e03c640 1 -- 172.21.15.5:0/416871946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb88819b8a0 con 0x7fb888107e90 2024-09-11T23:19:39.032 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.046+0000 7fb88e03c640 1 --2- 172.21.15.5:0/416871946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb888107e90 0x7fb88819b360 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb884031c70 tx=0x7fb884031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:39.032 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.046+0000 7fb87f7fe640 1 -- 172.21.15.5:0/416871946 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb884041020 con 0x7fb888107e90 2024-09-11T23:19:39.032 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.046+0000 7fb87f7fe640 1 -- 172.21.15.5:0/416871946 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fb88403c900 con 0x7fb888107e90 2024-09-11T23:19:39.032 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.046+0000 7fb8902a0640 1 -- 172.21.15.5:0/416871946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb88819bb30 con 0x7fb888107e90 2024-09-11T23:19:39.032 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.046+0000 7fb87f7fe640 1 -- 172.21.15.5:0/416871946 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb884036040 con 0x7fb888107e90 2024-09-11T23:19:39.032 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.046+0000 7fb8902a0640 1 -- 172.21.15.5:0/416871946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb88819e820 con 0x7fb888107e90 2024-09-11T23:19:39.032 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.047+0000 7fb87f7fe640 1 -- 172.21.15.5:0/416871946 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fb884044020 con 0x7fb888107e90 2024-09-11T23:19:39.032 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.047+0000 7fb8902a0640 1 -- 172.21.15.5:0/416871946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8881082f0 con 0x7fb888107e90 2024-09-11T23:19:39.032 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.047+0000 7fb87f7fe640 1 --2- 172.21.15.5:0/416871946 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7fb874038fc0 0x7fb87403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:39.032 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.047+0000 7fb87f7fe640 1 -- 172.21.15.5:0/416871946 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb88406d540 con 0x7fb888107e90 2024-09-11T23:19:39.032 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.047+0000 7fb88d83b640 1 --2- 172.21.15.5:0/416871946 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7fb874038fc0 0x7fb87403b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:39.032 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.048+0000 7fb88d83b640 1 --2- 172.21.15.5:0/416871946 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7fb874038fc0 0x7fb87403b480 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb8780098c0 tx=0x7fb878006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:39.033 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.052+0000 7fb87f7fe640 1 -- 172.21.15.5:0/416871946 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb88404b020 con 0x7fb888107e90 2024-09-11T23:19:39.033 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.244+0000 7fb8902a0640 1 -- 172.21.15.5:0/416871946 --> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fb888102cd0 con 0x7fb874038fc0 2024-09-11T23:19:39.033 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.248+0000 7fb87f7fe640 1 -- 172.21.15.5:0/416871946 <== mgr.14116 v2:172.21.15.5:6800/1790126649 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fb888102cd0 con 0x7fb874038fc0 2024-09-11T23:19:39.033 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.250+0000 7fb8902a0640 1 -- 172.21.15.5:0/416871946 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7fb874038fc0 msgr2=0x7fb87403b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:39.033 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.250+0000 7fb8902a0640 1 --2- 172.21.15.5:0/416871946 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7fb874038fc0 0x7fb87403b480 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb8780098c0 tx=0x7fb878006db0 comp rx=0 tx=0).stop 2024-09-11T23:19:39.033 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.250+0000 7fb8902a0640 1 -- 172.21.15.5:0/416871946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb888107e90 msgr2=0x7fb88819b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:39.033 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.250+0000 7fb8902a0640 1 --2- 172.21.15.5:0/416871946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb888107e90 0x7fb88819b360 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb884031c70 tx=0x7fb884031ca0 comp rx=0 tx=0).stop 2024-09-11T23:19:39.033 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.250+0000 7fb8902a0640 1 -- 172.21.15.5:0/416871946 shutdown_connections 2024-09-11T23:19:39.033 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.250+0000 7fb8902a0640 1 --2- 172.21.15.5:0/416871946 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7fb874038fc0 0x7fb87403b480 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:39.033 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.250+0000 7fb8902a0640 1 --2- 172.21.15.5:0/416871946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb888107e90 0x7fb88819b360 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:39.033 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.251+0000 7fb8902a0640 1 -- 172.21.15.5:0/416871946 >> 172.21.15.5:0/416871946 conn(0x7fb888101a90 msgr2=0x7fb8881025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:39.033 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.251+0000 7fb8902a0640 1 -- 172.21.15.5:0/416871946 shutdown_connections 2024-09-11T23:19:39.033 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:38.251+0000 7fb8902a0640 1 -- 172.21.15.5:0/416871946 wait complete. 2024-09-11T23:19:39.034 INFO:teuthology.orchestra.run.smithi005.stdout:Deploying unmanaged mgr service... 2024-09-11T23:19:39.601 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:39 smithi005 ceph-mon[31201]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:19:39.601 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:39 smithi005 ceph-mon[31201]: Saving service mon spec with placement count:5 2024-09-11T23:19:39.601 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:39 smithi005 ceph-mon[31201]: from='mgr.14116 172.21.15.5:0/2286605363' entity='mgr.x' 2024-09-11T23:19:40.902 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:40 smithi005 ceph-mon[31201]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:19:40.902 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:40 smithi005 ceph-mon[31201]: Saving service mgr spec with placement count:2 2024-09-11T23:19:40.902 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:40 smithi005 ceph-mon[31201]: from='mgr.14116 172.21.15.5:0/2286605363' entity='mgr.x' 2024-09-11T23:19:41.027 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-11T23:19:41.027 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.446+0000 7fc7d8fd5640 1 Processor -- start 2024-09-11T23:19:41.027 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.446+0000 7fc7d8fd5640 1 -- start start 2024-09-11T23:19:41.027 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.446+0000 7fc7d8fd5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7d407de40 0x7fc7d407c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:41.027 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.446+0000 7fc7d8fd5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d407c870 con 0x7fc7d407de40 2024-09-11T23:19:41.027 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.446+0000 7fc7d259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7d407de40 0x7fc7d407c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:41.028 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.446+0000 7fc7d259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7d407de40 0x7fc7d407c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58456/0 (socket says 172.21.15.5:58456) 2024-09-11T23:19:41.028 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.446+0000 7fc7d259c640 1 -- 172.21.15.5:0/2897685682 learned_addr learned my addr 172.21.15.5:0/2897685682 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:41.028 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.447+0000 7fc7d259c640 1 -- 172.21.15.5:0/2897685682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7d407c9f0 con 0x7fc7d407de40 2024-09-11T23:19:41.028 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.447+0000 7fc7d259c640 1 --2- 172.21.15.5:0/2897685682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7d407de40 0x7fc7d407c2a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4009820 tx=0x7fc7c402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1695ae431fabbab server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:41.028 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.447+0000 7fc7d1d9b640 1 -- 172.21.15.5:0/2897685682 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7c4037070 con 0x7fc7d407de40 2024-09-11T23:19:41.028 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.448+0000 7fc7d1d9b640 1 -- 172.21.15.5:0/2897685682 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fc7c40328d0 con 0x7fc7d407de40 2024-09-11T23:19:41.028 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.448+0000 7fc7d1d9b640 1 -- 172.21.15.5:0/2897685682 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7c40307d0 con 0x7fc7d407de40 2024-09-11T23:19:41.028 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.448+0000 7fc7d8fd5640 1 -- 172.21.15.5:0/2897685682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7d407de40 msgr2=0x7fc7d407c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:41.028 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.448+0000 7fc7d8fd5640 1 --2- 172.21.15.5:0/2897685682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7d407de40 0x7fc7d407c2a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4009820 tx=0x7fc7c402a270 comp rx=0 tx=0).stop 2024-09-11T23:19:41.028 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.448+0000 7fc7d8fd5640 1 -- 172.21.15.5:0/2897685682 shutdown_connections 2024-09-11T23:19:41.028 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.448+0000 7fc7d8fd5640 1 --2- 172.21.15.5:0/2897685682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7d407de40 0x7fc7d407c2a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:41.028 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.448+0000 7fc7d8fd5640 1 -- 172.21.15.5:0/2897685682 >> 172.21.15.5:0/2897685682 conn(0x7fc7d4102bb0 msgr2=0x7fc7d4104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:41.028 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.448+0000 7fc7d8fd5640 1 -- 172.21.15.5:0/2897685682 shutdown_connections 2024-09-11T23:19:41.029 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.448+0000 7fc7d8fd5640 1 -- 172.21.15.5:0/2897685682 wait complete. 2024-09-11T23:19:41.029 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.449+0000 7fc7d8fd5640 1 Processor -- start 2024-09-11T23:19:41.029 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.449+0000 7fc7d8fd5640 1 -- start start 2024-09-11T23:19:41.029 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.449+0000 7fc7d8fd5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7d407de40 0x7fc7d419d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:41.029 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.449+0000 7fc7d8fd5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d410da30 con 0x7fc7d407de40 2024-09-11T23:19:41.029 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.449+0000 7fc7d259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7d407de40 0x7fc7d419d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:41.029 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.449+0000 7fc7d259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7d407de40 0x7fc7d419d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58470/0 (socket says 172.21.15.5:58470) 2024-09-11T23:19:41.029 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.449+0000 7fc7d259c640 1 -- 172.21.15.5:0/3938297460 learned_addr learned my addr 172.21.15.5:0/3938297460 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:41.029 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.450+0000 7fc7d259c640 1 -- 172.21.15.5:0/3938297460 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7d419daa0 con 0x7fc7d407de40 2024-09-11T23:19:41.030 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.450+0000 7fc7d259c640 1 --2- 172.21.15.5:0/3938297460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7d407de40 0x7fc7d419d560 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4032e10 tx=0x7fc7c4032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:41.030 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.450+0000 7fc7cb7fe640 1 -- 172.21.15.5:0/3938297460 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7c4042070 con 0x7fc7d407de40 2024-09-11T23:19:41.030 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.450+0000 7fc7d8fd5640 1 -- 172.21.15.5:0/3938297460 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7d419dd30 con 0x7fc7d407de40 2024-09-11T23:19:41.030 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.450+0000 7fc7cb7fe640 1 -- 172.21.15.5:0/3938297460 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fc7c4030c80 con 0x7fc7d407de40 2024-09-11T23:19:41.030 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.450+0000 7fc7cb7fe640 1 -- 172.21.15.5:0/3938297460 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7c4037040 con 0x7fc7d407de40 2024-09-11T23:19:41.030 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.450+0000 7fc7d8fd5640 1 -- 172.21.15.5:0/3938297460 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7d41a0a20 con 0x7fc7d407de40 2024-09-11T23:19:41.030 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.451+0000 7fc7cb7fe640 1 -- 172.21.15.5:0/3938297460 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fc7c4045070 con 0x7fc7d407de40 2024-09-11T23:19:41.030 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.451+0000 7fc7d8fd5640 1 -- 172.21.15.5:0/3938297460 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7d407c320 con 0x7fc7d407de40 2024-09-11T23:19:41.030 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.451+0000 7fc7cb7fe640 1 --2- 172.21.15.5:0/3938297460 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7fc7c0038f70 0x7fc7c003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:41.030 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.451+0000 7fc7cb7fe640 1 -- 172.21.15.5:0/3938297460 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc7c406c070 con 0x7fc7d407de40 2024-09-11T23:19:41.031 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.452+0000 7fc7cbfff640 1 --2- 172.21.15.5:0/3938297460 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7fc7c0038f70 0x7fc7c003b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:41.031 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.452+0000 7fc7cbfff640 1 --2- 172.21.15.5:0/3938297460 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7fc7c0038f70 0x7fc7c003b430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc0098c0 tx=0x7fc7bc006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:41.031 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.456+0000 7fc7cb7fe640 1 -- 172.21.15.5:0/3938297460 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc7c4045360 con 0x7fc7d407de40 2024-09-11T23:19:41.031 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.647+0000 7fc7d8fd5640 1 -- 172.21.15.5:0/3938297460 --> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fc7d4103e00 con 0x7fc7c0038f70 2024-09-11T23:19:41.031 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.651+0000 7fc7cb7fe640 1 -- 172.21.15.5:0/3938297460 <== mgr.14116 v2:172.21.15.5:6800/1790126649 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fc7d4103e00 con 0x7fc7c0038f70 2024-09-11T23:19:41.031 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.653+0000 7fc7d8fd5640 1 -- 172.21.15.5:0/3938297460 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7fc7c0038f70 msgr2=0x7fc7c003b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:41.031 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.653+0000 7fc7d8fd5640 1 --2- 172.21.15.5:0/3938297460 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7fc7c0038f70 0x7fc7c003b430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc0098c0 tx=0x7fc7bc006db0 comp rx=0 tx=0).stop 2024-09-11T23:19:41.031 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.653+0000 7fc7d8fd5640 1 -- 172.21.15.5:0/3938297460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7d407de40 msgr2=0x7fc7d419d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:41.031 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.653+0000 7fc7d8fd5640 1 --2- 172.21.15.5:0/3938297460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7d407de40 0x7fc7d419d560 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4032e10 tx=0x7fc7c4032e40 comp rx=0 tx=0).stop 2024-09-11T23:19:41.031 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.654+0000 7fc7d8fd5640 1 -- 172.21.15.5:0/3938297460 shutdown_connections 2024-09-11T23:19:41.031 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.654+0000 7fc7d8fd5640 1 --2- 172.21.15.5:0/3938297460 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7fc7c0038f70 0x7fc7c003b430 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:41.031 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.654+0000 7fc7d8fd5640 1 --2- 172.21.15.5:0/3938297460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7d407de40 0x7fc7d419d560 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:41.031 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.654+0000 7fc7d8fd5640 1 -- 172.21.15.5:0/3938297460 >> 172.21.15.5:0/3938297460 conn(0x7fc7d4102bb0 msgr2=0x7fc7d41036f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:41.032 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.654+0000 7fc7d8fd5640 1 -- 172.21.15.5:0/3938297460 shutdown_connections 2024-09-11T23:19:41.032 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:39.654+0000 7fc7d8fd5640 1 -- 172.21.15.5:0/3938297460 wait complete. 2024-09-11T23:19:42.166 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.474+0000 7f8f86146640 1 Processor -- start 2024-09-11T23:19:42.167 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.474+0000 7f8f86146640 1 -- start start 2024-09-11T23:19:42.167 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.474+0000 7f8f86146640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f80107f70 0x7f8f8010a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:42.167 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.474+0000 7f8f86146640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8f800757a0 con 0x7f8f80107f70 2024-09-11T23:19:42.167 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.474+0000 7f8f7f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f80107f70 0x7f8f8010a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:42.167 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.474+0000 7f8f7f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f80107f70 0x7f8f8010a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58486/0 (socket says 172.21.15.5:58486) 2024-09-11T23:19:42.167 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.474+0000 7f8f7f7fe640 1 -- 172.21.15.5:0/1107239665 learned_addr learned my addr 172.21.15.5:0/1107239665 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:42.167 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.475+0000 7f8f7f7fe640 1 -- 172.21.15.5:0/1107239665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f8010a8a0 con 0x7f8f80107f70 2024-09-11T23:19:42.167 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.475+0000 7f8f7f7fe640 1 --2- 172.21.15.5:0/1107239665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f80107f70 0x7f8f8010a360 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8f70009820 tx=0x7f8f7002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62ade4ef026c278d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:42.167 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.475+0000 7f8f7effd640 1 -- 172.21.15.5:0/1107239665 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f70037070 con 0x7f8f80107f70 2024-09-11T23:19:42.167 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.475+0000 7f8f7effd640 1 -- 172.21.15.5:0/1107239665 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8f700328f0 con 0x7f8f80107f70 2024-09-11T23:19:42.167 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.476+0000 7f8f7effd640 1 -- 172.21.15.5:0/1107239665 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f70030740 con 0x7f8f80107f70 2024-09-11T23:19:42.167 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.476+0000 7f8f86146640 1 -- 172.21.15.5:0/1107239665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f80107f70 msgr2=0x7f8f8010a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:42.168 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.476+0000 7f8f86146640 1 --2- 172.21.15.5:0/1107239665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f80107f70 0x7f8f8010a360 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8f70009820 tx=0x7f8f7002a270 comp rx=0 tx=0).stop 2024-09-11T23:19:42.168 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.476+0000 7f8f86146640 1 -- 172.21.15.5:0/1107239665 shutdown_connections 2024-09-11T23:19:42.168 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.476+0000 7f8f86146640 1 --2- 172.21.15.5:0/1107239665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f80107f70 0x7f8f8010a360 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:42.168 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.476+0000 7f8f86146640 1 -- 172.21.15.5:0/1107239665 >> 172.21.15.5:0/1107239665 conn(0x7f8f80101a90 msgr2=0x7f8f80103ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:42.168 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.477+0000 7f8f86146640 1 -- 172.21.15.5:0/1107239665 shutdown_connections 2024-09-11T23:19:42.168 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.477+0000 7f8f86146640 1 -- 172.21.15.5:0/1107239665 wait complete. 2024-09-11T23:19:42.168 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.477+0000 7f8f86146640 1 Processor -- start 2024-09-11T23:19:42.168 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.477+0000 7f8f86146640 1 -- start start 2024-09-11T23:19:42.168 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.477+0000 7f8f86146640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f80107f70 0x7f8f8019d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:42.168 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.477+0000 7f8f86146640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8f8010b800 con 0x7f8f80107f70 2024-09-11T23:19:42.168 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.478+0000 7f8f7f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f80107f70 0x7f8f8019d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:42.168 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.478+0000 7f8f7f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f80107f70 0x7f8f8019d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58494/0 (socket says 172.21.15.5:58494) 2024-09-11T23:19:42.168 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.478+0000 7f8f7f7fe640 1 -- 172.21.15.5:0/2713114605 learned_addr learned my addr 172.21.15.5:0/2713114605 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:42.168 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.478+0000 7f8f7f7fe640 1 -- 172.21.15.5:0/2713114605 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f8019db20 con 0x7f8f80107f70 2024-09-11T23:19:42.169 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.478+0000 7f8f7f7fe640 1 --2- 172.21.15.5:0/2713114605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f80107f70 0x7f8f8019d5e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8f70030cc0 tx=0x7f8f70030cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:42.169 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.478+0000 7f8f7d7fa640 1 -- 172.21.15.5:0/2713114605 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f70042070 con 0x7f8f80107f70 2024-09-11T23:19:42.169 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.478+0000 7f8f7d7fa640 1 -- 172.21.15.5:0/2713114605 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8f70030e60 con 0x7f8f80107f70 2024-09-11T23:19:42.169 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.478+0000 7f8f86146640 1 -- 172.21.15.5:0/2713114605 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f8019ddb0 con 0x7f8f80107f70 2024-09-11T23:19:42.169 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.478+0000 7f8f7d7fa640 1 -- 172.21.15.5:0/2713114605 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f70037040 con 0x7f8f80107f70 2024-09-11T23:19:42.169 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.478+0000 7f8f86146640 1 -- 172.21.15.5:0/2713114605 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f801a0aa0 con 0x7f8f80107f70 2024-09-11T23:19:42.169 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.479+0000 7f8f7d7fa640 1 -- 172.21.15.5:0/2713114605 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f8f70045070 con 0x7f8f80107f70 2024-09-11T23:19:42.169 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.480+0000 7f8f86146640 1 -- 172.21.15.5:0/2713114605 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f801083d0 con 0x7f8f80107f70 2024-09-11T23:19:42.169 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.480+0000 7f8f7d7fa640 1 --2- 172.21.15.5:0/2713114605 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7f8f6c038f70 0x7f8f6c03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:42.169 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.480+0000 7f8f7d7fa640 1 -- 172.21.15.5:0/2713114605 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f8f7006c080 con 0x7f8f80107f70 2024-09-11T23:19:42.169 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.480+0000 7f8f77fff640 1 --2- 172.21.15.5:0/2713114605 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7f8f6c038f70 0x7f8f6c03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:42.169 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.480+0000 7f8f77fff640 1 --2- 172.21.15.5:0/2713114605 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7f8f6c038f70 0x7f8f6c03b430 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8f680098c0 tx=0x7f8f68006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:42.169 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.485+0000 7f8f7d7fa640 1 -- 172.21.15.5:0/2713114605 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8f70045360 con 0x7f8f80107f70 2024-09-11T23:19:42.169 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.668+0000 7f8f86146640 1 -- 172.21.15.5:0/2713114605 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f8f801a1090 con 0x7f8f80107f70 2024-09-11T23:19:42.170 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.671+0000 7f8f7d7fa640 1 -- 172.21.15.5:0/2713114605 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f8f7002ed90 con 0x7f8f80107f70 2024-09-11T23:19:42.170 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.673+0000 7f8f86146640 1 -- 172.21.15.5:0/2713114605 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7f8f6c038f70 msgr2=0x7f8f6c03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:42.170 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.673+0000 7f8f86146640 1 --2- 172.21.15.5:0/2713114605 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7f8f6c038f70 0x7f8f6c03b430 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8f680098c0 tx=0x7f8f68006db0 comp rx=0 tx=0).stop 2024-09-11T23:19:42.170 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.673+0000 7f8f86146640 1 -- 172.21.15.5:0/2713114605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f80107f70 msgr2=0x7f8f8019d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:42.170 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.673+0000 7f8f86146640 1 --2- 172.21.15.5:0/2713114605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f80107f70 0x7f8f8019d5e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8f70030cc0 tx=0x7f8f70030cf0 comp rx=0 tx=0).stop 2024-09-11T23:19:42.170 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.674+0000 7f8f86146640 1 -- 172.21.15.5:0/2713114605 shutdown_connections 2024-09-11T23:19:42.170 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.674+0000 7f8f86146640 1 --2- 172.21.15.5:0/2713114605 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7f8f6c038f70 0x7f8f6c03b430 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:42.170 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.674+0000 7f8f86146640 1 --2- 172.21.15.5:0/2713114605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f80107f70 0x7f8f8019d5e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:42.170 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.674+0000 7f8f86146640 1 -- 172.21.15.5:0/2713114605 >> 172.21.15.5:0/2713114605 conn(0x7f8f80101a90 msgr2=0x7f8f801025b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:42.170 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.674+0000 7f8f86146640 1 -- 172.21.15.5:0/2713114605 shutdown_connections 2024-09-11T23:19:42.170 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:41.674+0000 7f8f86146640 1 -- 172.21.15.5:0/2713114605 wait complete. 2024-09-11T23:19:42.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:41 smithi005 ceph-mon[31201]: from='mgr.14116 172.21.15.5:0/2286605363' entity='mgr.x' 2024-09-11T23:19:42.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:41 smithi005 ceph-mon[31201]: from='mgr.14116 172.21.15.5:0/2286605363' entity='mgr.x' 2024-09-11T23:19:42.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:41 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/2713114605' entity='client.admin' 2024-09-11T23:19:43.909 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.762+0000 7f29f23bc640 1 Processor -- start 2024-09-11T23:19:43.910 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.762+0000 7f29f23bc640 1 -- start start 2024-09-11T23:19:43.910 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.762+0000 7f29f23bc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29ec107420 0x7f29ec107820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:43.910 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.762+0000 7f29f23bc640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f29ec107df0 con 0x7f29ec107420 2024-09-11T23:19:43.910 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.762+0000 7f29ebfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29ec107420 0x7f29ec107820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:43.910 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.762+0000 7f29ebfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29ec107420 0x7f29ec107820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58496/0 (socket says 172.21.15.5:58496) 2024-09-11T23:19:43.910 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.762+0000 7f29ebfff640 1 -- 172.21.15.5:0/3301871061 learned_addr learned my addr 172.21.15.5:0/3301871061 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:43.910 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.763+0000 7f29ebfff640 1 -- 172.21.15.5:0/3301871061 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29ec108620 con 0x7f29ec107420 2024-09-11T23:19:43.910 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.763+0000 7f29ebfff640 1 --2- 172.21.15.5:0/3301871061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29ec107420 0x7f29ec107820 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f29dc009820 tx=0x7f29dc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=257ddb97bdc0aa0c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:43.910 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.763+0000 7f29eaffd640 1 -- 172.21.15.5:0/3301871061 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29dc037070 con 0x7f29ec107420 2024-09-11T23:19:43.910 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.763+0000 7f29eaffd640 1 -- 172.21.15.5:0/3301871061 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f29dc0328f0 con 0x7f29ec107420 2024-09-11T23:19:43.911 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.763+0000 7f29eaffd640 1 -- 172.21.15.5:0/3301871061 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29dc030740 con 0x7f29ec107420 2024-09-11T23:19:43.911 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.764+0000 7f29f23bc640 1 -- 172.21.15.5:0/3301871061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29ec107420 msgr2=0x7f29ec107820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:43.911 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.764+0000 7f29f23bc640 1 --2- 172.21.15.5:0/3301871061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29ec107420 0x7f29ec107820 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f29dc009820 tx=0x7f29dc02a270 comp rx=0 tx=0).stop 2024-09-11T23:19:43.911 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.764+0000 7f29f23bc640 1 -- 172.21.15.5:0/3301871061 shutdown_connections 2024-09-11T23:19:43.911 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.764+0000 7f29f23bc640 1 --2- 172.21.15.5:0/3301871061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29ec107420 0x7f29ec107820 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:43.911 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.764+0000 7f29f23bc640 1 -- 172.21.15.5:0/3301871061 >> 172.21.15.5:0/3301871061 conn(0x7f29ec102bb0 msgr2=0x7f29ec104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:43.911 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.764+0000 7f29f23bc640 1 -- 172.21.15.5:0/3301871061 shutdown_connections 2024-09-11T23:19:43.911 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.764+0000 7f29f23bc640 1 -- 172.21.15.5:0/3301871061 wait complete. 2024-09-11T23:19:43.911 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.765+0000 7f29f23bc640 1 Processor -- start 2024-09-11T23:19:43.911 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.765+0000 7f29f23bc640 1 -- start start 2024-09-11T23:19:43.911 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.765+0000 7f29f23bc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29ec107420 0x7f29ec19b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:43.911 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.765+0000 7f29f23bc640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f29ec10b9d0 con 0x7f29ec107420 2024-09-11T23:19:43.911 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.765+0000 7f29ebfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29ec107420 0x7f29ec19b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:43.911 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.765+0000 7f29ebfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29ec107420 0x7f29ec19b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58500/0 (socket says 172.21.15.5:58500) 2024-09-11T23:19:43.912 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.765+0000 7f29ebfff640 1 -- 172.21.15.5:0/3153900826 learned_addr learned my addr 172.21.15.5:0/3153900826 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:43.912 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.765+0000 7f29ebfff640 1 -- 172.21.15.5:0/3153900826 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29ec19b900 con 0x7f29ec107420 2024-09-11T23:19:43.912 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.766+0000 7f29ebfff640 1 --2- 172.21.15.5:0/3153900826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29ec107420 0x7f29ec19b3c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f29dc0097f0 tx=0x7f29dc030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:43.912 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.766+0000 7f29e97fa640 1 -- 172.21.15.5:0/3153900826 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29dc042070 con 0x7f29ec107420 2024-09-11T23:19:43.912 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.766+0000 7f29e97fa640 1 -- 172.21.15.5:0/3153900826 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f29dc030d80 con 0x7f29ec107420 2024-09-11T23:19:43.912 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.766+0000 7f29f23bc640 1 -- 172.21.15.5:0/3153900826 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29ec19bb90 con 0x7f29ec107420 2024-09-11T23:19:43.912 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.766+0000 7f29e97fa640 1 -- 172.21.15.5:0/3153900826 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29dc037040 con 0x7f29ec107420 2024-09-11T23:19:43.912 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.766+0000 7f29f23bc640 1 -- 172.21.15.5:0/3153900826 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29ec19e880 con 0x7f29ec107420 2024-09-11T23:19:43.912 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.767+0000 7f29e97fa640 1 -- 172.21.15.5:0/3153900826 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f29dc045070 con 0x7f29ec107420 2024-09-11T23:19:43.912 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.767+0000 7f29f23bc640 1 -- 172.21.15.5:0/3153900826 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29ec10bb50 con 0x7f29ec107420 2024-09-11T23:19:43.912 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.767+0000 7f29e97fa640 1 --2- 172.21.15.5:0/3153900826 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7f29d4038fc0 0x7f29d403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:43.912 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.767+0000 7f29e97fa640 1 -- 172.21.15.5:0/3153900826 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f29dc06c000 con 0x7f29ec107420 2024-09-11T23:19:43.912 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.767+0000 7f29eb7fe640 1 --2- 172.21.15.5:0/3153900826 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7f29d4038fc0 0x7f29d403b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:43.913 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.768+0000 7f29eb7fe640 1 --2- 172.21.15.5:0/3153900826 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7f29d4038fc0 0x7f29d403b480 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f29e00098c0 tx=0x7f29e0006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:43.913 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.772+0000 7f29e97fa640 1 -- 172.21.15.5:0/3153900826 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f29dc045520 con 0x7f29ec107420 2024-09-11T23:19:43.913 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.947+0000 7f29f23bc640 1 -- 172.21.15.5:0/3153900826 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f29ec1078a0 con 0x7f29ec107420 2024-09-11T23:19:43.913 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.949+0000 7f29e97fa640 1 -- 172.21.15.5:0/3153900826 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f29dc03add0 con 0x7f29ec107420 2024-09-11T23:19:43.913 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.951+0000 7f29f23bc640 1 -- 172.21.15.5:0/3153900826 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7f29d4038fc0 msgr2=0x7f29d403b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:43.913 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.951+0000 7f29f23bc640 1 --2- 172.21.15.5:0/3153900826 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7f29d4038fc0 0x7f29d403b480 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f29e00098c0 tx=0x7f29e0006db0 comp rx=0 tx=0).stop 2024-09-11T23:19:43.913 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.951+0000 7f29f23bc640 1 -- 172.21.15.5:0/3153900826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29ec107420 msgr2=0x7f29ec19b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:43.913 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.951+0000 7f29f23bc640 1 --2- 172.21.15.5:0/3153900826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29ec107420 0x7f29ec19b3c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f29dc0097f0 tx=0x7f29dc030c70 comp rx=0 tx=0).stop 2024-09-11T23:19:43.913 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.951+0000 7f29f23bc640 1 -- 172.21.15.5:0/3153900826 shutdown_connections 2024-09-11T23:19:43.913 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.951+0000 7f29f23bc640 1 --2- 172.21.15.5:0/3153900826 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7f29d4038fc0 0x7f29d403b480 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:43.913 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.951+0000 7f29f23bc640 1 --2- 172.21.15.5:0/3153900826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29ec107420 0x7f29ec19b3c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:43.913 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.951+0000 7f29f23bc640 1 -- 172.21.15.5:0/3153900826 >> 172.21.15.5:0/3153900826 conn(0x7f29ec102bb0 msgr2=0x7f29ec1036e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:43.913 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.952+0000 7f29f23bc640 1 -- 172.21.15.5:0/3153900826 shutdown_connections 2024-09-11T23:19:43.914 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:42.952+0000 7f29f23bc640 1 -- 172.21.15.5:0/3153900826 wait complete. 2024-09-11T23:19:43.914 INFO:teuthology.orchestra.run.smithi005.stdout:Enabling the dashboard module... 2024-09-11T23:19:44.170 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:43 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/3153900826' entity='client.admin' 2024-09-11T23:19:44.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:43 smithi005 ceph-mon[31201]: from='mgr.14116 172.21.15.5:0/2286605363' entity='mgr.x' 2024-09-11T23:19:45.151 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:44 smithi005 ceph-mon[31201]: from='mgr.14116 172.21.15.5:0/2286605363' entity='mgr.x' 2024-09-11T23:19:45.151 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:44 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/1987209782' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-11T23:19:45.152 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:45 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: ignoring --setuser ceph since I am not root 2024-09-11T23:19:45.152 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:45 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: ignoring --setgroup ceph since I am not root 2024-09-11T23:19:45.152 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:45 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:45.112+0000 7fd61060d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T23:19:45.474 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:45 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:45.172+0000 7fd61060d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T23:19:45.474 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:45 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:45.326+0000 7fd61060d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T23:19:45.474 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:45 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:45.397+0000 7fd61060d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T23:19:45.726 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.363+0000 7f243c45f640 1 Processor -- start 2024-09-11T23:19:45.731 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.363+0000 7f243c45f640 1 -- start start 2024-09-11T23:19:45.732 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.363+0000 7f243c45f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2434107420 0x7f2434107820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:45.732 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.363+0000 7f243c45f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2434107df0 con 0x7f2434107420 2024-09-11T23:19:45.732 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.363+0000 7f243a1fb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2434107420 0x7f2434107820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:45.732 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.363+0000 7f243a1fb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2434107420 0x7f2434107820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51182/0 (socket says 172.21.15.5:51182) 2024-09-11T23:19:45.732 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.363+0000 7f243a1fb640 1 -- 172.21.15.5:0/1166877527 learned_addr learned my addr 172.21.15.5:0/1166877527 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:45.732 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.364+0000 7f243a1fb640 1 -- 172.21.15.5:0/1166877527 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2434108620 con 0x7f2434107420 2024-09-11T23:19:45.732 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.364+0000 7f243a1fb640 1 --2- 172.21.15.5:0/1166877527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2434107420 0x7f2434107820 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2430009820 tx=0x7f243002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5491fa69a557bc57 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:45.732 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.364+0000 7f24391f9640 1 -- 172.21.15.5:0/1166877527 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2430037070 con 0x7f2434107420 2024-09-11T23:19:45.733 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.364+0000 7f24391f9640 1 -- 172.21.15.5:0/1166877527 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f24300328f0 con 0x7f2434107420 2024-09-11T23:19:45.733 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.364+0000 7f24391f9640 1 -- 172.21.15.5:0/1166877527 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2430030740 con 0x7f2434107420 2024-09-11T23:19:45.733 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.365+0000 7f243c45f640 1 -- 172.21.15.5:0/1166877527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2434107420 msgr2=0x7f2434107820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:45.733 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.365+0000 7f243c45f640 1 --2- 172.21.15.5:0/1166877527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2434107420 0x7f2434107820 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2430009820 tx=0x7f243002a270 comp rx=0 tx=0).stop 2024-09-11T23:19:45.733 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.365+0000 7f243c45f640 1 -- 172.21.15.5:0/1166877527 shutdown_connections 2024-09-11T23:19:45.733 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.365+0000 7f243c45f640 1 --2- 172.21.15.5:0/1166877527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2434107420 0x7f2434107820 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:45.733 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.365+0000 7f243c45f640 1 -- 172.21.15.5:0/1166877527 >> 172.21.15.5:0/1166877527 conn(0x7f2434102bb0 msgr2=0x7f2434104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:45.733 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.365+0000 7f243c45f640 1 -- 172.21.15.5:0/1166877527 shutdown_connections 2024-09-11T23:19:45.733 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.365+0000 7f243c45f640 1 -- 172.21.15.5:0/1166877527 wait complete. 2024-09-11T23:19:45.733 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.366+0000 7f243c45f640 1 Processor -- start 2024-09-11T23:19:45.733 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.366+0000 7f243c45f640 1 -- start start 2024-09-11T23:19:45.733 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.366+0000 7f243c45f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2434107420 0x7f243419d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:45.734 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.366+0000 7f243c45f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f243410b9d0 con 0x7f2434107420 2024-09-11T23:19:45.734 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.366+0000 7f243a1fb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2434107420 0x7f243419d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:45.734 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.366+0000 7f243a1fb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2434107420 0x7f243419d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51192/0 (socket says 172.21.15.5:51192) 2024-09-11T23:19:45.734 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.366+0000 7f243a1fb640 1 -- 172.21.15.5:0/1987209782 learned_addr learned my addr 172.21.15.5:0/1987209782 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:45.734 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.366+0000 7f243a1fb640 1 -- 172.21.15.5:0/1987209782 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f243419db20 con 0x7f2434107420 2024-09-11T23:19:45.734 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.367+0000 7f243a1fb640 1 --2- 172.21.15.5:0/1987209782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2434107420 0x7f243419d5e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2430009940 tx=0x7f2430030cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:45.734 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.367+0000 7f242b7fe640 1 -- 172.21.15.5:0/1987209782 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2430042070 con 0x7f2434107420 2024-09-11T23:19:45.734 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.367+0000 7f242b7fe640 1 -- 172.21.15.5:0/1987209782 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2430030e30 con 0x7f2434107420 2024-09-11T23:19:45.734 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.367+0000 7f243c45f640 1 -- 172.21.15.5:0/1987209782 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f243419ddb0 con 0x7f2434107420 2024-09-11T23:19:45.734 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.367+0000 7f242b7fe640 1 -- 172.21.15.5:0/1987209782 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2430037040 con 0x7f2434107420 2024-09-11T23:19:45.734 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.367+0000 7f243c45f640 1 -- 172.21.15.5:0/1987209782 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24341a0aa0 con 0x7f2434107420 2024-09-11T23:19:45.734 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.368+0000 7f242b7fe640 1 -- 172.21.15.5:0/1987209782 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f2430045070 con 0x7f2434107420 2024-09-11T23:19:45.734 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.368+0000 7f242b7fe640 1 --2- 172.21.15.5:0/1987209782 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7f2420038fc0 0x7f242003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:45.735 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.368+0000 7f243c45f640 1 -- 172.21.15.5:0/1987209782 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f243410bb50 con 0x7f2434107420 2024-09-11T23:19:45.735 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.368+0000 7f242b7fe640 1 -- 172.21.15.5:0/1987209782 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f243006c130 con 0x7f2434107420 2024-09-11T23:19:45.735 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.368+0000 7f24399fa640 1 --2- 172.21.15.5:0/1987209782 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7f2420038fc0 0x7f242003b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:45.735 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.368+0000 7f24399fa640 1 --2- 172.21.15.5:0/1987209782 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7f2420038fc0 0x7f242003b480 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f24240098c0 tx=0x7f2424006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:45.735 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.373+0000 7f242b7fe640 1 -- 172.21.15.5:0/1987209782 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f243003add0 con 0x7f2434107420 2024-09-11T23:19:45.735 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.607+0000 7f243c45f640 1 -- 172.21.15.5:0/1987209782 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f24341a0c70 con 0x7f2434107420 2024-09-11T23:19:45.735 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.959+0000 7f242b7fe640 1 -- 172.21.15.5:0/1987209782 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f2430045520 con 0x7f2434107420 2024-09-11T23:19:45.735 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.961+0000 7f242b7fe640 1 -- 172.21.15.5:0/1987209782 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f243003cb40 con 0x7f2434107420 2024-09-11T23:19:45.735 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.962+0000 7f243c45f640 1 -- 172.21.15.5:0/1987209782 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7f2420038fc0 msgr2=0x7f242003b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:45.735 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.962+0000 7f243c45f640 1 --2- 172.21.15.5:0/1987209782 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7f2420038fc0 0x7f242003b480 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f24240098c0 tx=0x7f2424006db0 comp rx=0 tx=0).stop 2024-09-11T23:19:45.735 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.962+0000 7f243c45f640 1 -- 172.21.15.5:0/1987209782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2434107420 msgr2=0x7f243419d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:45.735 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.962+0000 7f243c45f640 1 --2- 172.21.15.5:0/1987209782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2434107420 0x7f243419d5e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2430009940 tx=0x7f2430030cc0 comp rx=0 tx=0).stop 2024-09-11T23:19:45.736 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.962+0000 7f243c45f640 1 -- 172.21.15.5:0/1987209782 shutdown_connections 2024-09-11T23:19:45.736 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.962+0000 7f243c45f640 1 --2- 172.21.15.5:0/1987209782 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7f2420038fc0 0x7f242003b480 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:45.736 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.962+0000 7f243c45f640 1 --2- 172.21.15.5:0/1987209782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2434107420 0x7f243419d5e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:45.736 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.962+0000 7f243c45f640 1 -- 172.21.15.5:0/1987209782 >> 172.21.15.5:0/1987209782 conn(0x7f2434102bb0 msgr2=0x7f2434103660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:45.736 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.962+0000 7f243c45f640 1 -- 172.21.15.5:0/1987209782 shutdown_connections 2024-09-11T23:19:45.736 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:44.962+0000 7f243c45f640 1 -- 172.21.15.5:0/1987209782 wait complete. 2024-09-11T23:19:45.852 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:45 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:45.551+0000 7fd61060d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:19:45.852 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:45 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:45.698+0000 7fd61060d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T23:19:46.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:45 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/1987209782' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-11T23:19:46.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:45 smithi005 ceph-mon[31201]: mgrmap e9: x(active, since 18s) 2024-09-11T23:19:46.109 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:46 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:46.045+0000 7fd61060d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T23:19:46.109 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:46 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:46.109+0000 7fd61060d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T23:19:46.414 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:46 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:46.308+0000 7fd61060d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T23:19:47.099 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:46 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/2929619447' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-11T23:19:47.350 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2024-09-11T23:19:47.350 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-11T23:19:47.350 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-11T23:19:47.350 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-11T23:19:47.350 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-11T23:19:47.350 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2024-09-11T23:19:47.351 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.207+0000 7fe949824640 1 Processor -- start 2024-09-11T23:19:47.351 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.207+0000 7fe949824640 1 -- start start 2024-09-11T23:19:47.351 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.207+0000 7fe949824640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe94407de60 0x7fe94407c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:47.351 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.207+0000 7fe949824640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe94407c890 con 0x7fe94407de60 2024-09-11T23:19:47.351 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.207+0000 7fe942ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe94407de60 0x7fe94407c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:47.351 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.208+0000 7fe942ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe94407de60 0x7fe94407c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51208/0 (socket says 172.21.15.5:51208) 2024-09-11T23:19:47.351 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.208+0000 7fe942ffd640 1 -- 172.21.15.5:0/702100753 learned_addr learned my addr 172.21.15.5:0/702100753 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:47.351 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.208+0000 7fe942ffd640 1 -- 172.21.15.5:0/702100753 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe94407ca10 con 0x7fe94407de60 2024-09-11T23:19:47.351 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.209+0000 7fe942ffd640 1 --2- 172.21.15.5:0/702100753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe94407de60 0x7fe94407c2c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe934009820 tx=0x7fe93402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be15ea1a29240b55 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:47.351 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.209+0000 7fe941ffb640 1 -- 172.21.15.5:0/702100753 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe934037070 con 0x7fe94407de60 2024-09-11T23:19:47.351 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.209+0000 7fe941ffb640 1 -- 172.21.15.5:0/702100753 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe9340328f0 con 0x7fe94407de60 2024-09-11T23:19:47.351 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.209+0000 7fe941ffb640 1 -- 172.21.15.5:0/702100753 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe934030740 con 0x7fe94407de60 2024-09-11T23:19:47.352 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.210+0000 7fe949824640 1 -- 172.21.15.5:0/702100753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe94407de60 msgr2=0x7fe94407c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:47.352 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.210+0000 7fe949824640 1 --2- 172.21.15.5:0/702100753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe94407de60 0x7fe94407c2c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe934009820 tx=0x7fe93402a270 comp rx=0 tx=0).stop 2024-09-11T23:19:47.352 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.211+0000 7fe949824640 1 -- 172.21.15.5:0/702100753 shutdown_connections 2024-09-11T23:19:47.352 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.211+0000 7fe949824640 1 --2- 172.21.15.5:0/702100753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe94407de60 0x7fe94407c2c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:47.352 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.211+0000 7fe949824640 1 -- 172.21.15.5:0/702100753 >> 172.21.15.5:0/702100753 conn(0x7fe944102bb0 msgr2=0x7fe944104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:47.352 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.211+0000 7fe949824640 1 -- 172.21.15.5:0/702100753 shutdown_connections 2024-09-11T23:19:47.352 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.211+0000 7fe949824640 1 -- 172.21.15.5:0/702100753 wait complete. 2024-09-11T23:19:47.352 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.211+0000 7fe949824640 1 Processor -- start 2024-09-11T23:19:47.352 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.212+0000 7fe949824640 1 -- start start 2024-09-11T23:19:47.353 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.212+0000 7fe949824640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe94407de60 0x7fe94419d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:47.353 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.212+0000 7fe949824640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe94410da70 con 0x7fe94407de60 2024-09-11T23:19:47.353 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.212+0000 7fe942ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe94407de60 0x7fe94419d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:47.353 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.212+0000 7fe942ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe94407de60 0x7fe94419d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51212/0 (socket says 172.21.15.5:51212) 2024-09-11T23:19:47.353 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.212+0000 7fe942ffd640 1 -- 172.21.15.5:0/2929619447 learned_addr learned my addr 172.21.15.5:0/2929619447 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:47.353 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.212+0000 7fe942ffd640 1 -- 172.21.15.5:0/2929619447 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe94419daf0 con 0x7fe94407de60 2024-09-11T23:19:47.353 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.212+0000 7fe942ffd640 1 --2- 172.21.15.5:0/2929619447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe94407de60 0x7fe94419d5b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe934009940 tx=0x7fe934030cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:47.353 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.213+0000 7fe948822640 1 -- 172.21.15.5:0/2929619447 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe934042070 con 0x7fe94407de60 2024-09-11T23:19:47.353 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.213+0000 7fe948822640 1 -- 172.21.15.5:0/2929619447 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe934030e30 con 0x7fe94407de60 2024-09-11T23:19:47.353 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.213+0000 7fe949824640 1 -- 172.21.15.5:0/2929619447 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe94419dd80 con 0x7fe94407de60 2024-09-11T23:19:47.353 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.213+0000 7fe948822640 1 -- 172.21.15.5:0/2929619447 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe934037040 con 0x7fe94407de60 2024-09-11T23:19:47.353 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.213+0000 7fe949824640 1 -- 172.21.15.5:0/2929619447 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9441a0a70 con 0x7fe94407de60 2024-09-11T23:19:47.353 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.213+0000 7fe948822640 1 -- 172.21.15.5:0/2929619447 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7fe934045070 con 0x7fe94407de60 2024-09-11T23:19:47.354 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.214+0000 7fe949824640 1 -- 172.21.15.5:0/2929619447 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe94407c340 con 0x7fe94407de60 2024-09-11T23:19:47.354 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.214+0000 7fe948822640 1 --2- 172.21.15.5:0/2929619447 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7fe92c038fc0 0x7fe92c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:47.354 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.214+0000 7fe948822640 1 -- 172.21.15.5:0/2929619447 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe93406c1f0 con 0x7fe94407de60 2024-09-11T23:19:47.354 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.214+0000 7fe9427fc640 1 -- 172.21.15.5:0/2929619447 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7fe92c038fc0 msgr2=0x7fe92c03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/1790126649 2024-09-11T23:19:47.354 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.214+0000 7fe9427fc640 1 --2- 172.21.15.5:0/2929619447 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7fe92c038fc0 0x7fe92c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:19:47.354 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.219+0000 7fe948822640 1 -- 172.21.15.5:0/2929619447 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe934045520 con 0x7fe94407de60 2024-09-11T23:19:47.354 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.415+0000 7fe9427fc640 1 -- 172.21.15.5:0/2929619447 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7fe92c038fc0 msgr2=0x7fe92c03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/1790126649 2024-09-11T23:19:47.354 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.415+0000 7fe9427fc640 1 --2- 172.21.15.5:0/2929619447 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7fe92c038fc0 0x7fe92c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T23:19:47.354 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.443+0000 7fe949824640 1 -- 172.21.15.5:0/2929619447 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fe9441a0c40 con 0x7fe94407de60 2024-09-11T23:19:47.354 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.444+0000 7fe948822640 1 -- 172.21.15.5:0/2929619447 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7fe9441a0c40 con 0x7fe94407de60 2024-09-11T23:19:47.354 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.447+0000 7fe949824640 1 -- 172.21.15.5:0/2929619447 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7fe92c038fc0 msgr2=0x7fe92c03b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:19:47.354 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.447+0000 7fe949824640 1 --2- 172.21.15.5:0/2929619447 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7fe92c038fc0 0x7fe92c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:47.355 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.447+0000 7fe949824640 1 -- 172.21.15.5:0/2929619447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe94407de60 msgr2=0x7fe94419d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:47.355 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.447+0000 7fe949824640 1 --2- 172.21.15.5:0/2929619447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe94407de60 0x7fe94419d5b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe934009940 tx=0x7fe934030cc0 comp rx=0 tx=0).stop 2024-09-11T23:19:47.355 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.447+0000 7fe949824640 1 -- 172.21.15.5:0/2929619447 shutdown_connections 2024-09-11T23:19:47.355 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.447+0000 7fe949824640 1 --2- 172.21.15.5:0/2929619447 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7fe92c038fc0 0x7fe92c03b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:47.355 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.447+0000 7fe949824640 1 --2- 172.21.15.5:0/2929619447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe94407de60 0x7fe94419d5b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:47.355 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.447+0000 7fe949824640 1 -- 172.21.15.5:0/2929619447 >> 172.21.15.5:0/2929619447 conn(0x7fe944102bb0 msgr2=0x7fe9441036f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:47.355 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.447+0000 7fe949824640 1 -- 172.21.15.5:0/2929619447 shutdown_connections 2024-09-11T23:19:47.355 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:46.447+0000 7fe949824640 1 -- 172.21.15.5:0/2929619447 wait complete. 2024-09-11T23:19:47.355 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for the mgr to restart... 2024-09-11T23:19:47.355 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for mgr epoch 9... 2024-09-11T23:19:47.467 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:47 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:47.242+0000 7fd61060d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T23:19:47.468 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:47 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:47.313+0000 7fd61060d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T23:19:48.333 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:48 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:48.072+0000 7fd61060d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T23:19:48.334 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:48 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:48.192+0000 7fd61060d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T23:19:48.631 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:48 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:48.341+0000 7fd61060d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:19:48.631 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:48 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:48.405+0000 7fd61060d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T23:19:48.631 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:48 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:48.560+0000 7fd61060d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T23:19:48.631 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:48 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:48.631+0000 7fd61060d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T23:19:48.926 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:48 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:48.693+0000 7fd61060d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T23:19:48.926 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:48 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:48.858+0000 7fd61060d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T23:19:48.926 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:48 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:48.926+0000 7fd61060d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T23:19:49.205 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:48 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:48.996+0000 7fd61060d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T23:19:49.205 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:49 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:49.082+0000 7fd61060d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T23:19:49.205 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:49 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:49.143+0000 7fd61060d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T23:19:49.205 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:49 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:49.205+0000 7fd61060d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T23:19:50.286 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:50 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:50.030+0000 7fd61060d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T23:19:50.287 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:50 smithi005 ceph-mon[31201]: Active manager daemon x restarted 2024-09-11T23:19:50.287 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:50 smithi005 ceph-mon[31201]: Activating manager daemon x 2024-09-11T23:19:50.287 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:50 smithi005 ceph-mon[31201]: osdmap e3: 0 total, 0 up, 0 in 2024-09-11T23:19:50.287 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:50 smithi005 ceph-mon[31201]: mgrmap e10: x(active, starting, since 0.00365459s) 2024-09-11T23:19:50.287 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:50 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:19:50.287 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:50 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-11T23:19:50.287 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:50 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-11T23:19:50.287 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:50 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-11T23:19:50.287 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:50 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-11T23:19:50.288 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:50 smithi005 ceph-mon[31201]: Manager daemon x is now available 2024-09-11T23:19:50.288 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:50 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:19:50.288 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:50 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-11T23:19:50.288 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:50 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-11T23:19:51.944 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:51 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:51.672+0000 7fd5760d6640 -1 log_channel(cephadm) log [ERR] : [11/Sep/2024:23:19:51] ENGINE Error in HTTPServer.serve 2024-09-11T23:19:51.944 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:51 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: Traceback (most recent call last): 2024-09-11T23:19:51.944 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:51 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T23:19:51.944 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:51 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: self._connections.run(self.expiration_interval) 2024-09-11T23:19:51.944 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:51 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T23:19:51.944 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:51 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: self._run(expiration_interval) 2024-09-11T23:19:51.944 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:51 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T23:19:51.945 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:51 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T23:19:51.945 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:51 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T23:19:51.945 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:51 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T23:19:51.945 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:51 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T23:19:51.945 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:51 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: s = self.context.wrap_socket( 2024-09-11T23:19:51.945 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:51 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T23:19:51.946 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:51 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: return self.sslsocket_class._create( 2024-09-11T23:19:51.946 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:51 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T23:19:51.946 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:51 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: self.do_handshake() 2024-09-11T23:19:51.946 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:51 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T23:19:51.947 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:51 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: self._sslobj.do_handshake() 2024-09-11T23:19:51.948 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:51 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T23:19:51.948 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:19:51 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:19:51.958 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2024-09-11T23:19:51.958 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-11T23:19:51.958 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-11T23:19:51.958 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2024-09-11T23:19:51.958 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:47.727+0000 7f61243c4640 1 Processor -- start 2024-09-11T23:19:51.958 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:47.727+0000 7f61243c4640 1 -- start start 2024-09-11T23:19:51.958 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:47.727+0000 7f61243c4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f611c07cd10 0x7f611c07b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:51.958 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:47.727+0000 7f61243c4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f611c07b740 con 0x7f611c07cd10 2024-09-11T23:19:51.958 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:47.727+0000 7f6122160640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f611c07cd10 0x7f611c07b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:51.958 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:47.727+0000 7f6122160640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f611c07cd10 0x7f611c07b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51214/0 (socket says 172.21.15.5:51214) 2024-09-11T23:19:51.958 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:47.727+0000 7f6122160640 1 -- 172.21.15.5:0/3226781906 learned_addr learned my addr 172.21.15.5:0/3226781906 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:51.959 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:47.727+0000 7f6122160640 1 -- 172.21.15.5:0/3226781906 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f611c07b8c0 con 0x7f611c07cd10 2024-09-11T23:19:51.959 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:47.728+0000 7f6122160640 1 --2- 172.21.15.5:0/3226781906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f611c07cd10 0x7f611c07b170 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6118009820 tx=0x7f611802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ab411809d02d1ce server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:51.959 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:47.728+0000 7f612115e640 1 -- 172.21.15.5:0/3226781906 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6118037070 con 0x7f611c07cd10 2024-09-11T23:19:51.959 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:47.728+0000 7f612115e640 1 -- 172.21.15.5:0/3226781906 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f61180328f0 con 0x7f611c07cd10 2024-09-11T23:19:51.959 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:47.728+0000 7f612115e640 1 -- 172.21.15.5:0/3226781906 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6118030740 con 0x7f611c07cd10 2024-09-11T23:19:51.959 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:47.729+0000 7f61243c4640 1 -- 172.21.15.5:0/3226781906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f611c07cd10 msgr2=0x7f611c07b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:51.959 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:47.729+0000 7f61243c4640 1 --2- 172.21.15.5:0/3226781906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f611c07cd10 0x7f611c07b170 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6118009820 tx=0x7f611802a270 comp rx=0 tx=0).stop 2024-09-11T23:19:51.959 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:47.729+0000 7f61243c4640 1 -- 172.21.15.5:0/3226781906 shutdown_connections 2024-09-11T23:19:51.959 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:47.729+0000 7f61243c4640 1 --2- 172.21.15.5:0/3226781906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f611c07cd10 0x7f611c07b170 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:51.959 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:47.729+0000 7f61243c4640 1 -- 172.21.15.5:0/3226781906 >> 172.21.15.5:0/3226781906 conn(0x7f611c102bd0 msgr2=0x7f611c104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:51.959 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:47.729+0000 7f61243c4640 1 -- 172.21.15.5:0/3226781906 shutdown_connections 2024-09-11T23:19:51.959 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:47.729+0000 7f61243c4640 1 -- 172.21.15.5:0/3226781906 wait complete. 2024-09-11T23:19:51.960 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:47.730+0000 7f61243c4640 1 Processor -- start 2024-09-11T23:19:51.960 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:47.730+0000 7f61243c4640 1 -- start start 2024-09-11T23:19:51.960 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:47.730+0000 7f61243c4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f611c07cd10 0x7f611c19d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:51.960 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:47.730+0000 7f61243c4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f611c10da30 con 0x7f611c07cd10 2024-09-11T23:19:51.960 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:47.730+0000 7f6122160640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f611c07cd10 0x7f611c19d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:51.960 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:47.730+0000 7f6122160640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f611c07cd10 0x7f611c19d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51222/0 (socket says 172.21.15.5:51222) 2024-09-11T23:19:51.960 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:47.730+0000 7f6122160640 1 -- 172.21.15.5:0/2630716394 learned_addr learned my addr 172.21.15.5:0/2630716394 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:51.960 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:47.730+0000 7f6122160640 1 -- 172.21.15.5:0/2630716394 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f611c19dad0 con 0x7f611c07cd10 2024-09-11T23:19:51.960 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:47.730+0000 7f6122160640 1 --2- 172.21.15.5:0/2630716394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f611c07cd10 0x7f611c19d590 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f61180097f0 tx=0x7f6118030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:51.960 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:47.731+0000 7f61137fe640 1 -- 172.21.15.5:0/2630716394 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6118042070 con 0x7f611c07cd10 2024-09-11T23:19:51.960 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:47.731+0000 7f61243c4640 1 -- 172.21.15.5:0/2630716394 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f611c19dd60 con 0x7f611c07cd10 2024-09-11T23:19:51.960 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:47.731+0000 7f61137fe640 1 -- 172.21.15.5:0/2630716394 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6118030d80 con 0x7f611c07cd10 2024-09-11T23:19:51.961 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:47.731+0000 7f61137fe640 1 -- 172.21.15.5:0/2630716394 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6118037040 con 0x7f611c07cd10 2024-09-11T23:19:51.961 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:47.731+0000 7f61243c4640 1 -- 172.21.15.5:0/2630716394 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f611c1a0a50 con 0x7f611c07cd10 2024-09-11T23:19:51.961 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:47.732+0000 7f61137fe640 1 -- 172.21.15.5:0/2630716394 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f6118045070 con 0x7f611c07cd10 2024-09-11T23:19:51.961 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:47.732+0000 7f61137fe640 1 --2- 172.21.15.5:0/2630716394 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7f6108038fc0 0x7f610803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:51.961 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:47.732+0000 7f61137fe640 1 -- 172.21.15.5:0/2630716394 --> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f610803bb90 con 0x7f6108038fc0 2024-09-11T23:19:51.961 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:47.732+0000 7f61137fe640 1 -- 172.21.15.5:0/2630716394 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f611806c1b0 con 0x7f611c07cd10 2024-09-11T23:19:51.961 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:47.732+0000 7f612195f640 1 -- 172.21.15.5:0/2630716394 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7f6108038fc0 msgr2=0x7f610803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/1790126649 2024-09-11T23:19:51.961 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:47.732+0000 7f612195f640 1 --2- 172.21.15.5:0/2630716394 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7f6108038fc0 0x7f610803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:19:51.961 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:47.933+0000 7f612195f640 1 -- 172.21.15.5:0/2630716394 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7f6108038fc0 msgr2=0x7f610803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/1790126649 2024-09-11T23:19:51.961 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:47.933+0000 7f612195f640 1 --2- 172.21.15.5:0/2630716394 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7f6108038fc0 0x7f610803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T23:19:51.961 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:48.334+0000 7f612195f640 1 -- 172.21.15.5:0/2630716394 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7f6108038fc0 msgr2=0x7f610803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/1790126649 2024-09-11T23:19:51.961 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:48.334+0000 7f612195f640 1 --2- 172.21.15.5:0/2630716394 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7f6108038fc0 0x7f610803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T23:19:51.962 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:49.135+0000 7f612195f640 1 -- 172.21.15.5:0/2630716394 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7f6108038fc0 msgr2=0x7f610803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/1790126649 2024-09-11T23:19:51.962 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:49.135+0000 7f612195f640 1 --2- 172.21.15.5:0/2630716394 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7f6108038fc0 0x7f610803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T23:19:51.962 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:50.033+0000 7f61137fe640 1 -- 172.21.15.5:0/2630716394 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mgrmap(e 10) ==== 46067+0+0 (secure 0 0 0) 0x7f611806ac60 con 0x7f611c07cd10 2024-09-11T23:19:51.962 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:50.034+0000 7f61137fe640 1 -- 172.21.15.5:0/2630716394 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7f6108038fc0 msgr2=0x7f610803b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:19:51.962 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:50.034+0000 7f61137fe640 1 --2- 172.21.15.5:0/2630716394 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7f6108038fc0 0x7f610803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:51.962 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:51.035+0000 7f61137fe640 1 -- 172.21.15.5:0/2630716394 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7f6118046bd0 con 0x7f611c07cd10 2024-09-11T23:19:51.962 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:51.035+0000 7f61137fe640 1 --2- 172.21.15.5:0/2630716394 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f610803ca80 0x7f610803ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:51.962 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:51.035+0000 7f61137fe640 1 -- 172.21.15.5:0/2630716394 --> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f6118039e50 con 0x7f610803ca80 2024-09-11T23:19:51.962 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:51.035+0000 7f612195f640 1 --2- 172.21.15.5:0/2630716394 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f610803ca80 0x7f610803ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:51.962 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:51.036+0000 7f612195f640 1 --2- 172.21.15.5:0/2630716394 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f610803ca80 0x7f610803ee70 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f610c003980 tx=0x7f610c006e10 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:51.962 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:51.037+0000 7f61137fe640 1 -- 172.21.15.5:0/2630716394 <== mgr.14148 v2:172.21.15.5:6800/2285128668 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f6118039e50 con 0x7f610803ca80 2024-09-11T23:19:51.962 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:51.044+0000 7f61243c4640 1 -- 172.21.15.5:0/2630716394 --> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f611c07b1f0 con 0x7f610803ca80 2024-09-11T23:19:51.962 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:51.044+0000 7f61137fe640 1 -- 172.21.15.5:0/2630716394 <== mgr.14148 v2:172.21.15.5:6800/2285128668 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f611c07b1f0 con 0x7f610803ca80 2024-09-11T23:19:51.963 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:51.044+0000 7f61243c4640 1 -- 172.21.15.5:0/2630716394 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f610803ca80 msgr2=0x7f610803ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:51.963 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:51.044+0000 7f61243c4640 1 --2- 172.21.15.5:0/2630716394 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f610803ca80 0x7f610803ee70 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f610c003980 tx=0x7f610c006e10 comp rx=0 tx=0).stop 2024-09-11T23:19:51.963 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:51.044+0000 7f61243c4640 1 -- 172.21.15.5:0/2630716394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f611c07cd10 msgr2=0x7f611c19d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:51.963 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:51.044+0000 7f61243c4640 1 --2- 172.21.15.5:0/2630716394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f611c07cd10 0x7f611c19d590 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f61180097f0 tx=0x7f6118030c70 comp rx=0 tx=0).stop 2024-09-11T23:19:51.963 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:51.044+0000 7f61243c4640 1 -- 172.21.15.5:0/2630716394 shutdown_connections 2024-09-11T23:19:51.963 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:51.044+0000 7f61243c4640 1 --2- 172.21.15.5:0/2630716394 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f610803ca80 0x7f610803ee70 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:51.963 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:51.044+0000 7f61243c4640 1 --2- 172.21.15.5:0/2630716394 >> [v2:172.21.15.5:6800/1790126649,v1:172.21.15.5:6801/1790126649] conn(0x7f6108038fc0 0x7f610803b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:51.963 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:51.044+0000 7f61243c4640 1 --2- 172.21.15.5:0/2630716394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f611c07cd10 0x7f611c19d590 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:51.963 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:51.044+0000 7f61243c4640 1 -- 172.21.15.5:0/2630716394 >> 172.21.15.5:0/2630716394 conn(0x7f611c102bd0 msgr2=0x7f611c103720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:51.963 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:51.044+0000 7f61243c4640 1 -- 172.21.15.5:0/2630716394 shutdown_connections 2024-09-11T23:19:51.963 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:51.044+0000 7f61243c4640 1 -- 172.21.15.5:0/2630716394 wait complete. 2024-09-11T23:19:51.963 INFO:teuthology.orchestra.run.smithi005.stdout:mgr epoch 9 is available 2024-09-11T23:19:51.963 INFO:teuthology.orchestra.run.smithi005.stdout:Generating a dashboard self-signed certificate... 2024-09-11T23:19:52.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:52 smithi005 ceph-mon[31201]: mgrmap e11: x(active, since 1.00612s) 2024-09-11T23:19:52.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:52 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:19:52.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:52 smithi005 ceph-mon[31201]: [11/Sep/2024:23:19:51] ENGINE Bus STARTING 2024-09-11T23:19:52.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:52 smithi005 ceph-mon[31201]: [11/Sep/2024:23:19:51] ENGINE Serving on http://172.21.15.5:8765 2024-09-11T23:19:52.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:52 smithi005 ceph-mon[31201]: [11/Sep/2024:23:19:51] ENGINE Serving on https://172.21.15.5:7150 2024-09-11T23:19:52.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:52 smithi005 ceph-mon[31201]: [11/Sep/2024:23:19:51] ENGINE Bus STARTED 2024-09-11T23:19:52.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:52 smithi005 ceph-mon[31201]: [11/Sep/2024:23:19:51] ENGINE Error in HTTPServer.serve 2024-09-11T23:19:52.225 INFO:journalctl@ceph.mon.a.smithi005.stdout: Traceback (most recent call last): 2024-09-11T23:19:52.225 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T23:19:52.225 INFO:journalctl@ceph.mon.a.smithi005.stdout: self._connections.run(self.expiration_interval) 2024-09-11T23:19:52.225 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T23:19:52.225 INFO:journalctl@ceph.mon.a.smithi005.stdout: self._run(expiration_interval) 2024-09-11T23:19:52.225 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T23:19:52.225 INFO:journalctl@ceph.mon.a.smithi005.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T23:19:52.225 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T23:19:52.225 INFO:journalctl@ceph.mon.a.smithi005.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T23:19:52.226 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T23:19:52.226 INFO:journalctl@ceph.mon.a.smithi005.stdout: s = self.context.wrap_socket( 2024-09-11T23:19:52.226 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T23:19:52.226 INFO:journalctl@ceph.mon.a.smithi005.stdout: return self.sslsocket_class._create( 2024-09-11T23:19:52.226 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T23:19:52.226 INFO:journalctl@ceph.mon.a.smithi005.stdout: self.do_handshake() 2024-09-11T23:19:52.226 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T23:19:52.226 INFO:journalctl@ceph.mon.a.smithi005.stdout: self._sslobj.do_handshake() 2024-09-11T23:19:52.226 INFO:journalctl@ceph.mon.a.smithi005.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T23:19:53.199 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-11T23:19:53.199 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.355+0000 7fa962fa2640 1 Processor -- start 2024-09-11T23:19:53.199 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.355+0000 7fa962fa2640 1 -- start start 2024-09-11T23:19:53.199 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.355+0000 7fa962fa2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa95c106110 0x7fa95c106510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:53.199 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.355+0000 7fa962fa2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa95c106ae0 con 0x7fa95c106110 2024-09-11T23:19:53.200 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.355+0000 7fa961fa0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa95c106110 0x7fa95c106510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:53.200 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.355+0000 7fa961fa0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa95c106110 0x7fa95c106510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51302/0 (socket says 172.21.15.5:51302) 2024-09-11T23:19:53.200 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.355+0000 7fa961fa0640 1 -- 172.21.15.5:0/467585486 learned_addr learned my addr 172.21.15.5:0/467585486 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:53.200 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.356+0000 7fa961fa0640 1 -- 172.21.15.5:0/467585486 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa95c107310 con 0x7fa95c106110 2024-09-11T23:19:53.200 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.356+0000 7fa961fa0640 1 --2- 172.21.15.5:0/467585486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa95c106110 0x7fa95c106510 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa958009820 tx=0x7fa95802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f69911309c0e989a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:53.200 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.357+0000 7fa960f9e640 1 -- 172.21.15.5:0/467585486 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa958037070 con 0x7fa95c106110 2024-09-11T23:19:53.200 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.357+0000 7fa960f9e640 1 -- 172.21.15.5:0/467585486 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa9580328f0 con 0x7fa95c106110 2024-09-11T23:19:53.200 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.357+0000 7fa960f9e640 1 -- 172.21.15.5:0/467585486 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa958030740 con 0x7fa95c106110 2024-09-11T23:19:53.200 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.358+0000 7fa962fa2640 1 -- 172.21.15.5:0/467585486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa95c106110 msgr2=0x7fa95c106510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:53.200 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.358+0000 7fa962fa2640 1 --2- 172.21.15.5:0/467585486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa95c106110 0x7fa95c106510 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa958009820 tx=0x7fa95802a270 comp rx=0 tx=0).stop 2024-09-11T23:19:53.200 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.358+0000 7fa962fa2640 1 -- 172.21.15.5:0/467585486 shutdown_connections 2024-09-11T23:19:53.200 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.358+0000 7fa962fa2640 1 --2- 172.21.15.5:0/467585486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa95c106110 0x7fa95c106510 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:53.201 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.358+0000 7fa962fa2640 1 -- 172.21.15.5:0/467585486 >> 172.21.15.5:0/467585486 conn(0x7fa95c1018c0 msgr2=0x7fa95c103ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:53.201 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.358+0000 7fa962fa2640 1 -- 172.21.15.5:0/467585486 shutdown_connections 2024-09-11T23:19:53.201 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.358+0000 7fa962fa2640 1 -- 172.21.15.5:0/467585486 wait complete. 2024-09-11T23:19:53.201 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.358+0000 7fa962fa2640 1 Processor -- start 2024-09-11T23:19:53.201 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.358+0000 7fa962fa2640 1 -- start start 2024-09-11T23:19:53.201 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.359+0000 7fa962fa2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa95c106110 0x7fa95c19b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:53.201 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.359+0000 7fa962fa2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa95c10a6c0 con 0x7fa95c106110 2024-09-11T23:19:53.201 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.359+0000 7fa961fa0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa95c106110 0x7fa95c19b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:53.201 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.359+0000 7fa961fa0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa95c106110 0x7fa95c19b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51316/0 (socket says 172.21.15.5:51316) 2024-09-11T23:19:53.201 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.359+0000 7fa961fa0640 1 -- 172.21.15.5:0/2200579308 learned_addr learned my addr 172.21.15.5:0/2200579308 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:53.201 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.359+0000 7fa961fa0640 1 -- 172.21.15.5:0/2200579308 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa95c19b760 con 0x7fa95c106110 2024-09-11T23:19:53.201 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.359+0000 7fa961fa0640 1 --2- 172.21.15.5:0/2200579308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa95c106110 0x7fa95c19b220 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa9580097f0 tx=0x7fa958030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:53.202 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.359+0000 7fa952ffd640 1 -- 172.21.15.5:0/2200579308 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa958042070 con 0x7fa95c106110 2024-09-11T23:19:53.202 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.359+0000 7fa952ffd640 1 -- 172.21.15.5:0/2200579308 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa958030d80 con 0x7fa95c106110 2024-09-11T23:19:53.202 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.359+0000 7fa962fa2640 1 -- 172.21.15.5:0/2200579308 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa95c19b9f0 con 0x7fa95c106110 2024-09-11T23:19:53.202 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.360+0000 7fa952ffd640 1 -- 172.21.15.5:0/2200579308 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa958037040 con 0x7fa95c106110 2024-09-11T23:19:53.202 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.360+0000 7fa962fa2640 1 -- 172.21.15.5:0/2200579308 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa95c19e6e0 con 0x7fa95c106110 2024-09-11T23:19:53.202 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.361+0000 7fa962fa2640 1 -- 172.21.15.5:0/2200579308 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa95c10a840 con 0x7fa95c106110 2024-09-11T23:19:53.202 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.361+0000 7fa952ffd640 1 -- 172.21.15.5:0/2200579308 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7fa958045070 con 0x7fa95c106110 2024-09-11T23:19:53.202 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.361+0000 7fa952ffd640 1 --2- 172.21.15.5:0/2200579308 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fa948038eb0 0x7fa94803b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:53.202 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.361+0000 7fa952ffd640 1 -- 172.21.15.5:0/2200579308 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa95806c0e0 con 0x7fa95c106110 2024-09-11T23:19:53.202 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.361+0000 7fa96179f640 1 --2- 172.21.15.5:0/2200579308 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fa948038eb0 0x7fa94803b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:53.202 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.362+0000 7fa96179f640 1 --2- 172.21.15.5:0/2200579308 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fa948038eb0 0x7fa94803b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa94c0098c0 tx=0x7fa94c006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:53.202 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.370+0000 7fa952ffd640 1 -- 172.21.15.5:0/2200579308 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa958045360 con 0x7fa95c106110 2024-09-11T23:19:53.203 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.397+0000 7fa952ffd640 1 -- 172.21.15.5:0/2200579308 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7fa95803b330 con 0x7fa95c106110 2024-09-11T23:19:53.203 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.558+0000 7fa962fa2640 1 -- 172.21.15.5:0/2200579308 --> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7fa95c02da20 con 0x7fa948038eb0 2024-09-11T23:19:53.203 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.619+0000 7fa952ffd640 1 -- 172.21.15.5:0/2200579308 <== mgr.14148 v2:172.21.15.5:6800/2285128668 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7fa95c02da20 con 0x7fa948038eb0 2024-09-11T23:19:53.203 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.621+0000 7fa962fa2640 1 -- 172.21.15.5:0/2200579308 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fa948038eb0 msgr2=0x7fa94803b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:53.203 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.621+0000 7fa962fa2640 1 --2- 172.21.15.5:0/2200579308 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fa948038eb0 0x7fa94803b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa94c0098c0 tx=0x7fa94c006db0 comp rx=0 tx=0).stop 2024-09-11T23:19:53.203 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.621+0000 7fa962fa2640 1 -- 172.21.15.5:0/2200579308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa95c106110 msgr2=0x7fa95c19b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:53.203 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.621+0000 7fa962fa2640 1 --2- 172.21.15.5:0/2200579308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa95c106110 0x7fa95c19b220 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa9580097f0 tx=0x7fa958030c70 comp rx=0 tx=0).stop 2024-09-11T23:19:53.203 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.622+0000 7fa962fa2640 1 -- 172.21.15.5:0/2200579308 shutdown_connections 2024-09-11T23:19:53.203 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.622+0000 7fa962fa2640 1 --2- 172.21.15.5:0/2200579308 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fa948038eb0 0x7fa94803b370 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:53.203 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.622+0000 7fa962fa2640 1 --2- 172.21.15.5:0/2200579308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa95c106110 0x7fa95c19b220 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:53.203 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.622+0000 7fa962fa2640 1 -- 172.21.15.5:0/2200579308 >> 172.21.15.5:0/2200579308 conn(0x7fa95c1018c0 msgr2=0x7fa95c1027f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:53.203 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.622+0000 7fa962fa2640 1 -- 172.21.15.5:0/2200579308 shutdown_connections 2024-09-11T23:19:53.204 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:52.622+0000 7fa962fa2640 1 -- 172.21.15.5:0/2200579308 wait complete. 2024-09-11T23:19:53.204 INFO:teuthology.orchestra.run.smithi005.stdout:Creating initial admin user... 2024-09-11T23:19:53.602 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:53 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:19:53.602 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:53 smithi005 ceph-mon[31201]: mgrmap e12: x(active, since 2s) 2024-09-11T23:19:53.602 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:53 smithi005 ceph-mon[31201]: from='client.14160 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:19:53.602 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:53 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:19:53.602 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:53 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:19:54.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:54 smithi005 ceph-mon[31201]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:19:54.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:54 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:19:54.876 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$EAUOZfa8Q6r/SyBWmrQqqOUEWr7/Mlr0Xl0d7S95UxshKLndSXVCO", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726096794, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-11T23:19:54.876 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:53.617+0000 7fe24dc1c640 1 Processor -- start 2024-09-11T23:19:54.876 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:53.617+0000 7fe24dc1c640 1 -- start start 2024-09-11T23:19:54.876 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:53.617+0000 7fe24dc1c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe248107420 0x7fe248107820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:54.876 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:53.617+0000 7fe24dc1c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe248107df0 con 0x7fe248107420 2024-09-11T23:19:54.877 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:53.617+0000 7fe2477fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe248107420 0x7fe248107820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:54.877 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:53.617+0000 7fe2477fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe248107420 0x7fe248107820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37268/0 (socket says 172.21.15.5:37268) 2024-09-11T23:19:54.877 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:53.617+0000 7fe2477fe640 1 -- 172.21.15.5:0/1307424262 learned_addr learned my addr 172.21.15.5:0/1307424262 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:54.877 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:53.618+0000 7fe2477fe640 1 -- 172.21.15.5:0/1307424262 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe248108620 con 0x7fe248107420 2024-09-11T23:19:54.877 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:53.618+0000 7fe2477fe640 1 --2- 172.21.15.5:0/1307424262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe248107420 0x7fe248107820 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe238009e80 tx=0x7fe23802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bb95c225dbbae28 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:54.877 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:53.619+0000 7fe2467fc640 1 -- 172.21.15.5:0/1307424262 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe238036070 con 0x7fe248107420 2024-09-11T23:19:54.877 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:53.619+0000 7fe2467fc640 1 -- 172.21.15.5:0/1307424262 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe2380318b0 con 0x7fe248107420 2024-09-11T23:19:54.877 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:53.619+0000 7fe2467fc640 1 -- 172.21.15.5:0/1307424262 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe238007930 con 0x7fe248107420 2024-09-11T23:19:54.877 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:53.619+0000 7fe24dc1c640 1 -- 172.21.15.5:0/1307424262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe248107420 msgr2=0x7fe248107820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:54.877 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:53.619+0000 7fe24dc1c640 1 --2- 172.21.15.5:0/1307424262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe248107420 0x7fe248107820 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe238009e80 tx=0x7fe23802a7a0 comp rx=0 tx=0).stop 2024-09-11T23:19:54.877 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:53.619+0000 7fe24dc1c640 1 -- 172.21.15.5:0/1307424262 shutdown_connections 2024-09-11T23:19:54.878 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:53.619+0000 7fe24dc1c640 1 --2- 172.21.15.5:0/1307424262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe248107420 0x7fe248107820 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:54.878 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:53.619+0000 7fe24dc1c640 1 -- 172.21.15.5:0/1307424262 >> 172.21.15.5:0/1307424262 conn(0x7fe248102bb0 msgr2=0x7fe248104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:54.878 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:53.619+0000 7fe24dc1c640 1 -- 172.21.15.5:0/1307424262 shutdown_connections 2024-09-11T23:19:54.878 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:53.619+0000 7fe24dc1c640 1 -- 172.21.15.5:0/1307424262 wait complete. 2024-09-11T23:19:54.878 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:53.620+0000 7fe24dc1c640 1 Processor -- start 2024-09-11T23:19:54.878 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:53.620+0000 7fe24dc1c640 1 -- start start 2024-09-11T23:19:54.878 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:53.620+0000 7fe24dc1c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe248107420 0x7fe24807db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:54.878 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:53.620+0000 7fe24dc1c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe24810b9d0 con 0x7fe248107420 2024-09-11T23:19:54.878 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:53.620+0000 7fe2477fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe248107420 0x7fe24807db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:54.878 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:53.620+0000 7fe2477fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe248107420 0x7fe24807db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37274/0 (socket says 172.21.15.5:37274) 2024-09-11T23:19:54.878 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:53.620+0000 7fe2477fe640 1 -- 172.21.15.5:0/3006549496 learned_addr learned my addr 172.21.15.5:0/3006549496 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:54.878 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:53.621+0000 7fe2477fe640 1 -- 172.21.15.5:0/3006549496 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe24807e050 con 0x7fe248107420 2024-09-11T23:19:54.879 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:53.621+0000 7fe2477fe640 1 --2- 172.21.15.5:0/3006549496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe248107420 0x7fe24807db10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe238007b60 tx=0x7fe238031c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:54.879 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:53.621+0000 7fe244ff9640 1 -- 172.21.15.5:0/3006549496 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe238036050 con 0x7fe248107420 2024-09-11T23:19:54.879 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:53.621+0000 7fe244ff9640 1 -- 172.21.15.5:0/3006549496 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe238042070 con 0x7fe248107420 2024-09-11T23:19:54.879 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:53.621+0000 7fe24dc1c640 1 -- 172.21.15.5:0/3006549496 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe24807c240 con 0x7fe248107420 2024-09-11T23:19:54.879 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:53.621+0000 7fe244ff9640 1 -- 172.21.15.5:0/3006549496 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe23803da30 con 0x7fe248107420 2024-09-11T23:19:54.879 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:53.621+0000 7fe24dc1c640 1 -- 172.21.15.5:0/3006549496 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe24807c780 con 0x7fe248107420 2024-09-11T23:19:54.879 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:53.622+0000 7fe244ff9640 1 -- 172.21.15.5:0/3006549496 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7fe23803dce0 con 0x7fe248107420 2024-09-11T23:19:54.879 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:53.622+0000 7fe244ff9640 1 --2- 172.21.15.5:0/3006549496 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe234039020 0x7fe23403b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:54.879 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:53.622+0000 7fe24dc1c640 1 -- 172.21.15.5:0/3006549496 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2481078a0 con 0x7fe248107420 2024-09-11T23:19:54.879 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:53.622+0000 7fe244ff9640 1 -- 172.21.15.5:0/3006549496 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fe23806d6c0 con 0x7fe248107420 2024-09-11T23:19:54.879 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:53.622+0000 7fe246ffd640 1 --2- 172.21.15.5:0/3006549496 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe234039020 0x7fe23403b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:54.879 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:53.623+0000 7fe246ffd640 1 --2- 172.21.15.5:0/3006549496 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe234039020 0x7fe23403b4e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe2300098c0 tx=0x7fe230006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:54.879 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:53.627+0000 7fe244ff9640 1 -- 172.21.15.5:0/3006549496 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe238045520 con 0x7fe248107420 2024-09-11T23:19:54.880 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:53.818+0000 7fe24dc1c640 1 -- 172.21.15.5:0/3006549496 --> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7fe24807ca00 con 0x7fe234039020 2024-09-11T23:19:54.880 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:54.067+0000 7fe244ff9640 1 -- 172.21.15.5:0/3006549496 <== mgr.14148 v2:172.21.15.5:6800/2285128668 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7fe24807ca00 con 0x7fe234039020 2024-09-11T23:19:54.880 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:54.069+0000 7fe24dc1c640 1 -- 172.21.15.5:0/3006549496 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe234039020 msgr2=0x7fe23403b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:54.880 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:54.069+0000 7fe24dc1c640 1 --2- 172.21.15.5:0/3006549496 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe234039020 0x7fe23403b4e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe2300098c0 tx=0x7fe230006db0 comp rx=0 tx=0).stop 2024-09-11T23:19:54.880 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:54.069+0000 7fe24dc1c640 1 -- 172.21.15.5:0/3006549496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe248107420 msgr2=0x7fe24807db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:54.880 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:54.069+0000 7fe24dc1c640 1 --2- 172.21.15.5:0/3006549496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe248107420 0x7fe24807db10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe238007b60 tx=0x7fe238031c90 comp rx=0 tx=0).stop 2024-09-11T23:19:54.880 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:54.069+0000 7fe24dc1c640 1 -- 172.21.15.5:0/3006549496 shutdown_connections 2024-09-11T23:19:54.880 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:54.069+0000 7fe24dc1c640 1 --2- 172.21.15.5:0/3006549496 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe234039020 0x7fe23403b4e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:54.880 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:54.069+0000 7fe24dc1c640 1 --2- 172.21.15.5:0/3006549496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe248107420 0x7fe24807db10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:54.880 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:54.069+0000 7fe24dc1c640 1 -- 172.21.15.5:0/3006549496 >> 172.21.15.5:0/3006549496 conn(0x7fe248102bb0 msgr2=0x7fe248103720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:54.880 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:54.070+0000 7fe24dc1c640 1 -- 172.21.15.5:0/3006549496 shutdown_connections 2024-09-11T23:19:54.880 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:54.070+0000 7fe24dc1c640 1 -- 172.21.15.5:0/3006549496 wait complete. 2024-09-11T23:19:54.881 INFO:teuthology.orchestra.run.smithi005.stdout:Fetching dashboard port number... 2024-09-11T23:19:55.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:55 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/415980606' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-11T23:19:56.360 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 8443 2024-09-11T23:19:56.360 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.303+0000 7fa6672b6640 1 Processor -- start 2024-09-11T23:19:56.360 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.303+0000 7fa6672b6640 1 -- start start 2024-09-11T23:19:56.360 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.303+0000 7fa6672b6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa66007cd10 0x7fa66007b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:56.361 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.303+0000 7fa6672b6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa66007b740 con 0x7fa66007cd10 2024-09-11T23:19:56.361 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.304+0000 7fa665052640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa66007cd10 0x7fa66007b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:56.361 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.304+0000 7fa665052640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa66007cd10 0x7fa66007b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37276/0 (socket says 172.21.15.5:37276) 2024-09-11T23:19:56.361 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.304+0000 7fa665052640 1 -- 172.21.15.5:0/936707941 learned_addr learned my addr 172.21.15.5:0/936707941 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:56.361 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.304+0000 7fa665052640 1 -- 172.21.15.5:0/936707941 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa66007b8c0 con 0x7fa66007cd10 2024-09-11T23:19:56.361 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.305+0000 7fa665052640 1 --2- 172.21.15.5:0/936707941 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa66007cd10 0x7fa66007b170 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa65c009820 tx=0x7fa65c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e66a0e72e010832 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:56.361 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.305+0000 7fa657fff640 1 -- 172.21.15.5:0/936707941 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa65c037070 con 0x7fa66007cd10 2024-09-11T23:19:56.361 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.305+0000 7fa657fff640 1 -- 172.21.15.5:0/936707941 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa65c0328f0 con 0x7fa66007cd10 2024-09-11T23:19:56.361 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.305+0000 7fa657fff640 1 -- 172.21.15.5:0/936707941 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa65c030740 con 0x7fa66007cd10 2024-09-11T23:19:56.361 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.305+0000 7fa6672b6640 1 -- 172.21.15.5:0/936707941 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa66007cd10 msgr2=0x7fa66007b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:56.361 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.305+0000 7fa6672b6640 1 --2- 172.21.15.5:0/936707941 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa66007cd10 0x7fa66007b170 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa65c009820 tx=0x7fa65c02a270 comp rx=0 tx=0).stop 2024-09-11T23:19:56.361 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.305+0000 7fa6672b6640 1 -- 172.21.15.5:0/936707941 shutdown_connections 2024-09-11T23:19:56.362 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.305+0000 7fa6672b6640 1 --2- 172.21.15.5:0/936707941 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa66007cd10 0x7fa66007b170 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:56.362 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.305+0000 7fa6672b6640 1 -- 172.21.15.5:0/936707941 >> 172.21.15.5:0/936707941 conn(0x7fa660102bc0 msgr2=0x7fa660104fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:56.362 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.306+0000 7fa6672b6640 1 -- 172.21.15.5:0/936707941 shutdown_connections 2024-09-11T23:19:56.362 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.306+0000 7fa6672b6640 1 -- 172.21.15.5:0/936707941 wait complete. 2024-09-11T23:19:56.362 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.306+0000 7fa6672b6640 1 Processor -- start 2024-09-11T23:19:56.362 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.306+0000 7fa6672b6640 1 -- start start 2024-09-11T23:19:56.362 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.306+0000 7fa6672b6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa66007cd10 0x7fa66019d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:56.362 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.306+0000 7fa6672b6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa66010da40 con 0x7fa66007cd10 2024-09-11T23:19:56.362 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.306+0000 7fa665052640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa66007cd10 0x7fa66019d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:56.362 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.307+0000 7fa665052640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa66007cd10 0x7fa66019d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37280/0 (socket says 172.21.15.5:37280) 2024-09-11T23:19:56.362 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.307+0000 7fa665052640 1 -- 172.21.15.5:0/415980606 learned_addr learned my addr 172.21.15.5:0/415980606 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:56.362 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.307+0000 7fa665052640 1 -- 172.21.15.5:0/415980606 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa66019dac0 con 0x7fa66007cd10 2024-09-11T23:19:56.362 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.307+0000 7fa665052640 1 --2- 172.21.15.5:0/415980606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa66007cd10 0x7fa66019d580 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa65c0097f0 tx=0x7fa65c030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:56.363 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.307+0000 7fa6567fc640 1 -- 172.21.15.5:0/415980606 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa65c042070 con 0x7fa66007cd10 2024-09-11T23:19:56.363 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.307+0000 7fa6672b6640 1 -- 172.21.15.5:0/415980606 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa66019dd50 con 0x7fa66007cd10 2024-09-11T23:19:56.363 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.307+0000 7fa6567fc640 1 -- 172.21.15.5:0/415980606 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa65c030d80 con 0x7fa66007cd10 2024-09-11T23:19:56.363 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.307+0000 7fa6567fc640 1 -- 172.21.15.5:0/415980606 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa65c037040 con 0x7fa66007cd10 2024-09-11T23:19:56.363 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.307+0000 7fa6672b6640 1 -- 172.21.15.5:0/415980606 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6601a0a40 con 0x7fa66007cd10 2024-09-11T23:19:56.363 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.308+0000 7fa6567fc640 1 -- 172.21.15.5:0/415980606 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7fa65c045070 con 0x7fa66007cd10 2024-09-11T23:19:56.363 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.308+0000 7fa6672b6640 1 -- 172.21.15.5:0/415980606 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa66007b1f0 con 0x7fa66007cd10 2024-09-11T23:19:56.363 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.308+0000 7fa6567fc640 1 --2- 172.21.15.5:0/415980606 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fa64c039020 0x7fa64c03b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:56.363 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.308+0000 7fa6567fc640 1 -- 172.21.15.5:0/415980606 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa65c06c140 con 0x7fa66007cd10 2024-09-11T23:19:56.363 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.308+0000 7fa664851640 1 --2- 172.21.15.5:0/415980606 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fa64c039020 0x7fa64c03b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:56.363 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.309+0000 7fa664851640 1 --2- 172.21.15.5:0/415980606 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fa64c039020 0x7fa64c03b4e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa6500098c0 tx=0x7fa650006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:56.363 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.313+0000 7fa6567fc640 1 -- 172.21.15.5:0/415980606 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa65c045520 con 0x7fa66007cd10 2024-09-11T23:19:56.363 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.493+0000 7fa6672b6640 1 -- 172.21.15.5:0/415980606 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7fa6601a1030 con 0x7fa66007cd10 2024-09-11T23:19:56.364 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.493+0000 7fa6567fc640 1 -- 172.21.15.5:0/415980606 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7fa65c03add0 con 0x7fa66007cd10 2024-09-11T23:19:56.364 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.495+0000 7fa6672b6640 1 -- 172.21.15.5:0/415980606 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fa64c039020 msgr2=0x7fa64c03b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:56.364 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.495+0000 7fa6672b6640 1 --2- 172.21.15.5:0/415980606 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fa64c039020 0x7fa64c03b4e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa6500098c0 tx=0x7fa650006db0 comp rx=0 tx=0).stop 2024-09-11T23:19:56.364 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.495+0000 7fa6672b6640 1 -- 172.21.15.5:0/415980606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa66007cd10 msgr2=0x7fa66019d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:56.364 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.495+0000 7fa6672b6640 1 --2- 172.21.15.5:0/415980606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa66007cd10 0x7fa66019d580 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa65c0097f0 tx=0x7fa65c030c70 comp rx=0 tx=0).stop 2024-09-11T23:19:56.364 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.495+0000 7fa6672b6640 1 -- 172.21.15.5:0/415980606 shutdown_connections 2024-09-11T23:19:56.364 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.495+0000 7fa6672b6640 1 --2- 172.21.15.5:0/415980606 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fa64c039020 0x7fa64c03b4e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:56.364 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.495+0000 7fa6672b6640 1 --2- 172.21.15.5:0/415980606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa66007cd10 0x7fa66019d580 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:56.364 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.495+0000 7fa6672b6640 1 -- 172.21.15.5:0/415980606 >> 172.21.15.5:0/415980606 conn(0x7fa660102bc0 msgr2=0x7fa6601036b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:56.364 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.495+0000 7fa6672b6640 1 -- 172.21.15.5:0/415980606 shutdown_connections 2024-09-11T23:19:56.365 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:55.495+0000 7fa6672b6640 1 -- 172.21.15.5:0/415980606 wait complete. 2024-09-11T23:19:56.372 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-11T23:19:56.372 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout disabled 2024-09-11T23:19:56.380 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-11T23:19:56.381 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2024-09-11T23:19:56.381 INFO:teuthology.orchestra.run.smithi005.stdout:firewalld.service is not enabled 2024-09-11T23:19:56.381 INFO:teuthology.orchestra.run.smithi005.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-11T23:19:56.383 INFO:teuthology.orchestra.run.smithi005.stdout:Ceph Dashboard is now available at: 2024-09-11T23:19:56.383 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:19:56.384 INFO:teuthology.orchestra.run.smithi005.stdout: URL: https://smithi005.front.sepia.ceph.com:8443/ 2024-09-11T23:19:56.384 INFO:teuthology.orchestra.run.smithi005.stdout: User: admin 2024-09-11T23:19:56.384 INFO:teuthology.orchestra.run.smithi005.stdout: Password: j1179s0gg6 2024-09-11T23:19:56.384 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:19:56.384 INFO:teuthology.orchestra.run.smithi005.stdout:Saving cluster configuration to /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/config directory 2024-09-11T23:19:57.633 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:56.762+0000 7f1b88fd2640 1 Processor -- start 2024-09-11T23:19:57.633 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:56.762+0000 7f1b88fd2640 1 -- start start 2024-09-11T23:19:57.633 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:56.762+0000 7f1b88fd2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b84107420 0x7f1b84107820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:57.633 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:56.762+0000 7f1b88fd2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1b84107df0 con 0x7f1b84107420 2024-09-11T23:19:57.633 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:56.763+0000 7f1b8259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b84107420 0x7f1b84107820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:57.633 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:56.763+0000 7f1b8259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b84107420 0x7f1b84107820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37292/0 (socket says 172.21.15.5:37292) 2024-09-11T23:19:57.633 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:56.763+0000 7f1b8259c640 1 -- 172.21.15.5:0/2332899224 learned_addr learned my addr 172.21.15.5:0/2332899224 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:57.634 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:56.763+0000 7f1b8259c640 1 -- 172.21.15.5:0/2332899224 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b84108620 con 0x7f1b84107420 2024-09-11T23:19:57.634 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:56.764+0000 7f1b8259c640 1 --2- 172.21.15.5:0/2332899224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b84107420 0x7f1b84107820 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1b74009820 tx=0x7f1b7402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6473806e241d1914 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:57.634 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:56.764+0000 7f1b8159a640 1 -- 172.21.15.5:0/2332899224 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b74037070 con 0x7f1b84107420 2024-09-11T23:19:57.634 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:56.764+0000 7f1b8159a640 1 -- 172.21.15.5:0/2332899224 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1b740328f0 con 0x7f1b84107420 2024-09-11T23:19:57.634 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:56.764+0000 7f1b8159a640 1 -- 172.21.15.5:0/2332899224 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b74030740 con 0x7f1b84107420 2024-09-11T23:19:57.634 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:56.765+0000 7f1b88fd2640 1 -- 172.21.15.5:0/2332899224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b84107420 msgr2=0x7f1b84107820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:57.634 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:56.765+0000 7f1b88fd2640 1 --2- 172.21.15.5:0/2332899224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b84107420 0x7f1b84107820 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1b74009820 tx=0x7f1b7402a270 comp rx=0 tx=0).stop 2024-09-11T23:19:57.634 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:56.765+0000 7f1b88fd2640 1 -- 172.21.15.5:0/2332899224 shutdown_connections 2024-09-11T23:19:57.634 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:56.765+0000 7f1b88fd2640 1 --2- 172.21.15.5:0/2332899224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b84107420 0x7f1b84107820 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:57.634 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:56.765+0000 7f1b88fd2640 1 -- 172.21.15.5:0/2332899224 >> 172.21.15.5:0/2332899224 conn(0x7f1b84102bb0 msgr2=0x7f1b84104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:57.634 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:56.765+0000 7f1b88fd2640 1 -- 172.21.15.5:0/2332899224 shutdown_connections 2024-09-11T23:19:57.634 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:56.765+0000 7f1b88fd2640 1 -- 172.21.15.5:0/2332899224 wait complete. 2024-09-11T23:19:57.634 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:56.766+0000 7f1b88fd2640 1 Processor -- start 2024-09-11T23:19:57.635 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:56.766+0000 7f1b88fd2640 1 -- start start 2024-09-11T23:19:57.635 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:56.766+0000 7f1b88fd2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b84107420 0x7f1b8419d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:57.635 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:56.766+0000 7f1b88fd2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8410b9d0 con 0x7f1b84107420 2024-09-11T23:19:57.635 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:56.766+0000 7f1b8259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b84107420 0x7f1b8419d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:57.635 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:56.767+0000 7f1b8259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b84107420 0x7f1b8419d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37308/0 (socket says 172.21.15.5:37308) 2024-09-11T23:19:57.635 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:56.767+0000 7f1b8259c640 1 -- 172.21.15.5:0/3577576478 learned_addr learned my addr 172.21.15.5:0/3577576478 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:57.635 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:56.767+0000 7f1b8259c640 1 -- 172.21.15.5:0/3577576478 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b8419db30 con 0x7f1b84107420 2024-09-11T23:19:57.635 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:56.767+0000 7f1b8259c640 1 --2- 172.21.15.5:0/3577576478 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b84107420 0x7f1b8419d5f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1b740097f0 tx=0x7f1b74030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:57.635 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:56.767+0000 7f1b737fe640 1 -- 172.21.15.5:0/3577576478 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b74042070 con 0x7f1b84107420 2024-09-11T23:19:57.635 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:56.767+0000 7f1b737fe640 1 -- 172.21.15.5:0/3577576478 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1b74030d80 con 0x7f1b84107420 2024-09-11T23:19:57.635 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:56.767+0000 7f1b88fd2640 1 -- 172.21.15.5:0/3577576478 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b8419ddc0 con 0x7f1b84107420 2024-09-11T23:19:57.635 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:56.767+0000 7f1b737fe640 1 -- 172.21.15.5:0/3577576478 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b74037040 con 0x7f1b84107420 2024-09-11T23:19:57.636 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:56.767+0000 7f1b88fd2640 1 -- 172.21.15.5:0/3577576478 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b841a0ab0 con 0x7f1b84107420 2024-09-11T23:19:57.636 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:56.768+0000 7f1b737fe640 1 -- 172.21.15.5:0/3577576478 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f1b74045070 con 0x7f1b84107420 2024-09-11T23:19:57.636 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:56.768+0000 7f1b737fe640 1 --2- 172.21.15.5:0/3577576478 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f1b6c039060 0x7f1b6c03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:57.636 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:56.768+0000 7f1b88fd2640 1 -- 172.21.15.5:0/3577576478 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b8410bb50 con 0x7f1b84107420 2024-09-11T23:19:57.636 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:56.768+0000 7f1b737fe640 1 -- 172.21.15.5:0/3577576478 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f1b7406c260 con 0x7f1b84107420 2024-09-11T23:19:57.636 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:56.769+0000 7f1b81d9b640 1 --2- 172.21.15.5:0/3577576478 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f1b6c039060 0x7f1b6c03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:57.636 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:56.769+0000 7f1b81d9b640 1 --2- 172.21.15.5:0/3577576478 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f1b6c039060 0x7f1b6c03b520 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1b780098c0 tx=0x7f1b78006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:57.636 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:56.774+0000 7f1b737fe640 1 -- 172.21.15.5:0/3577576478 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1b7402ed90 con 0x7f1b84107420 2024-09-11T23:19:57.636 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:57.046+0000 7f1b88fd2640 1 -- 172.21.15.5:0/3577576478 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f1b841a0c80 con 0x7f1b84107420 2024-09-11T23:19:57.636 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:57.049+0000 7f1b737fe640 1 -- 172.21.15.5:0/3577576478 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f1b7403c730 con 0x7f1b84107420 2024-09-11T23:19:57.636 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-11T23:19:57.636 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:57.051+0000 7f1b88fd2640 1 -- 172.21.15.5:0/3577576478 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f1b6c039060 msgr2=0x7f1b6c03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:57.636 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:57.051+0000 7f1b88fd2640 1 --2- 172.21.15.5:0/3577576478 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f1b6c039060 0x7f1b6c03b520 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1b780098c0 tx=0x7f1b78006db0 comp rx=0 tx=0).stop 2024-09-11T23:19:57.637 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:57.051+0000 7f1b88fd2640 1 -- 172.21.15.5:0/3577576478 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b84107420 msgr2=0x7f1b8419d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:57.637 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:57.051+0000 7f1b88fd2640 1 --2- 172.21.15.5:0/3577576478 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b84107420 0x7f1b8419d5f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1b740097f0 tx=0x7f1b74030c70 comp rx=0 tx=0).stop 2024-09-11T23:19:57.637 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:57.051+0000 7f1b88fd2640 1 -- 172.21.15.5:0/3577576478 shutdown_connections 2024-09-11T23:19:57.637 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:57.051+0000 7f1b88fd2640 1 --2- 172.21.15.5:0/3577576478 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f1b6c039060 0x7f1b6c03b520 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:57.637 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:57.051+0000 7f1b88fd2640 1 --2- 172.21.15.5:0/3577576478 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b84107420 0x7f1b8419d5f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:57.637 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:57.051+0000 7f1b88fd2640 1 -- 172.21.15.5:0/3577576478 >> 172.21.15.5:0/3577576478 conn(0x7f1b84102bb0 msgr2=0x7f1b84103650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:57.637 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:57.051+0000 7f1b88fd2640 1 -- 172.21.15.5:0/3577576478 shutdown_connections 2024-09-11T23:19:57.637 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-09-11T23:19:57.051+0000 7f1b88fd2640 1 -- 172.21.15.5:0/3577576478 wait complete. 2024-09-11T23:19:57.637 INFO:teuthology.orchestra.run.smithi005.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-11T23:19:57.637 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:19:57.637 INFO:teuthology.orchestra.run.smithi005.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-11T23:19:57.637 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:19:57.637 INFO:teuthology.orchestra.run.smithi005.stdout:Or, if you are only running a single cluster on this host: 2024-09-11T23:19:57.638 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:19:57.638 INFO:teuthology.orchestra.run.smithi005.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-11T23:19:57.638 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:19:57.638 INFO:teuthology.orchestra.run.smithi005.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-11T23:19:57.638 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:19:57.638 INFO:teuthology.orchestra.run.smithi005.stdout: ceph telemetry on 2024-09-11T23:19:57.638 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:19:57.638 INFO:teuthology.orchestra.run.smithi005.stdout:For more information see: 2024-09-11T23:19:57.638 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:19:57.638 INFO:teuthology.orchestra.run.smithi005.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-11T23:19:57.638 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:19:57.638 INFO:teuthology.orchestra.run.smithi005.stdout:Bootstrap complete. 2024-09-11T23:19:57.657 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:57 smithi005 ceph-mon[31201]: mgrmap e13: x(active, since 6s) 2024-09-11T23:19:57.657 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:19:57 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/3577576478' entity='client.admin' 2024-09-11T23:19:57.673 INFO:tasks.cephadm:Fetching config... 2024-09-11T23:19:57.673 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-11T23:19:57.673 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-11T23:19:57.690 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-11T23:19:57.690 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-11T23:19:57.690 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-11T23:19:57.746 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-11T23:19:57.747 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-11T23:19:57.747 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-11T23:19:57.812 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-11T23:19:57.812 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-11T23:19:57.813 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-11T23:19:57.869 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-11T23:19:57.869 DEBUG:teuthology.orchestra.run.smithi005:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCtAHVVOdjEMBULa+HOO2sWwtJdW05tyfOVK01iiDTjp1r0JHgCbLAQQc79KPePtCP0BOYUJxJ0rp9RlEu5tJHv7b2vcU7CiuZv59BnfogBSUcNqIt2w6+9eSzSQSyXH8M+oz6rynAQn0VQvx9tbf/478JDQyyRvjdbEQdAdLoIwRTxh8SIIsqyKBYfgW6uc71IHlXfdNNnVbvuYtbOLbXXWw3+Yi82GLd0b8G7+SYJz+Qe5ZussXvq22vfZ7DmAnum53Pm/e4g0Otv6Y2+9OqUr19Y9YJREbsN+p2TB106WwI5aMu6/3fhcL/pPJ80w3sPsyndD+F4BYHNxty7xOkVpp0+IgfVPxapJX6H1zitLRDXnCrD2Wi/kt8SpRmuXATnueSbjqfWmM/zmo8jp5MAIHElAe/580K57oAbPSHJLanJU3B1Yd9tCb2dt9Qrx1htHhm9aZiCJvCQlM6CuZ8wln6Y8p8H/RRqkK7OaQ3Jp3lq8Zi/MPDrZVlHJo1hJA8= ceph-1f5284d2-7094-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-11T23:19:57.957 INFO:teuthology.orchestra.run.smithi005.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCtAHVVOdjEMBULa+HOO2sWwtJdW05tyfOVK01iiDTjp1r0JHgCbLAQQc79KPePtCP0BOYUJxJ0rp9RlEu5tJHv7b2vcU7CiuZv59BnfogBSUcNqIt2w6+9eSzSQSyXH8M+oz6rynAQn0VQvx9tbf/478JDQyyRvjdbEQdAdLoIwRTxh8SIIsqyKBYfgW6uc71IHlXfdNNnVbvuYtbOLbXXWw3+Yi82GLd0b8G7+SYJz+Qe5ZussXvq22vfZ7DmAnum53Pm/e4g0Otv6Y2+9OqUr19Y9YJREbsN+p2TB106WwI5aMu6/3fhcL/pPJ80w3sPsyndD+F4BYHNxty7xOkVpp0+IgfVPxapJX6H1zitLRDXnCrD2Wi/kt8SpRmuXATnueSbjqfWmM/zmo8jp5MAIHElAe/580K57oAbPSHJLanJU3B1Yd9tCb2dt9Qrx1htHhm9aZiCJvCQlM6CuZ8wln6Y8p8H/RRqkK7OaQ3Jp3lq8Zi/MPDrZVlHJo1hJA8= ceph-1f5284d2-7094-11ef-bcea-c7b262605968 2024-09-11T23:19:57.971 DEBUG:teuthology.orchestra.run.smithi159:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCtAHVVOdjEMBULa+HOO2sWwtJdW05tyfOVK01iiDTjp1r0JHgCbLAQQc79KPePtCP0BOYUJxJ0rp9RlEu5tJHv7b2vcU7CiuZv59BnfogBSUcNqIt2w6+9eSzSQSyXH8M+oz6rynAQn0VQvx9tbf/478JDQyyRvjdbEQdAdLoIwRTxh8SIIsqyKBYfgW6uc71IHlXfdNNnVbvuYtbOLbXXWw3+Yi82GLd0b8G7+SYJz+Qe5ZussXvq22vfZ7DmAnum53Pm/e4g0Otv6Y2+9OqUr19Y9YJREbsN+p2TB106WwI5aMu6/3fhcL/pPJ80w3sPsyndD+F4BYHNxty7xOkVpp0+IgfVPxapJX6H1zitLRDXnCrD2Wi/kt8SpRmuXATnueSbjqfWmM/zmo8jp5MAIHElAe/580K57oAbPSHJLanJU3B1Yd9tCb2dt9Qrx1htHhm9aZiCJvCQlM6CuZ8wln6Y8p8H/RRqkK7OaQ3Jp3lq8Zi/MPDrZVlHJo1hJA8= ceph-1f5284d2-7094-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-11T23:19:58.025 INFO:teuthology.orchestra.run.smithi159.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCtAHVVOdjEMBULa+HOO2sWwtJdW05tyfOVK01iiDTjp1r0JHgCbLAQQc79KPePtCP0BOYUJxJ0rp9RlEu5tJHv7b2vcU7CiuZv59BnfogBSUcNqIt2w6+9eSzSQSyXH8M+oz6rynAQn0VQvx9tbf/478JDQyyRvjdbEQdAdLoIwRTxh8SIIsqyKBYfgW6uc71IHlXfdNNnVbvuYtbOLbXXWw3+Yi82GLd0b8G7+SYJz+Qe5ZussXvq22vfZ7DmAnum53Pm/e4g0Otv6Y2+9OqUr19Y9YJREbsN+p2TB106WwI5aMu6/3fhcL/pPJ80w3sPsyndD+F4BYHNxty7xOkVpp0+IgfVPxapJX6H1zitLRDXnCrD2Wi/kt8SpRmuXATnueSbjqfWmM/zmo8jp5MAIHElAe/580K57oAbPSHJLanJU3B1Yd9tCb2dt9Qrx1htHhm9aZiCJvCQlM6CuZ8wln6Y8p8H/RRqkK7OaQ3Jp3lq8Zi/MPDrZVlHJo1hJA8= ceph-1f5284d2-7094-11ef-bcea-c7b262605968 2024-09-11T23:19:58.037 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCtAHVVOdjEMBULa+HOO2sWwtJdW05tyfOVK01iiDTjp1r0JHgCbLAQQc79KPePtCP0BOYUJxJ0rp9RlEu5tJHv7b2vcU7CiuZv59BnfogBSUcNqIt2w6+9eSzSQSyXH8M+oz6rynAQn0VQvx9tbf/478JDQyyRvjdbEQdAdLoIwRTxh8SIIsqyKBYfgW6uc71IHlXfdNNnVbvuYtbOLbXXWw3+Yi82GLd0b8G7+SYJz+Qe5ZussXvq22vfZ7DmAnum53Pm/e4g0Otv6Y2+9OqUr19Y9YJREbsN+p2TB106WwI5aMu6/3fhcL/pPJ80w3sPsyndD+F4BYHNxty7xOkVpp0+IgfVPxapJX6H1zitLRDXnCrD2Wi/kt8SpRmuXATnueSbjqfWmM/zmo8jp5MAIHElAe/580K57oAbPSHJLanJU3B1Yd9tCb2dt9Qrx1htHhm9aZiCJvCQlM6CuZ8wln6Y8p8H/RRqkK7OaQ3Jp3lq8Zi/MPDrZVlHJo1hJA8= ceph-1f5284d2-7094-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-11T23:19:58.161 INFO:teuthology.orchestra.run.smithi172.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCtAHVVOdjEMBULa+HOO2sWwtJdW05tyfOVK01iiDTjp1r0JHgCbLAQQc79KPePtCP0BOYUJxJ0rp9RlEu5tJHv7b2vcU7CiuZv59BnfogBSUcNqIt2w6+9eSzSQSyXH8M+oz6rynAQn0VQvx9tbf/478JDQyyRvjdbEQdAdLoIwRTxh8SIIsqyKBYfgW6uc71IHlXfdNNnVbvuYtbOLbXXWw3+Yi82GLd0b8G7+SYJz+Qe5ZussXvq22vfZ7DmAnum53Pm/e4g0Otv6Y2+9OqUr19Y9YJREbsN+p2TB106WwI5aMu6/3fhcL/pPJ80w3sPsyndD+F4BYHNxty7xOkVpp0+IgfVPxapJX6H1zitLRDXnCrD2Wi/kt8SpRmuXATnueSbjqfWmM/zmo8jp5MAIHElAe/580K57oAbPSHJLanJU3B1Yd9tCb2dt9Qrx1htHhm9aZiCJvCQlM6CuZ8wln6Y8p8H/RRqkK7OaQ3Jp3lq8Zi/MPDrZVlHJo1hJA8= ceph-1f5284d2-7094-11ef-bcea-c7b262605968 2024-09-11T23:19:58.175 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-11T23:19:58.431 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:19:59.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:19:59.010+0000 7fcfeb6a2640 1 -- 172.21.15.5:0/1464287726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfe41020a0 msgr2=0x7fcfe4104490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:59.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:19:59.010+0000 7fcfeb6a2640 1 --2- 172.21.15.5:0/1464287726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfe41020a0 0x7fcfe4104490 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0009880 tx=0x7fcfe002a5d0 comp rx=0 tx=0).stop 2024-09-11T23:19:59.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:19:59.010+0000 7fcfeb6a2640 1 -- 172.21.15.5:0/1464287726 shutdown_connections 2024-09-11T23:19:59.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:19:59.010+0000 7fcfeb6a2640 1 --2- 172.21.15.5:0/1464287726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfe41020a0 0x7fcfe4104490 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:59.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:19:59.010+0000 7fcfeb6a2640 1 -- 172.21.15.5:0/1464287726 >> 172.21.15.5:0/1464287726 conn(0x7fcfe40fbc80 msgr2=0x7fcfe40fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:59.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:19:59.010+0000 7fcfeb6a2640 1 -- 172.21.15.5:0/1464287726 shutdown_connections 2024-09-11T23:19:59.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:19:59.010+0000 7fcfeb6a2640 1 -- 172.21.15.5:0/1464287726 wait complete. 2024-09-11T23:19:59.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:19:59.011+0000 7fcfeb6a2640 1 Processor -- start 2024-09-11T23:19:59.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:19:59.011+0000 7fcfeb6a2640 1 -- start start 2024-09-11T23:19:59.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:19:59.011+0000 7fcfeb6a2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfe41020a0 0x7fcfe4196c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:59.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:19:59.011+0000 7fcfeb6a2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe4107560 con 0x7fcfe41020a0 2024-09-11T23:19:59.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:19:59.011+0000 7fcfe943e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfe41020a0 0x7fcfe4196c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:59.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:19:59.011+0000 7fcfe943e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfe41020a0 0x7fcfe4196c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37326/0 (socket says 172.21.15.5:37326) 2024-09-11T23:19:59.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:19:59.011+0000 7fcfe943e640 1 -- 172.21.15.5:0/3557054773 learned_addr learned my addr 172.21.15.5:0/3557054773 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:19:59.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:19:59.012+0000 7fcfe943e640 1 -- 172.21.15.5:0/3557054773 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfe41971a0 con 0x7fcfe41020a0 2024-09-11T23:19:59.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:19:59.012+0000 7fcfe943e640 1 --2- 172.21.15.5:0/3557054773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfe41020a0 0x7fcfe4196c60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0009230 tx=0x7fcfe00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:59.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:19:59.012+0000 7fcfda7fc640 1 -- 172.21.15.5:0/3557054773 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfe003f070 con 0x7fcfe41020a0 2024-09-11T23:19:59.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:19:59.012+0000 7fcfda7fc640 1 -- 172.21.15.5:0/3557054773 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcfe0003aa0 con 0x7fcfe41020a0 2024-09-11T23:19:59.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:19:59.012+0000 7fcfeb6a2640 1 -- 172.21.15.5:0/3557054773 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfe4197490 con 0x7fcfe41020a0 2024-09-11T23:19:59.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:19:59.012+0000 7fcfda7fc640 1 -- 172.21.15.5:0/3557054773 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfe0035030 con 0x7fcfe41020a0 2024-09-11T23:19:59.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:19:59.012+0000 7fcfeb6a2640 1 -- 172.21.15.5:0/3557054773 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfe419a120 con 0x7fcfe41020a0 2024-09-11T23:19:59.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:19:59.013+0000 7fcfda7fc640 1 -- 172.21.15.5:0/3557054773 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7fcfe0042070 con 0x7fcfe41020a0 2024-09-11T23:19:59.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:19:59.013+0000 7fcfeb6a2640 1 -- 172.21.15.5:0/3557054773 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfe4107ce0 con 0x7fcfe41020a0 2024-09-11T23:19:59.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:19:59.013+0000 7fcfda7fc640 1 --2- 172.21.15.5:0/3557054773 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fcfd00390c0 0x7fcfd003b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:59.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:19:59.013+0000 7fcfda7fc640 1 -- 172.21.15.5:0/3557054773 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fcfe006cce0 con 0x7fcfe41020a0 2024-09-11T23:19:59.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:19:59.013+0000 7fcfe8c3d640 1 --2- 172.21.15.5:0/3557054773 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fcfd00390c0 0x7fcfd003b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:59.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:19:59.014+0000 7fcfe8c3d640 1 --2- 172.21.15.5:0/3557054773 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fcfd00390c0 0x7fcfd003b580 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcfd40098c0 tx=0x7fcfd4006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:59.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:19:59.018+0000 7fcfda7fc640 1 -- 172.21.15.5:0/3557054773 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcfe004a260 con 0x7fcfe41020a0 2024-09-11T23:19:59.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:19:59.201+0000 7fcfeb6a2640 1 -- 172.21.15.5:0/3557054773 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7fcfe402d970 con 0x7fcfe41020a0 2024-09-11T23:19:59.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:19:59.204+0000 7fcfda7fc640 1 -- 172.21.15.5:0/3557054773 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7fcfe0039350 con 0x7fcfe41020a0 2024-09-11T23:19:59.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:19:59.206+0000 7fcfeb6a2640 1 -- 172.21.15.5:0/3557054773 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fcfd00390c0 msgr2=0x7fcfd003b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:59.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:19:59.206+0000 7fcfeb6a2640 1 --2- 172.21.15.5:0/3557054773 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fcfd00390c0 0x7fcfd003b580 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcfd40098c0 tx=0x7fcfd4006db0 comp rx=0 tx=0).stop 2024-09-11T23:19:59.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:19:59.206+0000 7fcfeb6a2640 1 -- 172.21.15.5:0/3557054773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfe41020a0 msgr2=0x7fcfe4196c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:59.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:19:59.206+0000 7fcfeb6a2640 1 --2- 172.21.15.5:0/3557054773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfe41020a0 0x7fcfe4196c60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0009230 tx=0x7fcfe00048f0 comp rx=0 tx=0).stop 2024-09-11T23:19:59.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:19:59.207+0000 7fcfeb6a2640 1 -- 172.21.15.5:0/3557054773 shutdown_connections 2024-09-11T23:19:59.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:19:59.207+0000 7fcfeb6a2640 1 --2- 172.21.15.5:0/3557054773 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fcfd00390c0 0x7fcfd003b580 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:59.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:19:59.207+0000 7fcfeb6a2640 1 --2- 172.21.15.5:0/3557054773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfe41020a0 0x7fcfe4196c60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:59.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:19:59.207+0000 7fcfeb6a2640 1 -- 172.21.15.5:0/3557054773 >> 172.21.15.5:0/3557054773 conn(0x7fcfe40fbc80 msgr2=0x7fcfe40fc750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:59.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:19:59.207+0000 7fcfeb6a2640 1 -- 172.21.15.5:0/3557054773 shutdown_connections 2024-09-11T23:19:59.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:19:59.207+0000 7fcfeb6a2640 1 -- 172.21.15.5:0/3557054773 wait complete. 2024-09-11T23:20:00.001 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-11T23:20:00.001 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-11T23:20:00.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:00 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/3557054773' entity='client.admin' 2024-09-11T23:20:00.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:00 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:00.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:00 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:00.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:00 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi005", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:20:00.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:00 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:00.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:00 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:20:00.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:00 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:00.516 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:20:01.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:01.137+0000 7fc2a6a93640 1 -- 172.21.15.5:0/3770379831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2a00ff8b0 msgr2=0x7fc2a00ffcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:01.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:01.137+0000 7fc2a6a93640 1 --2- 172.21.15.5:0/3770379831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2a00ff8b0 0x7fc2a00ffcb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc290009c20 tx=0x7fc29002aa90 comp rx=0 tx=0).stop 2024-09-11T23:20:01.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:01.137+0000 7fc2a6a93640 1 -- 172.21.15.5:0/3770379831 shutdown_connections 2024-09-11T23:20:01.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:01.137+0000 7fc2a6a93640 1 --2- 172.21.15.5:0/3770379831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2a00ff8b0 0x7fc2a00ffcb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:01.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:01.137+0000 7fc2a6a93640 1 -- 172.21.15.5:0/3770379831 >> 172.21.15.5:0/3770379831 conn(0x7fc2a00fb400 msgr2=0x7fc2a00fd840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:01.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:01.137+0000 7fc2a6a93640 1 -- 172.21.15.5:0/3770379831 shutdown_connections 2024-09-11T23:20:01.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:01.137+0000 7fc2a6a93640 1 -- 172.21.15.5:0/3770379831 wait complete. 2024-09-11T23:20:01.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:01.138+0000 7fc2a6a93640 1 Processor -- start 2024-09-11T23:20:01.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:01.138+0000 7fc2a6a93640 1 -- start start 2024-09-11T23:20:01.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:01.138+0000 7fc2a6a93640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2a00ff8b0 0x7fc2a0196cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:01.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:01.138+0000 7fc2a6a93640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a01075b0 con 0x7fc2a00ff8b0 2024-09-11T23:20:01.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:01.138+0000 7fc2a482f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2a00ff8b0 0x7fc2a0196cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:01.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:01.138+0000 7fc2a482f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2a00ff8b0 0x7fc2a0196cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37344/0 (socket says 172.21.15.5:37344) 2024-09-11T23:20:01.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:01.138+0000 7fc2a482f640 1 -- 172.21.15.5:0/2100214613 learned_addr learned my addr 172.21.15.5:0/2100214613 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:20:01.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:01.139+0000 7fc2a482f640 1 -- 172.21.15.5:0/2100214613 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2a01971f0 con 0x7fc2a00ff8b0 2024-09-11T23:20:01.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:01.139+0000 7fc2a482f640 1 --2- 172.21.15.5:0/2100214613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2a00ff8b0 0x7fc2a0196cb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc290009410 tx=0x7fc290030f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:01.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:01.139+0000 7fc29dffb640 1 -- 172.21.15.5:0/2100214613 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc290047070 con 0x7fc2a00ff8b0 2024-09-11T23:20:01.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:01.139+0000 7fc2a6a93640 1 -- 172.21.15.5:0/2100214613 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2a0197480 con 0x7fc2a00ff8b0 2024-09-11T23:20:01.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:01.139+0000 7fc29dffb640 1 -- 172.21.15.5:0/2100214613 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc290003e20 con 0x7fc2a00ff8b0 2024-09-11T23:20:01.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:01.139+0000 7fc29dffb640 1 -- 172.21.15.5:0/2100214613 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc290033050 con 0x7fc2a00ff8b0 2024-09-11T23:20:01.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:01.139+0000 7fc2a6a93640 1 -- 172.21.15.5:0/2100214613 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2a019a170 con 0x7fc2a00ff8b0 2024-09-11T23:20:01.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:01.140+0000 7fc29dffb640 1 -- 172.21.15.5:0/2100214613 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7fc29004a070 con 0x7fc2a00ff8b0 2024-09-11T23:20:01.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:01.140+0000 7fc2a6a93640 1 -- 172.21.15.5:0/2100214613 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2a0107d30 con 0x7fc2a00ff8b0 2024-09-11T23:20:01.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:01.140+0000 7fc29dffb640 1 --2- 172.21.15.5:0/2100214613 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fc28c039060 0x7fc28c03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:01.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:01.140+0000 7fc29dffb640 1 -- 172.21.15.5:0/2100214613 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc29003e030 con 0x7fc2a00ff8b0 2024-09-11T23:20:01.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:01.141+0000 7fc29ffff640 1 --2- 172.21.15.5:0/2100214613 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fc28c039060 0x7fc28c03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:01.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:01.141+0000 7fc29ffff640 1 --2- 172.21.15.5:0/2100214613 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fc28c039060 0x7fc28c03b520 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc2880098c0 tx=0x7fc288006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:01.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:01.146+0000 7fc29dffb640 1 -- 172.21.15.5:0/2100214613 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc2900492c0 con 0x7fc2a00ff8b0 2024-09-11T23:20:01.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:01.333+0000 7fc2a6a93640 1 -- 172.21.15.5:0/2100214613 --> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7fc2a002d8c0 con 0x7fc28c039060 2024-09-11T23:20:01.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:01.336+0000 7fc29dffb640 1 -- 172.21.15.5:0/2100214613 <== mgr.14148 v2:172.21.15.5:6800/2285128668 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc2a002d8c0 con 0x7fc28c039060 2024-09-11T23:20:01.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:01.338+0000 7fc2a6a93640 1 -- 172.21.15.5:0/2100214613 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fc28c039060 msgr2=0x7fc28c03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:01.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:01.338+0000 7fc2a6a93640 1 --2- 172.21.15.5:0/2100214613 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fc28c039060 0x7fc28c03b520 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc2880098c0 tx=0x7fc288006db0 comp rx=0 tx=0).stop 2024-09-11T23:20:01.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:01.338+0000 7fc2a6a93640 1 -- 172.21.15.5:0/2100214613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2a00ff8b0 msgr2=0x7fc2a0196cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:01.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:01.338+0000 7fc2a6a93640 1 --2- 172.21.15.5:0/2100214613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2a00ff8b0 0x7fc2a0196cb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc290009410 tx=0x7fc290030f50 comp rx=0 tx=0).stop 2024-09-11T23:20:01.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:01.338+0000 7fc2a6a93640 1 -- 172.21.15.5:0/2100214613 shutdown_connections 2024-09-11T23:20:01.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:01.338+0000 7fc2a6a93640 1 --2- 172.21.15.5:0/2100214613 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fc28c039060 0x7fc28c03b520 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:01.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:01.338+0000 7fc2a6a93640 1 --2- 172.21.15.5:0/2100214613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2a00ff8b0 0x7fc2a0196cb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:01.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:01.338+0000 7fc2a6a93640 1 -- 172.21.15.5:0/2100214613 >> 172.21.15.5:0/2100214613 conn(0x7fc2a00fb400 msgr2=0x7fc2a00fbe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:01.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:01.338+0000 7fc2a6a93640 1 -- 172.21.15.5:0/2100214613 shutdown_connections 2024-09-11T23:20:01.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:01.338+0000 7fc2a6a93640 1 -- 172.21.15.5:0/2100214613 wait complete. 2024-09-11T23:20:02.128 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi159 2024-09-11T23:20:02.128 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-11T23:20:02.128 DEBUG:teuthology.orchestra.run.smithi159:> dd of=/etc/ceph/ceph.conf 2024-09-11T23:20:02.147 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-11T23:20:02.148 DEBUG:teuthology.orchestra.run.smithi159:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-11T23:20:02.206 INFO:tasks.cephadm:Adding host smithi159 to orchestrator... 2024-09-11T23:20:02.207 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph orch host add smithi159 2024-09-11T23:20:02.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:02 smithi005 ceph-mon[31201]: from='client.14170 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:20:02.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:02 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:02.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:02 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:20:02.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:02 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:20:02.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:02 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:20:02.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:02 smithi005 ceph-mon[31201]: Updating smithi005:/etc/ceph/ceph.conf 2024-09-11T23:20:02.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:02 smithi005 ceph-mon[31201]: Updating smithi005:/var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:20:02.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:02 smithi005 ceph-mon[31201]: Updating smithi005:/etc/ceph/ceph.client.admin.keyring 2024-09-11T23:20:02.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:02 smithi005 ceph-mon[31201]: Updating smithi005:/var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T23:20:02.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:02 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:02.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:02 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:02.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:02 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:02.641 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:20:03.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:03.111+0000 7fde14b0f640 1 -- 172.21.15.5:0/3423631647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde10102750 msgr2=0x7fde10102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:03.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:03.111+0000 7fde14b0f640 1 --2- 172.21.15.5:0/3423631647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde10102750 0x7fde10102b30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fde00009880 tx=0x7fde0002a670 comp rx=0 tx=0).stop 2024-09-11T23:20:03.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:03.111+0000 7fde14b0f640 1 -- 172.21.15.5:0/3423631647 shutdown_connections 2024-09-11T23:20:03.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:03.111+0000 7fde14b0f640 1 --2- 172.21.15.5:0/3423631647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde10102750 0x7fde10102b30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:03.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:03.111+0000 7fde14b0f640 1 -- 172.21.15.5:0/3423631647 >> 172.21.15.5:0/3423631647 conn(0x7fde100fc1b0 msgr2=0x7fde100fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:03.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:03.111+0000 7fde14b0f640 1 -- 172.21.15.5:0/3423631647 shutdown_connections 2024-09-11T23:20:03.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:03.111+0000 7fde14b0f640 1 -- 172.21.15.5:0/3423631647 wait complete. 2024-09-11T23:20:03.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:03.112+0000 7fde14b0f640 1 Processor -- start 2024-09-11T23:20:03.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:03.112+0000 7fde14b0f640 1 -- start start 2024-09-11T23:20:03.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:03.112+0000 7fde14b0f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde10102750 0x7fde101003b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:03.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:03.112+0000 7fde14b0f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fde1010bb70 con 0x7fde10102750 2024-09-11T23:20:03.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:03.112+0000 7fde0e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde10102750 0x7fde101003b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:03.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:03.112+0000 7fde0e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde10102750 0x7fde101003b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37366/0 (socket says 172.21.15.5:37366) 2024-09-11T23:20:03.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:03.112+0000 7fde0e59c640 1 -- 172.21.15.5:0/1715398791 learned_addr learned my addr 172.21.15.5:0/1715398791 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:20:03.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:03.112+0000 7fde0e59c640 1 -- 172.21.15.5:0/1715398791 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde101022a0 con 0x7fde10102750 2024-09-11T23:20:03.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:03.113+0000 7fde0e59c640 1 --2- 172.21.15.5:0/1715398791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde10102750 0x7fde101003b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fde00009230 tx=0x7fde000048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:03.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:03.113+0000 7fddff7fe640 1 -- 172.21.15.5:0/1715398791 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde0003f070 con 0x7fde10102750 2024-09-11T23:20:03.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:03.113+0000 7fddff7fe640 1 -- 172.21.15.5:0/1715398791 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fde00004d10 con 0x7fde10102750 2024-09-11T23:20:03.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:03.113+0000 7fddff7fe640 1 -- 172.21.15.5:0/1715398791 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde00035030 con 0x7fde10102750 2024-09-11T23:20:03.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:03.113+0000 7fde14b0f640 1 -- 172.21.15.5:0/1715398791 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde101008f0 con 0x7fde10102750 2024-09-11T23:20:03.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:03.113+0000 7fde14b0f640 1 -- 172.21.15.5:0/1715398791 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde10100db0 con 0x7fde10102750 2024-09-11T23:20:03.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:03.114+0000 7fddff7fe640 1 -- 172.21.15.5:0/1715398791 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7fde00042070 con 0x7fde10102750 2024-09-11T23:20:03.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:03.114+0000 7fde14b0f640 1 -- 172.21.15.5:0/1715398791 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde1006a7b0 con 0x7fde10102750 2024-09-11T23:20:03.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:03.114+0000 7fddff7fe640 1 --2- 172.21.15.5:0/1715398791 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fddf8039060 0x7fddf803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:03.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:03.114+0000 7fddff7fe640 1 -- 172.21.15.5:0/1715398791 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fde0006cf70 con 0x7fde10102750 2024-09-11T23:20:03.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:03.114+0000 7fde0dd9b640 1 --2- 172.21.15.5:0/1715398791 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fddf8039060 0x7fddf803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:03.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:03.115+0000 7fde0dd9b640 1 --2- 172.21.15.5:0/1715398791 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fddf8039060 0x7fddf803b520 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fde040098c0 tx=0x7fde04006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:03.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:03.119+0000 7fddff7fe640 1 -- 172.21.15.5:0/1715398791 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fde00003b10 con 0x7fde10102750 2024-09-11T23:20:03.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:03.299+0000 7fde14b0f640 1 -- 172.21.15.5:0/1715398791 --> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi159", "target": ["mon-mgr", ""]}) -- 0x7fde101018e0 con 0x7fddf8039060 2024-09-11T23:20:04.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:04 smithi005 ceph-mon[31201]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi159", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:20:05.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:05 smithi005 ceph-mon[31201]: Deploying cephadm binary to smithi159 2024-09-11T23:20:07.145 INFO:teuthology.orchestra.run.smithi005.stdout:Added host 'smithi159' with addr '172.21.15.159' 2024-09-11T23:20:07.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:07.144+0000 7fddff7fe640 1 -- 172.21.15.5:0/1715398791 <== mgr.14148 v2:172.21.15.5:6800/2285128668 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fde101018e0 con 0x7fddf8039060 2024-09-11T23:20:07.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:07.147+0000 7fde14b0f640 1 -- 172.21.15.5:0/1715398791 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fddf8039060 msgr2=0x7fddf803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:07.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:07.147+0000 7fde14b0f640 1 --2- 172.21.15.5:0/1715398791 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fddf8039060 0x7fddf803b520 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fde040098c0 tx=0x7fde04006db0 comp rx=0 tx=0).stop 2024-09-11T23:20:07.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:07.147+0000 7fde14b0f640 1 -- 172.21.15.5:0/1715398791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde10102750 msgr2=0x7fde101003b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:07.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:07.147+0000 7fde14b0f640 1 --2- 172.21.15.5:0/1715398791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde10102750 0x7fde101003b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fde00009230 tx=0x7fde000048f0 comp rx=0 tx=0).stop 2024-09-11T23:20:07.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:07.147+0000 7fde14b0f640 1 -- 172.21.15.5:0/1715398791 shutdown_connections 2024-09-11T23:20:07.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:07.147+0000 7fde14b0f640 1 --2- 172.21.15.5:0/1715398791 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fddf8039060 0x7fddf803b520 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:07.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:07.147+0000 7fde14b0f640 1 --2- 172.21.15.5:0/1715398791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde10102750 0x7fde101003b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:07.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:07.147+0000 7fde14b0f640 1 -- 172.21.15.5:0/1715398791 >> 172.21.15.5:0/1715398791 conn(0x7fde100fc1b0 msgr2=0x7fde10105510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:07.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:07.148+0000 7fde14b0f640 1 -- 172.21.15.5:0/1715398791 shutdown_connections 2024-09-11T23:20:07.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:07.148+0000 7fde14b0f640 1 -- 172.21.15.5:0/1715398791 wait complete. 2024-09-11T23:20:07.799 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-11T23:20:08.054 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:20:08.395 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:08 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:08.395 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:08 smithi005 ceph-mon[31201]: Added host smithi159 2024-09-11T23:20:08.395 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:08 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:20:08.396 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:08 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:08.396 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:08 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:08.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:08.473+0000 7f4b871cc640 1 -- 172.21.15.5:0/129881305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b80106560 msgr2=0x7f4b80106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:08.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:08.473+0000 7f4b871cc640 1 --2- 172.21.15.5:0/129881305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b80106560 0x7f4b80106940 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4b74009880 tx=0x7f4b7402a5d0 comp rx=0 tx=0).stop 2024-09-11T23:20:08.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:08.473+0000 7f4b871cc640 1 -- 172.21.15.5:0/129881305 shutdown_connections 2024-09-11T23:20:08.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:08.473+0000 7f4b871cc640 1 --2- 172.21.15.5:0/129881305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b80106560 0x7f4b80106940 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:08.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:08.473+0000 7f4b871cc640 1 -- 172.21.15.5:0/129881305 >> 172.21.15.5:0/129881305 conn(0x7f4b800fc1b0 msgr2=0x7f4b800fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:08.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:08.473+0000 7f4b871cc640 1 -- 172.21.15.5:0/129881305 shutdown_connections 2024-09-11T23:20:08.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:08.473+0000 7f4b871cc640 1 -- 172.21.15.5:0/129881305 wait complete. 2024-09-11T23:20:08.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:08.474+0000 7f4b871cc640 1 Processor -- start 2024-09-11T23:20:08.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:08.474+0000 7f4b871cc640 1 -- start start 2024-09-11T23:20:08.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:08.474+0000 7f4b871cc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b80106560 0x7f4b80195f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:08.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:08.474+0000 7f4b871cc640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4b8010aa40 con 0x7f4b80106560 2024-09-11T23:20:08.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:08.474+0000 7f4b84f68640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b80106560 0x7f4b80195f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:08.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:08.474+0000 7f4b84f68640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b80106560 0x7f4b80195f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41404/0 (socket says 172.21.15.5:41404) 2024-09-11T23:20:08.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:08.474+0000 7f4b84f68640 1 -- 172.21.15.5:0/1670751830 learned_addr learned my addr 172.21.15.5:0/1670751830 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:20:08.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:08.474+0000 7f4b84f68640 1 -- 172.21.15.5:0/1670751830 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b80196460 con 0x7f4b80106560 2024-09-11T23:20:08.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:08.475+0000 7f4b84f68640 1 --2- 172.21.15.5:0/1670751830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b80106560 0x7f4b80195f20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4b74009230 tx=0x7f4b740048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:08.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:08.475+0000 7f4b7dffb640 1 -- 172.21.15.5:0/1670751830 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b7403f070 con 0x7f4b80106560 2024-09-11T23:20:08.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:08.475+0000 7f4b871cc640 1 -- 172.21.15.5:0/1670751830 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b801966f0 con 0x7f4b80106560 2024-09-11T23:20:08.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:08.475+0000 7f4b7dffb640 1 -- 172.21.15.5:0/1670751830 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4b74004d10 con 0x7f4b80106560 2024-09-11T23:20:08.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:08.475+0000 7f4b7dffb640 1 -- 172.21.15.5:0/1670751830 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b74035030 con 0x7f4b80106560 2024-09-11T23:20:08.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:08.475+0000 7f4b871cc640 1 -- 172.21.15.5:0/1670751830 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b8019a7f0 con 0x7f4b80106560 2024-09-11T23:20:08.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:08.476+0000 7f4b7dffb640 1 -- 172.21.15.5:0/1670751830 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f4b74042070 con 0x7f4b80106560 2024-09-11T23:20:08.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:08.476+0000 7f4b7dffb640 1 --2- 172.21.15.5:0/1670751830 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f4b700390c0 0x7f4b7003b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:08.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:08.476+0000 7f4b7dffb640 1 -- 172.21.15.5:0/1670751830 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f4b7406cdd0 con 0x7f4b80106560 2024-09-11T23:20:08.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:08.476+0000 7f4b871cc640 1 -- 172.21.15.5:0/1670751830 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b80101bd0 con 0x7f4b80106560 2024-09-11T23:20:08.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:08.476+0000 7f4b7ffff640 1 --2- 172.21.15.5:0/1670751830 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f4b700390c0 0x7f4b7003b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:08.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:08.477+0000 7f4b7ffff640 1 --2- 172.21.15.5:0/1670751830 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f4b700390c0 0x7f4b7003b580 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c0098c0 tx=0x7f4b6c006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:08.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:08.481+0000 7f4b7dffb640 1 -- 172.21.15.5:0/1670751830 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4b74039350 con 0x7f4b80106560 2024-09-11T23:20:08.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:08.662+0000 7f4b871cc640 1 -- 172.21.15.5:0/1670751830 --> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4b801069c0 con 0x7f4b700390c0 2024-09-11T23:20:08.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:08.663+0000 7f4b7dffb640 1 -- 172.21.15.5:0/1670751830 <== mgr.14148 v2:172.21.15.5:6800/2285128668 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+159 (secure 0 0 0) 0x7f4b801069c0 con 0x7f4b700390c0 2024-09-11T23:20:08.663 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:20:08.664 INFO:teuthology.orchestra.run.smithi005.stdout:[{"addr": "172.21.15.5", "hostname": "smithi005", "labels": [], "status": ""}, {"addr": "172.21.15.159", "hostname": "smithi159", "labels": [], "status": ""}] 2024-09-11T23:20:08.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:08.665+0000 7f4b871cc640 1 -- 172.21.15.5:0/1670751830 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f4b700390c0 msgr2=0x7f4b7003b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:08.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:08.665+0000 7f4b871cc640 1 --2- 172.21.15.5:0/1670751830 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f4b700390c0 0x7f4b7003b580 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c0098c0 tx=0x7f4b6c006db0 comp rx=0 tx=0).stop 2024-09-11T23:20:08.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:08.665+0000 7f4b871cc640 1 -- 172.21.15.5:0/1670751830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b80106560 msgr2=0x7f4b80195f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:08.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:08.665+0000 7f4b871cc640 1 --2- 172.21.15.5:0/1670751830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b80106560 0x7f4b80195f20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4b74009230 tx=0x7f4b740048f0 comp rx=0 tx=0).stop 2024-09-11T23:20:08.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:08.665+0000 7f4b871cc640 1 -- 172.21.15.5:0/1670751830 shutdown_connections 2024-09-11T23:20:08.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:08.665+0000 7f4b871cc640 1 --2- 172.21.15.5:0/1670751830 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f4b700390c0 0x7f4b7003b580 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:08.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:08.665+0000 7f4b871cc640 1 --2- 172.21.15.5:0/1670751830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b80106560 0x7f4b80195f20 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:08.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:08.665+0000 7f4b871cc640 1 -- 172.21.15.5:0/1670751830 >> 172.21.15.5:0/1670751830 conn(0x7f4b800fc1b0 msgr2=0x7f4b800fdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:08.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:08.665+0000 7f4b871cc640 1 -- 172.21.15.5:0/1670751830 shutdown_connections 2024-09-11T23:20:08.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:08.665+0000 7f4b871cc640 1 -- 172.21.15.5:0/1670751830 wait complete. 2024-09-11T23:20:09.299 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi172 2024-09-11T23:20:09.299 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-11T23:20:09.300 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/etc/ceph/ceph.conf 2024-09-11T23:20:09.319 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-11T23:20:09.320 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-11T23:20:09.378 INFO:tasks.cephadm:Adding host smithi172 to orchestrator... 2024-09-11T23:20:09.378 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph orch host add smithi172 2024-09-11T23:20:09.627 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:20:09.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:09 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:09.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:09 smithi005 ceph-mon[31201]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:20:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:10.032+0000 7f8b1f757640 1 -- 172.21.15.5:0/3686348389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b18106560 msgr2=0x7f8b18106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:10.032+0000 7f8b1f757640 1 --2- 172.21.15.5:0/3686348389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b18106560 0x7f8b18106940 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8b14009880 tx=0x7f8b1402a5d0 comp rx=0 tx=0).stop 2024-09-11T23:20:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:10.032+0000 7f8b1f757640 1 -- 172.21.15.5:0/3686348389 shutdown_connections 2024-09-11T23:20:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:10.032+0000 7f8b1f757640 1 --2- 172.21.15.5:0/3686348389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b18106560 0x7f8b18106940 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:10.032+0000 7f8b1f757640 1 -- 172.21.15.5:0/3686348389 >> 172.21.15.5:0/3686348389 conn(0x7f8b180fc1b0 msgr2=0x7f8b180fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:10.032+0000 7f8b1f757640 1 -- 172.21.15.5:0/3686348389 shutdown_connections 2024-09-11T23:20:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:10.032+0000 7f8b1f757640 1 -- 172.21.15.5:0/3686348389 wait complete. 2024-09-11T23:20:10.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:10.032+0000 7f8b1f757640 1 Processor -- start 2024-09-11T23:20:10.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:10.032+0000 7f8b1f757640 1 -- start start 2024-09-11T23:20:10.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:10.033+0000 7f8b1f757640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b18106560 0x7f8b18197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:10.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:10.033+0000 7f8b1f757640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8b1810aa40 con 0x7f8b18106560 2024-09-11T23:20:10.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:10.033+0000 7f8b1d4f3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b18106560 0x7f8b18197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:10.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:10.033+0000 7f8b1d4f3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b18106560 0x7f8b18197e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41428/0 (socket says 172.21.15.5:41428) 2024-09-11T23:20:10.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:10.033+0000 7f8b1d4f3640 1 -- 172.21.15.5:0/1941860869 learned_addr learned my addr 172.21.15.5:0/1941860869 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:20:10.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:10.033+0000 7f8b1d4f3640 1 -- 172.21.15.5:0/1941860869 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b181983d0 con 0x7f8b18106560 2024-09-11T23:20:10.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:10.033+0000 7f8b1d4f3640 1 --2- 172.21.15.5:0/1941860869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b18106560 0x7f8b18197e90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8b14009230 tx=0x7f8b140048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:10.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:10.033+0000 7f8b0e7fc640 1 -- 172.21.15.5:0/1941860869 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b1403f070 con 0x7f8b18106560 2024-09-11T23:20:10.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:10.033+0000 7f8b0e7fc640 1 -- 172.21.15.5:0/1941860869 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8b14004d10 con 0x7f8b18106560 2024-09-11T23:20:10.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:10.033+0000 7f8b1f757640 1 -- 172.21.15.5:0/1941860869 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b18198660 con 0x7f8b18106560 2024-09-11T23:20:10.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:10.034+0000 7f8b0e7fc640 1 -- 172.21.15.5:0/1941860869 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b14035030 con 0x7f8b18106560 2024-09-11T23:20:10.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:10.034+0000 7f8b1f757640 1 -- 172.21.15.5:0/1941860869 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b18198ac0 con 0x7f8b18106560 2024-09-11T23:20:10.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:10.034+0000 7f8b0e7fc640 1 -- 172.21.15.5:0/1941860869 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f8b14042070 con 0x7f8b18106560 2024-09-11T23:20:10.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:10.034+0000 7f8b0e7fc640 1 --2- 172.21.15.5:0/1941860869 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f8b040390c0 0x7f8b0403b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:10.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:10.035+0000 7f8b0e7fc640 1 -- 172.21.15.5:0/1941860869 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f8b1406ccd0 con 0x7f8b18106560 2024-09-11T23:20:10.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:10.035+0000 7f8b1ccf2640 1 --2- 172.21.15.5:0/1941860869 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f8b040390c0 0x7f8b0403b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:10.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:10.035+0000 7f8b1f757640 1 -- 172.21.15.5:0/1941860869 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b18101bd0 con 0x7f8b18106560 2024-09-11T23:20:10.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:10.035+0000 7f8b1ccf2640 1 --2- 172.21.15.5:0/1941860869 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f8b040390c0 0x7f8b0403b580 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8b080098c0 tx=0x7f8b08006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:10.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:10.040+0000 7f8b0e7fc640 1 -- 172.21.15.5:0/1941860869 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8b14039350 con 0x7f8b18106560 2024-09-11T23:20:10.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:10.221+0000 7f8b1f757640 1 -- 172.21.15.5:0/1941860869 --> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi172", "target": ["mon-mgr", ""]}) -- 0x7f8b181069c0 con 0x7f8b040390c0 2024-09-11T23:20:11.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:11 smithi005 ceph-mon[31201]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:11.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:11 smithi005 ceph-mon[31201]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi172", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:20:12.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:12 smithi005 ceph-mon[31201]: Deploying cephadm binary to smithi172 2024-09-11T23:20:12.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:12 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:12.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:12 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:12.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:12 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:12.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:12 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:12.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:12 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi159", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:20:12.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:12 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:20:12.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:12 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:20:12.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:12 smithi005 ceph-mon[31201]: Updating smithi159:/etc/ceph/ceph.conf 2024-09-11T23:20:12.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:12 smithi005 ceph-mon[31201]: Updating smithi159:/var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:20:12.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:12 smithi005 ceph-mon[31201]: Updating smithi159:/etc/ceph/ceph.client.admin.keyring 2024-09-11T23:20:12.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:12 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:12.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:12 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:12.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:12 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:13.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:13 smithi005 ceph-mon[31201]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:13.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:13 smithi005 ceph-mon[31201]: Updating smithi159:/var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T23:20:14.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:14.149+0000 7f8b0e7fc640 1 -- 172.21.15.5:0/1941860869 <== mgr.14148 v2:172.21.15.5:6800/2285128668 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f8b181069c0 con 0x7f8b040390c0 2024-09-11T23:20:14.150 INFO:teuthology.orchestra.run.smithi005.stdout:Added host 'smithi172' with addr '172.21.15.172' 2024-09-11T23:20:14.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:14.151+0000 7f8b1f757640 1 -- 172.21.15.5:0/1941860869 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f8b040390c0 msgr2=0x7f8b0403b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:14.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:14.151+0000 7f8b1f757640 1 --2- 172.21.15.5:0/1941860869 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f8b040390c0 0x7f8b0403b580 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8b080098c0 tx=0x7f8b08006db0 comp rx=0 tx=0).stop 2024-09-11T23:20:14.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:14.151+0000 7f8b1f757640 1 -- 172.21.15.5:0/1941860869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b18106560 msgr2=0x7f8b18197e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:14.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:14.151+0000 7f8b1f757640 1 --2- 172.21.15.5:0/1941860869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b18106560 0x7f8b18197e90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8b14009230 tx=0x7f8b140048f0 comp rx=0 tx=0).stop 2024-09-11T23:20:14.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:14.151+0000 7f8b1f757640 1 -- 172.21.15.5:0/1941860869 shutdown_connections 2024-09-11T23:20:14.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:14.151+0000 7f8b1f757640 1 --2- 172.21.15.5:0/1941860869 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f8b040390c0 0x7f8b0403b580 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:14.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:14.151+0000 7f8b1f757640 1 --2- 172.21.15.5:0/1941860869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b18106560 0x7f8b18197e90 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:14.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:14.151+0000 7f8b1f757640 1 -- 172.21.15.5:0/1941860869 >> 172.21.15.5:0/1941860869 conn(0x7f8b180fc1b0 msgr2=0x7f8b180fdb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:14.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:14.151+0000 7f8b1f757640 1 -- 172.21.15.5:0/1941860869 shutdown_connections 2024-09-11T23:20:14.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:14.151+0000 7f8b1f757640 1 -- 172.21.15.5:0/1941860869 wait complete. 2024-09-11T23:20:14.775 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-11T23:20:15.027 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:20:15.439 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:15 smithi005 ceph-mon[31201]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:15.439 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:15 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:15.440 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:15 smithi005 ceph-mon[31201]: Added host smithi172 2024-09-11T23:20:15.440 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:15 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:20:15.440 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:15 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:15.440 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:15 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:15.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:15.454+0000 7fe4a0eaf640 1 -- 172.21.15.5:0/3653948902 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe49c106560 msgr2=0x7fe49c106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:15.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:15.454+0000 7fe4a0eaf640 1 --2- 172.21.15.5:0/3653948902 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe49c106560 0x7fe49c106940 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe48c009880 tx=0x7fe48c02a5d0 comp rx=0 tx=0).stop 2024-09-11T23:20:15.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:15.454+0000 7fe4a0eaf640 1 -- 172.21.15.5:0/3653948902 shutdown_connections 2024-09-11T23:20:15.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:15.454+0000 7fe4a0eaf640 1 --2- 172.21.15.5:0/3653948902 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe49c106560 0x7fe49c106940 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:15.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:15.454+0000 7fe4a0eaf640 1 -- 172.21.15.5:0/3653948902 >> 172.21.15.5:0/3653948902 conn(0x7fe49c0fc1b0 msgr2=0x7fe49c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:15.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:15.454+0000 7fe4a0eaf640 1 -- 172.21.15.5:0/3653948902 shutdown_connections 2024-09-11T23:20:15.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:15.454+0000 7fe4a0eaf640 1 -- 172.21.15.5:0/3653948902 wait complete. 2024-09-11T23:20:15.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:15.455+0000 7fe4a0eaf640 1 Processor -- start 2024-09-11T23:20:15.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:15.455+0000 7fe4a0eaf640 1 -- start start 2024-09-11T23:20:15.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:15.455+0000 7fe4a0eaf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe49c106560 0x7fe49c197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:15.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:15.455+0000 7fe4a0eaf640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe49c10aa40 con 0x7fe49c106560 2024-09-11T23:20:15.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:15.455+0000 7fe49a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe49c106560 0x7fe49c197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:15.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:15.455+0000 7fe49a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe49c106560 0x7fe49c197e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36046/0 (socket says 172.21.15.5:36046) 2024-09-11T23:20:15.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:15.455+0000 7fe49a59c640 1 -- 172.21.15.5:0/2672419272 learned_addr learned my addr 172.21.15.5:0/2672419272 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:20:15.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:15.456+0000 7fe49a59c640 1 -- 172.21.15.5:0/2672419272 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe49c1983d0 con 0x7fe49c106560 2024-09-11T23:20:15.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:15.456+0000 7fe49a59c640 1 --2- 172.21.15.5:0/2672419272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe49c106560 0x7fe49c197e90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe48c009230 tx=0x7fe48c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:15.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:15.456+0000 7fe493fff640 1 -- 172.21.15.5:0/2672419272 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe48c03f070 con 0x7fe49c106560 2024-09-11T23:20:15.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:15.456+0000 7fe4a0eaf640 1 -- 172.21.15.5:0/2672419272 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe49c198660 con 0x7fe49c106560 2024-09-11T23:20:15.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:15.456+0000 7fe493fff640 1 -- 172.21.15.5:0/2672419272 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe48c004d10 con 0x7fe49c106560 2024-09-11T23:20:15.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:15.456+0000 7fe493fff640 1 -- 172.21.15.5:0/2672419272 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe48c035030 con 0x7fe49c106560 2024-09-11T23:20:15.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:15.456+0000 7fe4a0eaf640 1 -- 172.21.15.5:0/2672419272 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe49c198ac0 con 0x7fe49c106560 2024-09-11T23:20:15.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:15.457+0000 7fe493fff640 1 -- 172.21.15.5:0/2672419272 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7fe48c042070 con 0x7fe49c106560 2024-09-11T23:20:15.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:15.457+0000 7fe4a0eaf640 1 -- 172.21.15.5:0/2672419272 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe49c101bd0 con 0x7fe49c106560 2024-09-11T23:20:15.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:15.457+0000 7fe493fff640 1 --2- 172.21.15.5:0/2672419272 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe488039060 0x7fe48803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:15.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:15.457+0000 7fe493fff640 1 -- 172.21.15.5:0/2672419272 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fe48c06ccf0 con 0x7fe49c106560 2024-09-11T23:20:15.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:15.458+0000 7fe491d9b640 1 --2- 172.21.15.5:0/2672419272 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe488039060 0x7fe48803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:15.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:15.458+0000 7fe491d9b640 1 --2- 172.21.15.5:0/2672419272 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe488039060 0x7fe48803b520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe4840098c0 tx=0x7fe484006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:15.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:15.462+0000 7fe493fff640 1 -- 172.21.15.5:0/2672419272 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe48c071070 con 0x7fe49c106560 2024-09-11T23:20:15.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:15.658+0000 7fe4a0eaf640 1 -- 172.21.15.5:0/2672419272 --> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe49c1069c0 con 0x7fe488039060 2024-09-11T23:20:15.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:15.659+0000 7fe493fff640 1 -- 172.21.15.5:0/2672419272 <== mgr.14148 v2:172.21.15.5:6800/2285128668 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+239 (secure 0 0 0) 0x7fe49c1069c0 con 0x7fe488039060 2024-09-11T23:20:15.660 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:20:15.660 INFO:teuthology.orchestra.run.smithi005.stdout:[{"addr": "172.21.15.5", "hostname": "smithi005", "labels": [], "status": ""}, {"addr": "172.21.15.159", "hostname": "smithi159", "labels": [], "status": ""}, {"addr": "172.21.15.172", "hostname": "smithi172", "labels": [], "status": ""}] 2024-09-11T23:20:15.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:15.661+0000 7fe4a0eaf640 1 -- 172.21.15.5:0/2672419272 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe488039060 msgr2=0x7fe48803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:15.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:15.661+0000 7fe4a0eaf640 1 --2- 172.21.15.5:0/2672419272 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe488039060 0x7fe48803b520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe4840098c0 tx=0x7fe484006db0 comp rx=0 tx=0).stop 2024-09-11T23:20:15.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:15.661+0000 7fe4a0eaf640 1 -- 172.21.15.5:0/2672419272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe49c106560 msgr2=0x7fe49c197e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:15.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:15.661+0000 7fe4a0eaf640 1 --2- 172.21.15.5:0/2672419272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe49c106560 0x7fe49c197e90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe48c009230 tx=0x7fe48c0048f0 comp rx=0 tx=0).stop 2024-09-11T23:20:15.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:15.661+0000 7fe4a0eaf640 1 -- 172.21.15.5:0/2672419272 shutdown_connections 2024-09-11T23:20:15.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:15.661+0000 7fe4a0eaf640 1 --2- 172.21.15.5:0/2672419272 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe488039060 0x7fe48803b520 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:15.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:15.661+0000 7fe4a0eaf640 1 --2- 172.21.15.5:0/2672419272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe49c106560 0x7fe49c197e90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:15.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:15.661+0000 7fe4a0eaf640 1 -- 172.21.15.5:0/2672419272 >> 172.21.15.5:0/2672419272 conn(0x7fe49c0fc1b0 msgr2=0x7fe49c0fdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:15.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:15.661+0000 7fe4a0eaf640 1 -- 172.21.15.5:0/2672419272 shutdown_connections 2024-09-11T23:20:15.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:15.661+0000 7fe4a0eaf640 1 -- 172.21.15.5:0/2672419272 wait complete. 2024-09-11T23:20:16.229 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-11T23:20:16.230 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph osd crush tunables default 2024-09-11T23:20:16.479 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:20:16.837 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:16 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:16.837 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:16 smithi005 ceph-mon[31201]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:20:16.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:16.919+0000 7f2bba879640 1 -- 172.21.15.5:0/1715103582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bb4106560 msgr2=0x7f2bb4106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:16.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:16.919+0000 7f2bba879640 1 --2- 172.21.15.5:0/1715103582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bb4106560 0x7f2bb4106940 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4009880 tx=0x7f2ba402a5d0 comp rx=0 tx=0).stop 2024-09-11T23:20:16.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:16.919+0000 7f2bba879640 1 -- 172.21.15.5:0/1715103582 shutdown_connections 2024-09-11T23:20:16.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:16.919+0000 7f2bba879640 1 --2- 172.21.15.5:0/1715103582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bb4106560 0x7f2bb4106940 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:16.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:16.919+0000 7f2bba879640 1 -- 172.21.15.5:0/1715103582 >> 172.21.15.5:0/1715103582 conn(0x7f2bb40fc1b0 msgr2=0x7f2bb40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:16.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:16.919+0000 7f2bba879640 1 -- 172.21.15.5:0/1715103582 shutdown_connections 2024-09-11T23:20:16.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:16.919+0000 7f2bba879640 1 -- 172.21.15.5:0/1715103582 wait complete. 2024-09-11T23:20:16.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:16.919+0000 7f2bba879640 1 Processor -- start 2024-09-11T23:20:16.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:16.920+0000 7f2bba879640 1 -- start start 2024-09-11T23:20:16.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:16.920+0000 7f2bba879640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bb4106560 0x7f2bb4197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:16.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:16.920+0000 7f2bba879640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb410aa40 con 0x7f2bb4106560 2024-09-11T23:20:16.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:16.920+0000 7f2bb3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bb4106560 0x7f2bb4197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:16.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:16.920+0000 7f2bb3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bb4106560 0x7f2bb4197e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36062/0 (socket says 172.21.15.5:36062) 2024-09-11T23:20:16.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:16.920+0000 7f2bb3fff640 1 -- 172.21.15.5:0/255362369 learned_addr learned my addr 172.21.15.5:0/255362369 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:20:16.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:16.920+0000 7f2bb3fff640 1 -- 172.21.15.5:0/255362369 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bb4198350 con 0x7f2bb4106560 2024-09-11T23:20:16.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:16.920+0000 7f2bb3fff640 1 --2- 172.21.15.5:0/255362369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bb4106560 0x7f2bb4197e10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4009230 tx=0x7f2ba40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:16.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:16.920+0000 7f2bb17fa640 1 -- 172.21.15.5:0/255362369 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ba403f070 con 0x7f2bb4106560 2024-09-11T23:20:16.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:16.921+0000 7f2bb17fa640 1 -- 172.21.15.5:0/255362369 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2ba4004d10 con 0x7f2bb4106560 2024-09-11T23:20:16.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:16.921+0000 7f2bba879640 1 -- 172.21.15.5:0/255362369 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bb41985e0 con 0x7f2bb4106560 2024-09-11T23:20:16.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:16.921+0000 7f2bb17fa640 1 -- 172.21.15.5:0/255362369 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ba4035030 con 0x7f2bb4106560 2024-09-11T23:20:16.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:16.921+0000 7f2bba879640 1 -- 172.21.15.5:0/255362369 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bb4198a40 con 0x7f2bb4106560 2024-09-11T23:20:16.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:16.922+0000 7f2bb17fa640 1 -- 172.21.15.5:0/255362369 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f2ba4042070 con 0x7f2bb4106560 2024-09-11T23:20:16.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:16.922+0000 7f2bba879640 1 -- 172.21.15.5:0/255362369 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bb4101bd0 con 0x7f2bb4106560 2024-09-11T23:20:16.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:16.922+0000 7f2bb17fa640 1 --2- 172.21.15.5:0/255362369 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f2b9c03d4d0 0x7f2b9c03f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:16.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:16.922+0000 7f2bb17fa640 1 -- 172.21.15.5:0/255362369 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f2ba406ce50 con 0x7f2bb4106560 2024-09-11T23:20:16.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:16.922+0000 7f2bb37fe640 1 --2- 172.21.15.5:0/255362369 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f2b9c03d4d0 0x7f2b9c03f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:16.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:16.922+0000 7f2bb37fe640 1 --2- 172.21.15.5:0/255362369 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f2b9c03d4d0 0x7f2b9c03f990 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2ba80098c0 tx=0x7f2ba8006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:16.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:16.927+0000 7f2bb17fa640 1 -- 172.21.15.5:0/255362369 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2ba4039350 con 0x7f2bb4106560 2024-09-11T23:20:17.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:17.109+0000 7f2bba879640 1 -- 172.21.15.5:0/255362369 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f2bb41069c0 con 0x7f2bb4106560 2024-09-11T23:20:17.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:17.534+0000 7f2bb17fa640 1 -- 172.21.15.5:0/255362369 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f2ba406e030 con 0x7f2bb4106560 2024-09-11T23:20:17.535 INFO:teuthology.orchestra.run.smithi005.stderr:adjusted tunables profile to default 2024-09-11T23:20:17.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:17.537+0000 7f2bba879640 1 -- 172.21.15.5:0/255362369 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f2b9c03d4d0 msgr2=0x7f2b9c03f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:17.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:17.537+0000 7f2bba879640 1 --2- 172.21.15.5:0/255362369 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f2b9c03d4d0 0x7f2b9c03f990 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2ba80098c0 tx=0x7f2ba8006db0 comp rx=0 tx=0).stop 2024-09-11T23:20:17.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:17.537+0000 7f2bba879640 1 -- 172.21.15.5:0/255362369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bb4106560 msgr2=0x7f2bb4197e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:17.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:17.537+0000 7f2bba879640 1 --2- 172.21.15.5:0/255362369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bb4106560 0x7f2bb4197e10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4009230 tx=0x7f2ba40048f0 comp rx=0 tx=0).stop 2024-09-11T23:20:17.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:17.537+0000 7f2bba879640 1 -- 172.21.15.5:0/255362369 shutdown_connections 2024-09-11T23:20:17.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:17.537+0000 7f2bba879640 1 --2- 172.21.15.5:0/255362369 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f2b9c03d4d0 0x7f2b9c03f990 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:17.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:17.537+0000 7f2bba879640 1 --2- 172.21.15.5:0/255362369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bb4106560 0x7f2bb4197e10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:17.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:17.537+0000 7f2bba879640 1 -- 172.21.15.5:0/255362369 >> 172.21.15.5:0/255362369 conn(0x7f2bb40fc1b0 msgr2=0x7f2bb40fdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:17.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:17.537+0000 7f2bba879640 1 -- 172.21.15.5:0/255362369 shutdown_connections 2024-09-11T23:20:17.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:17.538+0000 7f2bba879640 1 -- 172.21.15.5:0/255362369 wait complete. 2024-09-11T23:20:17.824 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:17 smithi005 ceph-mon[31201]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:17.824 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:17 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/255362369' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-11T23:20:18.098 INFO:tasks.cephadm:Adding mon.a on smithi005 2024-09-11T23:20:18.098 INFO:tasks.cephadm:Adding mon.b on smithi159 2024-09-11T23:20:18.098 INFO:tasks.cephadm:Adding mon.c on smithi172 2024-09-11T23:20:18.098 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph orch apply mon '3;smithi005:172.21.15.5=a;smithi159:172.21.15.159=b;smithi172:172.21.15.172=c' 2024-09-11T23:20:18.342 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-11T23:20:18.389 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-11T23:20:18.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:18.856+0000 7fab5927e640 1 -- 172.21.15.172:0/3348194582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab541015e0 msgr2=0x7fab541019e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:18.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:18.856+0000 7fab5927e640 1 --2- 172.21.15.172:0/3348194582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab541015e0 0x7fab541019e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fab44009880 tx=0x7fab4402a5d0 comp rx=0 tx=0).stop 2024-09-11T23:20:18.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:18.856+0000 7fab5927e640 1 -- 172.21.15.172:0/3348194582 shutdown_connections 2024-09-11T23:20:18.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:18.856+0000 7fab5927e640 1 --2- 172.21.15.172:0/3348194582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab541015e0 0x7fab541019e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:18.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:18.856+0000 7fab5927e640 1 -- 172.21.15.172:0/3348194582 >> 172.21.15.172:0/3348194582 conn(0x7fab540fcd70 msgr2=0x7fab540ff1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:18.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:18.856+0000 7fab5927e640 1 -- 172.21.15.172:0/3348194582 shutdown_connections 2024-09-11T23:20:18.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:18.856+0000 7fab5927e640 1 -- 172.21.15.172:0/3348194582 wait complete. 2024-09-11T23:20:18.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:18.857+0000 7fab5927e640 1 Processor -- start 2024-09-11T23:20:18.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:18.857+0000 7fab5927e640 1 -- start start 2024-09-11T23:20:18.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:18.857+0000 7fab5927e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab541015e0 0x7fab54075eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:18.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:18.857+0000 7fab5927e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fab541075a0 con 0x7fab541015e0 2024-09-11T23:20:18.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:18.857+0000 7fab52ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab541015e0 0x7fab54075eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:18.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:18.857+0000 7fab52ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab541015e0 0x7fab54075eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.172:52850/0 (socket says 172.21.15.172:52850) 2024-09-11T23:20:18.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:18.857+0000 7fab52ffd640 1 -- 172.21.15.172:0/1319708908 learned_addr learned my addr 172.21.15.172:0/1319708908 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-11T23:20:18.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:18.858+0000 7fab52ffd640 1 -- 172.21.15.172:0/1319708908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab540763f0 con 0x7fab541015e0 2024-09-11T23:20:18.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:18.858+0000 7fab52ffd640 1 --2- 172.21.15.172:0/1319708908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab541015e0 0x7fab54075eb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fab44009230 tx=0x7fab440048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:18.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:18.858+0000 7fab4bfff640 1 -- 172.21.15.172:0/1319708908 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab4403f070 con 0x7fab541015e0 2024-09-11T23:20:18.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:18.858+0000 7fab5927e640 1 -- 172.21.15.172:0/1319708908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab540745e0 con 0x7fab541015e0 2024-09-11T23:20:18.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:18.858+0000 7fab4bfff640 1 -- 172.21.15.172:0/1319708908 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fab44003aa0 con 0x7fab541015e0 2024-09-11T23:20:18.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:18.858+0000 7fab4bfff640 1 -- 172.21.15.172:0/1319708908 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab44035030 con 0x7fab541015e0 2024-09-11T23:20:18.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:18.858+0000 7fab5927e640 1 -- 172.21.15.172:0/1319708908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab54074b20 con 0x7fab541015e0 2024-09-11T23:20:18.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:18.859+0000 7fab4bfff640 1 -- 172.21.15.172:0/1319708908 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7fab44042070 con 0x7fab541015e0 2024-09-11T23:20:18.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:18.859+0000 7fab5927e640 1 -- 172.21.15.172:0/1319708908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab54107d20 con 0x7fab541015e0 2024-09-11T23:20:18.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:18.859+0000 7fab4bfff640 1 --2- 172.21.15.172:0/1319708908 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fab40039060 0x7fab4003b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:18.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:18.859+0000 7fab4bfff640 1 -- 172.21.15.172:0/1319708908 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fab4406cf20 con 0x7fab541015e0 2024-09-11T23:20:18.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:18.860+0000 7fab527fc640 1 --2- 172.21.15.172:0/1319708908 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fab40039060 0x7fab4003b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:18.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:18.860+0000 7fab527fc640 1 --2- 172.21.15.172:0/1319708908 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fab40039060 0x7fab4003b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fab3c0098c0 tx=0x7fab3c006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:18.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:18.865+0000 7fab4bfff640 1 -- 172.21.15.172:0/1319708908 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fab440035f0 con 0x7fab541015e0 2024-09-11T23:20:18.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:18 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/255362369' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-11T23:20:18.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:18 smithi005 ceph-mon[31201]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T23:20:18.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:18 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:18.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:18 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:18.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:18 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:18.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:18 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:18.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:18 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi172", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:20:18.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:18 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:20:18.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:18 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:20:19.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:19.059+0000 7fab5927e640 1 -- 172.21.15.172:0/1319708908 --> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi005:172.21.15.5=a;smithi159:172.21.15.159=b;smithi172:172.21.15.172=c", "target": ["mon-mgr", ""]}) -- 0x7fab54190120 con 0x7fab40039060 2024-09-11T23:20:19.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:19.065+0000 7fab4bfff640 1 -- 172.21.15.172:0/1319708908 <== mgr.14148 v2:172.21.15.5:6800/2285128668 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fab54190120 con 0x7fab40039060 2024-09-11T23:20:19.065 INFO:teuthology.orchestra.run.smithi172.stdout:Scheduled mon update... 2024-09-11T23:20:19.067 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:19.067+0000 7fab5927e640 1 -- 172.21.15.172:0/1319708908 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fab40039060 msgr2=0x7fab4003b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:19.067 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:19.067+0000 7fab5927e640 1 --2- 172.21.15.172:0/1319708908 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fab40039060 0x7fab4003b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fab3c0098c0 tx=0x7fab3c006db0 comp rx=0 tx=0).stop 2024-09-11T23:20:19.067 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:19.067+0000 7fab5927e640 1 -- 172.21.15.172:0/1319708908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab541015e0 msgr2=0x7fab54075eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:19.067 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:19.067+0000 7fab5927e640 1 --2- 172.21.15.172:0/1319708908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab541015e0 0x7fab54075eb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fab44009230 tx=0x7fab440048f0 comp rx=0 tx=0).stop 2024-09-11T23:20:19.067 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:19.067+0000 7fab5927e640 1 -- 172.21.15.172:0/1319708908 shutdown_connections 2024-09-11T23:20:19.067 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:19.067+0000 7fab5927e640 1 --2- 172.21.15.172:0/1319708908 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fab40039060 0x7fab4003b520 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:19.067 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:19.067+0000 7fab5927e640 1 --2- 172.21.15.172:0/1319708908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab541015e0 0x7fab54075eb0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:19.067 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:19.067+0000 7fab5927e640 1 -- 172.21.15.172:0/1319708908 >> 172.21.15.172:0/1319708908 conn(0x7fab540fcd70 msgr2=0x7fab540fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:19.067 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:19.067+0000 7fab5927e640 1 -- 172.21.15.172:0/1319708908 shutdown_connections 2024-09-11T23:20:19.067 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:19.067+0000 7fab5927e640 1 -- 172.21.15.172:0/1319708908 wait complete. 2024-09-11T23:20:19.833 DEBUG:teuthology.orchestra.run.smithi159:mon.b> sudo journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mon.b.service 2024-09-11T23:20:19.836 DEBUG:teuthology.orchestra.run.smithi172:mon.c> sudo journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mon.c.service 2024-09-11T23:20:19.839 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-11T23:20:19.840 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-11T23:20:19.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:19 smithi005 ceph-mon[31201]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:19.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:19 smithi005 ceph-mon[31201]: Updating smithi172:/etc/ceph/ceph.conf 2024-09-11T23:20:19.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:19 smithi005 ceph-mon[31201]: Updating smithi172:/var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:20:19.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:19 smithi005 ceph-mon[31201]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-09-11T23:20:19.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:19 smithi005 ceph-mon[31201]: Updating smithi172:/var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T23:20:19.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:19 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:19.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:19 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:19.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:19 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:19.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:19 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:19.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:19 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:20:19.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:19 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:20:20.515 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:20:20.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:20.960+0000 7f410f290640 1 -- 172.21.15.172:0/2250374306 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4108107660 msgr2=0x7f4108107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:20.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:20.960+0000 7f410f290640 1 --2- 172.21.15.172:0/2250374306 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4108107660 0x7f4108107a40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f40fc009880 tx=0x7f40fc02a5d0 comp rx=0 tx=0).stop 2024-09-11T23:20:20.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:20.960+0000 7f410f290640 1 -- 172.21.15.172:0/2250374306 shutdown_connections 2024-09-11T23:20:20.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:20.960+0000 7f410f290640 1 --2- 172.21.15.172:0/2250374306 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4108107660 0x7f4108107a40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:20.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:20.960+0000 7f410f290640 1 -- 172.21.15.172:0/2250374306 >> 172.21.15.172:0/2250374306 conn(0x7f41080fd290 msgr2=0x7f41080ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:20.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:20.960+0000 7f410f290640 1 -- 172.21.15.172:0/2250374306 shutdown_connections 2024-09-11T23:20:20.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:20.960+0000 7f410f290640 1 -- 172.21.15.172:0/2250374306 wait complete. 2024-09-11T23:20:20.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:20.961+0000 7f410f290640 1 Processor -- start 2024-09-11T23:20:20.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:20.961+0000 7f410f290640 1 -- start start 2024-09-11T23:20:20.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:20.961+0000 7f410f290640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4108107660 0x7f41081992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:20.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:20.961+0000 7f410f290640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f410810bb40 con 0x7f4108107660 2024-09-11T23:20:20.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:20.961+0000 7f410d02c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4108107660 0x7f41081992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:20.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:20.961+0000 7f410d02c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4108107660 0x7f41081992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.172:52872/0 (socket says 172.21.15.172:52872) 2024-09-11T23:20:20.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:20.961+0000 7f410d02c640 1 -- 172.21.15.172:0/4196922057 learned_addr learned my addr 172.21.15.172:0/4196922057 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-11T23:20:20.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:20.962+0000 7f410d02c640 1 -- 172.21.15.172:0/4196922057 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41081997e0 con 0x7f4108107660 2024-09-11T23:20:20.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:20.962+0000 7f410d02c640 1 --2- 172.21.15.172:0/4196922057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4108107660 0x7f41081992a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f40fc009230 tx=0x7f40fc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:20.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:20.962+0000 7f40fa7fc640 1 -- 172.21.15.172:0/4196922057 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40fc03f070 con 0x7f4108107660 2024-09-11T23:20:20.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:20.962+0000 7f410f290640 1 -- 172.21.15.172:0/4196922057 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4108199a70 con 0x7f4108107660 2024-09-11T23:20:20.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:20.962+0000 7f40fa7fc640 1 -- 172.21.15.172:0/4196922057 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f40fc003aa0 con 0x7f4108107660 2024-09-11T23:20:20.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:20.962+0000 7f40fa7fc640 1 -- 172.21.15.172:0/4196922057 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40fc035030 con 0x7f4108107660 2024-09-11T23:20:20.967 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:20.962+0000 7f410f290640 1 -- 172.21.15.172:0/4196922057 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4108199ed0 con 0x7f4108107660 2024-09-11T23:20:20.967 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:20.963+0000 7f410f290640 1 -- 172.21.15.172:0/4196922057 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4108102cd0 con 0x7f4108107660 2024-09-11T23:20:20.967 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:20.963+0000 7f40fa7fc640 1 -- 172.21.15.172:0/4196922057 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f40fc042070 con 0x7f4108107660 2024-09-11T23:20:20.967 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:20.964+0000 7f40fa7fc640 1 --2- 172.21.15.172:0/4196922057 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f40f4039060 0x7f40f403b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:20.967 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:20.964+0000 7f40fa7fc640 1 -- 172.21.15.172:0/4196922057 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f40fc06cc50 con 0x7f4108107660 2024-09-11T23:20:20.967 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:20.964+0000 7f410c82b640 1 --2- 172.21.15.172:0/4196922057 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f40f4039060 0x7f40f403b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:20.967 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:20.964+0000 7f410c82b640 1 --2- 172.21.15.172:0/4196922057 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f40f4039060 0x7f40f403b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f41040098c0 tx=0x7f4104006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:20.969 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:20.969+0000 7f40fa7fc640 1 -- 172.21.15.172:0/4196922057 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f40fc072020 con 0x7f4108107660 2024-09-11T23:20:20.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:20 smithi005 ceph-mon[31201]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi005:172.21.15.5=a;smithi159:172.21.15.159=b;smithi172:172.21.15.172=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:20:20.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:20 smithi005 ceph-mon[31201]: Saving service mon spec with placement smithi005:172.21.15.5=a;smithi159:172.21.15.159=b;smithi172:172.21.15.172=c;count:3 2024-09-11T23:20:20.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:20 smithi005 ceph-mon[31201]: Deploying daemon mon.c on smithi172 2024-09-11T23:20:21.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:21.202+0000 7f410f290640 1 -- 172.21.15.172:0/4196922057 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f410819a660 con 0x7f4108107660 2024-09-11T23:20:21.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:21.203+0000 7f40fa7fc640 1 -- 172.21.15.172:0/4196922057 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+741 (secure 0 0 0) 0x7f40fc04c350 con 0x7f4108107660 2024-09-11T23:20:21.203 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-11T23:20:21.203 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"1f5284d2-7094-11ef-bcea-c7b262605968","modified":"2024-09-11T23:18:57.103876Z","created":"2024-09-11T23:18:57.103876Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-11T23:20:21.203 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2024-09-11T23:20:21.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:21.205+0000 7f410f290640 1 -- 172.21.15.172:0/4196922057 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f40f4039060 msgr2=0x7f40f403b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:21.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:21.205+0000 7f410f290640 1 --2- 172.21.15.172:0/4196922057 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f40f4039060 0x7f40f403b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f41040098c0 tx=0x7f4104006db0 comp rx=0 tx=0).stop 2024-09-11T23:20:21.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:21.205+0000 7f410f290640 1 -- 172.21.15.172:0/4196922057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4108107660 msgr2=0x7f41081992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:21.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:21.205+0000 7f410f290640 1 --2- 172.21.15.172:0/4196922057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4108107660 0x7f41081992a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f40fc009230 tx=0x7f40fc0048f0 comp rx=0 tx=0).stop 2024-09-11T23:20:21.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:21.205+0000 7f410f290640 1 -- 172.21.15.172:0/4196922057 shutdown_connections 2024-09-11T23:20:21.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:21.205+0000 7f410f290640 1 --2- 172.21.15.172:0/4196922057 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f40f4039060 0x7f40f403b520 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:21.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:21.205+0000 7f410f290640 1 --2- 172.21.15.172:0/4196922057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4108107660 0x7f41081992a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:21.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:21.205+0000 7f410f290640 1 -- 172.21.15.172:0/4196922057 >> 172.21.15.172:0/4196922057 conn(0x7f41080fd290 msgr2=0x7f41080ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:21.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:21.205+0000 7f410f290640 1 -- 172.21.15.172:0/4196922057 shutdown_connections 2024-09-11T23:20:21.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:21.205+0000 7f410f290640 1 -- 172.21.15.172:0/4196922057 wait complete. 2024-09-11T23:20:21.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:21 smithi005 ceph-mon[31201]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:21.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:21 smithi005 ceph-mon[31201]: from='client.? 172.21.15.172:0/4196922057' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T23:20:22.810 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-11T23:20:22.811 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-11T23:20:23.145 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:20:23.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:23.724+0000 7fdda38f1640 1 -- 172.21.15.172:0/3883370319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd9c106650 msgr2=0x7fdd9c106a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:23.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:23.724+0000 7fdda38f1640 1 --2- 172.21.15.172:0/3883370319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd9c106650 0x7fdd9c106a30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdd98009880 tx=0x7fdd9802a5d0 comp rx=0 tx=0).stop 2024-09-11T23:20:23.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:23.724+0000 7fdda38f1640 1 -- 172.21.15.172:0/3883370319 shutdown_connections 2024-09-11T23:20:23.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:23.724+0000 7fdda38f1640 1 --2- 172.21.15.172:0/3883370319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd9c106650 0x7fdd9c106a30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:23.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:23.724+0000 7fdda38f1640 1 -- 172.21.15.172:0/3883370319 >> 172.21.15.172:0/3883370319 conn(0x7fdd9c0fc280 msgr2=0x7fdd9c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:23.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:23.725+0000 7fdda38f1640 1 -- 172.21.15.172:0/3883370319 shutdown_connections 2024-09-11T23:20:23.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:23.725+0000 7fdda38f1640 1 -- 172.21.15.172:0/3883370319 wait complete. 2024-09-11T23:20:23.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:23.725+0000 7fdda38f1640 1 Processor -- start 2024-09-11T23:20:23.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:23.725+0000 7fdda38f1640 1 -- start start 2024-09-11T23:20:23.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:23.725+0000 7fdda38f1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd9c106650 0x7fdd9c198000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:23.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:23.725+0000 7fdda38f1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdd9c10ab30 con 0x7fdd9c106650 2024-09-11T23:20:23.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:23.726+0000 7fdda168d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd9c106650 0x7fdd9c198000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:23.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:23.726+0000 7fdda168d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd9c106650 0x7fdd9c198000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.172:52898/0 (socket says 172.21.15.172:52898) 2024-09-11T23:20:23.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:23.726+0000 7fdda168d640 1 -- 172.21.15.172:0/3916597860 learned_addr learned my addr 172.21.15.172:0/3916597860 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-11T23:20:23.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:23.726+0000 7fdda168d640 1 -- 172.21.15.172:0/3916597860 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd9c198540 con 0x7fdd9c106650 2024-09-11T23:20:23.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:23.726+0000 7fdda168d640 1 --2- 172.21.15.172:0/3916597860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd9c106650 0x7fdd9c198000 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdd98009230 tx=0x7fdd980048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:23.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:23.726+0000 7fdd927fc640 1 -- 172.21.15.172:0/3916597860 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd9803f070 con 0x7fdd9c106650 2024-09-11T23:20:23.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:23.726+0000 7fdda38f1640 1 -- 172.21.15.172:0/3916597860 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd9c1987d0 con 0x7fdd9c106650 2024-09-11T23:20:23.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:23.726+0000 7fdd927fc640 1 -- 172.21.15.172:0/3916597860 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdd98004d10 con 0x7fdd9c106650 2024-09-11T23:20:23.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:23.726+0000 7fdd927fc640 1 -- 172.21.15.172:0/3916597860 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd98035030 con 0x7fdd9c106650 2024-09-11T23:20:23.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:23.726+0000 7fdda38f1640 1 -- 172.21.15.172:0/3916597860 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd9c198c30 con 0x7fdd9c106650 2024-09-11T23:20:23.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:23.727+0000 7fdda38f1640 1 -- 172.21.15.172:0/3916597860 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd9c101cc0 con 0x7fdd9c106650 2024-09-11T23:20:23.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:23.727+0000 7fdd927fc640 1 -- 172.21.15.172:0/3916597860 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7fdd98042070 con 0x7fdd9c106650 2024-09-11T23:20:23.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:23.727+0000 7fdd927fc640 1 --2- 172.21.15.172:0/3916597860 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fdd88039060 0x7fdd8803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:23.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:23.727+0000 7fdd927fc640 1 -- 172.21.15.172:0/3916597860 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fdd9806cd80 con 0x7fdd9c106650 2024-09-11T23:20:23.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:23.728+0000 7fdda0e8c640 1 --2- 172.21.15.172:0/3916597860 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fdd88039060 0x7fdd8803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:23.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:23.728+0000 7fdda0e8c640 1 --2- 172.21.15.172:0/3916597860 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fdd88039060 0x7fdd8803b520 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c0098c0 tx=0x7fdd8c006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:23.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:23.733+0000 7fdd927fc640 1 -- 172.21.15.172:0/3916597860 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdd9802fdc0 con 0x7fdd9c106650 2024-09-11T23:20:23.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:23 smithi005 ceph-mon[31201]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:23.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:23.986+0000 7fdda38f1640 1 -- 172.21.15.172:0/3916597860 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fdd9c106ab0 con 0x7fdd9c106650 2024-09-11T23:20:23.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:23.987+0000 7fdd927fc640 1 -- 172.21.15.172:0/3916597860 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+741 (secure 0 0 0) 0x7fdd98003970 con 0x7fdd9c106650 2024-09-11T23:20:23.987 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-11T23:20:23.987 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"1f5284d2-7094-11ef-bcea-c7b262605968","modified":"2024-09-11T23:18:57.103876Z","created":"2024-09-11T23:18:57.103876Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-11T23:20:23.987 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2024-09-11T23:20:23.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:23.989+0000 7fdda38f1640 1 -- 172.21.15.172:0/3916597860 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fdd88039060 msgr2=0x7fdd8803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:23.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:23.989+0000 7fdda38f1640 1 --2- 172.21.15.172:0/3916597860 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fdd88039060 0x7fdd8803b520 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c0098c0 tx=0x7fdd8c006db0 comp rx=0 tx=0).stop 2024-09-11T23:20:23.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:23.989+0000 7fdda38f1640 1 -- 172.21.15.172:0/3916597860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd9c106650 msgr2=0x7fdd9c198000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:23.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:23.989+0000 7fdda38f1640 1 --2- 172.21.15.172:0/3916597860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd9c106650 0x7fdd9c198000 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdd98009230 tx=0x7fdd980048f0 comp rx=0 tx=0).stop 2024-09-11T23:20:23.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:23.989+0000 7fdda38f1640 1 -- 172.21.15.172:0/3916597860 shutdown_connections 2024-09-11T23:20:23.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:23.989+0000 7fdda38f1640 1 --2- 172.21.15.172:0/3916597860 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fdd88039060 0x7fdd8803b520 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:23.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:23.989+0000 7fdda38f1640 1 --2- 172.21.15.172:0/3916597860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd9c106650 0x7fdd9c198000 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:23.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:23.989+0000 7fdda38f1640 1 -- 172.21.15.172:0/3916597860 >> 172.21.15.172:0/3916597860 conn(0x7fdd9c0fc280 msgr2=0x7fdd9c0fdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:23.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:23.989+0000 7fdda38f1640 1 -- 172.21.15.172:0/3916597860 shutdown_connections 2024-09-11T23:20:23.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:23.989+0000 7fdda38f1640 1 -- 172.21.15.172:0/3916597860 wait complete. 2024-09-11T23:20:24.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:24 smithi005 ceph-mon[31201]: from='client.? 172.21.15.172:0/3916597860' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T23:20:25.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:25 smithi172 systemd[1]: Started Ceph mon.c for 1f5284d2-7094-11ef-bcea-c7b262605968. 2024-09-11T23:20:25.698 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-11T23:20:25.699 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-11T23:20:25.948 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:20:30.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:30 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:20:30.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:30 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:20:30.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:30 smithi172 ceph-mon[34855]: mon.a calling monitor election 2024-09-11T23:20:30.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:30 smithi172 ceph-mon[34855]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:30.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:30 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:20:30.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:30 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:20:30.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:30 smithi172 ceph-mon[34855]: mon.c calling monitor election 2024-09-11T23:20:30.386 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:30 smithi172 ceph-mon[34855]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:30.386 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:30 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:20:30.386 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:30 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:20:30.386 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:30 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:20:30.386 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:30 smithi172 ceph-mon[34855]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-11T23:20:30.386 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:30 smithi172 ceph-mon[34855]: monmap epoch 2 2024-09-11T23:20:30.386 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:30 smithi172 ceph-mon[34855]: fsid 1f5284d2-7094-11ef-bcea-c7b262605968 2024-09-11T23:20:30.386 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:30 smithi172 ceph-mon[34855]: last_changed 2024-09-11T23:20:25.054166+0000 2024-09-11T23:20:30.386 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:30 smithi172 ceph-mon[34855]: created 2024-09-11T23:18:57.103876+0000 2024-09-11T23:20:30.386 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:30 smithi172 ceph-mon[34855]: min_mon_release 19 (squid) 2024-09-11T23:20:30.386 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:30 smithi172 ceph-mon[34855]: election_strategy: 1 2024-09-11T23:20:30.386 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:30 smithi172 ceph-mon[34855]: 0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-09-11T23:20:30.386 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:30 smithi172 ceph-mon[34855]: 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.c 2024-09-11T23:20:30.386 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:30 smithi172 ceph-mon[34855]: fsmap 2024-09-11T23:20:30.387 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:30 smithi172 ceph-mon[34855]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T23:20:30.387 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:30 smithi172 ceph-mon[34855]: mgrmap e13: x(active, since 40s) 2024-09-11T23:20:30.387 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:30 smithi172 ceph-mon[34855]: overall HEALTH_OK 2024-09-11T23:20:30.387 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:30 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:30.387 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:30 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:30.387 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:30 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:30.387 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:30 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:20:30.387 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:30 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:20:30.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:30 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:20:30.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:30 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:20:30.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:30 smithi005 ceph-mon[31201]: mon.a calling monitor election 2024-09-11T23:20:30.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:30 smithi005 ceph-mon[31201]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:30.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:30 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:20:30.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:30 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:20:30.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:30 smithi005 ceph-mon[31201]: mon.c calling monitor election 2024-09-11T23:20:30.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:30 smithi005 ceph-mon[31201]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:30.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:30 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:20:30.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:30 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:20:30.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:30 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:20:30.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:30 smithi005 ceph-mon[31201]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-11T23:20:30.476 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:30 smithi005 ceph-mon[31201]: monmap epoch 2 2024-09-11T23:20:30.476 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:30 smithi005 ceph-mon[31201]: fsid 1f5284d2-7094-11ef-bcea-c7b262605968 2024-09-11T23:20:30.476 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:30 smithi005 ceph-mon[31201]: last_changed 2024-09-11T23:20:25.054166+0000 2024-09-11T23:20:30.476 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:30 smithi005 ceph-mon[31201]: created 2024-09-11T23:18:57.103876+0000 2024-09-11T23:20:30.476 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:30 smithi005 ceph-mon[31201]: min_mon_release 19 (squid) 2024-09-11T23:20:30.476 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:30 smithi005 ceph-mon[31201]: election_strategy: 1 2024-09-11T23:20:30.476 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:30 smithi005 ceph-mon[31201]: 0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-09-11T23:20:30.476 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:30 smithi005 ceph-mon[31201]: 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.c 2024-09-11T23:20:30.476 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:30 smithi005 ceph-mon[31201]: fsmap 2024-09-11T23:20:30.476 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:30 smithi005 ceph-mon[31201]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T23:20:30.476 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:30 smithi005 ceph-mon[31201]: mgrmap e13: x(active, since 40s) 2024-09-11T23:20:30.476 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:30 smithi005 ceph-mon[31201]: overall HEALTH_OK 2024-09-11T23:20:30.476 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:30 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:30.476 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:30 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:30.477 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:30 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:30.477 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:30 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:20:30.477 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:30 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:20:30.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:30.778+0000 7f184bd81640 1 -- 172.21.15.172:0/1471261649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1830005740 msgr2=0x7f1830007bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:30.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:30.778+0000 7f184bd81640 1 --2- 172.21.15.172:0/1471261649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1830005740 0x7f1830007bd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f18441016c0 tx=0x7f183802c490 comp rx=0 tx=0).stop 2024-09-11T23:20:30.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:30.778+0000 7f184bd81640 1 -- 172.21.15.172:0/1471261649 shutdown_connections 2024-09-11T23:20:30.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:30.778+0000 7f184bd81640 1 --2- 172.21.15.172:0/1471261649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1830005740 0x7f1830007bd0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:30.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:30.778+0000 7f184bd81640 1 -- 172.21.15.172:0/1471261649 >> 172.21.15.172:0/1471261649 conn(0x7f18440fc280 msgr2=0x7f18440fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:30.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:30.778+0000 7f184bd81640 1 -- 172.21.15.172:0/1471261649 shutdown_connections 2024-09-11T23:20:30.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:30.778+0000 7f184bd81640 1 -- 172.21.15.172:0/1471261649 wait complete. 2024-09-11T23:20:30.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:30.779+0000 7f184bd81640 1 Processor -- start 2024-09-11T23:20:30.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:30.779+0000 7f184bd81640 1 -- start start 2024-09-11T23:20:30.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:30.779+0000 7f184bd81640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1830005740 0x7f1844194fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:30.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:30.779+0000 7f184bd81640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1844195510 0x7f18441998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:30.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:30.779+0000 7f184bd81640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1844107570 con 0x7f1830005740 2024-09-11T23:20:30.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:30.779+0000 7f184bd81640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f18441073f0 con 0x7f1844195510 2024-09-11T23:20:30.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:30.779+0000 7f184931c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1844195510 0x7f18441998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:30.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:30.779+0000 7f184931c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1844195510 0x7f18441998a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40408/0 (socket says 172.21.15.172:40408) 2024-09-11T23:20:30.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:30.779+0000 7f184931c640 1 -- 172.21.15.172:0/3323905854 learned_addr learned my addr 172.21.15.172:0/3323905854 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-11T23:20:30.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:30.779+0000 7f184931c640 1 -- 172.21.15.172:0/3323905854 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1844195510 msgr2=0x7f18441998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-11T23:20:30.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:30.779+0000 7f184931c640 1 -- 172.21.15.172:0/3323905854 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1844195510 msgr2=0x7f18441998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T23:20:30.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:30.779+0000 7f184931c640 1 --2- 172.21.15.172:0/3323905854 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1844195510 0x7f18441998a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T23:20:30.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:30.779+0000 7f1849b1d640 1 --2- 172.21.15.172:0/3323905854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1830005740 0x7f1844194fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:30.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:30.779+0000 7f184931c640 1 --2- 172.21.15.172:0/3323905854 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1844195510 0x7f18441998a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:20:30.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:30.780+0000 7f1849b1d640 1 -- 172.21.15.172:0/3323905854 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1844195510 msgr2=0x7f18441998a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:20:30.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:30.780+0000 7f1849b1d640 1 --2- 172.21.15.172:0/3323905854 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1844195510 0x7f18441998a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:30.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:30.780+0000 7f1849b1d640 1 -- 172.21.15.172:0/3323905854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1844195b30 con 0x7f1830005740 2024-09-11T23:20:30.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:30.780+0000 7f1849b1d640 1 --2- 172.21.15.172:0/3323905854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1830005740 0x7f1844194fd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1838005f30 tx=0x7f18380339a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:30.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:30.780+0000 7f1836ffd640 1 -- 172.21.15.172:0/3323905854 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f1838038040 con 0x7f1830005740 2024-09-11T23:20:30.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:30.780+0000 7f1836ffd640 1 -- 172.21.15.172:0/3323905854 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f18380055c0 con 0x7f1830005740 2024-09-11T23:20:30.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:30.780+0000 7f184bd81640 1 -- 172.21.15.172:0/3323905854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1844199de0 con 0x7f1830005740 2024-09-11T23:20:30.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:30.780+0000 7f1836ffd640 1 -- 172.21.15.172:0/3323905854 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f1838004980 con 0x7f1830005740 2024-09-11T23:20:30.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:30.780+0000 7f184bd81640 1 -- 172.21.15.172:0/3323905854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f184419a3a0 con 0x7f1830005740 2024-09-11T23:20:30.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:30.781+0000 7f1836ffd640 1 -- 172.21.15.172:0/3323905854 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f1838043020 con 0x7f1830005740 2024-09-11T23:20:30.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:30.782+0000 7f184bd81640 1 -- 172.21.15.172:0/3323905854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1844101cc0 con 0x7f1830005740 2024-09-11T23:20:30.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:30.782+0000 7f1836ffd640 1 --2- 172.21.15.172:0/3323905854 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f1828038e50 0x7f182803b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:30.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:30.782+0000 7f1836ffd640 1 -- 172.21.15.172:0/3323905854 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f183806e520 con 0x7f1830005740 2024-09-11T23:20:30.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:30.782+0000 7f184931c640 1 --2- 172.21.15.172:0/3323905854 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f1828038e50 0x7f182803b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:30.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:30.783+0000 7f184931c640 1 --2- 172.21.15.172:0/3323905854 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f1828038e50 0x7f182803b310 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1840009100 tx=0x7f1840008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:30.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:30.787+0000 7f1836ffd640 1 -- 172.21.15.172:0/3323905854 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f183804a020 con 0x7f1830005740 2024-09-11T23:20:31.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:31.020+0000 7f184bd81640 1 -- 172.21.15.172:0/3323905854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f184419a680 con 0x7f1830005740 2024-09-11T23:20:31.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:31.021+0000 7f1836ffd640 1 -- 172.21.15.172:0/3323905854 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1011 (secure 0 0 0) 0x7f183804d350 con 0x7f1830005740 2024-09-11T23:20:31.021 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-11T23:20:31.021 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":2,"fsid":"1f5284d2-7094-11ef-bcea-c7b262605968","modified":"2024-09-11T23:20:25.054166Z","created":"2024-09-11T23:18:57.103876Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:3300","nonce":0},{"type":"v1","addr":"172.21.15.172:6789","nonce":0}]},"addr":"172.21.15.172:6789/0","public_addr":"172.21.15.172:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-11T23:20:31.021 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 2 2024-09-11T23:20:31.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:31.023+0000 7f184bd81640 1 -- 172.21.15.172:0/3323905854 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f1828038e50 msgr2=0x7f182803b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:31.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:31.023+0000 7f184bd81640 1 --2- 172.21.15.172:0/3323905854 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f1828038e50 0x7f182803b310 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1840009100 tx=0x7f1840008040 comp rx=0 tx=0).stop 2024-09-11T23:20:31.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:31.023+0000 7f184bd81640 1 -- 172.21.15.172:0/3323905854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1830005740 msgr2=0x7f1844194fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:31.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:31.023+0000 7f184bd81640 1 --2- 172.21.15.172:0/3323905854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1830005740 0x7f1844194fd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1838005f30 tx=0x7f18380339a0 comp rx=0 tx=0).stop 2024-09-11T23:20:31.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:31.023+0000 7f184bd81640 1 -- 172.21.15.172:0/3323905854 shutdown_connections 2024-09-11T23:20:31.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:31.023+0000 7f184bd81640 1 --2- 172.21.15.172:0/3323905854 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f1828038e50 0x7f182803b310 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:31.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:31.023+0000 7f184bd81640 1 --2- 172.21.15.172:0/3323905854 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1844195510 0x7f18441998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:31.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:31.023+0000 7f184bd81640 1 --2- 172.21.15.172:0/3323905854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1830005740 0x7f1844194fd0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:31.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:31.023+0000 7f184bd81640 1 -- 172.21.15.172:0/3323905854 >> 172.21.15.172:0/3323905854 conn(0x7f18440fc280 msgr2=0x7f18441049e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:31.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:31.023+0000 7f184bd81640 1 -- 172.21.15.172:0/3323905854 shutdown_connections 2024-09-11T23:20:31.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:31.023+0000 7f184bd81640 1 -- 172.21.15.172:0/3323905854 wait complete. 2024-09-11T23:20:31.379 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:31 smithi172 ceph-mon[34855]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:31.379 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:31 smithi172 ceph-mon[34855]: Deploying daemon mon.b on smithi159 2024-09-11T23:20:31.379 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:31 smithi172 ceph-mon[34855]: from='client.? 172.21.15.172:0/3323905854' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T23:20:31.380 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:31 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:20:31.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:31 smithi005 ceph-mon[31201]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:31.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:31 smithi005 ceph-mon[31201]: Deploying daemon mon.b on smithi159 2024-09-11T23:20:31.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:31 smithi005 ceph-mon[31201]: from='client.? 172.21.15.172:0/3323905854' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T23:20:31.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:31 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:20:32.684 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-11T23:20:32.684 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-11T23:20:32.937 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:20:33.329 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:33 smithi172 ceph-mon[34855]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:33.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.328+0000 7f9ef6f3b640 1 -- 172.21.15.172:0/2221049858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ef0102900 msgr2=0x7f9ef0102ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:33.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.328+0000 7f9ef6f3b640 1 --2- 172.21.15.172:0/2221049858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ef0102900 0x7f9ef0102ce0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4009880 tx=0x7f9ee402a670 comp rx=0 tx=0).stop 2024-09-11T23:20:33.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.328+0000 7f9ef6f3b640 1 -- 172.21.15.172:0/2221049858 shutdown_connections 2024-09-11T23:20:33.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.328+0000 7f9ef6f3b640 1 --2- 172.21.15.172:0/2221049858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ef0102900 0x7f9ef0102ce0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:33.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.328+0000 7f9ef6f3b640 1 -- 172.21.15.172:0/2221049858 >> 172.21.15.172:0/2221049858 conn(0x7f9ef00fc280 msgr2=0x7f9ef00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:33.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.329+0000 7f9ef6f3b640 1 -- 172.21.15.172:0/2221049858 shutdown_connections 2024-09-11T23:20:33.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.329+0000 7f9ef6f3b640 1 -- 172.21.15.172:0/2221049858 wait complete. 2024-09-11T23:20:33.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.329+0000 7f9ef6f3b640 1 Processor -- start 2024-09-11T23:20:33.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.329+0000 7f9ef6f3b640 1 -- start start 2024-09-11T23:20:33.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.329+0000 7f9ef6f3b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ef0102900 0x7f9ef0197340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:33.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.329+0000 7f9ef6f3b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ef0197880 0x7f9ef019bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:33.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.329+0000 7f9ef6f3b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef010bc50 con 0x7f9ef0197880 2024-09-11T23:20:33.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.329+0000 7f9ef6f3b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef010bad0 con 0x7f9ef0102900 2024-09-11T23:20:33.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.330+0000 7f9ef4cd7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ef0102900 0x7f9ef0197340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:33.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.330+0000 7f9ef4cd7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ef0102900 0x7f9ef0197340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40410/0 (socket says 172.21.15.172:40410) 2024-09-11T23:20:33.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.330+0000 7f9ef4cd7640 1 -- 172.21.15.172:0/1446713276 learned_addr learned my addr 172.21.15.172:0/1446713276 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-11T23:20:33.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.330+0000 7f9eeffff640 1 --2- 172.21.15.172:0/1446713276 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ef0197880 0x7f9ef019bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:33.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.330+0000 7f9ef4cd7640 1 -- 172.21.15.172:0/1446713276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ef0102900 msgr2=0x7f9ef0197340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-11T23:20:33.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.330+0000 7f9ef4cd7640 1 -- 172.21.15.172:0/1446713276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ef0102900 msgr2=0x7f9ef0197340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T23:20:33.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.330+0000 7f9ef4cd7640 1 --2- 172.21.15.172:0/1446713276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ef0102900 0x7f9ef0197340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T23:20:33.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.330+0000 7f9ef4cd7640 1 --2- 172.21.15.172:0/1446713276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ef0102900 0x7f9ef0197340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:20:33.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.330+0000 7f9eeffff640 1 -- 172.21.15.172:0/1446713276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ef0102900 msgr2=0x7f9ef0197340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:20:33.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.330+0000 7f9eeffff640 1 --2- 172.21.15.172:0/1446713276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ef0102900 0x7f9ef0197340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:33.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.330+0000 7f9eeffff640 1 -- 172.21.15.172:0/1446713276 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ef0197ea0 con 0x7f9ef0197880 2024-09-11T23:20:33.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.330+0000 7f9eeffff640 1 --2- 172.21.15.172:0/1446713276 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ef0197880 0x7f9ef019bc10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9edc00b3d0 tx=0x7f9edc00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:33.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.330+0000 7f9eedffb640 1 -- 172.21.15.172:0/1446713276 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f9edc011630 con 0x7f9ef0197880 2024-09-11T23:20:33.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.330+0000 7f9eedffb640 1 -- 172.21.15.172:0/1446713276 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9edc011c80 con 0x7f9ef0197880 2024-09-11T23:20:33.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.330+0000 7f9ef6f3b640 1 -- 172.21.15.172:0/1446713276 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ef019c150 con 0x7f9ef0197880 2024-09-11T23:20:33.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.330+0000 7f9eedffb640 1 -- 172.21.15.172:0/1446713276 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f9edc010d80 con 0x7f9ef0197880 2024-09-11T23:20:33.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.331+0000 7f9ef6f3b640 1 -- 172.21.15.172:0/1446713276 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ef019c690 con 0x7f9ef0197880 2024-09-11T23:20:33.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.331+0000 7f9eedffb640 1 -- 172.21.15.172:0/1446713276 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f9edc018020 con 0x7f9ef0197880 2024-09-11T23:20:33.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.332+0000 7f9eedffb640 1 --2- 172.21.15.172:0/1446713276 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f9ee0038df0 0x7f9ee003b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:33.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.332+0000 7f9ef6f3b640 1 -- 172.21.15.172:0/1446713276 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ef006a430 con 0x7f9ef0197880 2024-09-11T23:20:33.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.332+0000 7f9eedffb640 1 -- 172.21.15.172:0/1446713276 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f9edc04be80 con 0x7f9ef0197880 2024-09-11T23:20:33.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.332+0000 7f9ef4cd7640 1 --2- 172.21.15.172:0/1446713276 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f9ee0038df0 0x7f9ee003b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:33.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.333+0000 7f9ef4cd7640 1 --2- 172.21.15.172:0/1446713276 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f9ee0038df0 0x7f9ee003b2b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9ee402ac60 tx=0x7f9ee402ab70 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:33.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.337+0000 7f9eedffb640 1 -- 172.21.15.172:0/1446713276 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9edc01f020 con 0x7f9ef0197880 2024-09-11T23:20:33.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:33 smithi005 ceph-mon[31201]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:33.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.567+0000 7f9ef6f3b640 1 -- 172.21.15.172:0/1446713276 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f9ef0102ce0 con 0x7f9ef0197880 2024-09-11T23:20:33.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.567+0000 7f9eedffb640 1 -- 172.21.15.172:0/1446713276 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1011 (secure 0 0 0) 0x7f9ef0102ce0 con 0x7f9ef0197880 2024-09-11T23:20:33.567 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-11T23:20:33.568 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":2,"fsid":"1f5284d2-7094-11ef-bcea-c7b262605968","modified":"2024-09-11T23:20:25.054166Z","created":"2024-09-11T23:18:57.103876Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:3300","nonce":0},{"type":"v1","addr":"172.21.15.172:6789","nonce":0}]},"addr":"172.21.15.172:6789/0","public_addr":"172.21.15.172:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-11T23:20:33.568 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 2 2024-09-11T23:20:33.569 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.569+0000 7f9ef6f3b640 1 -- 172.21.15.172:0/1446713276 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f9ee0038df0 msgr2=0x7f9ee003b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:33.569 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.569+0000 7f9ef6f3b640 1 --2- 172.21.15.172:0/1446713276 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f9ee0038df0 0x7f9ee003b2b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9ee402ac60 tx=0x7f9ee402ab70 comp rx=0 tx=0).stop 2024-09-11T23:20:33.569 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.569+0000 7f9ef6f3b640 1 -- 172.21.15.172:0/1446713276 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ef0197880 msgr2=0x7f9ef019bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:33.569 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.569+0000 7f9ef6f3b640 1 --2- 172.21.15.172:0/1446713276 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ef0197880 0x7f9ef019bc10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9edc00b3d0 tx=0x7f9edc00b890 comp rx=0 tx=0).stop 2024-09-11T23:20:33.569 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.569+0000 7f9ef6f3b640 1 -- 172.21.15.172:0/1446713276 shutdown_connections 2024-09-11T23:20:33.570 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.569+0000 7f9ef6f3b640 1 --2- 172.21.15.172:0/1446713276 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f9ee0038df0 0x7f9ee003b2b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:33.570 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.569+0000 7f9ef6f3b640 1 --2- 172.21.15.172:0/1446713276 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ef0197880 0x7f9ef019bc10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:33.570 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.569+0000 7f9ef6f3b640 1 --2- 172.21.15.172:0/1446713276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ef0102900 0x7f9ef0197340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:33.570 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.569+0000 7f9ef6f3b640 1 -- 172.21.15.172:0/1446713276 >> 172.21.15.172:0/1446713276 conn(0x7f9ef00fc280 msgr2=0x7f9ef01056c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:33.570 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.569+0000 7f9ef6f3b640 1 -- 172.21.15.172:0/1446713276 shutdown_connections 2024-09-11T23:20:33.570 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:33.569+0000 7f9ef6f3b640 1 -- 172.21.15.172:0/1446713276 wait complete. 2024-09-11T23:20:34.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:33 smithi159 systemd[1]: Started Ceph mon.b for 1f5284d2-7094-11ef-bcea-c7b262605968. 2024-09-11T23:20:35.173 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-11T23:20:35.173 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-11T23:20:35.424 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:20:39.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.071+0000 7f5cb5373640 1 -- 172.21.15.172:0/53653497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c9c003530 msgr2=0x7f5c9c0059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:39.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.071+0000 7f5cb5373640 1 --2- 172.21.15.172:0/53653497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c9c003530 0x7f5c9c0059c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5cb01016a0 tx=0x7f5ca802bd70 comp rx=0 tx=0).stop 2024-09-11T23:20:39.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.071+0000 7f5cb5373640 1 -- 172.21.15.172:0/53653497 shutdown_connections 2024-09-11T23:20:39.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.071+0000 7f5cb5373640 1 --2- 172.21.15.172:0/53653497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c9c003530 0x7f5c9c0059c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:39.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.071+0000 7f5cb5373640 1 -- 172.21.15.172:0/53653497 >> 172.21.15.172:0/53653497 conn(0x7f5cb00fc220 msgr2=0x7f5cb00fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:39.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.072+0000 7f5cb5373640 1 -- 172.21.15.172:0/53653497 shutdown_connections 2024-09-11T23:20:39.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.072+0000 7f5cb5373640 1 -- 172.21.15.172:0/53653497 wait complete. 2024-09-11T23:20:39.075 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.073+0000 7f5cb5373640 1 Processor -- start 2024-09-11T23:20:39.075 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.073+0000 7f5cb5373640 1 -- start start 2024-09-11T23:20:39.075 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.073+0000 7f5cb5373640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c9c003530 0x7f5cb01980c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:39.075 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.073+0000 7f5cb5373640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cb0198600 0x7f5cb0198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:39.075 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.073+0000 7f5cb5373640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cb01a1130 0x7f5cb01a3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:39.075 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.073+0000 7f5cb5373640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb0108510 con 0x7f5cb0198600 2024-09-11T23:20:39.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.073+0000 7f5cb5373640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb0108390 con 0x7f5cb01a1130 2024-09-11T23:20:39.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.073+0000 7f5cb5373640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb0108690 con 0x7f5c9c003530 2024-09-11T23:20:39.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.074+0000 7f5cae7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cb0198600 0x7f5cb0198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:39.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.074+0000 7f5caeffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c9c003530 0x7f5cb01980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:39.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.074+0000 7f5cae7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cb0198600 0x7f5cb0198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.172:57746/0 (socket says 172.21.15.172:57746) 2024-09-11T23:20:39.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.074+0000 7f5cae7fc640 1 -- 172.21.15.172:0/2382737571 learned_addr learned my addr 172.21.15.172:0/2382737571 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-11T23:20:39.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.074+0000 7f5caf7fe640 1 --2- 172.21.15.172:0/2382737571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cb01a1130 0x7f5cb01a3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:39.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.074+0000 7f5caeffd640 1 -- 172.21.15.172:0/2382737571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c9c003530 msgr2=0x7f5cb01980c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-11T23:20:39.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.074+0000 7f5caeffd640 1 -- 172.21.15.172:0/2382737571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c9c003530 msgr2=0x7f5cb01980c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T23:20:39.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.074+0000 7f5caeffd640 1 --2- 172.21.15.172:0/2382737571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c9c003530 0x7f5cb01980c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T23:20:39.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.074+0000 7f5caeffd640 1 --2- 172.21.15.172:0/2382737571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c9c003530 0x7f5cb01980c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:20:39.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.074+0000 7f5caf7fe640 1 -- 172.21.15.172:0/2382737571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cb01a1130 msgr2=0x7f5cb01a3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-11T23:20:39.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.074+0000 7f5caf7fe640 1 -- 172.21.15.172:0/2382737571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cb01a1130 msgr2=0x7f5cb01a3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T23:20:39.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.074+0000 7f5caf7fe640 1 --2- 172.21.15.172:0/2382737571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cb01a1130 0x7f5cb01a3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T23:20:39.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.074+0000 7f5caf7fe640 1 --2- 172.21.15.172:0/2382737571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cb01a1130 0x7f5cb01a3520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:20:39.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.074+0000 7f5cae7fc640 1 -- 172.21.15.172:0/2382737571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c9c003530 msgr2=0x7f5cb01980c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:20:39.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.074+0000 7f5cae7fc640 1 --2- 172.21.15.172:0/2382737571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c9c003530 0x7f5cb01980c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:39.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.074+0000 7f5cae7fc640 1 -- 172.21.15.172:0/2382737571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cb01a1130 msgr2=0x7f5cb01a3520 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:20:39.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.074+0000 7f5cae7fc640 1 --2- 172.21.15.172:0/2382737571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cb01a1130 0x7f5cb01a3520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:39.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.074+0000 7f5cae7fc640 1 -- 172.21.15.172:0/2382737571 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cb01a3d70 con 0x7f5cb0198600 2024-09-11T23:20:39.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.074+0000 7f5cae7fc640 1 --2- 172.21.15.172:0/2382737571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cb0198600 0x7f5cb0198a60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5c9800b520 tx=0x7f5c9800b9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:39.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.075+0000 7f5ca7fff640 1 -- 172.21.15.172:0/2382737571 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c98004230 con 0x7f5cb0198600 2024-09-11T23:20:39.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.075+0000 7f5ca7fff640 1 -- 172.21.15.172:0/2382737571 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5c980043d0 con 0x7f5cb0198600 2024-09-11T23:20:39.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.075+0000 7f5cb5373640 1 -- 172.21.15.172:0/2382737571 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cb01a3fa0 con 0x7f5cb0198600 2024-09-11T23:20:39.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.075+0000 7f5ca7fff640 1 -- 172.21.15.172:0/2382737571 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c98003cf0 con 0x7f5cb0198600 2024-09-11T23:20:39.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.075+0000 7f5cb5373640 1 -- 172.21.15.172:0/2382737571 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cb01a4530 con 0x7f5cb0198600 2024-09-11T23:20:39.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.076+0000 7f5ca7fff640 1 -- 172.21.15.172:0/2382737571 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f5c9800e070 con 0x7f5cb0198600 2024-09-11T23:20:39.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.076+0000 7f5cb5373640 1 -- 172.21.15.172:0/2382737571 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cb0109600 con 0x7f5cb0198600 2024-09-11T23:20:39.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.076+0000 7f5ca7fff640 1 --2- 172.21.15.172:0/2382737571 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f5c900394f0 0x7f5c9003b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:39.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.076+0000 7f5ca7fff640 1 -- 172.21.15.172:0/2382737571 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f5c9804ba10 con 0x7f5cb0198600 2024-09-11T23:20:39.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.076+0000 7f5caeffd640 1 --2- 172.21.15.172:0/2382737571 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f5c900394f0 0x7f5c9003b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:39.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.077+0000 7f5caeffd640 1 --2- 172.21.15.172:0/2382737571 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f5c900394f0 0x7f5c9003b9b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5ca8009b10 tx=0x7f5ca8005f80 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:39.082 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.081+0000 7f5ca7fff640 1 -- 172.21.15.172:0/2382737571 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5c98014020 con 0x7f5cb0198600 2024-09-11T23:20:39.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:38 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:20:39.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:38 smithi005 ceph-mon[31201]: mon.a calling monitor election 2024-09-11T23:20:39.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:38 smithi005 ceph-mon[31201]: mon.c calling monitor election 2024-09-11T23:20:39.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:38 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:20:39.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:38 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:20:39.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:38 smithi005 ceph-mon[31201]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:39.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:38 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:20:39.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:38 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:20:39.226 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:38 smithi005 ceph-mon[31201]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:39.226 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:38 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:20:39.226 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:38 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:20:39.226 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:38 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:20:39.226 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:38 smithi005 ceph-mon[31201]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-11T23:20:39.226 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:38 smithi005 ceph-mon[31201]: monmap epoch 3 2024-09-11T23:20:39.226 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:38 smithi005 ceph-mon[31201]: fsid 1f5284d2-7094-11ef-bcea-c7b262605968 2024-09-11T23:20:39.226 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:38 smithi005 ceph-mon[31201]: last_changed 2024-09-11T23:20:33.888394+0000 2024-09-11T23:20:39.226 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:38 smithi005 ceph-mon[31201]: created 2024-09-11T23:18:57.103876+0000 2024-09-11T23:20:39.226 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:38 smithi005 ceph-mon[31201]: min_mon_release 19 (squid) 2024-09-11T23:20:39.226 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:38 smithi005 ceph-mon[31201]: election_strategy: 1 2024-09-11T23:20:39.226 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:38 smithi005 ceph-mon[31201]: 0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-09-11T23:20:39.226 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:38 smithi005 ceph-mon[31201]: 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.c 2024-09-11T23:20:39.227 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:38 smithi005 ceph-mon[31201]: 2: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-09-11T23:20:39.227 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:38 smithi005 ceph-mon[31201]: fsmap 2024-09-11T23:20:39.227 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:38 smithi005 ceph-mon[31201]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T23:20:39.227 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:38 smithi005 ceph-mon[31201]: mgrmap e13: x(active, since 48s) 2024-09-11T23:20:39.227 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:38 smithi005 ceph-mon[31201]: overall HEALTH_OK 2024-09-11T23:20:39.227 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:38 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:39.227 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:38 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:39.227 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:38 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:39.227 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:38 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:39.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.321+0000 7f5cb5373640 1 -- 172.21.15.172:0/2382737571 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f5cb002d7c0 con 0x7f5cb0198600 2024-09-11T23:20:39.323 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:38 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:20:39.323 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:38 smithi172 ceph-mon[34855]: mon.a calling monitor election 2024-09-11T23:20:39.323 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:38 smithi172 ceph-mon[34855]: mon.c calling monitor election 2024-09-11T23:20:39.323 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:38 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:20:39.323 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:38 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:20:39.323 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:38 smithi172 ceph-mon[34855]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:39.323 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:38 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:20:39.324 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:38 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:20:39.324 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:38 smithi172 ceph-mon[34855]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:39.324 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:38 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:20:39.324 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:38 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:20:39.324 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:38 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:20:39.324 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:38 smithi172 ceph-mon[34855]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-11T23:20:39.324 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:38 smithi172 ceph-mon[34855]: monmap epoch 3 2024-09-11T23:20:39.324 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:38 smithi172 ceph-mon[34855]: fsid 1f5284d2-7094-11ef-bcea-c7b262605968 2024-09-11T23:20:39.324 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:38 smithi172 ceph-mon[34855]: last_changed 2024-09-11T23:20:33.888394+0000 2024-09-11T23:20:39.324 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:38 smithi172 ceph-mon[34855]: created 2024-09-11T23:18:57.103876+0000 2024-09-11T23:20:39.324 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:38 smithi172 ceph-mon[34855]: min_mon_release 19 (squid) 2024-09-11T23:20:39.324 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:38 smithi172 ceph-mon[34855]: election_strategy: 1 2024-09-11T23:20:39.324 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:38 smithi172 ceph-mon[34855]: 0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-09-11T23:20:39.325 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:38 smithi172 ceph-mon[34855]: 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.c 2024-09-11T23:20:39.325 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:38 smithi172 ceph-mon[34855]: 2: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-09-11T23:20:39.325 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:38 smithi172 ceph-mon[34855]: fsmap 2024-09-11T23:20:39.325 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:38 smithi172 ceph-mon[34855]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T23:20:39.325 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:38 smithi172 ceph-mon[34855]: mgrmap e13: x(active, since 48s) 2024-09-11T23:20:39.325 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:38 smithi172 ceph-mon[34855]: overall HEALTH_OK 2024-09-11T23:20:39.325 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:38 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:39.325 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:38 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:39.325 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:38 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:39.325 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:38 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:39.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.322+0000 7f5ca7fff640 1 -- 172.21.15.172:0/2382737571 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1279 (secure 0 0 0) 0x7f5c98020350 con 0x7f5cb0198600 2024-09-11T23:20:39.326 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-11T23:20:39.326 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":3,"fsid":"1f5284d2-7094-11ef-bcea-c7b262605968","modified":"2024-09-11T23:20:33.888394Z","created":"2024-09-11T23:18:57.103876Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:3300","nonce":0},{"type":"v1","addr":"172.21.15.172:6789","nonce":0}]},"addr":"172.21.15.172:6789/0","public_addr":"172.21.15.172:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:3300","nonce":0},{"type":"v1","addr":"172.21.15.159:6789","nonce":0}]},"addr":"172.21.15.159:6789/0","public_addr":"172.21.15.159:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-11T23:20:39.327 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 3 2024-09-11T23:20:39.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.325+0000 7f5cb5373640 1 -- 172.21.15.172:0/2382737571 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f5c900394f0 msgr2=0x7f5c9003b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:39.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.325+0000 7f5cb5373640 1 --2- 172.21.15.172:0/2382737571 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f5c900394f0 0x7f5c9003b9b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5ca8009b10 tx=0x7f5ca8005f80 comp rx=0 tx=0).stop 2024-09-11T23:20:39.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.325+0000 7f5cb5373640 1 -- 172.21.15.172:0/2382737571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cb0198600 msgr2=0x7f5cb0198a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:39.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.325+0000 7f5cb5373640 1 --2- 172.21.15.172:0/2382737571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cb0198600 0x7f5cb0198a60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5c9800b520 tx=0x7f5c9800b9e0 comp rx=0 tx=0).stop 2024-09-11T23:20:39.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.325+0000 7f5cb5373640 1 -- 172.21.15.172:0/2382737571 shutdown_connections 2024-09-11T23:20:39.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.325+0000 7f5cb5373640 1 --2- 172.21.15.172:0/2382737571 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f5c900394f0 0x7f5c9003b9b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:39.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.325+0000 7f5cb5373640 1 --2- 172.21.15.172:0/2382737571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cb01a1130 0x7f5cb01a3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:39.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.325+0000 7f5cb5373640 1 --2- 172.21.15.172:0/2382737571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cb0198600 0x7f5cb0198a60 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:39.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.325+0000 7f5cb5373640 1 --2- 172.21.15.172:0/2382737571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c9c003530 0x7f5cb01980c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:39.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.325+0000 7f5cb5373640 1 -- 172.21.15.172:0/2382737571 >> 172.21.15.172:0/2382737571 conn(0x7f5cb00fc220 msgr2=0x7f5cb0105140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:39.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.325+0000 7f5cb5373640 1 -- 172.21.15.172:0/2382737571 shutdown_connections 2024-09-11T23:20:39.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:39.325+0000 7f5cb5373640 1 -- 172.21.15.172:0/2382737571 wait complete. 2024-09-11T23:20:39.927 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-11T23:20:39.927 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph config generate-minimal-conf 2024-09-11T23:20:40.193 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:20:40.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:39 smithi005 ceph-mon[31201]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:40.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:39 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:20:40.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:39 smithi005 ceph-mon[31201]: from='client.? 172.21.15.172:0/2382737571' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T23:20:40.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:39 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:20:40.236 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:39 smithi172 ceph-mon[34855]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:40.236 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:39 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:20:40.236 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:39 smithi172 ceph-mon[34855]: from='client.? 172.21.15.172:0/2382737571' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T23:20:40.236 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:39 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:20:40.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.608+0000 7faf113bf640 1 -- 172.21.15.5:0/335436407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf0c1027f0 msgr2=0x7faf0c102bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:40.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.608+0000 7faf113bf640 1 --2- 172.21.15.5:0/335436407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf0c1027f0 0x7faf0c102bd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7faefc009c10 tx=0x7faefc02aa10 comp rx=0 tx=0).stop 2024-09-11T23:20:40.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.608+0000 7faf113bf640 1 -- 172.21.15.5:0/335436407 shutdown_connections 2024-09-11T23:20:40.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.608+0000 7faf113bf640 1 --2- 172.21.15.5:0/335436407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf0c1027f0 0x7faf0c102bd0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:40.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.608+0000 7faf113bf640 1 -- 172.21.15.5:0/335436407 >> 172.21.15.5:0/335436407 conn(0x7faf0c077310 msgr2=0x7faf0c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:40.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.608+0000 7faf113bf640 1 -- 172.21.15.5:0/335436407 shutdown_connections 2024-09-11T23:20:40.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.608+0000 7faf113bf640 1 -- 172.21.15.5:0/335436407 wait complete. 2024-09-11T23:20:40.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.608+0000 7faf113bf640 1 Processor -- start 2024-09-11T23:20:40.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.609+0000 7faf113bf640 1 -- start start 2024-09-11T23:20:40.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.609+0000 7faf113bf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf0c1027f0 0x7faf0c197310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:40.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.609+0000 7faf113bf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf0c197850 0x7faf0c19bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:40.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.609+0000 7faf113bf640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf0c19c120 0x7faf0c19c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:40.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.609+0000 7faf113bf640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7faf0c10bae0 con 0x7faf0c1027f0 2024-09-11T23:20:40.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.609+0000 7faf113bf640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7faf0c10b960 con 0x7faf0c19c120 2024-09-11T23:20:40.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.609+0000 7faf113bf640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7faf0c10bc60 con 0x7faf0c197850 2024-09-11T23:20:40.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.609+0000 7faf0affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf0c1027f0 0x7faf0c197310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:40.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.609+0000 7faf0affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf0c1027f0 0x7faf0c197310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55842/0 (socket says 172.21.15.5:55842) 2024-09-11T23:20:40.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.609+0000 7faf0affd640 1 -- 172.21.15.5:0/1196538482 learned_addr learned my addr 172.21.15.5:0/1196538482 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:20:40.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.609+0000 7faf0a7fc640 1 --2- 172.21.15.5:0/1196538482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf0c197850 0x7faf0c19bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:40.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.609+0000 7faf0affd640 1 -- 172.21.15.5:0/1196538482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf0c197850 msgr2=0x7faf0c19bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:40.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.609+0000 7faf0affd640 1 --2- 172.21.15.5:0/1196538482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf0c197850 0x7faf0c19bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:40.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.609+0000 7faf0affd640 1 -- 172.21.15.5:0/1196538482 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf0c19c120 msgr2=0x7faf0c19c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:40.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.609+0000 7faf0b7fe640 1 --2- 172.21.15.5:0/1196538482 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf0c19c120 0x7faf0c19c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:40.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.609+0000 7faf0affd640 1 --2- 172.21.15.5:0/1196538482 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf0c19c120 0x7faf0c19c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:40.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.609+0000 7faf0affd640 1 -- 172.21.15.5:0/1196538482 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf0c1a3e90 con 0x7faf0c1027f0 2024-09-11T23:20:40.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.610+0000 7faf0b7fe640 1 --2- 172.21.15.5:0/1196538482 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf0c19c120 0x7faf0c19c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:40.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.610+0000 7faf0affd640 1 --2- 172.21.15.5:0/1196538482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf0c1027f0 0x7faf0c197310 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faefc000f80 tx=0x7faefc003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:40.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.610+0000 7faf03fff640 1 -- 172.21.15.5:0/1196538482 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faefc034070 con 0x7faf0c1027f0 2024-09-11T23:20:40.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.610+0000 7faf03fff640 1 -- 172.21.15.5:0/1196538482 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7faefc030b60 con 0x7faf0c1027f0 2024-09-11T23:20:40.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.610+0000 7faf03fff640 1 -- 172.21.15.5:0/1196538482 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faefc004460 con 0x7faf0c1027f0 2024-09-11T23:20:40.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.610+0000 7faf113bf640 1 -- 172.21.15.5:0/1196538482 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf0c100380 con 0x7faf0c1027f0 2024-09-11T23:20:40.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.610+0000 7faf113bf640 1 -- 172.21.15.5:0/1196538482 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf0c1007b0 con 0x7faf0c1027f0 2024-09-11T23:20:40.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.611+0000 7faf03fff640 1 -- 172.21.15.5:0/1196538482 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7faefc037020 con 0x7faf0c1027f0 2024-09-11T23:20:40.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.611+0000 7faf03fff640 1 --2- 172.21.15.5:0/1196538482 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7faef80394f0 0x7faef803b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:40.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.611+0000 7faf03fff640 1 -- 172.21.15.5:0/1196538482 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7faefc06dd60 con 0x7faf0c1027f0 2024-09-11T23:20:40.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.611+0000 7faf113bf640 1 -- 172.21.15.5:0/1196538482 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf0c102c50 con 0x7faf0c1027f0 2024-09-11T23:20:40.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.611+0000 7faf0a7fc640 1 --2- 172.21.15.5:0/1196538482 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7faef80394f0 0x7faef803b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:40.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.612+0000 7faf0a7fc640 1 --2- 172.21.15.5:0/1196538482 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7faef80394f0 0x7faef803b9b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7faef4009950 tx=0x7faef4008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:40.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.616+0000 7faf03fff640 1 -- 172.21.15.5:0/1196538482 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faefc03f070 con 0x7faf0c1027f0 2024-09-11T23:20:40.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.795+0000 7faf113bf640 1 -- 172.21.15.5:0/1196538482 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7faf0c100b50 con 0x7faf0c1027f0 2024-09-11T23:20:40.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.796+0000 7faf03fff640 1 -- 172.21.15.5:0/1196538482 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+273 (secure 0 0 0) 0x7faefc02c040 con 0x7faf0c1027f0 2024-09-11T23:20:40.796 INFO:teuthology.orchestra.run.smithi005.stdout:# minimal ceph.conf for 1f5284d2-7094-11ef-bcea-c7b262605968 2024-09-11T23:20:40.796 INFO:teuthology.orchestra.run.smithi005.stdout:[global] 2024-09-11T23:20:40.796 INFO:teuthology.orchestra.run.smithi005.stdout: fsid = 1f5284d2-7094-11ef-bcea-c7b262605968 2024-09-11T23:20:40.796 INFO:teuthology.orchestra.run.smithi005.stdout: mon_host = [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2024-09-11T23:20:40.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.798+0000 7faf113bf640 1 -- 172.21.15.5:0/1196538482 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7faef80394f0 msgr2=0x7faef803b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:40.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.798+0000 7faf113bf640 1 --2- 172.21.15.5:0/1196538482 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7faef80394f0 0x7faef803b9b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7faef4009950 tx=0x7faef4008040 comp rx=0 tx=0).stop 2024-09-11T23:20:40.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.798+0000 7faf113bf640 1 -- 172.21.15.5:0/1196538482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf0c1027f0 msgr2=0x7faf0c197310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:40.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.798+0000 7faf113bf640 1 --2- 172.21.15.5:0/1196538482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf0c1027f0 0x7faf0c197310 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faefc000f80 tx=0x7faefc003f90 comp rx=0 tx=0).stop 2024-09-11T23:20:40.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.798+0000 7faf113bf640 1 -- 172.21.15.5:0/1196538482 shutdown_connections 2024-09-11T23:20:40.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.798+0000 7faf113bf640 1 --2- 172.21.15.5:0/1196538482 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7faef80394f0 0x7faef803b9b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:40.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.798+0000 7faf113bf640 1 --2- 172.21.15.5:0/1196538482 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf0c19c120 0x7faf0c19c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:40.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.798+0000 7faf113bf640 1 --2- 172.21.15.5:0/1196538482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf0c197850 0x7faf0c19bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:40.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.798+0000 7faf113bf640 1 --2- 172.21.15.5:0/1196538482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf0c1027f0 0x7faf0c197310 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:40.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.798+0000 7faf113bf640 1 -- 172.21.15.5:0/1196538482 >> 172.21.15.5:0/1196538482 conn(0x7faf0c077310 msgr2=0x7faf0c103570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:40.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.798+0000 7faf113bf640 1 -- 172.21.15.5:0/1196538482 shutdown_connections 2024-09-11T23:20:40.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:40.798+0000 7faf113bf640 1 -- 172.21.15.5:0/1196538482 wait complete. 2024-09-11T23:20:41.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:40 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:20:41.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:40 smithi159 ceph-mon[34394]: mon.a calling monitor election 2024-09-11T23:20:41.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:40 smithi159 ceph-mon[34394]: mon.c calling monitor election 2024-09-11T23:20:41.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:40 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:20:41.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:40 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:20:41.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:40 smithi159 ceph-mon[34394]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:41.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:40 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:20:41.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:40 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:20:41.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:40 smithi159 ceph-mon[34394]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:41.378 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:40 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:20:41.378 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:40 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:20:41.378 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:40 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:20:41.378 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:40 smithi159 ceph-mon[34394]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-11T23:20:41.378 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:40 smithi159 ceph-mon[34394]: monmap epoch 3 2024-09-11T23:20:41.378 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:40 smithi159 ceph-mon[34394]: fsid 1f5284d2-7094-11ef-bcea-c7b262605968 2024-09-11T23:20:41.378 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:40 smithi159 ceph-mon[34394]: last_changed 2024-09-11T23:20:33.888394+0000 2024-09-11T23:20:41.378 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:40 smithi159 ceph-mon[34394]: created 2024-09-11T23:18:57.103876+0000 2024-09-11T23:20:41.378 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:40 smithi159 ceph-mon[34394]: min_mon_release 19 (squid) 2024-09-11T23:20:41.378 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:40 smithi159 ceph-mon[34394]: election_strategy: 1 2024-09-11T23:20:41.379 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:40 smithi159 ceph-mon[34394]: 0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-09-11T23:20:41.379 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:40 smithi159 ceph-mon[34394]: 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.c 2024-09-11T23:20:41.379 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:40 smithi159 ceph-mon[34394]: 2: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-09-11T23:20:41.379 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:40 smithi159 ceph-mon[34394]: fsmap 2024-09-11T23:20:41.379 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:40 smithi159 ceph-mon[34394]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T23:20:41.380 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:40 smithi159 ceph-mon[34394]: mgrmap e13: x(active, since 48s) 2024-09-11T23:20:41.380 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:40 smithi159 ceph-mon[34394]: overall HEALTH_OK 2024-09-11T23:20:41.380 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:40 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:41.380 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:40 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:41.380 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:40 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:41.380 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:40 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:41.380 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:40 smithi159 ceph-mon[34394]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:41.380 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:40 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:20:41.380 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:40 smithi159 ceph-mon[34394]: from='client.? 172.21.15.172:0/2382737571' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T23:20:41.381 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:40 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:20:41.518 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-11T23:20:41.518 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-11T23:20:41.518 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/ceph/ceph.conf 2024-09-11T23:20:41.545 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-11T23:20:41.545 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-11T23:20:41.614 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-11T23:20:41.614 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/ceph/ceph.conf 2024-09-11T23:20:41.643 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-11T23:20:41.643 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-11T23:20:41.708 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-11T23:20:41.708 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.conf 2024-09-11T23:20:41.735 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-11T23:20:41.736 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-11T23:20:41.801 INFO:tasks.cephadm:Adding mgr.x on smithi005 2024-09-11T23:20:41.801 INFO:tasks.cephadm:Adding mgr.y on smithi159 2024-09-11T23:20:41.801 INFO:tasks.cephadm:Adding mgr.z on smithi172 2024-09-11T23:20:41.801 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph orch apply mgr '3;smithi005=x;smithi159=y;smithi172=z' 2024-09-11T23:20:41.861 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:41 smithi005 ceph-mon[31201]: mon.b calling monitor election 2024-09-11T23:20:41.861 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:41 smithi005 ceph-mon[31201]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:41.861 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:41 smithi005 ceph-mon[31201]: Updating smithi005:/etc/ceph/ceph.conf 2024-09-11T23:20:41.861 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:41 smithi005 ceph-mon[31201]: Updating smithi159:/etc/ceph/ceph.conf 2024-09-11T23:20:41.862 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:41 smithi005 ceph-mon[31201]: Updating smithi172:/etc/ceph/ceph.conf 2024-09-11T23:20:41.862 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:41 smithi005 ceph-mon[31201]: mon.b calling monitor election 2024-09-11T23:20:41.862 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:41 smithi005 ceph-mon[31201]: mon.c calling monitor election 2024-09-11T23:20:41.862 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:41 smithi005 ceph-mon[31201]: mon.a calling monitor election 2024-09-11T23:20:41.862 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:41 smithi005 ceph-mon[31201]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-11T23:20:41.862 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:41 smithi005 ceph-mon[31201]: monmap epoch 3 2024-09-11T23:20:41.862 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:41 smithi005 ceph-mon[31201]: fsid 1f5284d2-7094-11ef-bcea-c7b262605968 2024-09-11T23:20:41.862 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:41 smithi005 ceph-mon[31201]: last_changed 2024-09-11T23:20:33.888394+0000 2024-09-11T23:20:41.862 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:41 smithi005 ceph-mon[31201]: created 2024-09-11T23:18:57.103876+0000 2024-09-11T23:20:41.862 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:41 smithi005 ceph-mon[31201]: min_mon_release 19 (squid) 2024-09-11T23:20:41.863 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:41 smithi005 ceph-mon[31201]: election_strategy: 1 2024-09-11T23:20:41.863 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:41 smithi005 ceph-mon[31201]: 0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-09-11T23:20:41.863 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:41 smithi005 ceph-mon[31201]: 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.c 2024-09-11T23:20:41.863 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:41 smithi005 ceph-mon[31201]: 2: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-09-11T23:20:41.863 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:41 smithi005 ceph-mon[31201]: fsmap 2024-09-11T23:20:41.863 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:41 smithi005 ceph-mon[31201]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T23:20:41.863 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:41 smithi005 ceph-mon[31201]: mgrmap e13: x(active, since 50s) 2024-09-11T23:20:41.864 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:41 smithi005 ceph-mon[31201]: overall HEALTH_OK 2024-09-11T23:20:41.864 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:41 smithi005 ceph-mon[31201]: Updating smithi172:/var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:20:41.864 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:41 smithi005 ceph-mon[31201]: Updating smithi159:/var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:20:41.864 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:41 smithi005 ceph-mon[31201]: Updating smithi005:/var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:20:41.864 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:41 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:41.865 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:41 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:41.865 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:41 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:41.865 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:41 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:41.865 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:41 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:41.865 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:41 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:41.865 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:41 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:41.866 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:41 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:41.866 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:41 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:41.866 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:41 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:41.866 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:41 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:41.866 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:41 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:20:41.866 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:41 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T23:20:41.867 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:41 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:20:42.076 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:20:42.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:41 smithi159 ceph-mon[34394]: mon.b calling monitor election 2024-09-11T23:20:42.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:41 smithi159 ceph-mon[34394]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:42.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:41 smithi159 ceph-mon[34394]: Updating smithi005:/etc/ceph/ceph.conf 2024-09-11T23:20:42.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:41 smithi159 ceph-mon[34394]: Updating smithi159:/etc/ceph/ceph.conf 2024-09-11T23:20:42.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:41 smithi159 ceph-mon[34394]: Updating smithi172:/etc/ceph/ceph.conf 2024-09-11T23:20:42.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:41 smithi159 ceph-mon[34394]: mon.b calling monitor election 2024-09-11T23:20:42.128 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:41 smithi159 ceph-mon[34394]: mon.c calling monitor election 2024-09-11T23:20:42.128 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:41 smithi159 ceph-mon[34394]: mon.a calling monitor election 2024-09-11T23:20:42.128 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:41 smithi159 ceph-mon[34394]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-11T23:20:42.128 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:41 smithi159 ceph-mon[34394]: monmap epoch 3 2024-09-11T23:20:42.128 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:41 smithi159 ceph-mon[34394]: fsid 1f5284d2-7094-11ef-bcea-c7b262605968 2024-09-11T23:20:42.128 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:41 smithi159 ceph-mon[34394]: last_changed 2024-09-11T23:20:33.888394+0000 2024-09-11T23:20:42.128 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:41 smithi159 ceph-mon[34394]: created 2024-09-11T23:18:57.103876+0000 2024-09-11T23:20:42.128 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:41 smithi159 ceph-mon[34394]: min_mon_release 19 (squid) 2024-09-11T23:20:42.128 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:41 smithi159 ceph-mon[34394]: election_strategy: 1 2024-09-11T23:20:42.128 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:41 smithi159 ceph-mon[34394]: 0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-09-11T23:20:42.128 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:41 smithi159 ceph-mon[34394]: 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.c 2024-09-11T23:20:42.128 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:41 smithi159 ceph-mon[34394]: 2: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-09-11T23:20:42.128 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:41 smithi159 ceph-mon[34394]: fsmap 2024-09-11T23:20:42.128 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:41 smithi159 ceph-mon[34394]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T23:20:42.129 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:41 smithi159 ceph-mon[34394]: mgrmap e13: x(active, since 50s) 2024-09-11T23:20:42.129 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:41 smithi159 ceph-mon[34394]: overall HEALTH_OK 2024-09-11T23:20:42.129 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:41 smithi159 ceph-mon[34394]: Updating smithi172:/var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:20:42.129 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:41 smithi159 ceph-mon[34394]: Updating smithi159:/var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:20:42.129 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:41 smithi159 ceph-mon[34394]: Updating smithi005:/var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:20:42.129 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:41 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:42.129 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:41 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:42.129 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:41 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:42.129 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:41 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:42.129 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:41 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:42.129 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:41 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:42.129 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:41 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:42.129 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:41 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:42.129 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:41 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:42.130 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:41 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:42.130 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:41 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:42.130 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:41 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:20:42.130 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:41 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T23:20:42.130 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:41 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:20:42.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:41 smithi172 ceph-mon[34855]: mon.b calling monitor election 2024-09-11T23:20:42.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:41 smithi172 ceph-mon[34855]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:42.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:41 smithi172 ceph-mon[34855]: Updating smithi005:/etc/ceph/ceph.conf 2024-09-11T23:20:42.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:41 smithi172 ceph-mon[34855]: Updating smithi159:/etc/ceph/ceph.conf 2024-09-11T23:20:42.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:41 smithi172 ceph-mon[34855]: Updating smithi172:/etc/ceph/ceph.conf 2024-09-11T23:20:42.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:41 smithi172 ceph-mon[34855]: mon.b calling monitor election 2024-09-11T23:20:42.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:41 smithi172 ceph-mon[34855]: mon.c calling monitor election 2024-09-11T23:20:42.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:41 smithi172 ceph-mon[34855]: mon.a calling monitor election 2024-09-11T23:20:42.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:41 smithi172 ceph-mon[34855]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-11T23:20:42.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:41 smithi172 ceph-mon[34855]: monmap epoch 3 2024-09-11T23:20:42.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:41 smithi172 ceph-mon[34855]: fsid 1f5284d2-7094-11ef-bcea-c7b262605968 2024-09-11T23:20:42.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:41 smithi172 ceph-mon[34855]: last_changed 2024-09-11T23:20:33.888394+0000 2024-09-11T23:20:42.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:41 smithi172 ceph-mon[34855]: created 2024-09-11T23:18:57.103876+0000 2024-09-11T23:20:42.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:41 smithi172 ceph-mon[34855]: min_mon_release 19 (squid) 2024-09-11T23:20:42.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:41 smithi172 ceph-mon[34855]: election_strategy: 1 2024-09-11T23:20:42.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:41 smithi172 ceph-mon[34855]: 0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-09-11T23:20:42.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:41 smithi172 ceph-mon[34855]: 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.c 2024-09-11T23:20:42.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:41 smithi172 ceph-mon[34855]: 2: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-09-11T23:20:42.136 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:41 smithi172 ceph-mon[34855]: fsmap 2024-09-11T23:20:42.136 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:41 smithi172 ceph-mon[34855]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T23:20:42.136 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:41 smithi172 ceph-mon[34855]: mgrmap e13: x(active, since 50s) 2024-09-11T23:20:42.136 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:41 smithi172 ceph-mon[34855]: overall HEALTH_OK 2024-09-11T23:20:42.136 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:41 smithi172 ceph-mon[34855]: Updating smithi172:/var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:20:42.136 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:41 smithi172 ceph-mon[34855]: Updating smithi159:/var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:20:42.136 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:41 smithi172 ceph-mon[34855]: Updating smithi005:/var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:20:42.136 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:41 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:42.136 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:41 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:42.136 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:41 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:42.136 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:41 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:42.136 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:41 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:42.136 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:41 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:42.136 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:41 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:42.137 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:41 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:42.137 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:41 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:42.137 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:41 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:42.137 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:41 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:42.137 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:41 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:20:42.137 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:41 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T23:20:42.137 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:41 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:20:42.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.538+0000 7f253d936640 1 -- 172.21.15.172:0/1289197517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25381005f0 msgr2=0x7f25381009f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:42.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.538+0000 7f253d936640 1 --2- 172.21.15.172:0/1289197517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25381005f0 0x7f25381009f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2528009880 tx=0x7f252802a5d0 comp rx=0 tx=0).stop 2024-09-11T23:20:42.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.538+0000 7f253d936640 1 -- 172.21.15.172:0/1289197517 shutdown_connections 2024-09-11T23:20:42.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.538+0000 7f253d936640 1 --2- 172.21.15.172:0/1289197517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25381005f0 0x7f25381009f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:42.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.538+0000 7f253d936640 1 -- 172.21.15.172:0/1289197517 >> 172.21.15.172:0/1289197517 conn(0x7f25380fbda0 msgr2=0x7f25380fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:42.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.538+0000 7f253d936640 1 -- 172.21.15.172:0/1289197517 shutdown_connections 2024-09-11T23:20:42.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.538+0000 7f253d936640 1 -- 172.21.15.172:0/1289197517 wait complete. 2024-09-11T23:20:42.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.539+0000 7f253d936640 1 Processor -- start 2024-09-11T23:20:42.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.539+0000 7f253d936640 1 -- start start 2024-09-11T23:20:42.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.539+0000 7f253d936640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25381005f0 0x7f2538196f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:42.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.539+0000 7f253d936640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2538197450 0x7f253819c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:42.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.539+0000 7f253d936640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25381978d0 0x7f253819ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:42.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.539+0000 7f253d936640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2538107690 con 0x7f25381005f0 2024-09-11T23:20:42.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.539+0000 7f253d936640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f2538107510 con 0x7f25381978d0 2024-09-11T23:20:42.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.539+0000 7f253d936640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2538107810 con 0x7f2538197450 2024-09-11T23:20:42.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.539+0000 7f252e7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2538197450 0x7f253819c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:42.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.539+0000 7f252e7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2538197450 0x7f253819c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47984/0 (socket says 172.21.15.172:47984) 2024-09-11T23:20:42.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.539+0000 7f252e7fc640 1 -- 172.21.15.172:0/3494701751 learned_addr learned my addr 172.21.15.172:0/3494701751 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-11T23:20:42.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.539+0000 7f2536ffd640 1 --2- 172.21.15.172:0/3494701751 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25381005f0 0x7f2538196f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:42.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.539+0000 7f25377fe640 1 --2- 172.21.15.172:0/3494701751 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25381978d0 0x7f253819ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:42.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.540+0000 7f252e7fc640 1 -- 172.21.15.172:0/3494701751 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25381978d0 msgr2=0x7f253819ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:42.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.540+0000 7f252e7fc640 1 --2- 172.21.15.172:0/3494701751 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25381978d0 0x7f253819ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:42.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.540+0000 7f252e7fc640 1 -- 172.21.15.172:0/3494701751 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25381005f0 msgr2=0x7f2538196f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:42.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.540+0000 7f252e7fc640 1 --2- 172.21.15.172:0/3494701751 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25381005f0 0x7f2538196f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:42.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.540+0000 7f252e7fc640 1 -- 172.21.15.172:0/3494701751 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f253819f310 con 0x7f2538197450 2024-09-11T23:20:42.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.540+0000 7f252e7fc640 1 --2- 172.21.15.172:0/3494701751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2538197450 0x7f253819c4c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f252000b520 tx=0x7f252000b9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:42.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.540+0000 7f253c934640 1 -- 172.21.15.172:0/3494701751 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2520004230 con 0x7f2538197450 2024-09-11T23:20:42.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.540+0000 7f253d936640 1 -- 172.21.15.172:0/3494701751 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f253819f600 con 0x7f2538197450 2024-09-11T23:20:42.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.540+0000 7f253c934640 1 -- 172.21.15.172:0/3494701751 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f25200043d0 con 0x7f2538197450 2024-09-11T23:20:42.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.540+0000 7f253c934640 1 -- 172.21.15.172:0/3494701751 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2520003cf0 con 0x7f2538197450 2024-09-11T23:20:42.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.540+0000 7f253d936640 1 -- 172.21.15.172:0/3494701751 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f253819fbc0 con 0x7f2538197450 2024-09-11T23:20:42.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.541+0000 7f253c934640 1 -- 172.21.15.172:0/3494701751 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f252000e070 con 0x7f2538197450 2024-09-11T23:20:42.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.541+0000 7f253d936640 1 -- 172.21.15.172:0/3494701751 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2538190450 con 0x7f2538197450 2024-09-11T23:20:42.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.542+0000 7f253c934640 1 --2- 172.21.15.172:0/3494701751 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f25240394f0 0x7f252403b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:42.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.542+0000 7f253c934640 1 -- 172.21.15.172:0/3494701751 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f252004ba70 con 0x7f2538197450 2024-09-11T23:20:42.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.542+0000 7f2536ffd640 1 --2- 172.21.15.172:0/3494701751 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f25240394f0 0x7f252403b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:42.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.542+0000 7f2536ffd640 1 --2- 172.21.15.172:0/3494701751 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f25240394f0 0x7f252403b9b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f25280314e0 tx=0x7f2528005a20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:42.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.547+0000 7f253c934640 1 -- 172.21.15.172:0/3494701751 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2520014020 con 0x7f2538197450 2024-09-11T23:20:42.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:42 smithi005 ceph-mon[31201]: Reconfiguring mon.a (unknown last config time)... 2024-09-11T23:20:42.725 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:42 smithi005 ceph-mon[31201]: Reconfiguring daemon mon.a on smithi005 2024-09-11T23:20:42.725 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:42 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:20:42.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.725+0000 7f253d936640 1 -- 172.21.15.172:0/3494701751 --> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi005=x;smithi159=y;smithi172=z", "target": ["mon-mgr", ""]}) -- 0x7f25380626c0 con 0x7f25240394f0 2024-09-11T23:20:42.726 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:42 smithi172 ceph-mon[34855]: Reconfiguring mon.a (unknown last config time)... 2024-09-11T23:20:42.726 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:42 smithi172 ceph-mon[34855]: Reconfiguring daemon mon.a on smithi005 2024-09-11T23:20:42.726 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:42 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:20:42.731 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.731+0000 7f253c934640 1 -- 172.21.15.172:0/3494701751 <== mgr.14148 v2:172.21.15.5:6800/2285128668 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f25380626c0 con 0x7f25240394f0 2024-09-11T23:20:42.731 INFO:teuthology.orchestra.run.smithi172.stdout:Scheduled mgr update... 2024-09-11T23:20:42.733 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.733+0000 7f253d936640 1 -- 172.21.15.172:0/3494701751 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f25240394f0 msgr2=0x7f252403b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:42.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.733+0000 7f253d936640 1 --2- 172.21.15.172:0/3494701751 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f25240394f0 0x7f252403b9b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f25280314e0 tx=0x7f2528005a20 comp rx=0 tx=0).stop 2024-09-11T23:20:42.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.733+0000 7f253d936640 1 -- 172.21.15.172:0/3494701751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2538197450 msgr2=0x7f253819c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:42.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.733+0000 7f253d936640 1 --2- 172.21.15.172:0/3494701751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2538197450 0x7f253819c4c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f252000b520 tx=0x7f252000b9e0 comp rx=0 tx=0).stop 2024-09-11T23:20:42.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.733+0000 7f253d936640 1 -- 172.21.15.172:0/3494701751 shutdown_connections 2024-09-11T23:20:42.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.733+0000 7f253d936640 1 --2- 172.21.15.172:0/3494701751 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f25240394f0 0x7f252403b9b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:42.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.733+0000 7f253d936640 1 --2- 172.21.15.172:0/3494701751 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25381978d0 0x7f253819ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:42.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.733+0000 7f253d936640 1 --2- 172.21.15.172:0/3494701751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2538197450 0x7f253819c4c0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:42.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.733+0000 7f253d936640 1 --2- 172.21.15.172:0/3494701751 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25381005f0 0x7f2538196f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:42.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.733+0000 7f253d936640 1 -- 172.21.15.172:0/3494701751 >> 172.21.15.172:0/3494701751 conn(0x7f25380fbda0 msgr2=0x7f25380fc940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:42.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.733+0000 7f253d936640 1 -- 172.21.15.172:0/3494701751 shutdown_connections 2024-09-11T23:20:42.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:20:42.733+0000 7f253d936640 1 -- 172.21.15.172:0/3494701751 wait complete. 2024-09-11T23:20:43.107 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:42 smithi159 ceph-mon[34394]: Reconfiguring mon.a (unknown last config time)... 2024-09-11T23:20:43.107 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:42 smithi159 ceph-mon[34394]: Reconfiguring daemon mon.a on smithi005 2024-09-11T23:20:43.107 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:42 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:20:43.255 DEBUG:teuthology.orchestra.run.smithi159:mgr.y> sudo journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mgr.y.service 2024-09-11T23:20:43.257 DEBUG:teuthology.orchestra.run.smithi172:mgr.z> sudo journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mgr.z.service 2024-09-11T23:20:43.260 INFO:tasks.cephadm:Deploying OSDs... 2024-09-11T23:20:43.260 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-11T23:20:43.260 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T23:20:43.281 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T23:20:43.281 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_1 2024-09-11T23:20:43.341 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T23:20:43.341 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:20:43.341 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-11T23:20:43.341 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:20:43.341 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:20:43.341 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-09-11 23:20:00.925977946 +0000 2024-09-11T23:20:43.341 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-09-11 23:16:14.413732821 +0000 2024-09-11T23:20:43.342 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-09-11 23:16:14.413732821 +0000 2024-09-11T23:20:43.342 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-09-11 23:16:14.413732821 +0000 2024-09-11T23:20:43.342 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T23:20:43.411 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-09-11T23:20:43.411 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-09-11T23:20:43.411 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000128282 s, 4.0 MB/s 2024-09-11T23:20:43.413 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T23:20:43.472 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_2 2024-09-11T23:20:43.531 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T23:20:43.531 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:20:43.531 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-11T23:20:43.531 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:20:43.531 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:20:43.531 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-09-11 23:20:00.957977304 +0000 2024-09-11T23:20:43.531 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-09-11 23:16:14.733726305 +0000 2024-09-11T23:20:43.531 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-09-11 23:16:14.733726305 +0000 2024-09-11T23:20:43.531 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-09-11 23:16:14.733726305 +0000 2024-09-11T23:20:43.532 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T23:20:43.598 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-09-11T23:20:43.598 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-09-11T23:20:43.598 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000112234 s, 4.6 MB/s 2024-09-11T23:20:43.600 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T23:20:43.658 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_3 2024-09-11T23:20:43.715 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T23:20:43.715 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:20:43.715 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-11T23:20:43.715 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:20:43.716 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:20:43.716 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-09-11 23:20:00.988976683 +0000 2024-09-11T23:20:43.716 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-09-11 23:16:15.058719688 +0000 2024-09-11T23:20:43.716 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-09-11 23:16:15.058719688 +0000 2024-09-11T23:20:43.716 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-09-11 23:16:15.058719688 +0000 2024-09-11T23:20:43.716 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T23:20:43.782 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-09-11T23:20:43.782 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-09-11T23:20:43.782 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000118224 s, 4.3 MB/s 2024-09-11T23:20:43.784 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T23:20:43.841 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_4 2024-09-11T23:20:43.899 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T23:20:43.899 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:20:43.899 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-11T23:20:43.899 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:20:43.899 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:20:43.900 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-09-11 23:20:01.018976081 +0000 2024-09-11T23:20:43.900 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-09-11 23:16:15.385713030 +0000 2024-09-11T23:20:43.900 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-09-11 23:16:15.385713030 +0000 2024-09-11T23:20:43.900 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-09-11 23:16:15.385713030 +0000 2024-09-11T23:20:43.900 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T23:20:43.965 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-09-11T23:20:43.965 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-09-11T23:20:43.965 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000133534 s, 3.8 MB/s 2024-09-11T23:20:43.966 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T23:20:44.024 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-11T23:20:44.024 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T23:20:44.041 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T23:20:44.042 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_1 2024-09-11T23:20:44.099 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T23:20:44.099 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:20:44.099 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-11T23:20:44.099 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:20:44.100 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:20:44.100 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2024-09-11 23:20:33.310148818 +0000 2024-09-11T23:20:44.100 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2024-09-11 23:16:13.806964832 +0000 2024-09-11T23:20:44.100 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2024-09-11 23:16:13.806964832 +0000 2024-09-11T23:20:44.100 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2024-09-11 23:16:13.806964832 +0000 2024-09-11T23:20:44.100 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T23:20:44.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:43 smithi159 ceph-mon[34394]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:44.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:43 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:44.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:43 smithi159 ceph-mon[34394]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi005=x;smithi159=y;smithi172=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:20:44.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:43 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:44.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:43 smithi159 ceph-mon[34394]: Saving service mgr spec with placement smithi005=x;smithi159=y;smithi172=z;count:3 2024-09-11T23:20:44.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:43 smithi159 ceph-mon[34394]: Reconfiguring mon.b (monmap changed)... 2024-09-11T23:20:44.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:43 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:20:44.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:43 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:44.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:43 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T23:20:44.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:43 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:20:44.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:43 smithi159 ceph-mon[34394]: Reconfiguring daemon mon.b on smithi159 2024-09-11T23:20:44.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:43 smithi172 ceph-mon[34855]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:44.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:43 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:44.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:43 smithi172 ceph-mon[34855]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi005=x;smithi159=y;smithi172=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:20:44.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:43 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:44.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:43 smithi172 ceph-mon[34855]: Saving service mgr spec with placement smithi005=x;smithi159=y;smithi172=z;count:3 2024-09-11T23:20:44.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:43 smithi172 ceph-mon[34855]: Reconfiguring mon.b (monmap changed)... 2024-09-11T23:20:44.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:43 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:20:44.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:43 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:44.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:43 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T23:20:44.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:43 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:20:44.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:43 smithi172 ceph-mon[34855]: Reconfiguring daemon mon.b on smithi159 2024-09-11T23:20:44.152 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2024-09-11T23:20:44.152 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2024-09-11T23:20:44.152 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000217438 s, 2.4 MB/s 2024-09-11T23:20:44.153 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T23:20:44.211 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_2 2024-09-11T23:20:44.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:43 smithi005 ceph-mon[31201]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:44.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:43 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:44.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:43 smithi005 ceph-mon[31201]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi005=x;smithi159=y;smithi172=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:20:44.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:43 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:44.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:43 smithi005 ceph-mon[31201]: Saving service mgr spec with placement smithi005=x;smithi159=y;smithi172=z;count:3 2024-09-11T23:20:44.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:43 smithi005 ceph-mon[31201]: Reconfiguring mon.b (monmap changed)... 2024-09-11T23:20:44.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:43 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:20:44.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:43 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:44.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:43 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T23:20:44.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:43 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:20:44.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:43 smithi005 ceph-mon[31201]: Reconfiguring daemon mon.b on smithi159 2024-09-11T23:20:44.266 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T23:20:44.267 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:20:44.267 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-11T23:20:44.267 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:20:44.267 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:20:44.267 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2024-09-11 23:20:33.310148818 +0000 2024-09-11T23:20:44.267 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2024-09-11 23:16:14.128959096 +0000 2024-09-11T23:20:44.267 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2024-09-11 23:16:14.128959096 +0000 2024-09-11T23:20:44.267 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2024-09-11 23:16:14.128959096 +0000 2024-09-11T23:20:44.267 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T23:20:44.330 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2024-09-11T23:20:44.331 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2024-09-11T23:20:44.331 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000270554 s, 1.9 MB/s 2024-09-11T23:20:44.332 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T23:20:44.389 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_3 2024-09-11T23:20:44.446 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T23:20:44.446 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:20:44.446 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-11T23:20:44.446 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:20:44.446 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:20:44.447 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2024-09-11 23:20:33.310148818 +0000 2024-09-11T23:20:44.447 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2024-09-11 23:16:14.452953324 +0000 2024-09-11T23:20:44.447 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2024-09-11 23:16:14.452953324 +0000 2024-09-11T23:20:44.447 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2024-09-11 23:16:14.452953324 +0000 2024-09-11T23:20:44.448 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T23:20:44.509 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2024-09-11T23:20:44.509 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2024-09-11T23:20:44.509 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000290556 s, 1.8 MB/s 2024-09-11T23:20:44.511 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T23:20:44.567 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_4 2024-09-11T23:20:44.622 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T23:20:44.622 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:20:44.622 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-11T23:20:44.622 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:20:44.622 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:20:44.622 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2024-09-11 23:20:33.311148799 +0000 2024-09-11T23:20:44.622 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2024-09-11 23:16:14.793947247 +0000 2024-09-11T23:20:44.622 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2024-09-11 23:16:14.793947247 +0000 2024-09-11T23:20:44.623 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2024-09-11 23:16:14.793947247 +0000 2024-09-11T23:20:44.623 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T23:20:44.685 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2024-09-11T23:20:44.685 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2024-09-11T23:20:44.685 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000205901 s, 2.5 MB/s 2024-09-11T23:20:44.686 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T23:20:44.743 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-11T23:20:44.743 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T23:20:44.760 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T23:20:44.761 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_1 2024-09-11T23:20:44.817 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T23:20:44.817 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:20:44.817 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-11T23:20:44.817 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:20:44.817 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:20:44.817 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-09-11 23:20:23.916272686 +0000 2024-09-11T23:20:44.817 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-09-11 23:16:13.801009508 +0000 2024-09-11T23:20:44.817 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-09-11 23:16:13.801009508 +0000 2024-09-11T23:20:44.817 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-09-11 23:16:13.801009508 +0000 2024-09-11T23:20:44.818 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T23:20:44.880 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-09-11T23:20:44.880 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-09-11T23:20:44.880 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000194608 s, 2.6 MB/s 2024-09-11T23:20:44.881 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T23:20:44.938 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_2 2024-09-11T23:20:44.994 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T23:20:44.994 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:20:44.994 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-11T23:20:44.994 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:20:44.994 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:20:44.994 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-09-11 23:20:23.916272686 +0000 2024-09-11T23:20:44.994 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-09-11 23:16:14.141001375 +0000 2024-09-11T23:20:44.994 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-09-11 23:16:14.141001375 +0000 2024-09-11T23:20:44.994 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-09-11 23:16:14.141001375 +0000 2024-09-11T23:20:44.994 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T23:20:45.057 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-09-11T23:20:45.057 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-09-11T23:20:45.057 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000253266 s, 2.0 MB/s 2024-09-11T23:20:45.059 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T23:20:45.115 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_3 2024-09-11T23:20:45.169 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T23:20:45.170 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:20:45.170 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-11T23:20:45.170 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:20:45.170 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:20:45.170 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-09-11 23:20:23.917272662 +0000 2024-09-11T23:20:45.170 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-09-11 23:16:14.498992811 +0000 2024-09-11T23:20:45.170 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-09-11 23:16:14.498992811 +0000 2024-09-11T23:20:45.170 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-09-11 23:16:14.498992811 +0000 2024-09-11T23:20:45.170 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T23:20:45.233 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-09-11T23:20:45.234 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-09-11T23:20:45.234 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000165219 s, 3.1 MB/s 2024-09-11T23:20:45.235 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T23:20:45.291 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_4 2024-09-11T23:20:45.352 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T23:20:45.352 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:20:45.353 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-11T23:20:45.353 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:20:45.353 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:20:45.353 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-09-11 23:20:23.917272662 +0000 2024-09-11T23:20:45.353 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-09-11 23:16:14.842984582 +0000 2024-09-11T23:20:45.353 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-09-11 23:16:14.842984582 +0000 2024-09-11T23:20:45.353 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-09-11 23:16:14.842984582 +0000 2024-09-11T23:20:45.353 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T23:20:45.416 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-09-11T23:20:45.416 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-09-11T23:20:45.416 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000192222 s, 2.7 MB/s 2024-09-11T23:20:45.417 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T23:20:45.474 INFO:tasks.cephadm:Deploying osd.0 on smithi005 with /dev/vg_nvme/lv_4... 2024-09-11T23:20:45.474 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-11T23:20:45.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:45 smithi005 ceph-mon[31201]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:45.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:45 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:45.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:45 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:45.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:45 smithi005 ceph-mon[31201]: Reconfiguring mon.c (monmap changed)... 2024-09-11T23:20:45.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:45 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:20:45.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:45 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T23:20:45.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:45 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:20:45.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:45 smithi005 ceph-mon[31201]: Reconfiguring daemon mon.c on smithi172 2024-09-11T23:20:45.476 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:45 smithi172 ceph-mon[34855]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:45.476 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:45 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:45.476 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:45 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:45.476 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:45 smithi172 ceph-mon[34855]: Reconfiguring mon.c (monmap changed)... 2024-09-11T23:20:45.476 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:45 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:20:45.476 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:45 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T23:20:45.476 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:45 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:20:45.476 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:45 smithi172 ceph-mon[34855]: Reconfiguring daemon mon.c on smithi172 2024-09-11T23:20:45.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:45 smithi159 ceph-mon[34394]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:45.627 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:45 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:45.627 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:45 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:45.627 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:45 smithi159 ceph-mon[34394]: Reconfiguring mon.c (monmap changed)... 2024-09-11T23:20:45.627 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:45 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:20:45.627 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:45 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T23:20:45.627 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:45 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:20:45.627 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:45 smithi159 ceph-mon[34394]: Reconfiguring daemon mon.c on smithi172 2024-09-11T23:20:45.739 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:20:46.786 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:46 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:46.786 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:46 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:46.786 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:46 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:20:46.787 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:46 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:20:46.787 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:46 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:20:46.787 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:46 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:46.787 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:46 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T23:20:46.787 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:46 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T23:20:46.787 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:46 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T23:20:46.788 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:46 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:20:46.788 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:46 smithi005 ceph-mon[31201]: Deploying daemon mgr.z on smithi172 2024-09-11T23:20:46.849 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:46 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:46.850 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:46 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:46.850 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:46 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:20:46.850 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:46 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:20:46.850 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:46 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:20:46.850 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:46 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:46.850 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:46 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T23:20:46.850 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:46 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T23:20:46.850 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:46 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T23:20:46.850 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:46 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:20:46.850 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:46 smithi172 ceph-mon[34855]: Deploying daemon mgr.z on smithi172 2024-09-11T23:20:46.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:46 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:46.877 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:46 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:46.877 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:46 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:20:46.877 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:46 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:20:46.877 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:46 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:20:46.877 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:46 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:46.878 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:46 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T23:20:46.878 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:46 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T23:20:46.878 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:46 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T23:20:46.878 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:46 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:20:46.878 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:46 smithi159 ceph-mon[34394]: Deploying daemon mgr.z on smithi172 2024-09-11T23:20:47.522 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 11 23:20:47 smithi172 systemd[1]: Starting Ceph mgr.z for 1f5284d2-7094-11ef-bcea-c7b262605968... 2024-09-11T23:20:47.725 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:47 smithi005 ceph-mon[31201]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:47.773 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:47 smithi172 ceph-mon[34855]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:47.773 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 11 23:20:47 smithi172 podman[36650]: 2024-09-11 23:20:47.425012171 +0000 UTC m=+0.015619753 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:20:47.773 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 11 23:20:47 smithi172 podman[36650]: 2024-09-11 23:20:47.527303266 +0000 UTC m=+0.117910848 container create 6d4592a099c95e5dcb7028b7b33b17448f0991fb000f69db63d1ac1630aeee24 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T23:20:47.773 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 11 23:20:47 smithi172 podman[36650]: 2024-09-11 23:20:47.746477596 +0000 UTC m=+0.337085178 container init 6d4592a099c95e5dcb7028b7b33b17448f0991fb000f69db63d1ac1630aeee24 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-z, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-11T23:20:47.773 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 11 23:20:47 smithi172 podman[36650]: 2024-09-11 23:20:47.749183291 +0000 UTC m=+0.339790874 container start 6d4592a099c95e5dcb7028b7b33b17448f0991fb000f69db63d1ac1630aeee24 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-z, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-11T23:20:47.773 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 11 23:20:47 smithi172 ceph-mgr[36669]: -- 172.21.15.172:0/3718834742 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fcdc3fb0e0 con 0x55fcdc3d9400 2024-09-11T23:20:47.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:47 smithi159 ceph-mon[34394]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:48.078 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 11 23:20:47 smithi172 bash[36650]: 6d4592a099c95e5dcb7028b7b33b17448f0991fb000f69db63d1ac1630aeee24 2024-09-11T23:20:48.079 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 11 23:20:47 smithi172 systemd[1]: Started Ceph mgr.z for 1f5284d2-7094-11ef-bcea-c7b262605968. 2024-09-11T23:20:48.079 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 11 23:20:47 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-z[36665]: 2024-09-11T23:20:47.871+0000 7f1da53d5040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T23:20:48.079 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 11 23:20:47 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-z[36665]: 2024-09-11T23:20:47.929+0000 7f1da53d5040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T23:20:48.079 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 11 23:20:48 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-z[36665]: 2024-09-11T23:20:48.077+0000 7f1da53d5040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T23:20:48.113 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:20:48.140 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi005:vg_nvme/lv_4 2024-09-11T23:20:48.384 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 11 23:20:48 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-z[36665]: 2024-09-11T23:20:48.144+0000 7f1da53d5040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T23:20:48.384 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 11 23:20:48 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-z[36665]: 2024-09-11T23:20:48.290+0000 7f1da53d5040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:20:48.392 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:20:48.744 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 11 23:20:48 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-z[36665]: 2024-09-11T23:20:48.430+0000 7f1da53d5040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T23:20:48.744 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 11 23:20:48 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-z[36665]: 2024-09-11T23:20:48.743+0000 7f1da53d5040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T23:20:48.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:48.815+0000 7fc2ba41a640 1 -- 172.21.15.5:0/1955773098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2b41026d0 msgr2=0x7fc2b4108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:48.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:48.815+0000 7fc2ba41a640 1 --2- 172.21.15.5:0/1955773098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2b41026d0 0x7fc2b4108f60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac009ca0 tx=0x7fc2ac02a8c0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:48.815+0000 7fc2ba41a640 1 -- 172.21.15.5:0/1955773098 shutdown_connections 2024-09-11T23:20:48.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:48.815+0000 7fc2ba41a640 1 --2- 172.21.15.5:0/1955773098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2b41026d0 0x7fc2b4108f60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:48.815+0000 7fc2ba41a640 1 --2- 172.21.15.5:0/1955773098 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2b4101d10 0x7fc2b4102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:48.815+0000 7fc2ba41a640 1 --2- 172.21.15.5:0/1955773098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2b4100b10 0x7fc2b4100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:48.815+0000 7fc2ba41a640 1 -- 172.21.15.5:0/1955773098 >> 172.21.15.5:0/1955773098 conn(0x7fc2b40fc2a0 msgr2=0x7fc2b40fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:48.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:48.815+0000 7fc2ba41a640 1 -- 172.21.15.5:0/1955773098 shutdown_connections 2024-09-11T23:20:48.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:48.815+0000 7fc2ba41a640 1 -- 172.21.15.5:0/1955773098 wait complete. 2024-09-11T23:20:48.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:48.816+0000 7fc2ba41a640 1 Processor -- start 2024-09-11T23:20:48.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:48.816+0000 7fc2ba41a640 1 -- start start 2024-09-11T23:20:48.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:48.816+0000 7fc2ba41a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2b4100b10 0x7fc2b4199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:48.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:48.816+0000 7fc2ba41a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2b4101d10 0x7fc2b419a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:48.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:48.816+0000 7fc2ba41a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2b41026d0 0x7fc2b41a1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:48.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:48.816+0000 7fc2ba41a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b410c620 con 0x7fc2b41026d0 2024-09-11T23:20:48.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:48.816+0000 7fc2ba41a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b410c4a0 con 0x7fc2b4100b10 2024-09-11T23:20:48.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:48.816+0000 7fc2ba41a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b410c7a0 con 0x7fc2b4101d10 2024-09-11T23:20:48.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:48.816+0000 7fc2b89b7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2b41026d0 0x7fc2b41a1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:48.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:48.817+0000 7fc2b89b7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2b41026d0 0x7fc2b41a1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53580/0 (socket says 172.21.15.5:53580) 2024-09-11T23:20:48.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:48.817+0000 7fc2b89b7640 1 -- 172.21.15.5:0/1166104561 learned_addr learned my addr 172.21.15.5:0/1166104561 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:20:48.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:48.817+0000 7fc2b37fe640 1 --2- 172.21.15.5:0/1166104561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2b4101d10 0x7fc2b419a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:48.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:48.817+0000 7fc2b3fff640 1 --2- 172.21.15.5:0/1166104561 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2b4100b10 0x7fc2b4199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:48.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:48.817+0000 7fc2b89b7640 1 -- 172.21.15.5:0/1166104561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2b4101d10 msgr2=0x7fc2b419a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:48.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:48.817+0000 7fc2b89b7640 1 --2- 172.21.15.5:0/1166104561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2b4101d10 0x7fc2b419a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:48.817+0000 7fc2b89b7640 1 -- 172.21.15.5:0/1166104561 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2b4100b10 msgr2=0x7fc2b4199f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:48.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:48.817+0000 7fc2b89b7640 1 --2- 172.21.15.5:0/1166104561 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2b4100b10 0x7fc2b4199f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:48.817+0000 7fc2b89b7640 1 -- 172.21.15.5:0/1166104561 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2b41a1bc0 con 0x7fc2b41026d0 2024-09-11T23:20:48.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:48.817+0000 7fc2b89b7640 1 --2- 172.21.15.5:0/1166104561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2b41026d0 0x7fc2b41a1550 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac031970 tx=0x7fc2ac003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:48.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:48.817+0000 7fc2b17fa640 1 -- 172.21.15.5:0/1166104561 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac004040 con 0x7fc2b41026d0 2024-09-11T23:20:48.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:48.817+0000 7fc2b17fa640 1 -- 172.21.15.5:0/1166104561 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc2ac004690 con 0x7fc2b41026d0 2024-09-11T23:20:48.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:48.817+0000 7fc2ba41a640 1 -- 172.21.15.5:0/1166104561 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2b41a1e50 con 0x7fc2b41026d0 2024-09-11T23:20:48.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:48.817+0000 7fc2b17fa640 1 -- 172.21.15.5:0/1166104561 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac030b60 con 0x7fc2b41026d0 2024-09-11T23:20:48.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:48.817+0000 7fc2ba41a640 1 -- 172.21.15.5:0/1166104561 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2b41a2350 con 0x7fc2b41026d0 2024-09-11T23:20:48.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:48.818+0000 7fc2b17fa640 1 -- 172.21.15.5:0/1166104561 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7fc2ac030d00 con 0x7fc2b41026d0 2024-09-11T23:20:48.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:48.818+0000 7fc2b17fa640 1 --2- 172.21.15.5:0/1166104561 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fc29c0392c0 0x7fc29c03b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:48.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:48.818+0000 7fc2b17fa640 1 -- 172.21.15.5:0/1166104561 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc2ac06d6a0 con 0x7fc2b41026d0 2024-09-11T23:20:48.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:48.818+0000 7fc2ba41a640 1 -- 172.21.15.5:0/1166104561 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2b41a25b0 con 0x7fc2b41026d0 2024-09-11T23:20:48.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:48.819+0000 7fc2b3fff640 1 --2- 172.21.15.5:0/1166104561 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fc29c0392c0 0x7fc29c03b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:48.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:48.819+0000 7fc2b3fff640 1 --2- 172.21.15.5:0/1166104561 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fc29c0392c0 0x7fc29c03b780 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4101b70 tx=0x7fc2a4005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:48.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:48.823+0000 7fc2b17fa640 1 -- 172.21.15.5:0/1166104561 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc2ac04d3a0 con 0x7fc2b41026d0 2024-09-11T23:20:49.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:49.007+0000 7fc2ba41a640 1 -- 172.21.15.5:0/1166104561 --> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fc2b40fe4e0 con 0x7fc29c0392c0 2024-09-11T23:20:49.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:48 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:49.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:48 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:49.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:48 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:49.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:48 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T23:20:49.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:48 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T23:20:49.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:48 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T23:20:49.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:48 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:20:49.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:48 smithi159 ceph-mon[34394]: Deploying daemon mgr.y on smithi159 2024-09-11T23:20:49.134 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 11 23:20:48 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-z[36665]: 2024-09-11T23:20:48.804+0000 7f1da53d5040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T23:20:49.134 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 11 23:20:48 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-z[36665]: 2024-09-11T23:20:48.989+0000 7f1da53d5040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T23:20:49.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:48 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:49.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:48 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:49.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:48 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:49.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:48 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T23:20:49.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:48 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T23:20:49.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:48 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T23:20:49.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:48 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:20:49.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:48 smithi172 ceph-mon[34855]: Deploying daemon mgr.y on smithi159 2024-09-11T23:20:49.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:48 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:49.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:48 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:49.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:48 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:49.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:48 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T23:20:49.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:48 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T23:20:49.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:48 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T23:20:49.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:48 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:20:49.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:48 smithi005 ceph-mon[31201]: Deploying daemon mgr.y on smithi159 2024-09-11T23:20:49.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:49 smithi005 ceph-mon[31201]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:49.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:49 smithi005 ceph-mon[31201]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:20:49.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:49 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:20:49.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:49 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:20:49.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:49 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:20:50.072 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:49 smithi159 ceph-mon[34394]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:50.073 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:49 smithi159 ceph-mon[34394]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:20:50.073 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:49 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:20:50.073 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:49 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:20:50.073 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:49 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:20:50.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:49 smithi172 ceph-mon[34855]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:50.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:49 smithi172 ceph-mon[34855]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:20:50.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:49 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:20:50.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:49 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:20:50.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:49 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:20:50.135 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 11 23:20:49 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-z[36665]: 2024-09-11T23:20:49.871+0000 7f1da53d5040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T23:20:50.135 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 11 23:20:49 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-z[36665]: 2024-09-11T23:20:49.940+0000 7f1da53d5040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T23:20:50.346 INFO:journalctl@ceph.mgr.y.smithi159.stdout:Sep 11 23:20:50 smithi159 ceph-mgr[35764]: -- 172.21.15.159:0/2101689278 <== mon.2 v2:172.21.15.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d473a310e0 con 0x55d473a0f400 2024-09-11T23:20:50.612 INFO:journalctl@ceph.mgr.y.smithi159.stdout:Sep 11 23:20:50 smithi159 bash[35744]: cdfc321bcc95a731b951aa1f6dc71720115ee55b651615e92d791c4e3ba6d98c 2024-09-11T23:20:50.613 INFO:journalctl@ceph.mgr.y.smithi159.stdout:Sep 11 23:20:50 smithi159 systemd[1]: Started Ceph mgr.y for 1f5284d2-7094-11ef-bcea-c7b262605968. 2024-09-11T23:20:50.613 INFO:journalctl@ceph.mgr.y.smithi159.stdout:Sep 11 23:20:50 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-y[35760]: 2024-09-11T23:20:50.397+0000 7f3703d84040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T23:20:50.613 INFO:journalctl@ceph.mgr.y.smithi159.stdout:Sep 11 23:20:50 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-y[35760]: 2024-09-11T23:20:50.456+0000 7f3703d84040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T23:20:50.613 INFO:journalctl@ceph.mgr.y.smithi159.stdout:Sep 11 23:20:50 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-y[35760]: 2024-09-11T23:20:50.612+0000 7f3703d84040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T23:20:50.876 INFO:journalctl@ceph.mgr.y.smithi159.stdout:Sep 11 23:20:50 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-y[35760]: 2024-09-11T23:20:50.681+0000 7f3703d84040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T23:20:50.876 INFO:journalctl@ceph.mgr.y.smithi159.stdout:Sep 11 23:20:50 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-y[35760]: 2024-09-11T23:20:50.840+0000 7f3703d84040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:20:50.960 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 11 23:20:50 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-z[36665]: 2024-09-11T23:20:50.674+0000 7f1da53d5040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T23:20:50.960 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 11 23:20:50 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-z[36665]: 2024-09-11T23:20:50.798+0000 7f1da53d5040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T23:20:50.960 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 11 23:20:50 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-z[36665]: 2024-09-11T23:20:50.960+0000 7f1da53d5040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:20:51.244 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 11 23:20:51 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-z[36665]: 2024-09-11T23:20:51.021+0000 7f1da53d5040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T23:20:51.244 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 11 23:20:51 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-z[36665]: 2024-09-11T23:20:51.171+0000 7f1da53d5040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T23:20:51.244 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 11 23:20:51 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-z[36665]: 2024-09-11T23:20:51.243+0000 7f1da53d5040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T23:20:51.267 INFO:journalctl@ceph.mgr.y.smithi159.stdout:Sep 11 23:20:50 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-y[35760]: 2024-09-11T23:20:50.993+0000 7f3703d84040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T23:20:51.535 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 11 23:20:51 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-z[36665]: 2024-09-11T23:20:51.308+0000 7f1da53d5040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T23:20:51.535 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 11 23:20:51 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-z[36665]: 2024-09-11T23:20:51.470+0000 7f1da53d5040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T23:20:51.535 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 11 23:20:51 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-z[36665]: 2024-09-11T23:20:51.534+0000 7f1da53d5040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T23:20:51.535 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:51 smithi172 ceph-mon[34855]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:51.535 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:51 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:51.535 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:51 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:51.536 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:51 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:51.536 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:51 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:51.536 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:51 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:20:51.536 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:51 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/2273793724' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bf95ced0-780b-482f-87da-0b5e61de62ca"}]: dispatch 2024-09-11T23:20:51.536 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:51 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/2273793724' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bf95ced0-780b-482f-87da-0b5e61de62ca"}]': finished 2024-09-11T23:20:51.536 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:51 smithi172 ceph-mon[34855]: osdmap e5: 1 total, 0 up, 1 in 2024-09-11T23:20:51.536 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:51 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:20:51.573 INFO:journalctl@ceph.mgr.y.smithi159.stdout:Sep 11 23:20:51 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-y[35760]: 2024-09-11T23:20:51.317+0000 7f3703d84040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T23:20:51.573 INFO:journalctl@ceph.mgr.y.smithi159.stdout:Sep 11 23:20:51 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-y[35760]: 2024-09-11T23:20:51.379+0000 7f3703d84040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T23:20:51.574 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:51 smithi159 ceph-mon[34394]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:51.574 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:51 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:51.574 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:51 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:51.574 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:51 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:51.574 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:51 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:51.574 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:51 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:20:51.574 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:51 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/2273793724' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bf95ced0-780b-482f-87da-0b5e61de62ca"}]: dispatch 2024-09-11T23:20:51.574 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:51 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/2273793724' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bf95ced0-780b-482f-87da-0b5e61de62ca"}]': finished 2024-09-11T23:20:51.575 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:51 smithi159 ceph-mon[34394]: osdmap e5: 1 total, 0 up, 1 in 2024-09-11T23:20:51.575 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:51 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:20:51.705 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:51 smithi005 ceph-mon[31201]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:51.705 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:51 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:51.705 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:51 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:51.705 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:51 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:51.705 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:51 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:51.705 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:51 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:20:51.705 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:51 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/2273793724' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bf95ced0-780b-482f-87da-0b5e61de62ca"}]: dispatch 2024-09-11T23:20:51.706 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:51 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/2273793724' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bf95ced0-780b-482f-87da-0b5e61de62ca"}]': finished 2024-09-11T23:20:51.706 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:51 smithi005 ceph-mon[31201]: osdmap e5: 1 total, 0 up, 1 in 2024-09-11T23:20:51.706 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:51 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:20:51.816 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 11 23:20:51 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-z[36665]: 2024-09-11T23:20:51.603+0000 7f1da53d5040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T23:20:51.816 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 11 23:20:51 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-z[36665]: 2024-09-11T23:20:51.693+0000 7f1da53d5040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T23:20:51.816 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 11 23:20:51 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-z[36665]: 2024-09-11T23:20:51.754+0000 7f1da53d5040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T23:20:51.816 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 11 23:20:51 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-z[36665]: 2024-09-11T23:20:51.816+0000 7f1da53d5040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T23:20:51.876 INFO:journalctl@ceph.mgr.y.smithi159.stdout:Sep 11 23:20:51 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-y[35760]: 2024-09-11T23:20:51.573+0000 7f3703d84040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T23:20:52.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:52.678+0000 7fc2b17fa640 1 -- 172.21.15.5:0/1166104561 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 14) ==== 92059+0+0 (secure 0 0 0) 0x7fc2ac03bd10 con 0x7fc2b41026d0 2024-09-11T23:20:52.876 INFO:journalctl@ceph.mgr.y.smithi159.stdout:Sep 11 23:20:52 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-y[35760]: 2024-09-11T23:20:52.462+0000 7f3703d84040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T23:20:52.876 INFO:journalctl@ceph.mgr.y.smithi159.stdout:Sep 11 23:20:52 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-y[35760]: 2024-09-11T23:20:52.528+0000 7f3703d84040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T23:20:52.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:52 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:52.877 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:52 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:52.877 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:52 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:52.877 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:52 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:52.877 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:52 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:20:52.877 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:52 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:20:52.877 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:52 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:52.877 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:52 smithi159 ceph-mon[34394]: Reconfiguring mgr.x (unknown last config time)... 2024-09-11T23:20:52.877 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:52 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T23:20:52.877 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:52 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T23:20:52.877 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:52 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:20:52.877 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:52 smithi159 ceph-mon[34394]: Reconfiguring daemon mgr.x on smithi005 2024-09-11T23:20:52.878 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:52 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/1114409155' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:20:52.878 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:52 smithi159 ceph-mon[34394]: Standby manager daemon z started 2024-09-11T23:20:52.878 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:52 smithi159 ceph-mon[34394]: from='mgr.? 172.21.15.172:0/4072119731' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-11T23:20:52.878 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:52 smithi159 ceph-mon[34394]: from='mgr.? 172.21.15.172:0/4072119731' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T23:20:52.878 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:52 smithi159 ceph-mon[34394]: from='mgr.? 172.21.15.172:0/4072119731' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-11T23:20:52.878 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:52 smithi159 ceph-mon[34394]: from='mgr.? 172.21.15.172:0/4072119731' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T23:20:52.884 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 11 23:20:52 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-z[36665]: 2024-09-11T23:20:52.600+0000 7f1da53d5040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T23:20:52.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:52 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:52.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:52 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:52.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:52 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:52.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:52 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:52.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:52 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:20:52.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:52 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:20:52.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:52 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:52.885 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:52 smithi172 ceph-mon[34855]: Reconfiguring mgr.x (unknown last config time)... 2024-09-11T23:20:52.885 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:52 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T23:20:52.885 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:52 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T23:20:52.885 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:52 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:20:52.885 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:52 smithi172 ceph-mon[34855]: Reconfiguring daemon mgr.x on smithi005 2024-09-11T23:20:52.885 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:52 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/1114409155' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:20:52.885 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:52 smithi172 ceph-mon[34855]: Standby manager daemon z started 2024-09-11T23:20:52.885 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:52 smithi172 ceph-mon[34855]: from='mgr.? 172.21.15.172:0/4072119731' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-11T23:20:52.885 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:52 smithi172 ceph-mon[34855]: from='mgr.? 172.21.15.172:0/4072119731' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T23:20:52.885 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:52 smithi172 ceph-mon[34855]: from='mgr.? 172.21.15.172:0/4072119731' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-11T23:20:52.885 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:52 smithi172 ceph-mon[34855]: from='mgr.? 172.21.15.172:0/4072119731' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T23:20:52.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:52 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:52.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:52 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:52.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:52 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:52.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:52 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:52.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:52 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:20:52.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:52 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:20:52.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:52 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:52.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:52 smithi005 ceph-mon[31201]: Reconfiguring mgr.x (unknown last config time)... 2024-09-11T23:20:52.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:52 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T23:20:52.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:52 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T23:20:52.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:52 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:20:52.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:52 smithi005 ceph-mon[31201]: Reconfiguring daemon mgr.x on smithi005 2024-09-11T23:20:52.976 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:52 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/1114409155' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:20:52.976 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:52 smithi005 ceph-mon[31201]: Standby manager daemon z started 2024-09-11T23:20:52.976 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:52 smithi005 ceph-mon[31201]: from='mgr.? 172.21.15.172:0/4072119731' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-11T23:20:52.976 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:52 smithi005 ceph-mon[31201]: from='mgr.? 172.21.15.172:0/4072119731' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T23:20:52.976 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:52 smithi005 ceph-mon[31201]: from='mgr.? 172.21.15.172:0/4072119731' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-11T23:20:52.976 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:52 smithi005 ceph-mon[31201]: from='mgr.? 172.21.15.172:0/4072119731' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T23:20:53.503 INFO:journalctl@ceph.mgr.y.smithi159.stdout:Sep 11 23:20:53 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-y[35760]: 2024-09-11T23:20:53.248+0000 7f3703d84040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T23:20:53.503 INFO:journalctl@ceph.mgr.y.smithi159.stdout:Sep 11 23:20:53 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-y[35760]: 2024-09-11T23:20:53.362+0000 7f3703d84040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T23:20:53.503 INFO:journalctl@ceph.mgr.y.smithi159.stdout:Sep 11 23:20:53 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-y[35760]: 2024-09-11T23:20:53.502+0000 7f3703d84040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:20:53.780 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:53 smithi159 ceph-mon[34394]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:53.780 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:53 smithi159 ceph-mon[34394]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-11T23:20:53.780 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:53 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-11T23:20:53.780 INFO:journalctl@ceph.mgr.y.smithi159.stdout:Sep 11 23:20:53 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-y[35760]: 2024-09-11T23:20:53.563+0000 7f3703d84040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T23:20:53.780 INFO:journalctl@ceph.mgr.y.smithi159.stdout:Sep 11 23:20:53 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-y[35760]: 2024-09-11T23:20:53.712+0000 7f3703d84040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T23:20:53.780 INFO:journalctl@ceph.mgr.y.smithi159.stdout:Sep 11 23:20:53 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-y[35760]: 2024-09-11T23:20:53.779+0000 7f3703d84040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T23:20:53.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:53 smithi005 ceph-mon[31201]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:53.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:53 smithi005 ceph-mon[31201]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-11T23:20:53.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:53 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-11T23:20:54.059 INFO:journalctl@ceph.mgr.y.smithi159.stdout:Sep 11 23:20:53 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-y[35760]: 2024-09-11T23:20:53.839+0000 7f3703d84040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T23:20:54.060 INFO:journalctl@ceph.mgr.y.smithi159.stdout:Sep 11 23:20:53 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-y[35760]: 2024-09-11T23:20:53.995+0000 7f3703d84040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T23:20:54.060 INFO:journalctl@ceph.mgr.y.smithi159.stdout:Sep 11 23:20:54 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-y[35760]: 2024-09-11T23:20:54.059+0000 7f3703d84040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T23:20:54.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:53 smithi172 ceph-mon[34855]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:54.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:53 smithi172 ceph-mon[34855]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-11T23:20:54.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:53 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-11T23:20:54.324 INFO:journalctl@ceph.mgr.y.smithi159.stdout:Sep 11 23:20:54 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-y[35760]: 2024-09-11T23:20:54.125+0000 7f3703d84040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T23:20:54.324 INFO:journalctl@ceph.mgr.y.smithi159.stdout:Sep 11 23:20:54 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-y[35760]: 2024-09-11T23:20:54.206+0000 7f3703d84040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T23:20:54.324 INFO:journalctl@ceph.mgr.y.smithi159.stdout:Sep 11 23:20:54 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-y[35760]: 2024-09-11T23:20:54.265+0000 7f3703d84040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T23:20:54.324 INFO:journalctl@ceph.mgr.y.smithi159.stdout:Sep 11 23:20:54 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-y[35760]: 2024-09-11T23:20:54.324+0000 7f3703d84040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T23:20:55.376 INFO:journalctl@ceph.mgr.y.smithi159.stdout:Sep 11 23:20:55 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-y[35760]: 2024-09-11T23:20:55.106+0000 7f3703d84040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T23:20:55.777 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:55 smithi005 ceph-mon[31201]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:55.777 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:55 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:55.777 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:55 smithi005 ceph-mon[31201]: Standby manager daemon y started 2024-09-11T23:20:55.777 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:55 smithi005 ceph-mon[31201]: from='mgr.? 172.21.15.159:0/1696986234' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-11T23:20:55.777 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:55 smithi005 ceph-mon[31201]: from='mgr.? 172.21.15.159:0/1696986234' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T23:20:55.777 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:55 smithi005 ceph-mon[31201]: from='mgr.? 172.21.15.159:0/1696986234' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-11T23:20:55.777 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:55 smithi005 ceph-mon[31201]: from='mgr.? 172.21.15.159:0/1696986234' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T23:20:56.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:20:56.081+0000 7fc2b17fa640 1 -- 172.21.15.5:0/1166104561 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mgrmap(e 15) ==== 137776+0+0 (secure 0 0 0) 0x7fc2ac04a260 con 0x7fc2b41026d0 2024-09-11T23:20:56.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:55 smithi159 ceph-mon[34394]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:56.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:55 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:56.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:55 smithi159 ceph-mon[34394]: Standby manager daemon y started 2024-09-11T23:20:56.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:55 smithi159 ceph-mon[34394]: from='mgr.? 172.21.15.159:0/1696986234' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-11T23:20:56.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:55 smithi159 ceph-mon[34394]: from='mgr.? 172.21.15.159:0/1696986234' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T23:20:56.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:55 smithi159 ceph-mon[34394]: from='mgr.? 172.21.15.159:0/1696986234' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-11T23:20:56.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:55 smithi159 ceph-mon[34394]: from='mgr.? 172.21.15.159:0/1696986234' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T23:20:56.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:55 smithi172 ceph-mon[34855]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:56.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:55 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:56.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:55 smithi172 ceph-mon[34855]: Standby manager daemon y started 2024-09-11T23:20:56.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:55 smithi172 ceph-mon[34855]: from='mgr.? 172.21.15.159:0/1696986234' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-11T23:20:56.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:55 smithi172 ceph-mon[34855]: from='mgr.? 172.21.15.159:0/1696986234' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T23:20:56.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:55 smithi172 ceph-mon[34855]: from='mgr.? 172.21.15.159:0/1696986234' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-11T23:20:56.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:55 smithi172 ceph-mon[34855]: from='mgr.? 172.21.15.159:0/1696986234' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T23:20:57.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:57 smithi005 ceph-mon[31201]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:57.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:57 smithi005 ceph-mon[31201]: mgrmap e15: x(active, since 66s), standbys: z, y 2024-09-11T23:20:57.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:57 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-11T23:20:57.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:57 smithi159 ceph-mon[34394]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:57.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:57 smithi159 ceph-mon[34394]: mgrmap e15: x(active, since 66s), standbys: z, y 2024-09-11T23:20:57.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:57 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-11T23:20:57.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:57 smithi172 ceph-mon[34855]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:20:57.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:57 smithi172 ceph-mon[34855]: mgrmap e15: x(active, since 66s), standbys: z, y 2024-09-11T23:20:57.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:57 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-11T23:20:59.221 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:58 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:59.221 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:58 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:59.221 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:58 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:20:59.221 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:58 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:20:59.221 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:58 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:20:59.221 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:58 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:59.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:58 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:59.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:58 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:59.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:58 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:20:59.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:58 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:20:59.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:58 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:20:59.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:58 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:59.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:58 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:59.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:58 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:20:59.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:58 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:20:59.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:58 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:20:59.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:58 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:20:59.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:58 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:00.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:59 smithi005 ceph-mon[31201]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:21:00.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:59 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-11T23:21:00.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:20:59 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:21:00.277 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:59 smithi159 ceph-mon[34394]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:21:00.278 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:59 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-11T23:21:00.278 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:20:59 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:21:00.285 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:59 smithi172 ceph-mon[34855]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:21:00.285 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:59 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-11T23:21:00.285 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:20:59 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:21:01.335 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:00 smithi005 ceph-mon[31201]: Deploying daemon osd.0 on smithi005 2024-09-11T23:21:01.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:00 smithi159 ceph-mon[34394]: Deploying daemon osd.0 on smithi005 2024-09-11T23:21:01.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:00 smithi172 ceph-mon[34855]: Deploying daemon osd.0 on smithi005 2024-09-11T23:21:02.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:01 smithi005 ceph-mon[31201]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:21:02.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:01 smithi159 ceph-mon[34394]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:21:02.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:01 smithi172 ceph-mon[34855]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:21:04.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:03 smithi159 ceph-mon[34394]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:21:04.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:03 smithi172 ceph-mon[34855]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:21:04.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:03 smithi005 ceph-mon[31201]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:21:06.181 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:05 smithi005 ceph-mon[31201]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:21:06.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:05 smithi159 ceph-mon[34394]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:21:06.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:05 smithi172 ceph-mon[34855]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:21:07.105 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:06 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:21:07.106 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:06 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:07.106 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:06 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:07.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:06 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:21:07.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:06 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:07.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:06 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:07.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:06 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:21:07.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:06 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:07.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:06 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:08.189 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:07 smithi005 ceph-mon[31201]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:21:08.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:07 smithi159 ceph-mon[34394]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:21:08.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:07 smithi172 ceph-mon[34855]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:21:10.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:09 smithi159 ceph-mon[34394]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:21:10.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:09 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:10.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:09 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:10.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:09 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:21:10.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:09 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:21:10.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:09 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:10.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:09 smithi172 ceph-mon[34855]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:21:10.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:09 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:10.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:09 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:10.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:09 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:21:10.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:09 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:21:10.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:09 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:10.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:09 smithi005 ceph-mon[31201]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:21:10.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:09 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:10.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:09 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:10.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:09 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:21:10.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:09 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:21:10.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:09 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:10.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:21:10.586+0000 7fc2b17fa640 1 -- 172.21.15.5:0/1166104561 <== mgr.14148 v2:172.21.15.5:6800/2285128668 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc2b40fe4e0 con 0x7fc29c0392c0 2024-09-11T23:21:10.587 INFO:teuthology.orchestra.run.smithi005.stdout:Created osd(s) 0 on host 'smithi005' 2024-09-11T23:21:10.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:21:10.590+0000 7fc2ba41a640 1 -- 172.21.15.5:0/1166104561 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fc29c0392c0 msgr2=0x7fc29c03b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:10.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:21:10.590+0000 7fc2ba41a640 1 --2- 172.21.15.5:0/1166104561 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fc29c0392c0 0x7fc29c03b780 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4101b70 tx=0x7fc2a4005f90 comp rx=0 tx=0).stop 2024-09-11T23:21:10.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:21:10.590+0000 7fc2ba41a640 1 -- 172.21.15.5:0/1166104561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2b41026d0 msgr2=0x7fc2b41a1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:10.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:21:10.590+0000 7fc2ba41a640 1 --2- 172.21.15.5:0/1166104561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2b41026d0 0x7fc2b41a1550 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac031970 tx=0x7fc2ac003ba0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:21:10.590+0000 7fc2ba41a640 1 -- 172.21.15.5:0/1166104561 shutdown_connections 2024-09-11T23:21:10.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:21:10.590+0000 7fc2ba41a640 1 --2- 172.21.15.5:0/1166104561 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fc29c0392c0 0x7fc29c03b780 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:21:10.590+0000 7fc2ba41a640 1 --2- 172.21.15.5:0/1166104561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2b41026d0 0x7fc2b41a1550 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:21:10.590+0000 7fc2ba41a640 1 --2- 172.21.15.5:0/1166104561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2b4101d10 0x7fc2b419a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:21:10.590+0000 7fc2ba41a640 1 --2- 172.21.15.5:0/1166104561 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2b4100b10 0x7fc2b4199f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:21:10.590+0000 7fc2ba41a640 1 -- 172.21.15.5:0/1166104561 >> 172.21.15.5:0/1166104561 conn(0x7fc2b40fc2a0 msgr2=0x7fc2b40fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:10.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:21:10.590+0000 7fc2ba41a640 1 -- 172.21.15.5:0/1166104561 shutdown_connections 2024-09-11T23:21:10.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:21:10.590+0000 7fc2ba41a640 1 -- 172.21.15.5:0/1166104561 wait complete. 2024-09-11T23:21:10.938 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:10 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:21:10.938 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:10 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:10.938 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:10 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:11.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:10 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:21:11.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:10 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:11.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:10 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:11.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:10 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:21:11.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:10 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:11.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:10 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:11.259 DEBUG:teuthology.orchestra.run.smithi005:osd.0> sudo journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@osd.0.service 2024-09-11T23:21:11.261 INFO:tasks.cephadm:Deploying osd.1 on smithi159 with /dev/vg_nvme/lv_4... 2024-09-11T23:21:11.261 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-11T23:21:11.504 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T23:21:11.836 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:11 smithi159 ceph-mon[34394]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:21:11.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:11 smithi172 ceph-mon[34855]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:21:11.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:11 smithi005 ceph-mon[31201]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:21:12.296 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 11 23:21:12 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-0[44749]: 2024-09-11T23:21:12.009+0000 7f68438a0640 -1 osd.0 0 log_to_monitors true 2024-09-11T23:21:12.791 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:12 smithi159 ceph-mon[34394]: from='osd.0 [v2:172.21.15.5:6802/624761084,v1:172.21.15.5:6803/624761084]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-11T23:21:12.866 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:12 smithi005 ceph-mon[31201]: from='osd.0 [v2:172.21.15.5:6802/624761084,v1:172.21.15.5:6803/624761084]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-11T23:21:13.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:12 smithi172 ceph-mon[34855]: from='osd.0 [v2:172.21.15.5:6802/624761084,v1:172.21.15.5:6803/624761084]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-11T23:21:13.807 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-11T23:21:13.834 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi159:vg_nvme/lv_4 2024-09-11T23:21:14.089 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T23:21:14.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:13 smithi159 ceph-mon[34394]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:21:14.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:13 smithi159 ceph-mon[34394]: from='osd.0 [v2:172.21.15.5:6802/624761084,v1:172.21.15.5:6803/624761084]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-11T23:21:14.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:13 smithi159 ceph-mon[34394]: osdmap e6: 1 total, 0 up, 1 in 2024-09-11T23:21:14.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:13 smithi159 ceph-mon[34394]: from='osd.0 [v2:172.21.15.5:6802/624761084,v1:172.21.15.5:6803/624761084]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-09-11T23:21:14.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:13 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:21:14.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:13 smithi172 ceph-mon[34855]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:21:14.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:13 smithi172 ceph-mon[34855]: from='osd.0 [v2:172.21.15.5:6802/624761084,v1:172.21.15.5:6803/624761084]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-11T23:21:14.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:13 smithi172 ceph-mon[34855]: osdmap e6: 1 total, 0 up, 1 in 2024-09-11T23:21:14.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:13 smithi172 ceph-mon[34855]: from='osd.0 [v2:172.21.15.5:6802/624761084,v1:172.21.15.5:6803/624761084]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-09-11T23:21:14.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:13 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:21:14.137 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:13 smithi005 ceph-mon[31201]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:21:14.137 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:13 smithi005 ceph-mon[31201]: from='osd.0 [v2:172.21.15.5:6802/624761084,v1:172.21.15.5:6803/624761084]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-11T23:21:14.137 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:13 smithi005 ceph-mon[31201]: osdmap e6: 1 total, 0 up, 1 in 2024-09-11T23:21:14.137 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:13 smithi005 ceph-mon[31201]: from='osd.0 [v2:172.21.15.5:6802/624761084,v1:172.21.15.5:6803/624761084]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-09-11T23:21:14.137 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:13 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:21:14.137 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 11 23:21:13 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-0[44749]: 2024-09-11T23:21:13.793+0000 7f683f823640 -1 osd.0 0 waiting for initial osdmap 2024-09-11T23:21:14.137 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 11 23:21:13 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-0[44749]: 2024-09-11T23:21:13.795+0000 7f683b64b640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:21:14.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:14.591+0000 7fe969723640 1 -- 172.21.15.159:0/1237279532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe964102690 msgr2=0x7fe964108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:14.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:14.591+0000 7fe969723640 1 --2- 172.21.15.159:0/1237279532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe964102690 0x7fe964108f20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe95c009ca0 tx=0x7fe95c02a8c0 comp rx=0 tx=0).stop 2024-09-11T23:21:14.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:14.592+0000 7fe969723640 1 -- 172.21.15.159:0/1237279532 shutdown_connections 2024-09-11T23:21:14.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:14.592+0000 7fe969723640 1 --2- 172.21.15.159:0/1237279532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe964102690 0x7fe964108f20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:14.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:14.592+0000 7fe969723640 1 --2- 172.21.15.159:0/1237279532 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe964101cd0 0x7fe964102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:14.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:14.592+0000 7fe969723640 1 --2- 172.21.15.159:0/1237279532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe964100ad0 0x7fe964100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:14.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:14.592+0000 7fe969723640 1 -- 172.21.15.159:0/1237279532 >> 172.21.15.159:0/1237279532 conn(0x7fe9640fc280 msgr2=0x7fe9640fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:14.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:14.592+0000 7fe969723640 1 -- 172.21.15.159:0/1237279532 shutdown_connections 2024-09-11T23:21:14.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:14.592+0000 7fe969723640 1 -- 172.21.15.159:0/1237279532 wait complete. 2024-09-11T23:21:14.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:14.592+0000 7fe969723640 1 Processor -- start 2024-09-11T23:21:14.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:14.592+0000 7fe969723640 1 -- start start 2024-09-11T23:21:14.608 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:14.592+0000 7fe969723640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe964100ad0 0x7fe96406aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:14.608 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:14.592+0000 7fe969723640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe964101cd0 0x7fe96419cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:14.608 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:14.593+0000 7fe969723640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe964102690 0x7fe96419f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:14.608 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:14.593+0000 7fe969723640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe96410c600 con 0x7fe964102690 2024-09-11T23:21:14.608 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:14.593+0000 7fe969723640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe96410c480 con 0x7fe964101cd0 2024-09-11T23:21:14.608 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:14.593+0000 7fe969723640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe96410c780 con 0x7fe964100ad0 2024-09-11T23:21:14.608 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:14.593+0000 7fe95a7fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe964101cd0 0x7fe96419cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:14.608 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:14.593+0000 7fe95a7fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe964101cd0 0x7fe96419cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57076/0 (socket says 172.21.15.159:57076) 2024-09-11T23:21:14.608 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:14.593+0000 7fe95a7fc640 1 -- 172.21.15.159:0/4007476591 learned_addr learned my addr 172.21.15.159:0/4007476591 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-11T23:21:14.608 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:14.593+0000 7fe9637fe640 1 --2- 172.21.15.159:0/4007476591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe964102690 0x7fe96419f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:14.608 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:14.593+0000 7fe962ffd640 1 --2- 172.21.15.159:0/4007476591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe964100ad0 0x7fe96406aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:14.608 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:14.593+0000 7fe95a7fc640 1 -- 172.21.15.159:0/4007476591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe964100ad0 msgr2=0x7fe96406aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:14.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:14.593+0000 7fe95a7fc640 1 --2- 172.21.15.159:0/4007476591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe964100ad0 0x7fe96406aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:14.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:14.593+0000 7fe95a7fc640 1 -- 172.21.15.159:0/4007476591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe964102690 msgr2=0x7fe96419f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:14.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:14.593+0000 7fe95a7fc640 1 --2- 172.21.15.159:0/4007476591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe964102690 0x7fe96419f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:14.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:14.593+0000 7fe95a7fc640 1 -- 172.21.15.159:0/4007476591 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe96419fa70 con 0x7fe964101cd0 2024-09-11T23:21:14.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:14.593+0000 7fe95a7fc640 1 --2- 172.21.15.159:0/4007476591 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe964101cd0 0x7fe96419cb40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe94c00d770 tx=0x7fe94c00dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:14.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:14.593+0000 7fe960ff9640 1 -- 172.21.15.159:0/4007476591 <== mon.2 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe94c017070 con 0x7fe964101cd0 2024-09-11T23:21:14.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:14.593+0000 7fe969723640 1 -- 172.21.15.159:0/4007476591 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe96419fd00 con 0x7fe964101cd0 2024-09-11T23:21:14.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:14.593+0000 7fe969723640 1 -- 172.21.15.159:0/4007476591 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9641a01e0 con 0x7fe964101cd0 2024-09-11T23:21:14.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:14.593+0000 7fe960ff9640 1 -- 172.21.15.159:0/4007476591 <== mon.2 v2:172.21.15.159:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe94c0054d0 con 0x7fe964101cd0 2024-09-11T23:21:14.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:14.593+0000 7fe960ff9640 1 -- 172.21.15.159:0/4007476591 <== mon.2 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe94c004cf0 con 0x7fe964101cd0 2024-09-11T23:21:14.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:14.594+0000 7fe969723640 1 -- 172.21.15.159:0/4007476591 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9440052c0 con 0x7fe964101cd0 2024-09-11T23:21:14.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:14.595+0000 7fe960ff9640 1 -- 172.21.15.159:0/4007476591 <== mon.2 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 15) ==== 137776+0+0 (secure 0 0 0) 0x7fe94c004e90 con 0x7fe964101cd0 2024-09-11T23:21:14.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:14.596+0000 7fe960ff9640 1 --2- 172.21.15.159:0/4007476591 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe9500a2af0 0x7fe9500a4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:14.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:14.596+0000 7fe960ff9640 1 -- 172.21.15.159:0/4007476591 <== mon.2 v2:172.21.15.159:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7fe94c0cce10 con 0x7fe964101cd0 2024-09-11T23:21:14.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:14.596+0000 7fe962ffd640 1 --2- 172.21.15.159:0/4007476591 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe9500a2af0 0x7fe9500a4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:14.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:14.597+0000 7fe962ffd640 1 --2- 172.21.15.159:0/4007476591 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe9500a2af0 0x7fe9500a4fb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe964101b30 tx=0x7fe954005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:14.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:14.600+0000 7fe960ff9640 1 -- 172.21.15.159:0/4007476591 <== mon.2 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe94c09b900 con 0x7fe964101cd0 2024-09-11T23:21:14.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:14.774+0000 7fe969723640 1 -- 172.21.15.159:0/4007476591 --> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fe944000bf0 con 0x7fe9500a2af0 2024-09-11T23:21:15.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:14 smithi159 ceph-mon[34394]: from='osd.0 [v2:172.21.15.5:6802/624761084,v1:172.21.15.5:6803/624761084]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-09-11T23:21:15.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:14 smithi159 ceph-mon[34394]: osdmap e7: 1 total, 0 up, 1 in 2024-09-11T23:21:15.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:14 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:21:15.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:14 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:21:15.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:14 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:15.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:14 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:15.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:14 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:21:15.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:14 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:15.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:14 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:21:15.128 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:14 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:21:15.128 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:14 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:15.128 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:14 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:21:15.128 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:14 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:21:15.128 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:14 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:21:15.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:14 smithi172 ceph-mon[34855]: from='osd.0 [v2:172.21.15.5:6802/624761084,v1:172.21.15.5:6803/624761084]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-09-11T23:21:15.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:14 smithi172 ceph-mon[34855]: osdmap e7: 1 total, 0 up, 1 in 2024-09-11T23:21:15.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:14 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:21:15.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:14 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:21:15.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:14 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:15.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:14 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:15.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:14 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:21:15.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:14 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:15.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:14 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:21:15.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:14 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:21:15.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:14 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:15.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:14 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:21:15.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:14 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:21:15.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:14 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:21:15.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:14 smithi005 ceph-mon[31201]: from='osd.0 [v2:172.21.15.5:6802/624761084,v1:172.21.15.5:6803/624761084]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-09-11T23:21:15.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:14 smithi005 ceph-mon[31201]: osdmap e7: 1 total, 0 up, 1 in 2024-09-11T23:21:15.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:14 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:21:15.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:14 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:21:15.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:14 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:15.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:14 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:15.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:14 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:21:15.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:14 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:15.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:14 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:21:15.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:14 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:21:15.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:14 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:15.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:14 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:21:15.226 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:14 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:21:15.226 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:14 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:21:15.797 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:15 smithi159 ceph-mon[34394]: purged_snaps scrub starts 2024-09-11T23:21:15.797 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:15 smithi159 ceph-mon[34394]: purged_snaps scrub ok 2024-09-11T23:21:15.797 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:15 smithi159 ceph-mon[34394]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:21:15.797 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:15 smithi159 ceph-mon[34394]: Detected new or changed devices on smithi005 2024-09-11T23:21:15.797 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:15 smithi159 ceph-mon[34394]: Adjusting osd_memory_target on smithi005 to 17092M 2024-09-11T23:21:15.797 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:15 smithi159 ceph-mon[34394]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:21:15.798 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:15 smithi159 ceph-mon[34394]: osd.0 [v2:172.21.15.5:6802/624761084,v1:172.21.15.5:6803/624761084] boot 2024-09-11T23:21:15.798 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:15 smithi159 ceph-mon[34394]: osdmap e8: 1 total, 1 up, 1 in 2024-09-11T23:21:15.798 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:15 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:21:16.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:15 smithi172 ceph-mon[34855]: purged_snaps scrub starts 2024-09-11T23:21:16.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:15 smithi172 ceph-mon[34855]: purged_snaps scrub ok 2024-09-11T23:21:16.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:15 smithi172 ceph-mon[34855]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:21:16.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:15 smithi172 ceph-mon[34855]: Detected new or changed devices on smithi005 2024-09-11T23:21:16.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:15 smithi172 ceph-mon[34855]: Adjusting osd_memory_target on smithi005 to 17092M 2024-09-11T23:21:16.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:15 smithi172 ceph-mon[34855]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:21:16.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:15 smithi172 ceph-mon[34855]: osd.0 [v2:172.21.15.5:6802/624761084,v1:172.21.15.5:6803/624761084] boot 2024-09-11T23:21:16.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:15 smithi172 ceph-mon[34855]: osdmap e8: 1 total, 1 up, 1 in 2024-09-11T23:21:16.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:15 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:21:16.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:15 smithi005 ceph-mon[31201]: purged_snaps scrub starts 2024-09-11T23:21:16.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:15 smithi005 ceph-mon[31201]: purged_snaps scrub ok 2024-09-11T23:21:16.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:15 smithi005 ceph-mon[31201]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:21:16.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:15 smithi005 ceph-mon[31201]: Detected new or changed devices on smithi005 2024-09-11T23:21:16.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:15 smithi005 ceph-mon[31201]: Adjusting osd_memory_target on smithi005 to 17092M 2024-09-11T23:21:16.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:15 smithi005 ceph-mon[31201]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:21:16.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:15 smithi005 ceph-mon[31201]: osd.0 [v2:172.21.15.5:6802/624761084,v1:172.21.15.5:6803/624761084] boot 2024-09-11T23:21:16.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:15 smithi005 ceph-mon[31201]: osdmap e8: 1 total, 1 up, 1 in 2024-09-11T23:21:16.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:15 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:21:17.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:16 smithi159 ceph-mon[34394]: osdmap e9: 1 total, 1 up, 1 in 2024-09-11T23:21:17.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:16 smithi172 ceph-mon[34855]: osdmap e9: 1 total, 1 up, 1 in 2024-09-11T23:21:17.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:16 smithi005 ceph-mon[31201]: osdmap e9: 1 total, 1 up, 1 in 2024-09-11T23:21:18.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:17 smithi159 ceph-mon[34394]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:21:18.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:17 smithi159 ceph-mon[34394]: from='client.? 172.21.15.159:0/965515108' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d926484f-78a6-497b-843d-f2db54ade4a0"}]: dispatch 2024-09-11T23:21:18.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:17 smithi159 ceph-mon[34394]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d926484f-78a6-497b-843d-f2db54ade4a0"}]: dispatch 2024-09-11T23:21:18.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:17 smithi159 ceph-mon[34394]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d926484f-78a6-497b-843d-f2db54ade4a0"}]': finished 2024-09-11T23:21:18.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:17 smithi159 ceph-mon[34394]: osdmap e10: 2 total, 1 up, 2 in 2024-09-11T23:21:18.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:17 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:21:18.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:17 smithi159 ceph-mon[34394]: from='client.? 172.21.15.159:0/1372379760' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:21:18.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:17 smithi172 ceph-mon[34855]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:21:18.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:17 smithi172 ceph-mon[34855]: from='client.? 172.21.15.159:0/965515108' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d926484f-78a6-497b-843d-f2db54ade4a0"}]: dispatch 2024-09-11T23:21:18.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:17 smithi172 ceph-mon[34855]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d926484f-78a6-497b-843d-f2db54ade4a0"}]: dispatch 2024-09-11T23:21:18.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:17 smithi172 ceph-mon[34855]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d926484f-78a6-497b-843d-f2db54ade4a0"}]': finished 2024-09-11T23:21:18.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:17 smithi172 ceph-mon[34855]: osdmap e10: 2 total, 1 up, 2 in 2024-09-11T23:21:18.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:17 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:21:18.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:17 smithi172 ceph-mon[34855]: from='client.? 172.21.15.159:0/1372379760' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:21:18.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:17 smithi005 ceph-mon[31201]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:21:18.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:17 smithi005 ceph-mon[31201]: from='client.? 172.21.15.159:0/965515108' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d926484f-78a6-497b-843d-f2db54ade4a0"}]: dispatch 2024-09-11T23:21:18.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:17 smithi005 ceph-mon[31201]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d926484f-78a6-497b-843d-f2db54ade4a0"}]: dispatch 2024-09-11T23:21:18.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:17 smithi005 ceph-mon[31201]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d926484f-78a6-497b-843d-f2db54ade4a0"}]': finished 2024-09-11T23:21:18.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:17 smithi005 ceph-mon[31201]: osdmap e10: 2 total, 1 up, 2 in 2024-09-11T23:21:18.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:17 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:21:18.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:17 smithi005 ceph-mon[31201]: from='client.? 172.21.15.159:0/1372379760' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:21:20.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:19 smithi159 ceph-mon[34394]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:21:20.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:19 smithi172 ceph-mon[34855]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:21:20.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:19 smithi005 ceph-mon[31201]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:21:22.096 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:21 smithi159 ceph-mon[34394]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:21:22.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:21 smithi172 ceph-mon[34855]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:21:22.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:21 smithi005 ceph-mon[31201]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:21:24.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:23 smithi159 ceph-mon[34394]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:21:24.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:23 smithi172 ceph-mon[34855]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:21:24.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:23 smithi005 ceph-mon[31201]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:21:26.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:25 smithi159 ceph-mon[34394]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:21:26.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:25 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-11T23:21:26.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:25 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:21:26.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:25 smithi159 ceph-mon[34394]: Deploying daemon osd.1 on smithi159 2024-09-11T23:21:26.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:25 smithi172 ceph-mon[34855]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:21:26.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:25 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-11T23:21:26.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:25 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:21:26.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:25 smithi172 ceph-mon[34855]: Deploying daemon osd.1 on smithi159 2024-09-11T23:21:26.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:25 smithi005 ceph-mon[31201]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:21:26.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:25 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-11T23:21:26.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:25 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:21:26.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:25 smithi005 ceph-mon[31201]: Deploying daemon osd.1 on smithi159 2024-09-11T23:21:28.092 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:27 smithi159 ceph-mon[34394]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:21:28.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:27 smithi172 ceph-mon[34855]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:21:28.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:27 smithi005 ceph-mon[31201]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:21:29.987 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:29 smithi159 ceph-mon[34394]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:21:30.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:29 smithi172 ceph-mon[34855]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:21:30.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:29 smithi005 ceph-mon[31201]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:21:31.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:31 smithi159 ceph-mon[34394]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:21:31.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:31 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:21:31.877 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:31 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:31.877 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:31 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:32.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:31 smithi172 ceph-mon[34855]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:21:32.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:31 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:21:32.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:31 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:32.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:31 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:32.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:31 smithi005 ceph-mon[31201]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:21:32.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:31 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:21:32.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:31 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:32.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:31 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:34.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:33 smithi159 ceph-mon[34394]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:21:34.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:33 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:34.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:33 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:34.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:33 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:21:34.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:33 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:21:34.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:33 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:34.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:33 smithi172 ceph-mon[34855]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:21:34.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:33 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:34.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:33 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:34.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:33 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:21:34.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:33 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:21:34.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:33 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:34.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:33 smithi005 ceph-mon[31201]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:21:34.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:33 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:34.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:33 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:34.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:33 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:21:34.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:33 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:21:34.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:33 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:34.613 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:34.612+0000 7fe960ff9640 1 -- 172.21.15.159:0/4007476591 <== mgr.14148 v2:172.21.15.5:6800/2285128668 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe944000bf0 con 0x7fe9500a2af0 2024-09-11T23:21:34.613 INFO:teuthology.orchestra.run.smithi159.stdout:Created osd(s) 1 on host 'smithi159' 2024-09-11T23:21:34.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:34.614+0000 7fe969723640 1 -- 172.21.15.159:0/4007476591 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe9500a2af0 msgr2=0x7fe9500a4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:34.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:34.614+0000 7fe969723640 1 --2- 172.21.15.159:0/4007476591 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe9500a2af0 0x7fe9500a4fb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe964101b30 tx=0x7fe954005f90 comp rx=0 tx=0).stop 2024-09-11T23:21:34.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:34.614+0000 7fe969723640 1 -- 172.21.15.159:0/4007476591 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe964101cd0 msgr2=0x7fe96419cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:34.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:34.614+0000 7fe969723640 1 --2- 172.21.15.159:0/4007476591 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe964101cd0 0x7fe96419cb40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe94c00d770 tx=0x7fe94c00dc30 comp rx=0 tx=0).stop 2024-09-11T23:21:34.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:34.614+0000 7fe969723640 1 -- 172.21.15.159:0/4007476591 shutdown_connections 2024-09-11T23:21:34.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:34.614+0000 7fe969723640 1 --2- 172.21.15.159:0/4007476591 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe9500a2af0 0x7fe9500a4fb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:34.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:34.614+0000 7fe969723640 1 --2- 172.21.15.159:0/4007476591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe964102690 0x7fe96419f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:34.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:34.614+0000 7fe969723640 1 --2- 172.21.15.159:0/4007476591 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe964101cd0 0x7fe96419cb40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:34.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:34.614+0000 7fe969723640 1 --2- 172.21.15.159:0/4007476591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe964100ad0 0x7fe96406aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:34.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:34.614+0000 7fe969723640 1 -- 172.21.15.159:0/4007476591 >> 172.21.15.159:0/4007476591 conn(0x7fe9640fc280 msgr2=0x7fe964105140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:34.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:34.614+0000 7fe969723640 1 -- 172.21.15.159:0/4007476591 shutdown_connections 2024-09-11T23:21:34.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:21:34.614+0000 7fe969723640 1 -- 172.21.15.159:0/4007476591 wait complete. 2024-09-11T23:21:35.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:34 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:21:35.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:34 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:35.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:34 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:35.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:34 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:21:35.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:34 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:35.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:34 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:35.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:34 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:21:35.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:34 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:35.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:34 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:35.230 DEBUG:teuthology.orchestra.run.smithi159:osd.1> sudo journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@osd.1.service 2024-09-11T23:21:35.233 INFO:tasks.cephadm:Deploying osd.2 on smithi172 with /dev/vg_nvme/lv_4... 2024-09-11T23:21:35.233 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-11T23:21:35.486 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:21:35.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:35 smithi172 ceph-mon[34855]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:21:36.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:35 smithi159 ceph-mon[34394]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:21:36.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:35 smithi005 ceph-mon[31201]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:21:37.377 INFO:journalctl@ceph.osd.1.smithi159.stdout:Sep 11 23:21:37 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-1[38852]: 2024-09-11T23:21:37.027+0000 7f96f9b73640 -1 osd.1 0 log_to_monitors true 2024-09-11T23:21:37.728 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-11T23:21:37.752 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi172:vg_nvme/lv_4 2024-09-11T23:21:37.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:37 smithi172 ceph-mon[34855]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:21:37.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:37 smithi172 ceph-mon[34855]: from='osd.1 [v2:172.21.15.159:6800/2111290186,v1:172.21.15.159:6801/2111290186]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-11T23:21:37.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:37 smithi172 ceph-mon[34855]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-11T23:21:37.999 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:21:38.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:37 smithi159 ceph-mon[34394]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:21:38.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:37 smithi159 ceph-mon[34394]: from='osd.1 [v2:172.21.15.159:6800/2111290186,v1:172.21.15.159:6801/2111290186]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-11T23:21:38.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:37 smithi159 ceph-mon[34394]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-11T23:21:38.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:37 smithi005 ceph-mon[31201]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:21:38.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:37 smithi005 ceph-mon[31201]: from='osd.1 [v2:172.21.15.159:6800/2111290186,v1:172.21.15.159:6801/2111290186]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-11T23:21:38.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:37 smithi005 ceph-mon[31201]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-11T23:21:38.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:38.427+0000 7fdbae6d5640 1 -- 172.21.15.172:0/2577961379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdba8101c00 msgr2=0x7fdba8102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:38.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:38.427+0000 7fdbae6d5640 1 --2- 172.21.15.172:0/2577961379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdba8101c00 0x7fdba8102000 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fdb98009900 tx=0x7fdb9802a410 comp rx=0 tx=0).stop 2024-09-11T23:21:38.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:38.427+0000 7fdbae6d5640 1 -- 172.21.15.172:0/2577961379 shutdown_connections 2024-09-11T23:21:38.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:38.427+0000 7fdbae6d5640 1 --2- 172.21.15.172:0/2577961379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdba81037c0 0x7fdba810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:38.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:38.427+0000 7fdbae6d5640 1 --2- 172.21.15.172:0/2577961379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdba8102e00 0x7fdba8103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:38.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:38.427+0000 7fdbae6d5640 1 --2- 172.21.15.172:0/2577961379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdba8101c00 0x7fdba8102000 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:38.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:38.427+0000 7fdbae6d5640 1 -- 172.21.15.172:0/2577961379 >> 172.21.15.172:0/2577961379 conn(0x7fdba80fd390 msgr2=0x7fdba80ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:38.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:38.427+0000 7fdbae6d5640 1 -- 172.21.15.172:0/2577961379 shutdown_connections 2024-09-11T23:21:38.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:38.427+0000 7fdbae6d5640 1 -- 172.21.15.172:0/2577961379 wait complete. 2024-09-11T23:21:38.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:38.428+0000 7fdbae6d5640 1 Processor -- start 2024-09-11T23:21:38.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:38.428+0000 7fdbae6d5640 1 -- start start 2024-09-11T23:21:38.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:38.428+0000 7fdbae6d5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdba8101c00 0x7fdba8197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:38.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:38.428+0000 7fdbae6d5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdba8102e00 0x7fdba8198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:38.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:38.428+0000 7fdbae6d5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdba81037c0 0x7fdba819f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:38.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:38.428+0000 7fdbae6d5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdba810d730 con 0x7fdba81037c0 2024-09-11T23:21:38.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:38.428+0000 7fdbae6d5640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fdba810d5b0 con 0x7fdba8101c00 2024-09-11T23:21:38.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:38.428+0000 7fdbae6d5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdba810d8b0 con 0x7fdba8102e00 2024-09-11T23:21:38.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:38.429+0000 7fdba77fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdba8102e00 0x7fdba8198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:38.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:38.429+0000 7fdba77fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdba8102e00 0x7fdba8198320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42518/0 (socket says 172.21.15.172:42518) 2024-09-11T23:21:38.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:38.429+0000 7fdba77fe640 1 -- 172.21.15.172:0/158889363 learned_addr learned my addr 172.21.15.172:0/158889363 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-11T23:21:38.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:38.429+0000 7fdba7fff640 1 --2- 172.21.15.172:0/158889363 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdba8101c00 0x7fdba8197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:38.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:38.429+0000 7fdbacc72640 1 --2- 172.21.15.172:0/158889363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdba81037c0 0x7fdba819f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:38.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:38.429+0000 7fdba77fe640 1 -- 172.21.15.172:0/158889363 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdba8101c00 msgr2=0x7fdba8197de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:38.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:38.429+0000 7fdba77fe640 1 --2- 172.21.15.172:0/158889363 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdba8101c00 0x7fdba8197de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:38.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:38.429+0000 7fdba77fe640 1 -- 172.21.15.172:0/158889363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdba81037c0 msgr2=0x7fdba819f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:38.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:38.429+0000 7fdba77fe640 1 --2- 172.21.15.172:0/158889363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdba81037c0 0x7fdba819f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:38.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:38.429+0000 7fdba77fe640 1 -- 172.21.15.172:0/158889363 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdba819fa10 con 0x7fdba8102e00 2024-09-11T23:21:38.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:38.429+0000 7fdba77fe640 1 --2- 172.21.15.172:0/158889363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdba8102e00 0x7fdba8198320 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c00d770 tx=0x7fdb9c00dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:38.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:38.429+0000 7fdba57fa640 1 -- 172.21.15.172:0/158889363 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c017070 con 0x7fdba8102e00 2024-09-11T23:21:38.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:38.429+0000 7fdba57fa640 1 -- 172.21.15.172:0/158889363 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdb9c0054d0 con 0x7fdba8102e00 2024-09-11T23:21:38.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:38.429+0000 7fdbae6d5640 1 -- 172.21.15.172:0/158889363 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdba819fd00 con 0x7fdba8102e00 2024-09-11T23:21:38.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:38.429+0000 7fdba57fa640 1 -- 172.21.15.172:0/158889363 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c004cf0 con 0x7fdba8102e00 2024-09-11T23:21:38.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:38.429+0000 7fdbae6d5640 1 -- 172.21.15.172:0/158889363 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdba81a0190 con 0x7fdba8102e00 2024-09-11T23:21:38.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:38.430+0000 7fdbae6d5640 1 -- 172.21.15.172:0/158889363 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdba8109050 con 0x7fdba8102e00 2024-09-11T23:21:38.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:38.431+0000 7fdba57fa640 1 -- 172.21.15.172:0/158889363 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 15) ==== 137776+0+0 (secure 0 0 0) 0x7fdb9c004e90 con 0x7fdba8102e00 2024-09-11T23:21:38.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:38.432+0000 7fdba57fa640 1 --2- 172.21.15.172:0/158889363 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fdb900a2b20 0x7fdb900a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:38.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:38.432+0000 7fdba57fa640 1 -- 172.21.15.172:0/158889363 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 1903+0+0 (secure 0 0 0) 0x7fdb9c0cd390 con 0x7fdba8102e00 2024-09-11T23:21:38.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:38.432+0000 7fdba7fff640 1 --2- 172.21.15.172:0/158889363 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fdb900a2b20 0x7fdb900a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:38.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:38.433+0000 7fdba7fff640 1 --2- 172.21.15.172:0/158889363 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fdb900a2b20 0x7fdb900a4fe0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdb98004770 tx=0x7fdb98000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:38.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:38.436+0000 7fdba57fa640 1 -- 172.21.15.172:0/158889363 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdb9c09b690 con 0x7fdba8102e00 2024-09-11T23:21:38.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:38.612+0000 7fdbae6d5640 1 -- 172.21.15.172:0/158889363 --> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fdba8062630 con 0x7fdb900a2b20 2024-09-11T23:21:39.126 INFO:journalctl@ceph.osd.1.smithi159.stdout:Sep 11 23:21:38 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-1[38852]: 2024-09-11T23:21:38.845+0000 7f96f5af6640 -1 osd.1 0 waiting for initial osdmap 2024-09-11T23:21:39.126 INFO:journalctl@ceph.osd.1.smithi159.stdout:Sep 11 23:21:38 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-1[38852]: 2024-09-11T23:21:38.850+0000 7f96f191e640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:21:39.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:38 smithi159 ceph-mon[34394]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-11T23:21:39.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:38 smithi159 ceph-mon[34394]: from='osd.1 [v2:172.21.15.159:6800/2111290186,v1:172.21.15.159:6801/2111290186]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-11T23:21:39.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:38 smithi159 ceph-mon[34394]: osdmap e11: 2 total, 1 up, 2 in 2024-09-11T23:21:39.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:38 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:21:39.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:38 smithi159 ceph-mon[34394]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-11T23:21:39.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:38 smithi159 ceph-mon[34394]: Detected new or changed devices on smithi159 2024-09-11T23:21:39.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:38 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:39.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:38 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:39.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:38 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:21:39.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:38 smithi159 ceph-mon[34394]: Adjusting osd_memory_target on smithi159 to 17088M 2024-09-11T23:21:39.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:38 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:39.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:38 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:21:39.128 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:38 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:21:39.128 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:38 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:39.128 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:38 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:21:39.128 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:38 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:21:39.128 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:38 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:21:39.128 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:38 smithi159 ceph-mon[34394]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-11T23:21:39.129 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:38 smithi172 ceph-mon[34855]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-11T23:21:39.129 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:38 smithi172 ceph-mon[34855]: from='osd.1 [v2:172.21.15.159:6800/2111290186,v1:172.21.15.159:6801/2111290186]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-11T23:21:39.129 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:38 smithi172 ceph-mon[34855]: osdmap e11: 2 total, 1 up, 2 in 2024-09-11T23:21:39.129 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:38 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:21:39.129 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:38 smithi172 ceph-mon[34855]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-11T23:21:39.129 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:38 smithi172 ceph-mon[34855]: Detected new or changed devices on smithi159 2024-09-11T23:21:39.129 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:38 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:39.129 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:38 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:39.129 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:38 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:21:39.129 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:38 smithi172 ceph-mon[34855]: Adjusting osd_memory_target on smithi159 to 17088M 2024-09-11T23:21:39.129 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:38 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:39.129 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:38 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:21:39.129 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:38 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:21:39.130 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:38 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:39.130 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:38 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:21:39.130 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:38 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:21:39.130 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:38 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:21:39.130 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:38 smithi172 ceph-mon[34855]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-11T23:21:39.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:38 smithi005 ceph-mon[31201]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-11T23:21:39.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:38 smithi005 ceph-mon[31201]: from='osd.1 [v2:172.21.15.159:6800/2111290186,v1:172.21.15.159:6801/2111290186]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-11T23:21:39.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:38 smithi005 ceph-mon[31201]: osdmap e11: 2 total, 1 up, 2 in 2024-09-11T23:21:39.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:38 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:21:39.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:38 smithi005 ceph-mon[31201]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-11T23:21:39.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:38 smithi005 ceph-mon[31201]: Detected new or changed devices on smithi159 2024-09-11T23:21:39.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:38 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:39.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:38 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:39.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:38 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:21:39.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:38 smithi005 ceph-mon[31201]: Adjusting osd_memory_target on smithi159 to 17088M 2024-09-11T23:21:39.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:38 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:39.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:38 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:21:39.226 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:38 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:21:39.226 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:38 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:39.226 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:38 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:21:39.226 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:38 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:21:39.226 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:38 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:21:39.226 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:38 smithi005 ceph-mon[31201]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-11T23:21:40.114 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:39 smithi172 ceph-mon[34855]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:21:40.114 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:39 smithi172 ceph-mon[34855]: from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:21:40.114 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:39 smithi172 ceph-mon[34855]: osdmap e12: 2 total, 1 up, 2 in 2024-09-11T23:21:40.114 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:39 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:21:40.114 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:39 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:21:40.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:39 smithi159 ceph-mon[34394]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:21:40.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:39 smithi159 ceph-mon[34394]: from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:21:40.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:39 smithi159 ceph-mon[34394]: osdmap e12: 2 total, 1 up, 2 in 2024-09-11T23:21:40.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:39 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:21:40.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:39 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:21:40.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:39 smithi005 ceph-mon[31201]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:21:40.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:39 smithi005 ceph-mon[31201]: from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:21:40.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:39 smithi005 ceph-mon[31201]: osdmap e12: 2 total, 1 up, 2 in 2024-09-11T23:21:40.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:39 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:21:40.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:39 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:21:41.125 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:40 smithi172 ceph-mon[34855]: purged_snaps scrub starts 2024-09-11T23:21:41.125 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:40 smithi172 ceph-mon[34855]: purged_snaps scrub ok 2024-09-11T23:21:41.125 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:40 smithi172 ceph-mon[34855]: osd.1 [v2:172.21.15.159:6800/2111290186,v1:172.21.15.159:6801/2111290186] boot 2024-09-11T23:21:41.125 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:40 smithi172 ceph-mon[34855]: osdmap e13: 2 total, 2 up, 2 in 2024-09-11T23:21:41.125 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:40 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:21:41.126 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:40 smithi172 ceph-mon[34855]: from='client.? 172.21.15.172:0/137511820' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d92cd431-0ba7-4171-82b8-60fa3d63a64b"}]: dispatch 2024-09-11T23:21:41.126 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:40 smithi172 ceph-mon[34855]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d92cd431-0ba7-4171-82b8-60fa3d63a64b"}]: dispatch 2024-09-11T23:21:41.126 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:40 smithi172 ceph-mon[34855]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d92cd431-0ba7-4171-82b8-60fa3d63a64b"}]': finished 2024-09-11T23:21:41.126 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:40 smithi172 ceph-mon[34855]: osdmap e14: 3 total, 2 up, 3 in 2024-09-11T23:21:41.126 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:40 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:21:41.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:40 smithi159 ceph-mon[34394]: purged_snaps scrub starts 2024-09-11T23:21:41.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:40 smithi159 ceph-mon[34394]: purged_snaps scrub ok 2024-09-11T23:21:41.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:40 smithi159 ceph-mon[34394]: osd.1 [v2:172.21.15.159:6800/2111290186,v1:172.21.15.159:6801/2111290186] boot 2024-09-11T23:21:41.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:40 smithi159 ceph-mon[34394]: osdmap e13: 2 total, 2 up, 2 in 2024-09-11T23:21:41.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:40 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:21:41.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:40 smithi159 ceph-mon[34394]: from='client.? 172.21.15.172:0/137511820' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d92cd431-0ba7-4171-82b8-60fa3d63a64b"}]: dispatch 2024-09-11T23:21:41.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:40 smithi159 ceph-mon[34394]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d92cd431-0ba7-4171-82b8-60fa3d63a64b"}]: dispatch 2024-09-11T23:21:41.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:40 smithi159 ceph-mon[34394]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d92cd431-0ba7-4171-82b8-60fa3d63a64b"}]': finished 2024-09-11T23:21:41.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:40 smithi159 ceph-mon[34394]: osdmap e14: 3 total, 2 up, 3 in 2024-09-11T23:21:41.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:40 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:21:41.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:40 smithi005 ceph-mon[31201]: purged_snaps scrub starts 2024-09-11T23:21:41.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:40 smithi005 ceph-mon[31201]: purged_snaps scrub ok 2024-09-11T23:21:41.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:40 smithi005 ceph-mon[31201]: osd.1 [v2:172.21.15.159:6800/2111290186,v1:172.21.15.159:6801/2111290186] boot 2024-09-11T23:21:41.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:40 smithi005 ceph-mon[31201]: osdmap e13: 2 total, 2 up, 2 in 2024-09-11T23:21:41.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:40 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:21:41.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:40 smithi005 ceph-mon[31201]: from='client.? 172.21.15.172:0/137511820' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d92cd431-0ba7-4171-82b8-60fa3d63a64b"}]: dispatch 2024-09-11T23:21:41.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:40 smithi005 ceph-mon[31201]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d92cd431-0ba7-4171-82b8-60fa3d63a64b"}]: dispatch 2024-09-11T23:21:41.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:40 smithi005 ceph-mon[31201]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d92cd431-0ba7-4171-82b8-60fa3d63a64b"}]': finished 2024-09-11T23:21:41.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:40 smithi005 ceph-mon[31201]: osdmap e14: 3 total, 2 up, 3 in 2024-09-11T23:21:41.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:40 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:21:42.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:41 smithi159 ceph-mon[34394]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:21:42.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:41 smithi159 ceph-mon[34394]: from='client.? 172.21.15.172:0/696836658' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:21:42.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:41 smithi172 ceph-mon[34855]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:21:42.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:41 smithi172 ceph-mon[34855]: from='client.? 172.21.15.172:0/696836658' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:21:42.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:41 smithi005 ceph-mon[31201]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:21:42.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:41 smithi005 ceph-mon[31201]: from='client.? 172.21.15.172:0/696836658' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:21:44.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:43 smithi159 ceph-mon[34394]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:21:44.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:43 smithi172 ceph-mon[34855]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:21:44.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:43 smithi005 ceph-mon[31201]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:21:46.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:45 smithi159 ceph-mon[34394]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:21:46.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:45 smithi172 ceph-mon[34855]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:21:46.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:45 smithi005 ceph-mon[31201]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:21:48.106 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:47 smithi172 ceph-mon[34855]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:21:48.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:47 smithi159 ceph-mon[34394]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:21:48.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:47 smithi005 ceph-mon[31201]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:21:50.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:49 smithi159 ceph-mon[34394]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:21:50.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:49 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-11T23:21:50.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:49 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:21:50.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:49 smithi159 ceph-mon[34394]: Deploying daemon osd.2 on smithi172 2024-09-11T23:21:50.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:49 smithi172 ceph-mon[34855]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:21:50.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:49 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-11T23:21:50.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:49 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:21:50.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:49 smithi172 ceph-mon[34855]: Deploying daemon osd.2 on smithi172 2024-09-11T23:21:50.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:49 smithi005 ceph-mon[31201]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:21:50.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:49 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-11T23:21:50.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:49 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:21:50.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:49 smithi005 ceph-mon[31201]: Deploying daemon osd.2 on smithi172 2024-09-11T23:21:52.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:51 smithi159 ceph-mon[34394]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:21:52.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:51 smithi172 ceph-mon[34855]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:21:52.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:51 smithi005 ceph-mon[31201]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:21:54.035 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:53 smithi172 ceph-mon[34855]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:21:54.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:53 smithi159 ceph-mon[34394]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:21:54.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:53 smithi005 ceph-mon[31201]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:21:55.918 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:55 smithi172 ceph-mon[34855]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:21:55.918 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:55 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:21:55.918 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:55 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:55.918 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:55 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:56.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:55 smithi159 ceph-mon[34394]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:21:56.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:55 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:21:56.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:55 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:56.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:55 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:56.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:55 smithi005 ceph-mon[31201]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:21:56.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:55 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:21:56.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:55 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:56.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:55 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:58.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:57 smithi172 ceph-mon[34855]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:21:58.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:57 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:58.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:57 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:58.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:57 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:21:58.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:57 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:21:58.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:57 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:58.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:57 smithi005 ceph-mon[31201]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:21:58.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:57 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:58.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:57 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:58.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:57 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:21:58.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:57 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:21:58.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:57 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:58.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:57 smithi159 ceph-mon[34394]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:21:58.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:57 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:58.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:57 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:58.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:57 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:21:58.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:57 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:21:58.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:57 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:21:59.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:59.236+0000 7fdba57fa640 1 -- 172.21.15.172:0/158889363 <== mgr.14148 v2:172.21.15.5:6800/2285128668 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fdba8062630 con 0x7fdb900a2b20 2024-09-11T23:21:59.237 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 2 on host 'smithi172' 2024-09-11T23:21:59.240 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:59.239+0000 7fdbae6d5640 1 -- 172.21.15.172:0/158889363 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fdb900a2b20 msgr2=0x7fdb900a4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:59.240 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:59.239+0000 7fdbae6d5640 1 --2- 172.21.15.172:0/158889363 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fdb900a2b20 0x7fdb900a4fe0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdb98004770 tx=0x7fdb98000bc0 comp rx=0 tx=0).stop 2024-09-11T23:21:59.240 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:59.239+0000 7fdbae6d5640 1 -- 172.21.15.172:0/158889363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdba8102e00 msgr2=0x7fdba8198320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:59.240 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:59.239+0000 7fdbae6d5640 1 --2- 172.21.15.172:0/158889363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdba8102e00 0x7fdba8198320 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c00d770 tx=0x7fdb9c00dc30 comp rx=0 tx=0).stop 2024-09-11T23:21:59.240 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:59.239+0000 7fdbae6d5640 1 -- 172.21.15.172:0/158889363 shutdown_connections 2024-09-11T23:21:59.240 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:59.239+0000 7fdbae6d5640 1 --2- 172.21.15.172:0/158889363 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fdb900a2b20 0x7fdb900a4fe0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:59.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:59.239+0000 7fdbae6d5640 1 --2- 172.21.15.172:0/158889363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdba81037c0 0x7fdba819f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:59.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:59.239+0000 7fdbae6d5640 1 --2- 172.21.15.172:0/158889363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdba8102e00 0x7fdba8198320 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:59.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:59.239+0000 7fdbae6d5640 1 --2- 172.21.15.172:0/158889363 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdba8101c00 0x7fdba8197de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:59.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:59.239+0000 7fdbae6d5640 1 -- 172.21.15.172:0/158889363 >> 172.21.15.172:0/158889363 conn(0x7fdba80fd390 msgr2=0x7fdba8106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:59.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:59.239+0000 7fdbae6d5640 1 -- 172.21.15.172:0/158889363 shutdown_connections 2024-09-11T23:21:59.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:21:59.239+0000 7fdbae6d5640 1 -- 172.21.15.172:0/158889363 wait complete. 2024-09-11T23:21:59.861 DEBUG:teuthology.orchestra.run.smithi172:osd.2> sudo journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@osd.2.service 2024-09-11T23:21:59.864 INFO:tasks.cephadm:Deploying osd.3 on smithi005 with /dev/vg_nvme/lv_3... 2024-09-11T23:21:59.864 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-11T23:22:00.089 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:59 smithi172 ceph-mon[34855]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:22:00.090 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:59 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:22:00.090 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:59 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:00.090 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:21:59 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:00.118 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:22:00.178 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:59 smithi159 ceph-mon[34394]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:22:00.179 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:59 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:22:00.179 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:59 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:00.179 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:21:59 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:00.212 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:59 smithi005 ceph-mon[31201]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:22:00.212 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:59 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:22:00.212 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:59 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:00.212 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:21:59 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:01.486 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 11 23:22:01 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-2[39800]: 2024-09-11T23:22:01.250+0000 7f6400e52640 -1 osd.2 0 log_to_monitors true 2024-09-11T23:22:02.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:01 smithi172 ceph-mon[34855]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:22:02.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:01 smithi172 ceph-mon[34855]: from='osd.2 [v2:172.21.15.172:6800/299915717,v1:172.21.15.172:6801/299915717]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-11T23:22:02.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:01 smithi172 ceph-mon[34855]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-11T23:22:02.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:01 smithi005 ceph-mon[31201]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:22:02.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:01 smithi005 ceph-mon[31201]: from='osd.2 [v2:172.21.15.172:6800/299915717,v1:172.21.15.172:6801/299915717]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-11T23:22:02.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:01 smithi005 ceph-mon[31201]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-11T23:22:02.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:01 smithi159 ceph-mon[34394]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:22:02.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:01 smithi159 ceph-mon[34394]: from='osd.2 [v2:172.21.15.172:6800/299915717,v1:172.21.15.172:6801/299915717]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-11T23:22:02.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:01 smithi159 ceph-mon[34394]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-11T23:22:02.587 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:22:02.618 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi005:vg_nvme/lv_3 2024-09-11T23:22:02.895 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:22:03.134 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 11 23:22:02 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-2[39800]: 2024-09-11T23:22:02.896+0000 7f63fcdd5640 -1 osd.2 0 waiting for initial osdmap 2024-09-11T23:22:03.134 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 11 23:22:02 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-2[39800]: 2024-09-11T23:22:02.902+0000 7f63f8bfd640 -1 osd.2 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:22:03.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:02 smithi172 ceph-mon[34855]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-11T23:22:03.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:02 smithi172 ceph-mon[34855]: osdmap e15: 3 total, 2 up, 3 in 2024-09-11T23:22:03.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:02 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:22:03.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:02 smithi172 ceph-mon[34855]: from='osd.2 [v2:172.21.15.172:6800/299915717,v1:172.21.15.172:6801/299915717]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-11T23:22:03.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:02 smithi172 ceph-mon[34855]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-11T23:22:03.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:02 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:03.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:02 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:03.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:02 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:22:03.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:02 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:03.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:02 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:22:03.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:02 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:22:03.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:02 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:03.175 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:02 smithi005 ceph-mon[31201]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-11T23:22:03.175 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:02 smithi005 ceph-mon[31201]: osdmap e15: 3 total, 2 up, 3 in 2024-09-11T23:22:03.175 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:02 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:22:03.175 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:02 smithi005 ceph-mon[31201]: from='osd.2 [v2:172.21.15.172:6800/299915717,v1:172.21.15.172:6801/299915717]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-11T23:22:03.175 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:02 smithi005 ceph-mon[31201]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-11T23:22:03.175 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:02 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:03.175 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:02 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:03.175 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:02 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:22:03.176 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:02 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:03.176 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:02 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:22:03.176 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:02 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:22:03.176 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:02 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:03.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:02 smithi159 ceph-mon[34394]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-11T23:22:03.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:02 smithi159 ceph-mon[34394]: osdmap e15: 3 total, 2 up, 3 in 2024-09-11T23:22:03.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:02 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:22:03.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:02 smithi159 ceph-mon[34394]: from='osd.2 [v2:172.21.15.172:6800/299915717,v1:172.21.15.172:6801/299915717]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-11T23:22:03.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:02 smithi159 ceph-mon[34394]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-11T23:22:03.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:02 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:03.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:02 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:03.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:02 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:22:03.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:02 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:03.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:02 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:22:03.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:02 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:22:03.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:02 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:03.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:03.402+0000 7fc3f0b76640 1 -- 172.21.15.5:0/575222113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3ec100ad0 msgr2=0x7fc3ec100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:03.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:03.402+0000 7fc3f0b76640 1 --2- 172.21.15.5:0/575222113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3ec100ad0 0x7fc3ec100ed0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc009900 tx=0x7fc3dc02a410 comp rx=0 tx=0).stop 2024-09-11T23:22:03.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:03.403+0000 7fc3f0b76640 1 -- 172.21.15.5:0/575222113 shutdown_connections 2024-09-11T23:22:03.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:03.403+0000 7fc3f0b76640 1 --2- 172.21.15.5:0/575222113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3ec102690 0x7fc3ec108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:03.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:03.403+0000 7fc3f0b76640 1 --2- 172.21.15.5:0/575222113 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3ec101cd0 0x7fc3ec102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:03.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:03.403+0000 7fc3f0b76640 1 --2- 172.21.15.5:0/575222113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3ec100ad0 0x7fc3ec100ed0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:03.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:03.403+0000 7fc3f0b76640 1 -- 172.21.15.5:0/575222113 >> 172.21.15.5:0/575222113 conn(0x7fc3ec0fc280 msgr2=0x7fc3ec0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:03.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:03.403+0000 7fc3f0b76640 1 -- 172.21.15.5:0/575222113 shutdown_connections 2024-09-11T23:22:03.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:03.403+0000 7fc3f0b76640 1 -- 172.21.15.5:0/575222113 wait complete. 2024-09-11T23:22:03.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:03.404+0000 7fc3f0b76640 1 Processor -- start 2024-09-11T23:22:03.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:03.404+0000 7fc3f0b76640 1 -- start start 2024-09-11T23:22:03.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:03.404+0000 7fc3f0b76640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3ec100ad0 0x7fc3ec199f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:03.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:03.404+0000 7fc3f0b76640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3ec101cd0 0x7fc3ec19a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:03.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:03.404+0000 7fc3f0b76640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3ec102690 0x7fc3ec1a1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:03.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:03.404+0000 7fc3f0b76640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc3ec10c610 con 0x7fc3ec102690 2024-09-11T23:22:03.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:03.404+0000 7fc3f0b76640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc3ec10c490 con 0x7fc3ec101cd0 2024-09-11T23:22:03.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:03.404+0000 7fc3f0b76640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc3ec10c790 con 0x7fc3ec100ad0 2024-09-11T23:22:03.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:03.404+0000 7fc3ead9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3ec102690 0x7fc3ec1a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:03.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:03.404+0000 7fc3ead9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3ec102690 0x7fc3ec1a1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47912/0 (socket says 172.21.15.5:47912) 2024-09-11T23:22:03.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:03.404+0000 7fc3ead9d640 1 -- 172.21.15.5:0/1251251337 learned_addr learned my addr 172.21.15.5:0/1251251337 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:22:03.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:03.404+0000 7fc3e9d9b640 1 --2- 172.21.15.5:0/1251251337 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3ec101cd0 0x7fc3ec19a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:03.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:03.404+0000 7fc3ea59c640 1 --2- 172.21.15.5:0/1251251337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3ec100ad0 0x7fc3ec199f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:03.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:03.404+0000 7fc3ead9d640 1 -- 172.21.15.5:0/1251251337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3ec100ad0 msgr2=0x7fc3ec199f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:03.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:03.404+0000 7fc3ead9d640 1 --2- 172.21.15.5:0/1251251337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3ec100ad0 0x7fc3ec199f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:03.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:03.404+0000 7fc3ead9d640 1 -- 172.21.15.5:0/1251251337 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3ec101cd0 msgr2=0x7fc3ec19a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:03.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:03.404+0000 7fc3ead9d640 1 --2- 172.21.15.5:0/1251251337 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3ec101cd0 0x7fc3ec19a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:03.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:03.404+0000 7fc3ead9d640 1 -- 172.21.15.5:0/1251251337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3ec1a1b90 con 0x7fc3ec102690 2024-09-11T23:22:03.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:03.405+0000 7fc3ead9d640 1 --2- 172.21.15.5:0/1251251337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3ec102690 0x7fc3ec1a1520 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc3e400eaa0 tx=0x7fc3e400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:03.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:03.405+0000 7fc3db7fe640 1 -- 172.21.15.5:0/1251251337 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e4004d20 con 0x7fc3ec102690 2024-09-11T23:22:03.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:03.405+0000 7fc3f0b76640 1 -- 172.21.15.5:0/1251251337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3ec1a1e80 con 0x7fc3ec102690 2024-09-11T23:22:03.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:03.405+0000 7fc3db7fe640 1 -- 172.21.15.5:0/1251251337 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc3e4005020 con 0x7fc3ec102690 2024-09-11T23:22:03.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:03.405+0000 7fc3db7fe640 1 -- 172.21.15.5:0/1251251337 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e40116d0 con 0x7fc3ec102690 2024-09-11T23:22:03.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:03.405+0000 7fc3f0b76640 1 -- 172.21.15.5:0/1251251337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3ec1a2330 con 0x7fc3ec102690 2024-09-11T23:22:03.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:03.406+0000 7fc3f0b76640 1 -- 172.21.15.5:0/1251251337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3ec1a2650 con 0x7fc3ec102690 2024-09-11T23:22:03.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:03.407+0000 7fc3db7fe640 1 -- 172.21.15.5:0/1251251337 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 15) ==== 137776+0+0 (secure 0 0 0) 0x7fc3e400caf0 con 0x7fc3ec102690 2024-09-11T23:22:03.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:03.408+0000 7fc3db7fe640 1 --2- 172.21.15.5:0/1251251337 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fc3d40a2b20 0x7fc3d40a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:03.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:03.408+0000 7fc3ea59c640 1 --2- 172.21.15.5:0/1251251337 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fc3d40a2b20 0x7fc3d40a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:03.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:03.408+0000 7fc3db7fe640 1 -- 172.21.15.5:0/1251251337 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2571+0+0 (secure 0 0 0) 0x7fc3e40cdd70 con 0x7fc3ec102690 2024-09-11T23:22:03.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:03.409+0000 7fc3ea59c640 1 --2- 172.21.15.5:0/1251251337 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fc3d40a2b20 0x7fc3d40a4fe0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc004770 tx=0x7fc3dc000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:03.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:03.412+0000 7fc3db7fe640 1 -- 172.21.15.5:0/1251251337 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc3e4016030 con 0x7fc3ec102690 2024-09-11T23:22:03.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:03.597+0000 7fc3f0b76640 1 -- 172.21.15.5:0/1251251337 --> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fc3ec1a2820 con 0x7fc3d40a2b20 2024-09-11T23:22:04.156 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:03 smithi005 ceph-mon[31201]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:22:04.156 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:03 smithi005 ceph-mon[31201]: Detected new or changed devices on smithi172 2024-09-11T23:22:04.156 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:03 smithi005 ceph-mon[31201]: Adjusting osd_memory_target on smithi172 to 17088M 2024-09-11T23:22:04.156 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:03 smithi005 ceph-mon[31201]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-11T23:22:04.156 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:03 smithi005 ceph-mon[31201]: osdmap e16: 3 total, 2 up, 3 in 2024-09-11T23:22:04.156 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:03 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:22:04.156 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:03 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:22:04.156 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:03 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:22:04.157 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:03 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:22:04.157 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:03 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:22:04.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:03 smithi159 ceph-mon[34394]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:22:04.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:03 smithi159 ceph-mon[34394]: Detected new or changed devices on smithi172 2024-09-11T23:22:04.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:03 smithi159 ceph-mon[34394]: Adjusting osd_memory_target on smithi172 to 17088M 2024-09-11T23:22:04.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:03 smithi159 ceph-mon[34394]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-11T23:22:04.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:03 smithi159 ceph-mon[34394]: osdmap e16: 3 total, 2 up, 3 in 2024-09-11T23:22:04.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:03 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:22:04.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:03 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:22:04.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:03 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:22:04.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:03 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:22:04.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:03 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:22:04.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:03 smithi172 ceph-mon[34855]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:22:04.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:03 smithi172 ceph-mon[34855]: Detected new or changed devices on smithi172 2024-09-11T23:22:04.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:03 smithi172 ceph-mon[34855]: Adjusting osd_memory_target on smithi172 to 17088M 2024-09-11T23:22:04.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:03 smithi172 ceph-mon[34855]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-11T23:22:04.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:03 smithi172 ceph-mon[34855]: osdmap e16: 3 total, 2 up, 3 in 2024-09-11T23:22:04.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:03 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:22:04.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:03 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:22:04.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:03 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:22:04.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:03 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:22:04.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:03 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:22:05.102 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:04 smithi005 ceph-mon[31201]: purged_snaps scrub starts 2024-09-11T23:22:05.102 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:04 smithi005 ceph-mon[31201]: purged_snaps scrub ok 2024-09-11T23:22:05.102 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:04 smithi005 ceph-mon[31201]: from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:22:05.102 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:04 smithi005 ceph-mon[31201]: osd.2 [v2:172.21.15.172:6800/299915717,v1:172.21.15.172:6801/299915717] boot 2024-09-11T23:22:05.102 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:04 smithi005 ceph-mon[31201]: osdmap e17: 3 total, 3 up, 3 in 2024-09-11T23:22:05.103 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:04 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:22:05.103 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:04 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-11T23:22:05.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:04 smithi159 ceph-mon[34394]: purged_snaps scrub starts 2024-09-11T23:22:05.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:04 smithi159 ceph-mon[34394]: purged_snaps scrub ok 2024-09-11T23:22:05.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:04 smithi159 ceph-mon[34394]: from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:22:05.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:04 smithi159 ceph-mon[34394]: osd.2 [v2:172.21.15.172:6800/299915717,v1:172.21.15.172:6801/299915717] boot 2024-09-11T23:22:05.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:04 smithi159 ceph-mon[34394]: osdmap e17: 3 total, 3 up, 3 in 2024-09-11T23:22:05.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:04 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:22:05.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:04 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-11T23:22:05.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:04 smithi172 ceph-mon[34855]: purged_snaps scrub starts 2024-09-11T23:22:05.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:04 smithi172 ceph-mon[34855]: purged_snaps scrub ok 2024-09-11T23:22:05.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:04 smithi172 ceph-mon[34855]: from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:22:05.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:04 smithi172 ceph-mon[34855]: osd.2 [v2:172.21.15.172:6800/299915717,v1:172.21.15.172:6801/299915717] boot 2024-09-11T23:22:05.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:04 smithi172 ceph-mon[34855]: osdmap e17: 3 total, 3 up, 3 in 2024-09-11T23:22:05.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:04 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:22:05.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:04 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-11T23:22:06.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:05 smithi005 ceph-mon[31201]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:22:06.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:05 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-11T23:22:06.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:05 smithi005 ceph-mon[31201]: osdmap e18: 3 total, 3 up, 3 in 2024-09-11T23:22:06.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:05 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T23:22:06.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:05 smithi159 ceph-mon[34394]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:22:06.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:05 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-11T23:22:06.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:05 smithi159 ceph-mon[34394]: osdmap e18: 3 total, 3 up, 3 in 2024-09-11T23:22:06.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:05 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T23:22:06.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:05 smithi172 ceph-mon[34855]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:22:06.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:05 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-11T23:22:06.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:05 smithi172 ceph-mon[34855]: osdmap e18: 3 total, 3 up, 3 in 2024-09-11T23:22:06.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:05 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T23:22:06.724 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 11 23:22:06 smithi005 sudo[49473]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T23:22:06.724 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 11 23:22:06 smithi005 sudo[49473]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T23:22:06.724 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 11 23:22:06 smithi005 sudo[49473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T23:22:06.725 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 11 23:22:06 smithi005 sudo[49473]: pam_unix(sudo:session): session closed for user root 2024-09-11T23:22:06.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:06.922+0000 7fc3db7fe640 1 -- 172.21.15.5:0/1251251337 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fc3e4098330 con 0x7fc3ec102690 2024-09-11T23:22:07.196 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:06 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-11T23:22:07.196 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:06 smithi159 ceph-mon[34394]: osdmap e19: 3 total, 3 up, 3 in 2024-09-11T23:22:07.196 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:06 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/2128379212' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0521043b-559c-4671-b11e-9117871cff49"}]: dispatch 2024-09-11T23:22:07.196 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:06 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/2128379212' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0521043b-559c-4671-b11e-9117871cff49"}]': finished 2024-09-11T23:22:07.196 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:06 smithi159 ceph-mon[34394]: osdmap e20: 4 total, 3 up, 4 in 2024-09-11T23:22:07.196 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:06 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:22:07.196 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:06 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/1520586358' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:22:07.224 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 11 23:22:06 smithi005 sudo[49517]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T23:22:07.224 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 11 23:22:06 smithi005 sudo[49517]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T23:22:07.224 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 11 23:22:06 smithi005 sudo[49517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T23:22:07.224 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 11 23:22:06 smithi005 sudo[49517]: pam_unix(sudo:session): session closed for user root 2024-09-11T23:22:07.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:06 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-11T23:22:07.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:06 smithi005 ceph-mon[31201]: osdmap e19: 3 total, 3 up, 3 in 2024-09-11T23:22:07.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:06 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/2128379212' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0521043b-559c-4671-b11e-9117871cff49"}]: dispatch 2024-09-11T23:22:07.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:06 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/2128379212' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0521043b-559c-4671-b11e-9117871cff49"}]': finished 2024-09-11T23:22:07.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:06 smithi005 ceph-mon[31201]: osdmap e20: 4 total, 3 up, 4 in 2024-09-11T23:22:07.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:06 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:22:07.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:06 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/1520586358' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:22:07.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:06 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-11T23:22:07.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:06 smithi172 ceph-mon[34855]: osdmap e19: 3 total, 3 up, 3 in 2024-09-11T23:22:07.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:06 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/2128379212' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0521043b-559c-4671-b11e-9117871cff49"}]: dispatch 2024-09-11T23:22:07.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:06 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/2128379212' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0521043b-559c-4671-b11e-9117871cff49"}]': finished 2024-09-11T23:22:07.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:06 smithi172 ceph-mon[34855]: osdmap e20: 4 total, 3 up, 4 in 2024-09-11T23:22:07.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:06 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:22:07.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:06 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/1520586358' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:22:07.449 INFO:journalctl@ceph.osd.1.smithi159.stdout:Sep 11 23:22:07 smithi159 sudo[42668]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T23:22:07.450 INFO:journalctl@ceph.osd.1.smithi159.stdout:Sep 11 23:22:07 smithi159 sudo[42668]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T23:22:07.450 INFO:journalctl@ceph.osd.1.smithi159.stdout:Sep 11 23:22:07 smithi159 sudo[42668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T23:22:07.450 INFO:journalctl@ceph.osd.1.smithi159.stdout:Sep 11 23:22:07 smithi159 sudo[42668]: pam_unix(sudo:session): session closed for user root 2024-09-11T23:22:07.876 INFO:journalctl@ceph.osd.1.smithi159.stdout:Sep 11 23:22:07 smithi159 sudo[42671]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T23:22:07.876 INFO:journalctl@ceph.osd.1.smithi159.stdout:Sep 11 23:22:07 smithi159 sudo[42671]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T23:22:07.876 INFO:journalctl@ceph.osd.1.smithi159.stdout:Sep 11 23:22:07 smithi159 sudo[42671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T23:22:07.876 INFO:journalctl@ceph.osd.1.smithi159.stdout:Sep 11 23:22:07 smithi159 sudo[42671]: pam_unix(sudo:session): session closed for user root 2024-09-11T23:22:07.971 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:07 smithi172 ceph-mon[34855]: pgmap v77: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:22:07.971 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:07 smithi172 ceph-mon[34855]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-11T23:22:07.972 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:07 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:07.972 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:07 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:07.972 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 11 23:22:07 smithi172 sudo[43390]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T23:22:07.972 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 11 23:22:07 smithi172 sudo[43390]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T23:22:07.972 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 11 23:22:07 smithi172 sudo[43390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T23:22:07.972 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 11 23:22:07 smithi172 sudo[43390]: pam_unix(sudo:session): session closed for user root 2024-09-11T23:22:08.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:07 smithi005 ceph-mon[31201]: pgmap v77: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:22:08.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:07 smithi005 ceph-mon[31201]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-11T23:22:08.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:07 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:08.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:07 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:08.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:07 smithi159 ceph-mon[34394]: pgmap v77: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:22:08.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:07 smithi159 ceph-mon[34394]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-11T23:22:08.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:07 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:08.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:07 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:08.384 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 11 23:22:07 smithi172 sudo[43393]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T23:22:08.384 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 11 23:22:07 smithi172 sudo[43393]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T23:22:08.384 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 11 23:22:07 smithi172 sudo[43393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T23:22:08.384 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 11 23:22:07 smithi172 sudo[43393]: pam_unix(sudo:session): session closed for user root 2024-09-11T23:22:08.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:08 smithi005 sudo[49914]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T23:22:08.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:08 smithi005 sudo[49914]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T23:22:08.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:08 smithi005 sudo[49914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T23:22:08.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:08 smithi005 sudo[49914]: pam_unix(sudo:session): session closed for user root 2024-09-11T23:22:09.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:08 smithi005 sudo[49921]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T23:22:09.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:08 smithi005 sudo[49921]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T23:22:09.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:08 smithi005 sudo[49921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T23:22:09.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:08 smithi005 sudo[49921]: pam_unix(sudo:session): session closed for user root 2024-09-11T23:22:09.395 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:09 smithi172 sudo[43396]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T23:22:09.395 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:09 smithi172 sudo[43396]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T23:22:09.395 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:09 smithi172 sudo[43396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T23:22:09.395 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:09 smithi172 sudo[43396]: pam_unix(sudo:session): session closed for user root 2024-09-11T23:22:09.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:09 smithi172 sudo[43399]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T23:22:09.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:09 smithi172 sudo[43399]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T23:22:09.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:09 smithi172 sudo[43399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T23:22:09.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:09 smithi172 sudo[43399]: pam_unix(sudo:session): session closed for user root 2024-09-11T23:22:09.893 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:09 smithi159 sudo[42674]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T23:22:09.893 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:09 smithi159 sudo[42674]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T23:22:09.893 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:09 smithi159 sudo[42674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T23:22:09.893 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:09 smithi159 sudo[42674]: pam_unix(sudo:session): session closed for user root 2024-09-11T23:22:10.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:09 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:10.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:09 smithi005 ceph-mon[31201]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T23:22:10.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:09 smithi005 ceph-mon[31201]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T23:22:10.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:09 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:22:10.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:09 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:22:10.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:09 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:22:10.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:09 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:22:10.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:09 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:22:10.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:09 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:22:10.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:09 smithi159 sudo[42677]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T23:22:10.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:09 smithi159 sudo[42677]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T23:22:10.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:09 smithi159 sudo[42677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T23:22:10.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:09 smithi159 sudo[42677]: pam_unix(sudo:session): session closed for user root 2024-09-11T23:22:10.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:09 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:10.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:09 smithi159 ceph-mon[34394]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T23:22:10.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:09 smithi159 ceph-mon[34394]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T23:22:10.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:09 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:22:10.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:09 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:22:10.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:09 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:22:10.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:09 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:22:10.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:09 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:22:10.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:09 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:22:10.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:09 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:10.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:09 smithi172 ceph-mon[34855]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T23:22:10.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:09 smithi172 ceph-mon[34855]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T23:22:10.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:09 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:22:10.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:09 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:22:10.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:09 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:22:10.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:09 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:22:10.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:09 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:22:10.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:09 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:22:11.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:10 smithi005 ceph-mon[31201]: pgmap v79: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:22:11.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:10 smithi005 ceph-mon[31201]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T23:22:11.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:10 smithi005 ceph-mon[31201]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T23:22:11.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:10 smithi005 ceph-mon[31201]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T23:22:11.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:10 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:22:11.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:10 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:22:11.226 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:10 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:22:11.226 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:10 smithi005 ceph-mon[31201]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T23:22:11.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:10 smithi159 ceph-mon[34394]: pgmap v79: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:22:11.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:10 smithi159 ceph-mon[34394]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T23:22:11.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:10 smithi159 ceph-mon[34394]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T23:22:11.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:10 smithi159 ceph-mon[34394]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T23:22:11.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:10 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:22:11.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:10 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:22:11.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:10 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:22:11.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:10 smithi159 ceph-mon[34394]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T23:22:11.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:10 smithi172 ceph-mon[34855]: pgmap v79: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:22:11.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:10 smithi172 ceph-mon[34855]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T23:22:11.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:10 smithi172 ceph-mon[34855]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T23:22:11.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:10 smithi172 ceph-mon[34855]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T23:22:11.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:10 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:22:11.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:10 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:22:11.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:10 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:22:11.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:10 smithi172 ceph-mon[34855]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T23:22:11.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:11 smithi005 ceph-mon[31201]: pgmap v80: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:22:12.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:11 smithi159 ceph-mon[34394]: pgmap v80: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:22:12.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:11 smithi172 ceph-mon[34855]: pgmap v80: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:22:14.010 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:13 smithi005 ceph-mon[31201]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:22:14.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:13 smithi159 ceph-mon[34394]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:22:14.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:13 smithi172 ceph-mon[34855]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:22:15.205 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:14 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-11T23:22:15.205 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:14 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:22:15.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:14 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-11T23:22:15.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:14 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:22:15.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:14 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-11T23:22:15.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:14 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:22:16.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:15 smithi005 ceph-mon[31201]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:22:16.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:15 smithi005 ceph-mon[31201]: Deploying daemon osd.3 on smithi005 2024-09-11T23:22:16.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:15 smithi159 ceph-mon[34394]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:22:16.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:15 smithi159 ceph-mon[34394]: Deploying daemon osd.3 on smithi005 2024-09-11T23:22:16.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:15 smithi172 ceph-mon[34855]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:22:16.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:15 smithi172 ceph-mon[34855]: Deploying daemon osd.3 on smithi005 2024-09-11T23:22:18.175 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:17 smithi005 ceph-mon[31201]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:22:18.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:17 smithi159 ceph-mon[34394]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:22:18.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:17 smithi172 ceph-mon[34855]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:22:20.180 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:19 smithi005 ceph-mon[31201]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:22:20.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:19 smithi159 ceph-mon[34394]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:22:20.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:19 smithi172 ceph-mon[34855]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:22:22.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:21 smithi005 ceph-mon[31201]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:22:22.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:21 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:22:22.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:21 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:22.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:21 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:22.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:21 smithi159 ceph-mon[34394]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:22:22.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:21 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:22:22.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:21 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:22.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:21 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:22.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:21 smithi172 ceph-mon[34855]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:22:22.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:21 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:22:22.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:21 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:22.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:21 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:24.242 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:23 smithi005 ceph-mon[31201]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:22:24.243 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:23 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:24.243 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:23 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:24.243 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:23 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:22:24.243 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:23 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:22:24.243 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:23 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:24.380 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:23 smithi159 ceph-mon[34394]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:22:24.381 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:23 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:24.381 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:23 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:24.381 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:23 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:22:24.381 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:23 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:22:24.381 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:23 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:24.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:23 smithi172 ceph-mon[34855]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:22:24.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:23 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:24.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:23 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:24.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:23 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:22:24.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:23 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:22:24.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:23 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:25.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:25.417+0000 7fc3db7fe640 1 -- 172.21.15.5:0/1251251337 <== mgr.14148 v2:172.21.15.5:6800/2285128668 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc3ec1a2820 con 0x7fc3d40a2b20 2024-09-11T23:22:25.417 INFO:teuthology.orchestra.run.smithi005.stdout:Created osd(s) 3 on host 'smithi005' 2024-09-11T23:22:25.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:25.419+0000 7fc3f0b76640 1 -- 172.21.15.5:0/1251251337 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fc3d40a2b20 msgr2=0x7fc3d40a4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:25.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:25.419+0000 7fc3f0b76640 1 --2- 172.21.15.5:0/1251251337 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fc3d40a2b20 0x7fc3d40a4fe0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc004770 tx=0x7fc3dc000bc0 comp rx=0 tx=0).stop 2024-09-11T23:22:25.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:25.419+0000 7fc3f0b76640 1 -- 172.21.15.5:0/1251251337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3ec102690 msgr2=0x7fc3ec1a1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:25.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:25.419+0000 7fc3f0b76640 1 --2- 172.21.15.5:0/1251251337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3ec102690 0x7fc3ec1a1520 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc3e400eaa0 tx=0x7fc3e400eea0 comp rx=0 tx=0).stop 2024-09-11T23:22:25.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:25.419+0000 7fc3f0b76640 1 -- 172.21.15.5:0/1251251337 shutdown_connections 2024-09-11T23:22:25.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:25.419+0000 7fc3f0b76640 1 --2- 172.21.15.5:0/1251251337 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fc3d40a2b20 0x7fc3d40a4fe0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:25.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:25.419+0000 7fc3f0b76640 1 --2- 172.21.15.5:0/1251251337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3ec102690 0x7fc3ec1a1520 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:25.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:25.419+0000 7fc3f0b76640 1 --2- 172.21.15.5:0/1251251337 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3ec101cd0 0x7fc3ec19a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:25.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:25.419+0000 7fc3f0b76640 1 --2- 172.21.15.5:0/1251251337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3ec100ad0 0x7fc3ec199f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:25.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:25.419+0000 7fc3f0b76640 1 -- 172.21.15.5:0/1251251337 >> 172.21.15.5:0/1251251337 conn(0x7fc3ec0fc280 msgr2=0x7fc3ec069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:25.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:25.419+0000 7fc3f0b76640 1 -- 172.21.15.5:0/1251251337 shutdown_connections 2024-09-11T23:22:25.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:22:25.419+0000 7fc3f0b76640 1 -- 172.21.15.5:0/1251251337 wait complete. 2024-09-11T23:22:26.081 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:25 smithi005 ceph-mon[31201]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:22:26.081 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:25 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:22:26.081 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:25 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:26.081 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:25 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:26.106 DEBUG:teuthology.orchestra.run.smithi005:osd.3> sudo journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@osd.3.service 2024-09-11T23:22:26.108 INFO:tasks.cephadm:Deploying osd.4 on smithi159 with /dev/vg_nvme/lv_3... 2024-09-11T23:22:26.108 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-11T23:22:26.361 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T23:22:26.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:25 smithi159 ceph-mon[34394]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:22:26.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:25 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:22:26.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:25 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:26.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:25 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:26.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:25 smithi172 ceph-mon[34855]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:22:26.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:25 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:22:26.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:25 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:26.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:25 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:27.196 INFO:journalctl@ceph.osd.3.smithi005.stdout:Sep 11 23:22:26 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-3[51482]: 2024-09-11T23:22:26.933+0000 7f01aa9da640 -1 osd.3 0 log_to_monitors true 2024-09-11T23:22:28.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:27 smithi159 ceph-mon[34394]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:22:28.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:27 smithi159 ceph-mon[34394]: from='osd.3 [v2:172.21.15.5:6810/2080498921,v1:172.21.15.5:6811/2080498921]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-11T23:22:28.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:27 smithi005 ceph-mon[31201]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:22:28.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:27 smithi005 ceph-mon[31201]: from='osd.3 [v2:172.21.15.5:6810/2080498921,v1:172.21.15.5:6811/2080498921]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-11T23:22:28.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:27 smithi172 ceph-mon[34855]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:22:28.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:27 smithi172 ceph-mon[34855]: from='osd.3 [v2:172.21.15.5:6810/2080498921,v1:172.21.15.5:6811/2080498921]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-11T23:22:28.942 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-11T23:22:28.968 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi159:vg_nvme/lv_3 2024-09-11T23:22:29.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:28 smithi005 ceph-mon[31201]: from='osd.3 [v2:172.21.15.5:6810/2080498921,v1:172.21.15.5:6811/2080498921]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-11T23:22:29.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:28 smithi005 ceph-mon[31201]: osdmap e21: 4 total, 3 up, 4 in 2024-09-11T23:22:29.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:28 smithi005 ceph-mon[31201]: from='osd.3 [v2:172.21.15.5:6810/2080498921,v1:172.21.15.5:6811/2080498921]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-09-11T23:22:29.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:28 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:22:29.228 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T23:22:29.347 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:28 smithi159 ceph-mon[34394]: from='osd.3 [v2:172.21.15.5:6810/2080498921,v1:172.21.15.5:6811/2080498921]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-11T23:22:29.347 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:28 smithi159 ceph-mon[34394]: osdmap e21: 4 total, 3 up, 4 in 2024-09-11T23:22:29.347 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:28 smithi159 ceph-mon[34394]: from='osd.3 [v2:172.21.15.5:6810/2080498921,v1:172.21.15.5:6811/2080498921]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-09-11T23:22:29.347 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:28 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:22:29.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:28 smithi172 ceph-mon[34855]: from='osd.3 [v2:172.21.15.5:6810/2080498921,v1:172.21.15.5:6811/2080498921]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-11T23:22:29.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:28 smithi172 ceph-mon[34855]: osdmap e21: 4 total, 3 up, 4 in 2024-09-11T23:22:29.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:28 smithi172 ceph-mon[34855]: from='osd.3 [v2:172.21.15.5:6810/2080498921,v1:172.21.15.5:6811/2080498921]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-09-11T23:22:29.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:28 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:22:29.668 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:29.659+0000 7fe28e061640 1 -- 172.21.15.159:0/2809874543 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe288101bf0 msgr2=0x7fe288101ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:29.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:29.659+0000 7fe28e061640 1 --2- 172.21.15.159:0/2809874543 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe288101bf0 0x7fe288101ff0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe278009900 tx=0x7fe27802a410 comp rx=0 tx=0).stop 2024-09-11T23:22:29.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:29.659+0000 7fe28e061640 1 -- 172.21.15.159:0/2809874543 shutdown_connections 2024-09-11T23:22:29.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:29.659+0000 7fe28e061640 1 --2- 172.21.15.159:0/2809874543 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2881037b0 0x7fe28810a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:29.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:29.659+0000 7fe28e061640 1 --2- 172.21.15.159:0/2809874543 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe288102df0 0x7fe288103270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:29.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:29.659+0000 7fe28e061640 1 --2- 172.21.15.159:0/2809874543 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe288101bf0 0x7fe288101ff0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:29.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:29.659+0000 7fe28e061640 1 -- 172.21.15.159:0/2809874543 >> 172.21.15.159:0/2809874543 conn(0x7fe2880fd3c0 msgr2=0x7fe2880ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:29.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:29.659+0000 7fe28e061640 1 -- 172.21.15.159:0/2809874543 shutdown_connections 2024-09-11T23:22:29.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:29.659+0000 7fe28e061640 1 -- 172.21.15.159:0/2809874543 wait complete. 2024-09-11T23:22:29.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:29.659+0000 7fe28e061640 1 Processor -- start 2024-09-11T23:22:29.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:29.660+0000 7fe28e061640 1 -- start start 2024-09-11T23:22:29.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:29.660+0000 7fe28e061640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe288101bf0 0x7fe288075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:29.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:29.660+0000 7fe28e061640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe288102df0 0x7fe2880745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:29.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:29.660+0000 7fe28e061640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2881037b0 0x7fe288074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:29.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:29.660+0000 7fe28e061640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe28810d780 con 0x7fe288101bf0 2024-09-11T23:22:29.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:29.660+0000 7fe28e061640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe28810d600 con 0x7fe2881037b0 2024-09-11T23:22:29.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:29.660+0000 7fe28e061640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe28810d900 con 0x7fe288102df0 2024-09-11T23:22:29.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:29.660+0000 7fe287fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2881037b0 0x7fe288074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:29.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:29.660+0000 7fe287fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2881037b0 0x7fe288074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43588/0 (socket says 172.21.15.159:43588) 2024-09-11T23:22:29.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:29.660+0000 7fe287fff640 1 -- 172.21.15.159:0/3940811871 learned_addr learned my addr 172.21.15.159:0/3940811871 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-11T23:22:29.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:29.660+0000 7fe286ffd640 1 --2- 172.21.15.159:0/3940811871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe288102df0 0x7fe2880745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:29.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:29.660+0000 7fe2877fe640 1 --2- 172.21.15.159:0/3940811871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe288101bf0 0x7fe288075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:29.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:29.660+0000 7fe287fff640 1 -- 172.21.15.159:0/3940811871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe288102df0 msgr2=0x7fe2880745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:29.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:29.660+0000 7fe287fff640 1 --2- 172.21.15.159:0/3940811871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe288102df0 0x7fe2880745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:29.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:29.660+0000 7fe287fff640 1 -- 172.21.15.159:0/3940811871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe288101bf0 msgr2=0x7fe288075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:29.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:29.660+0000 7fe287fff640 1 --2- 172.21.15.159:0/3940811871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe288101bf0 0x7fe288075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:29.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:29.660+0000 7fe287fff640 1 -- 172.21.15.159:0/3940811871 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2880753e0 con 0x7fe2881037b0 2024-09-11T23:22:29.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:29.660+0000 7fe2877fe640 1 --2- 172.21.15.159:0/3940811871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe288101bf0 0x7fe288075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:22:29.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:29.660+0000 7fe287fff640 1 --2- 172.21.15.159:0/3940811871 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2881037b0 0x7fe288074b20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe28000eaa0 tx=0x7fe28000ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:29.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:29.660+0000 7fe284ff9640 1 -- 172.21.15.159:0/3940811871 <== mon.2 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28000cdb0 con 0x7fe2881037b0 2024-09-11T23:22:29.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:29.661+0000 7fe284ff9640 1 -- 172.21.15.159:0/3940811871 <== mon.2 v2:172.21.15.159:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe280005020 con 0x7fe2881037b0 2024-09-11T23:22:29.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:29.661+0000 7fe284ff9640 1 -- 172.21.15.159:0/3940811871 <== mon.2 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2800116d0 con 0x7fe2881037b0 2024-09-11T23:22:29.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:29.661+0000 7fe28e061640 1 -- 172.21.15.159:0/3940811871 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2881a1ff0 con 0x7fe2881037b0 2024-09-11T23:22:29.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:29.661+0000 7fe28e061640 1 -- 172.21.15.159:0/3940811871 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2881a24d0 con 0x7fe2881037b0 2024-09-11T23:22:29.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:29.662+0000 7fe28e061640 1 -- 172.21.15.159:0/3940811871 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe288109030 con 0x7fe2881037b0 2024-09-11T23:22:29.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:29.663+0000 7fe284ff9640 1 -- 172.21.15.159:0/3940811871 <== mon.2 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fe2800051d0 con 0x7fe2881037b0 2024-09-11T23:22:29.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:29.664+0000 7fe284ff9640 1 --2- 172.21.15.159:0/3940811871 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe2700a2b80 0x7fe2700a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:29.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:29.664+0000 7fe284ff9640 1 -- 172.21.15.159:0/3940811871 <== mon.2 v2:172.21.15.159:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 3389+0+0 (secure 0 0 0) 0x7fe2800cdfb0 con 0x7fe2881037b0 2024-09-11T23:22:29.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:29.664+0000 7fe2877fe640 1 --2- 172.21.15.159:0/3940811871 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe2700a2b80 0x7fe2700a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:29.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:29.664+0000 7fe2877fe640 1 --2- 172.21.15.159:0/3940811871 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe2700a2b80 0x7fe2700a5040 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe278006010 tx=0x7fe278000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:29.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:29.668+0000 7fe284ff9640 1 -- 172.21.15.159:0/3940811871 <== mon.2 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe280016030 con 0x7fe2881037b0 2024-09-11T23:22:29.724 INFO:journalctl@ceph.osd.3.smithi005.stdout:Sep 11 23:22:29 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-3[51482]: 2024-09-11T23:22:29.374+0000 7f01a695d640 -1 osd.3 0 waiting for initial osdmap 2024-09-11T23:22:29.724 INFO:journalctl@ceph.osd.3.smithi005.stdout:Sep 11 23:22:29 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-3[51482]: 2024-09-11T23:22:29.378+0000 7f019e77d640 -1 osd.3 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:22:29.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:29.841+0000 7fe28e061640 1 -- 172.21.15.159:0/3940811871 --> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fe288062630 con 0x7fe2700a2b80 2024-09-11T23:22:30.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:29 smithi005 ceph-mon[31201]: purged_snaps scrub starts 2024-09-11T23:22:30.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:29 smithi005 ceph-mon[31201]: purged_snaps scrub ok 2024-09-11T23:22:30.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:29 smithi005 ceph-mon[31201]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:22:30.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:29 smithi005 ceph-mon[31201]: from='osd.3 [v2:172.21.15.5:6810/2080498921,v1:172.21.15.5:6811/2080498921]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-09-11T23:22:30.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:29 smithi005 ceph-mon[31201]: osdmap e22: 4 total, 3 up, 4 in 2024-09-11T23:22:30.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:29 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:22:30.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:29 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:22:30.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:29 smithi005 ceph-mon[31201]: Detected new or changed devices on smithi005 2024-09-11T23:22:30.226 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:29 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:30.226 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:29 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:30.226 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:29 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:22:30.226 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:29 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:22:30.226 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:29 smithi005 ceph-mon[31201]: Adjusting osd_memory_target on smithi005 to 8546M 2024-09-11T23:22:30.226 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:29 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:30.226 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:29 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:22:30.226 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:29 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:22:30.226 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:29 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:30.226 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:29 smithi005 ceph-mon[31201]: from='osd.3 [v2:172.21.15.5:6810/2080498921,v1:172.21.15.5:6811/2080498921]' entity='osd.3' 2024-09-11T23:22:30.227 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:29 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:22:30.227 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:29 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:22:30.227 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:29 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:22:30.252 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:29 smithi159 ceph-mon[34394]: purged_snaps scrub starts 2024-09-11T23:22:30.252 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:29 smithi159 ceph-mon[34394]: purged_snaps scrub ok 2024-09-11T23:22:30.252 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:29 smithi159 ceph-mon[34394]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:22:30.252 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:29 smithi159 ceph-mon[34394]: from='osd.3 [v2:172.21.15.5:6810/2080498921,v1:172.21.15.5:6811/2080498921]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-09-11T23:22:30.252 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:29 smithi159 ceph-mon[34394]: osdmap e22: 4 total, 3 up, 4 in 2024-09-11T23:22:30.253 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:29 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:22:30.253 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:29 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:22:30.253 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:29 smithi159 ceph-mon[34394]: Detected new or changed devices on smithi005 2024-09-11T23:22:30.253 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:29 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:30.253 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:29 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:30.253 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:29 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:22:30.253 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:29 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:22:30.253 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:29 smithi159 ceph-mon[34394]: Adjusting osd_memory_target on smithi005 to 8546M 2024-09-11T23:22:30.253 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:29 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:30.253 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:29 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:22:30.253 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:29 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:22:30.254 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:29 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:30.254 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:29 smithi159 ceph-mon[34394]: from='osd.3 [v2:172.21.15.5:6810/2080498921,v1:172.21.15.5:6811/2080498921]' entity='osd.3' 2024-09-11T23:22:30.254 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:29 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:22:30.254 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:29 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:22:30.254 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:29 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:22:30.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:29 smithi172 ceph-mon[34855]: purged_snaps scrub starts 2024-09-11T23:22:30.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:29 smithi172 ceph-mon[34855]: purged_snaps scrub ok 2024-09-11T23:22:30.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:29 smithi172 ceph-mon[34855]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:22:30.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:29 smithi172 ceph-mon[34855]: from='osd.3 [v2:172.21.15.5:6810/2080498921,v1:172.21.15.5:6811/2080498921]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-09-11T23:22:30.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:29 smithi172 ceph-mon[34855]: osdmap e22: 4 total, 3 up, 4 in 2024-09-11T23:22:30.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:29 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:22:30.386 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:29 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:22:30.386 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:29 smithi172 ceph-mon[34855]: Detected new or changed devices on smithi005 2024-09-11T23:22:30.386 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:29 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:30.386 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:29 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:30.386 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:29 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:22:30.386 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:29 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:22:30.387 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:29 smithi172 ceph-mon[34855]: Adjusting osd_memory_target on smithi005 to 8546M 2024-09-11T23:22:30.387 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:29 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:30.387 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:29 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:22:30.387 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:29 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:22:30.387 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:29 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:30.387 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:29 smithi172 ceph-mon[34855]: from='osd.3 [v2:172.21.15.5:6810/2080498921,v1:172.21.15.5:6811/2080498921]' entity='osd.3' 2024-09-11T23:22:30.388 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:29 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:22:30.388 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:29 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:22:30.388 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:29 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:22:31.217 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:30 smithi159 ceph-mon[34394]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:22:31.217 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:30 smithi159 ceph-mon[34394]: osd.3 [v2:172.21.15.5:6810/2080498921,v1:172.21.15.5:6811/2080498921] boot 2024-09-11T23:22:31.217 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:30 smithi159 ceph-mon[34394]: osdmap e23: 4 total, 4 up, 4 in 2024-09-11T23:22:31.218 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:30 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:22:31.218 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:30 smithi159 ceph-mon[34394]: osdmap e24: 4 total, 4 up, 4 in 2024-09-11T23:22:31.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:30 smithi005 ceph-mon[31201]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:22:31.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:30 smithi005 ceph-mon[31201]: osd.3 [v2:172.21.15.5:6810/2080498921,v1:172.21.15.5:6811/2080498921] boot 2024-09-11T23:22:31.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:30 smithi005 ceph-mon[31201]: osdmap e23: 4 total, 4 up, 4 in 2024-09-11T23:22:31.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:30 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:22:31.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:30 smithi005 ceph-mon[31201]: osdmap e24: 4 total, 4 up, 4 in 2024-09-11T23:22:31.285 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:30 smithi172 ceph-mon[34855]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:22:31.285 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:30 smithi172 ceph-mon[34855]: osd.3 [v2:172.21.15.5:6810/2080498921,v1:172.21.15.5:6811/2080498921] boot 2024-09-11T23:22:31.285 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:30 smithi172 ceph-mon[34855]: osdmap e23: 4 total, 4 up, 4 in 2024-09-11T23:22:31.286 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:30 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:22:31.286 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:30 smithi172 ceph-mon[34855]: osdmap e24: 4 total, 4 up, 4 in 2024-09-11T23:22:32.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:31 smithi005 ceph-mon[31201]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2024-09-11T23:22:32.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:31 smithi005 ceph-mon[31201]: osdmap e25: 4 total, 4 up, 4 in 2024-09-11T23:22:32.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:31 smithi159 ceph-mon[34394]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2024-09-11T23:22:32.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:31 smithi159 ceph-mon[34394]: osdmap e25: 4 total, 4 up, 4 in 2024-09-11T23:22:32.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:31 smithi172 ceph-mon[34855]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2024-09-11T23:22:32.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:31 smithi172 ceph-mon[34855]: osdmap e25: 4 total, 4 up, 4 in 2024-09-11T23:22:33.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:32 smithi159 ceph-mon[34394]: osdmap e26: 4 total, 4 up, 4 in 2024-09-11T23:22:33.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:32 smithi159 ceph-mon[34394]: from='client.? 172.21.15.159:0/1405609319' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b968d762-a46e-4ae2-b19d-8225f82de613"}]: dispatch 2024-09-11T23:22:33.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:32 smithi159 ceph-mon[34394]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b968d762-a46e-4ae2-b19d-8225f82de613"}]: dispatch 2024-09-11T23:22:33.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:32 smithi159 ceph-mon[34394]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b968d762-a46e-4ae2-b19d-8225f82de613"}]': finished 2024-09-11T23:22:33.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:32 smithi159 ceph-mon[34394]: osdmap e27: 5 total, 4 up, 5 in 2024-09-11T23:22:33.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:32 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:22:33.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:32 smithi159 ceph-mon[34394]: from='client.? 172.21.15.159:0/1895753054' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:22:33.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:32 smithi172 ceph-mon[34855]: osdmap e26: 4 total, 4 up, 4 in 2024-09-11T23:22:33.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:32 smithi172 ceph-mon[34855]: from='client.? 172.21.15.159:0/1405609319' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b968d762-a46e-4ae2-b19d-8225f82de613"}]: dispatch 2024-09-11T23:22:33.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:32 smithi172 ceph-mon[34855]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b968d762-a46e-4ae2-b19d-8225f82de613"}]: dispatch 2024-09-11T23:22:33.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:32 smithi172 ceph-mon[34855]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b968d762-a46e-4ae2-b19d-8225f82de613"}]': finished 2024-09-11T23:22:33.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:32 smithi172 ceph-mon[34855]: osdmap e27: 5 total, 4 up, 5 in 2024-09-11T23:22:33.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:32 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:22:33.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:32 smithi172 ceph-mon[34855]: from='client.? 172.21.15.159:0/1895753054' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:22:33.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:32 smithi005 ceph-mon[31201]: osdmap e26: 4 total, 4 up, 4 in 2024-09-11T23:22:33.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:32 smithi005 ceph-mon[31201]: from='client.? 172.21.15.159:0/1405609319' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b968d762-a46e-4ae2-b19d-8225f82de613"}]: dispatch 2024-09-11T23:22:33.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:32 smithi005 ceph-mon[31201]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b968d762-a46e-4ae2-b19d-8225f82de613"}]: dispatch 2024-09-11T23:22:33.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:32 smithi005 ceph-mon[31201]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b968d762-a46e-4ae2-b19d-8225f82de613"}]': finished 2024-09-11T23:22:33.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:32 smithi005 ceph-mon[31201]: osdmap e27: 5 total, 4 up, 5 in 2024-09-11T23:22:33.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:32 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:22:33.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:32 smithi005 ceph-mon[31201]: from='client.? 172.21.15.159:0/1895753054' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:22:34.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:33 smithi159 ceph-mon[34394]: pgmap v97: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2024-09-11T23:22:34.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:33 smithi172 ceph-mon[34855]: pgmap v97: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2024-09-11T23:22:34.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:33 smithi005 ceph-mon[31201]: pgmap v97: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2024-09-11T23:22:36.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:35 smithi159 ceph-mon[34394]: pgmap v99: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2024-09-11T23:22:36.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:35 smithi172 ceph-mon[34855]: pgmap v99: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2024-09-11T23:22:36.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:35 smithi005 ceph-mon[31201]: pgmap v99: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2024-09-11T23:22:38.068 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:37 smithi159 ceph-mon[34394]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T23:22:38.295 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:37 smithi005 ceph-mon[31201]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T23:22:38.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:37 smithi172 ceph-mon[34855]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T23:22:40.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:39 smithi159 ceph-mon[34394]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-11T23:22:40.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:39 smithi172 ceph-mon[34855]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-11T23:22:40.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:39 smithi005 ceph-mon[31201]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-11T23:22:41.268 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:40 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-11T23:22:41.268 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:40 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:22:41.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:40 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-11T23:22:41.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:40 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:22:41.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:40 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-11T23:22:41.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:40 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:22:42.298 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:41 smithi159 ceph-mon[34394]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-11T23:22:42.298 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:41 smithi159 ceph-mon[34394]: Deploying daemon osd.4 on smithi159 2024-09-11T23:22:42.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:41 smithi172 ceph-mon[34855]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-11T23:22:42.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:41 smithi172 ceph-mon[34855]: Deploying daemon osd.4 on smithi159 2024-09-11T23:22:42.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:41 smithi005 ceph-mon[31201]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-11T23:22:42.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:41 smithi005 ceph-mon[31201]: Deploying daemon osd.4 on smithi159 2024-09-11T23:22:44.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:43 smithi159 ceph-mon[34394]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T23:22:44.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:43 smithi172 ceph-mon[34855]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T23:22:44.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:43 smithi005 ceph-mon[31201]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T23:22:46.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:45 smithi159 ceph-mon[34394]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-11T23:22:46.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:45 smithi172 ceph-mon[34855]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-11T23:22:46.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:45 smithi005 ceph-mon[31201]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-11T23:22:48.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:48 smithi159 ceph-mon[34394]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T23:22:48.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:48 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:22:48.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:48 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:48.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:48 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:48.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:48 smithi172 ceph-mon[34855]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T23:22:48.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:48 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:22:48.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:48 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:48.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:48 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:48.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:48 smithi005 ceph-mon[31201]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T23:22:48.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:48 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:22:48.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:48 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:48.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:48 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:50.267 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:50 smithi159 ceph-mon[34394]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:22:50.267 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:50 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:50.267 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:50 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:50.268 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:50 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:22:50.268 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:50 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:22:50.268 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:50 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:50.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:50 smithi172 ceph-mon[34855]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:22:50.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:50 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:50.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:50 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:50.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:50 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:22:50.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:50 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:22:50.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:50 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:50.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:50 smithi005 ceph-mon[31201]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:22:50.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:50 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:50.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:50 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:50.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:50 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:22:50.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:50 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:22:50.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:50 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:51.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:51.125+0000 7fe284ff9640 1 -- 172.21.15.159:0/3940811871 <== mgr.14148 v2:172.21.15.5:6800/2285128668 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe288062630 con 0x7fe2700a2b80 2024-09-11T23:22:51.126 INFO:teuthology.orchestra.run.smithi159.stdout:Created osd(s) 4 on host 'smithi159' 2024-09-11T23:22:51.128 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:51.127+0000 7fe28e061640 1 -- 172.21.15.159:0/3940811871 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe2700a2b80 msgr2=0x7fe2700a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:51.128 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:51.127+0000 7fe28e061640 1 --2- 172.21.15.159:0/3940811871 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe2700a2b80 0x7fe2700a5040 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe278006010 tx=0x7fe278000bc0 comp rx=0 tx=0).stop 2024-09-11T23:22:51.128 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:51.127+0000 7fe28e061640 1 -- 172.21.15.159:0/3940811871 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2881037b0 msgr2=0x7fe288074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:51.128 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:51.127+0000 7fe28e061640 1 --2- 172.21.15.159:0/3940811871 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2881037b0 0x7fe288074b20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe28000eaa0 tx=0x7fe28000ef60 comp rx=0 tx=0).stop 2024-09-11T23:22:51.128 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:51.127+0000 7fe28e061640 1 -- 172.21.15.159:0/3940811871 shutdown_connections 2024-09-11T23:22:51.128 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:51.127+0000 7fe28e061640 1 --2- 172.21.15.159:0/3940811871 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe2700a2b80 0x7fe2700a5040 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:51.128 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:51.127+0000 7fe28e061640 1 --2- 172.21.15.159:0/3940811871 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2881037b0 0x7fe288074b20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:51.128 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:51.127+0000 7fe28e061640 1 --2- 172.21.15.159:0/3940811871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe288102df0 0x7fe2880745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:51.128 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:51.127+0000 7fe28e061640 1 --2- 172.21.15.159:0/3940811871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe288101bf0 0x7fe288075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:51.128 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:51.127+0000 7fe28e061640 1 -- 172.21.15.159:0/3940811871 >> 172.21.15.159:0/3940811871 conn(0x7fe2880fd3c0 msgr2=0x7fe288106200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:51.128 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:51.128+0000 7fe28e061640 1 -- 172.21.15.159:0/3940811871 shutdown_connections 2024-09-11T23:22:51.129 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:22:51.128+0000 7fe28e061640 1 -- 172.21.15.159:0/3940811871 wait complete. 2024-09-11T23:22:51.739 DEBUG:teuthology.orchestra.run.smithi159:osd.4> sudo journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@osd.4.service 2024-09-11T23:22:51.741 INFO:tasks.cephadm:Deploying osd.5 on smithi172 with /dev/vg_nvme/lv_3... 2024-09-11T23:22:51.741 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-11T23:22:51.995 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:22:52.116 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:52 smithi172 ceph-mon[34855]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:22:52.116 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:52 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:22:52.116 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:52 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:52.116 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:52 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:52.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:52 smithi159 ceph-mon[34394]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:22:52.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:52 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:22:52.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:52 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:52.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:52 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:52.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:52 smithi005 ceph-mon[31201]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:22:52.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:52 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:22:52.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:52 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:52.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:52 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:53.099 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:53 smithi159 ceph-mon[34394]: from='osd.4 [v2:172.21.15.159:6808/4185908786,v1:172.21.15.159:6809/4185908786]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T23:22:53.099 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:53 smithi159 ceph-mon[34394]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T23:22:53.099 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 11 23:22:52 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-4[45422]: 2024-09-11T23:22:52.833+0000 7f0356857640 -1 osd.4 0 log_to_monitors true 2024-09-11T23:22:53.279 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:53 smithi172 ceph-mon[34855]: from='osd.4 [v2:172.21.15.159:6808/4185908786,v1:172.21.15.159:6809/4185908786]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T23:22:53.279 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:53 smithi172 ceph-mon[34855]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T23:22:53.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:53 smithi005 ceph-mon[31201]: from='osd.4 [v2:172.21.15.159:6808/4185908786,v1:172.21.15.159:6809/4185908786]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T23:22:53.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:53 smithi005 ceph-mon[31201]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T23:22:54.126 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 11 23:22:54 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-4[45422]: 2024-09-11T23:22:54.018+0000 7f03527da640 -1 osd.4 0 waiting for initial osdmap 2024-09-11T23:22:54.127 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 11 23:22:54 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-4[45422]: 2024-09-11T23:22:54.024+0000 7f034e602640 -1 osd.4 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:22:54.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:54 smithi159 ceph-mon[34394]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:22:54.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:54 smithi159 ceph-mon[34394]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-11T23:22:54.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:54 smithi159 ceph-mon[34394]: from='osd.4 [v2:172.21.15.159:6808/4185908786,v1:172.21.15.159:6809/4185908786]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-11T23:22:54.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:54 smithi159 ceph-mon[34394]: osdmap e28: 5 total, 4 up, 5 in 2024-09-11T23:22:54.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:54 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:22:54.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:54 smithi159 ceph-mon[34394]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-11T23:22:54.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:54 smithi172 ceph-mon[34855]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:22:54.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:54 smithi172 ceph-mon[34855]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-11T23:22:54.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:54 smithi172 ceph-mon[34855]: from='osd.4 [v2:172.21.15.159:6808/4185908786,v1:172.21.15.159:6809/4185908786]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-11T23:22:54.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:54 smithi172 ceph-mon[34855]: osdmap e28: 5 total, 4 up, 5 in 2024-09-11T23:22:54.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:54 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:22:54.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:54 smithi172 ceph-mon[34855]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-11T23:22:54.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:54 smithi005 ceph-mon[31201]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:22:54.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:54 smithi005 ceph-mon[31201]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-11T23:22:54.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:54 smithi005 ceph-mon[31201]: from='osd.4 [v2:172.21.15.159:6808/4185908786,v1:172.21.15.159:6809/4185908786]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-11T23:22:54.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:54 smithi005 ceph-mon[31201]: osdmap e28: 5 total, 4 up, 5 in 2024-09-11T23:22:54.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:54 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:22:54.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:54 smithi005 ceph-mon[31201]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-11T23:22:54.531 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-11T23:22:54.558 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi172:vg_nvme/lv_3 2024-09-11T23:22:54.811 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:22:55.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:55 smithi172 ceph-mon[34855]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-11T23:22:55.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:55 smithi172 ceph-mon[34855]: osdmap e29: 5 total, 4 up, 5 in 2024-09-11T23:22:55.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:55 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:22:55.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:55 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:22:55.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:55 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:55.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:55 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:55.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:55 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:22:55.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:55 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:22:55.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:55 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:55.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:55 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:22:55.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:55 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:22:55.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:55 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:55.286 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:22:55.284+0000 7f9dd28d4640 1 -- 172.21.15.172:0/2190660556 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9dcc1037c0 msgr2=0x7f9dcc10a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:55.286 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:22:55.284+0000 7f9dd28d4640 1 --2- 172.21.15.172:0/2190660556 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9dcc1037c0 0x7f9dcc10a050 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4009ca0 tx=0x7f9dc402a8c0 comp rx=0 tx=0).stop 2024-09-11T23:22:55.286 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:22:55.284+0000 7f9dd28d4640 1 -- 172.21.15.172:0/2190660556 shutdown_connections 2024-09-11T23:22:55.286 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:22:55.284+0000 7f9dd28d4640 1 --2- 172.21.15.172:0/2190660556 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9dcc1037c0 0x7f9dcc10a050 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:55.286 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:22:55.284+0000 7f9dd28d4640 1 --2- 172.21.15.172:0/2190660556 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dcc102e00 0x7f9dcc103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:55.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:22:55.284+0000 7f9dd28d4640 1 --2- 172.21.15.172:0/2190660556 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dcc101c00 0x7f9dcc102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:55.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:22:55.284+0000 7f9dd28d4640 1 -- 172.21.15.172:0/2190660556 >> 172.21.15.172:0/2190660556 conn(0x7f9dcc0fd3b0 msgr2=0x7f9dcc0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:55.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:22:55.284+0000 7f9dd28d4640 1 -- 172.21.15.172:0/2190660556 shutdown_connections 2024-09-11T23:22:55.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:22:55.284+0000 7f9dd28d4640 1 -- 172.21.15.172:0/2190660556 wait complete. 2024-09-11T23:22:55.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:22:55.284+0000 7f9dd28d4640 1 Processor -- start 2024-09-11T23:22:55.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:22:55.284+0000 7f9dd28d4640 1 -- start start 2024-09-11T23:22:55.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:22:55.285+0000 7f9dd28d4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9dcc101c00 0x7f9dcc197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:55.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:22:55.285+0000 7f9dd28d4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dcc102e00 0x7f9dcc1982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:55.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:22:55.285+0000 7f9dd28d4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dcc1037c0 0x7f9dcc19f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:55.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:22:55.285+0000 7f9dd28d4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9dcc10d710 con 0x7f9dcc1037c0 2024-09-11T23:22:55.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:22:55.285+0000 7f9dd28d4640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9dcc10d590 con 0x7f9dcc102e00 2024-09-11T23:22:55.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:22:55.285+0000 7f9dd28d4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9dcc10d890 con 0x7f9dcc101c00 2024-09-11T23:22:55.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:22:55.285+0000 7f9dcbfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9dcc101c00 0x7f9dcc197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:55.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:22:55.285+0000 7f9dcb7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dcc102e00 0x7f9dcc1982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:55.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:22:55.285+0000 7f9dcb7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dcc102e00 0x7f9dcc1982a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.172:58640/0 (socket says 172.21.15.172:58640) 2024-09-11T23:22:55.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:22:55.285+0000 7f9dcbfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9dcc101c00 0x7f9dcc197d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:37488/0 (socket says 172.21.15.172:37488) 2024-09-11T23:22:55.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:22:55.285+0000 7f9dcb7fe640 1 -- 172.21.15.172:0/4181351189 learned_addr learned my addr 172.21.15.172:0/4181351189 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-11T23:22:55.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:22:55.285+0000 7f9dd0e71640 1 --2- 172.21.15.172:0/4181351189 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dcc1037c0 0x7f9dcc19f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:55.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:22:55.285+0000 7f9dcb7fe640 1 -- 172.21.15.172:0/4181351189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9dcc101c00 msgr2=0x7f9dcc197d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:55.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:22:55.285+0000 7f9dcb7fe640 1 --2- 172.21.15.172:0/4181351189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9dcc101c00 0x7f9dcc197d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:55.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:22:55.285+0000 7f9dcb7fe640 1 -- 172.21.15.172:0/4181351189 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dcc1037c0 msgr2=0x7f9dcc19f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:55.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:22:55.285+0000 7f9dcb7fe640 1 --2- 172.21.15.172:0/4181351189 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dcc1037c0 0x7f9dcc19f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:55.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:22:55.285+0000 7f9dcb7fe640 1 -- 172.21.15.172:0/4181351189 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dcc19f990 con 0x7f9dcc102e00 2024-09-11T23:22:55.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:22:55.285+0000 7f9dd0e71640 1 --2- 172.21.15.172:0/4181351189 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dcc1037c0 0x7f9dcc19f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:22:55.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:22:55.286+0000 7f9dcb7fe640 1 --2- 172.21.15.172:0/4181351189 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dcc102e00 0x7f9dcc1982a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9dc000d950 tx=0x7f9dc000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:55.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:22:55.286+0000 7f9dc97fa640 1 -- 172.21.15.172:0/4181351189 <== mon.2 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc0017070 con 0x7f9dcc102e00 2024-09-11T23:22:55.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:22:55.286+0000 7f9dc97fa640 1 -- 172.21.15.172:0/4181351189 <== mon.2 v2:172.21.15.159:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9dc0009c30 con 0x7f9dcc102e00 2024-09-11T23:22:55.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:22:55.286+0000 7f9dd28d4640 1 -- 172.21.15.172:0/4181351189 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dcc074480 con 0x7f9dcc102e00 2024-09-11T23:22:55.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:22:55.286+0000 7f9dc97fa640 1 -- 172.21.15.172:0/4181351189 <== mon.2 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc000f620 con 0x7f9dcc102e00 2024-09-11T23:22:55.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:22:55.286+0000 7f9dd28d4640 1 -- 172.21.15.172:0/4181351189 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dcc0749c0 con 0x7f9dcc102e00 2024-09-11T23:22:55.290 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:22:55.287+0000 7f9dd28d4640 1 -- 172.21.15.172:0/4181351189 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dcc108ff0 con 0x7f9dcc102e00 2024-09-11T23:22:55.290 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:22:55.288+0000 7f9dc97fa640 1 -- 172.21.15.172:0/4181351189 <== mon.2 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f9dc0010460 con 0x7f9dcc102e00 2024-09-11T23:22:55.290 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:22:55.288+0000 7f9dc97fa640 1 --2- 172.21.15.172:0/4181351189 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f9db40a2c30 0x7f9db40a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:55.290 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:22:55.289+0000 7f9dc97fa640 1 -- 172.21.15.172:0/4181351189 <== mon.2 v2:172.21.15.159:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4101+0+0 (secure 0 0 0) 0x7f9dc00cdc10 con 0x7f9dcc102e00 2024-09-11T23:22:55.290 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:22:55.289+0000 7f9dcbfff640 1 --2- 172.21.15.172:0/4181351189 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f9db40a2c30 0x7f9db40a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:55.290 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:22:55.289+0000 7f9dcbfff640 1 --2- 172.21.15.172:0/4181351189 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f9db40a2c30 0x7f9db40a50f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc102c60 tx=0x7f9dbc010040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:55.293 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:22:55.293+0000 7f9dc97fa640 1 -- 172.21.15.172:0/4181351189 <== mon.2 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9dc009bb40 con 0x7f9dcc102e00 2024-09-11T23:22:55.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:55 smithi159 ceph-mon[34394]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-11T23:22:55.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:55 smithi159 ceph-mon[34394]: osdmap e29: 5 total, 4 up, 5 in 2024-09-11T23:22:55.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:55 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:22:55.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:55 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:22:55.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:55 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:55.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:55 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:55.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:55 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:22:55.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:55 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:22:55.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:55 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:55.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:55 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:22:55.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:55 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:22:55.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:55 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:55.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:22:55.471+0000 7f9dd28d4640 1 -- 172.21.15.172:0/4181351189 --> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f9dcc062630 con 0x7f9db40a2c30 2024-09-11T23:22:55.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:55 smithi005 ceph-mon[31201]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-11T23:22:55.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:55 smithi005 ceph-mon[31201]: osdmap e29: 5 total, 4 up, 5 in 2024-09-11T23:22:55.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:55 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:22:55.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:55 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:22:55.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:55 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:55.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:55 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:55.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:55 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:22:55.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:55 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:22:55.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:55 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:55.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:55 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:22:55.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:55 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:22:55.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:55 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:22:56.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:56 smithi172 ceph-mon[34855]: purged_snaps scrub starts 2024-09-11T23:22:56.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:56 smithi172 ceph-mon[34855]: purged_snaps scrub ok 2024-09-11T23:22:56.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:56 smithi172 ceph-mon[34855]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:22:56.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:56 smithi172 ceph-mon[34855]: Detected new or changed devices on smithi159 2024-09-11T23:22:56.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:56 smithi172 ceph-mon[34855]: Adjusting osd_memory_target on smithi159 to 8544M 2024-09-11T23:22:56.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:56 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:22:56.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:56 smithi172 ceph-mon[34855]: osd.4 [v2:172.21.15.159:6808/4185908786,v1:172.21.15.159:6809/4185908786] boot 2024-09-11T23:22:56.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:56 smithi172 ceph-mon[34855]: osdmap e30: 5 total, 5 up, 5 in 2024-09-11T23:22:56.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:56 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:22:56.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:56 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:22:56.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:56 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:22:56.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:56 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:22:56.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:56 smithi005 ceph-mon[31201]: purged_snaps scrub starts 2024-09-11T23:22:56.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:56 smithi005 ceph-mon[31201]: purged_snaps scrub ok 2024-09-11T23:22:56.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:56 smithi005 ceph-mon[31201]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:22:56.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:56 smithi005 ceph-mon[31201]: Detected new or changed devices on smithi159 2024-09-11T23:22:56.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:56 smithi005 ceph-mon[31201]: Adjusting osd_memory_target on smithi159 to 8544M 2024-09-11T23:22:56.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:56 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:22:56.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:56 smithi005 ceph-mon[31201]: osd.4 [v2:172.21.15.159:6808/4185908786,v1:172.21.15.159:6809/4185908786] boot 2024-09-11T23:22:56.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:56 smithi005 ceph-mon[31201]: osdmap e30: 5 total, 5 up, 5 in 2024-09-11T23:22:56.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:56 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:22:56.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:56 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:22:56.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:56 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:22:56.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:56 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:22:56.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:56 smithi159 ceph-mon[34394]: purged_snaps scrub starts 2024-09-11T23:22:56.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:56 smithi159 ceph-mon[34394]: purged_snaps scrub ok 2024-09-11T23:22:56.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:56 smithi159 ceph-mon[34394]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:22:56.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:56 smithi159 ceph-mon[34394]: Detected new or changed devices on smithi159 2024-09-11T23:22:56.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:56 smithi159 ceph-mon[34394]: Adjusting osd_memory_target on smithi159 to 8544M 2024-09-11T23:22:56.378 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:56 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:22:56.378 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:56 smithi159 ceph-mon[34394]: osd.4 [v2:172.21.15.159:6808/4185908786,v1:172.21.15.159:6809/4185908786] boot 2024-09-11T23:22:56.378 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:56 smithi159 ceph-mon[34394]: osdmap e30: 5 total, 5 up, 5 in 2024-09-11T23:22:56.378 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:56 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:22:56.378 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:56 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:22:56.378 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:56 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:22:56.378 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:56 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:22:57.300 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:57 smithi172 ceph-mon[34855]: from='client.24233 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:22:57.300 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:57 smithi172 ceph-mon[34855]: osdmap e31: 5 total, 5 up, 5 in 2024-09-11T23:22:57.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:57 smithi159 ceph-mon[34394]: from='client.24233 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:22:57.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:57 smithi159 ceph-mon[34394]: osdmap e31: 5 total, 5 up, 5 in 2024-09-11T23:22:57.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:57 smithi005 ceph-mon[31201]: from='client.24233 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:22:57.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:57 smithi005 ceph-mon[31201]: osdmap e31: 5 total, 5 up, 5 in 2024-09-11T23:22:58.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:58 smithi159 ceph-mon[34394]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:22:58.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:58 smithi159 ceph-mon[34394]: from='client.? 172.21.15.172:0/4115767867' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b0a518a-3d17-4635-81da-52f9ef83a574"}]: dispatch 2024-09-11T23:22:58.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:58 smithi159 ceph-mon[34394]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b0a518a-3d17-4635-81da-52f9ef83a574"}]: dispatch 2024-09-11T23:22:58.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:58 smithi159 ceph-mon[34394]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b0a518a-3d17-4635-81da-52f9ef83a574"}]': finished 2024-09-11T23:22:58.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:58 smithi159 ceph-mon[34394]: osdmap e32: 6 total, 5 up, 6 in 2024-09-11T23:22:58.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:58 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:22:58.378 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:58 smithi172 ceph-mon[34855]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:22:58.378 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:58 smithi172 ceph-mon[34855]: from='client.? 172.21.15.172:0/4115767867' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b0a518a-3d17-4635-81da-52f9ef83a574"}]: dispatch 2024-09-11T23:22:58.378 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:58 smithi172 ceph-mon[34855]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b0a518a-3d17-4635-81da-52f9ef83a574"}]: dispatch 2024-09-11T23:22:58.378 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:58 smithi172 ceph-mon[34855]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b0a518a-3d17-4635-81da-52f9ef83a574"}]': finished 2024-09-11T23:22:58.378 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:58 smithi172 ceph-mon[34855]: osdmap e32: 6 total, 5 up, 6 in 2024-09-11T23:22:58.378 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:58 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:22:58.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:58 smithi005 ceph-mon[31201]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:22:58.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:58 smithi005 ceph-mon[31201]: from='client.? 172.21.15.172:0/4115767867' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b0a518a-3d17-4635-81da-52f9ef83a574"}]: dispatch 2024-09-11T23:22:58.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:58 smithi005 ceph-mon[31201]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b0a518a-3d17-4635-81da-52f9ef83a574"}]: dispatch 2024-09-11T23:22:58.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:58 smithi005 ceph-mon[31201]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b0a518a-3d17-4635-81da-52f9ef83a574"}]': finished 2024-09-11T23:22:58.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:58 smithi005 ceph-mon[31201]: osdmap e32: 6 total, 5 up, 6 in 2024-09-11T23:22:58.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:58 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:22:59.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:22:59 smithi159 ceph-mon[34394]: from='client.? 172.21.15.172:0/1452826861' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:22:59.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:22:59 smithi172 ceph-mon[34855]: from='client.? 172.21.15.172:0/1452826861' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:22:59.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:22:59 smithi005 ceph-mon[31201]: from='client.? 172.21.15.172:0/1452826861' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:23:00.292 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:00 smithi159 ceph-mon[34394]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:23:00.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:00 smithi172 ceph-mon[34855]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:23:00.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:00 smithi005 ceph-mon[31201]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:23:02.186 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:02 smithi172 ceph-mon[34855]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:23:02.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:02 smithi159 ceph-mon[34394]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:23:02.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:02 smithi005 ceph-mon[31201]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:23:04.314 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:04 smithi172 ceph-mon[34855]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:23:04.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:04 smithi159 ceph-mon[34394]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:23:04.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:04 smithi005 ceph-mon[31201]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:23:06.172 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:06 smithi172 ceph-mon[34855]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:23:06.172 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:06 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-11T23:23:06.172 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:06 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:23:06.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:06 smithi159 ceph-mon[34394]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:23:06.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:06 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-11T23:23:06.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:06 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:23:06.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:06 smithi005 ceph-mon[31201]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:23:06.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:06 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-11T23:23:06.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:06 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:23:07.114 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:07 smithi172 ceph-mon[34855]: Deploying daemon osd.5 on smithi172 2024-09-11T23:23:07.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:07 smithi159 ceph-mon[34394]: Deploying daemon osd.5 on smithi172 2024-09-11T23:23:07.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:07 smithi005 ceph-mon[31201]: Deploying daemon osd.5 on smithi172 2024-09-11T23:23:08.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:08 smithi159 ceph-mon[34394]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:23:08.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:08 smithi172 ceph-mon[34855]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:23:08.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:08 smithi005 ceph-mon[31201]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:23:09.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:09 smithi159 ceph-mon[34394]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:23:09.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:09 smithi172 ceph-mon[34855]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:23:09.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:09 smithi005 ceph-mon[31201]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:23:11.136 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:11 smithi172 ceph-mon[34855]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:23:11.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:11 smithi159 ceph-mon[34394]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:23:11.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:11 smithi005 ceph-mon[31201]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:23:12.376 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:12 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:23:12.376 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:12 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:12.376 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:12 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:12.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:12 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:23:12.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:12 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:12.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:12 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:12.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:12 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:23:12.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:12 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:12.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:12 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:13.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:13 smithi172 ceph-mon[34855]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:23:14.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:13 smithi159 ceph-mon[34394]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:23:14.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:13 smithi005 ceph-mon[31201]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:23:15.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:15 smithi172 ceph-mon[34855]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:23:15.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:15 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:15.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:15 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:15.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:15 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:23:15.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:15 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:23:15.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:15 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:15.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:23:15.806+0000 7f9dc97fa640 1 -- 172.21.15.172:0/4181351189 <== mgr.14148 v2:172.21.15.5:6800/2285128668 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9dcc062630 con 0x7f9db40a2c30 2024-09-11T23:23:15.807 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 5 on host 'smithi172' 2024-09-11T23:23:15.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:23:15.808+0000 7f9dd28d4640 1 -- 172.21.15.172:0/4181351189 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f9db40a2c30 msgr2=0x7f9db40a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:15.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:23:15.808+0000 7f9dd28d4640 1 --2- 172.21.15.172:0/4181351189 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f9db40a2c30 0x7f9db40a50f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc102c60 tx=0x7f9dbc010040 comp rx=0 tx=0).stop 2024-09-11T23:23:15.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:23:15.809+0000 7f9dd28d4640 1 -- 172.21.15.172:0/4181351189 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dcc102e00 msgr2=0x7f9dcc1982a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:15.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:23:15.809+0000 7f9dd28d4640 1 --2- 172.21.15.172:0/4181351189 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dcc102e00 0x7f9dcc1982a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9dc000d950 tx=0x7f9dc000de10 comp rx=0 tx=0).stop 2024-09-11T23:23:15.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:23:15.809+0000 7f9dd28d4640 1 -- 172.21.15.172:0/4181351189 shutdown_connections 2024-09-11T23:23:15.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:23:15.809+0000 7f9dd28d4640 1 --2- 172.21.15.172:0/4181351189 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f9db40a2c30 0x7f9db40a50f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:15.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:23:15.809+0000 7f9dd28d4640 1 --2- 172.21.15.172:0/4181351189 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dcc1037c0 0x7f9dcc19f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:15.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:23:15.809+0000 7f9dd28d4640 1 --2- 172.21.15.172:0/4181351189 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dcc102e00 0x7f9dcc1982a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:15.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:23:15.809+0000 7f9dd28d4640 1 --2- 172.21.15.172:0/4181351189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9dcc101c00 0x7f9dcc197d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:15.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:23:15.809+0000 7f9dd28d4640 1 -- 172.21.15.172:0/4181351189 >> 172.21.15.172:0/4181351189 conn(0x7f9dcc0fd3b0 msgr2=0x7f9dcc1061c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:15.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:23:15.809+0000 7f9dd28d4640 1 -- 172.21.15.172:0/4181351189 shutdown_connections 2024-09-11T23:23:15.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:23:15.809+0000 7f9dd28d4640 1 -- 172.21.15.172:0/4181351189 wait complete. 2024-09-11T23:23:15.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:15 smithi159 ceph-mon[34394]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:23:15.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:15 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:15.877 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:15 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:15.877 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:15 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:23:15.877 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:15 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:23:15.877 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:15 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:15.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:15 smithi005 ceph-mon[31201]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:23:15.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:15 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:15.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:15 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:15.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:15 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:23:15.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:15 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:23:15.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:15 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:16.512 DEBUG:teuthology.orchestra.run.smithi172:osd.5> sudo journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@osd.5.service 2024-09-11T23:23:16.514 INFO:tasks.cephadm:Deploying osd.6 on smithi005 with /dev/vg_nvme/lv_2... 2024-09-11T23:23:16.514 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-11T23:23:16.781 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:23:16.805 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:16 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:23:16.805 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:16 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:16.805 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:16 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:16.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:16 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:23:16.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:16 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:16.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:16 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:16.903 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:16 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:23:16.903 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:16 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:16.903 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:16 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:17.818 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:17 smithi172 ceph-mon[34855]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:23:17.818 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:17 smithi172 ceph-mon[34855]: from='osd.5 [v2:172.21.15.172:6808/3742759000,v1:172.21.15.172:6809/3742759000]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T23:23:17.818 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:17 smithi172 ceph-mon[34855]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T23:23:17.818 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 11 23:23:17 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-5[46216]: 2024-09-11T23:23:17.562+0000 7f200b86e640 -1 osd.5 0 log_to_monitors true 2024-09-11T23:23:18.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:17 smithi005 ceph-mon[31201]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:23:18.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:17 smithi005 ceph-mon[31201]: from='osd.5 [v2:172.21.15.172:6808/3742759000,v1:172.21.15.172:6809/3742759000]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T23:23:18.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:17 smithi005 ceph-mon[31201]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T23:23:18.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:17 smithi159 ceph-mon[34394]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:23:18.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:17 smithi159 ceph-mon[34394]: from='osd.5 [v2:172.21.15.172:6808/3742759000,v1:172.21.15.172:6809/3742759000]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T23:23:18.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:17 smithi159 ceph-mon[34394]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T23:23:18.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:18 smithi005 ceph-mon[31201]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-11T23:23:18.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:18 smithi005 ceph-mon[31201]: osdmap e33: 6 total, 5 up, 6 in 2024-09-11T23:23:18.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:18 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:23:18.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:18 smithi005 ceph-mon[31201]: from='osd.5 [v2:172.21.15.172:6808/3742759000,v1:172.21.15.172:6809/3742759000]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-11T23:23:18.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:18 smithi005 ceph-mon[31201]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-11T23:23:19.050 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:18 smithi172 ceph-mon[34855]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-11T23:23:19.050 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:18 smithi172 ceph-mon[34855]: osdmap e33: 6 total, 5 up, 6 in 2024-09-11T23:23:19.050 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:18 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:23:19.050 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:18 smithi172 ceph-mon[34855]: from='osd.5 [v2:172.21.15.172:6808/3742759000,v1:172.21.15.172:6809/3742759000]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-11T23:23:19.050 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:18 smithi172 ceph-mon[34855]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-11T23:23:19.051 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 11 23:23:18 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-5[46216]: 2024-09-11T23:23:18.819+0000 7f20077f1640 -1 osd.5 0 waiting for initial osdmap 2024-09-11T23:23:19.051 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 11 23:23:18 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-5[46216]: 2024-09-11T23:23:18.826+0000 7f2003619640 -1 osd.5 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:23:19.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:18 smithi159 ceph-mon[34394]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-11T23:23:19.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:18 smithi159 ceph-mon[34394]: osdmap e33: 6 total, 5 up, 6 in 2024-09-11T23:23:19.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:18 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:23:19.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:18 smithi159 ceph-mon[34394]: from='osd.5 [v2:172.21.15.172:6808/3742759000,v1:172.21.15.172:6809/3742759000]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-11T23:23:19.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:18 smithi159 ceph-mon[34394]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-11T23:23:19.429 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:23:19.460 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi005:vg_nvme/lv_2 2024-09-11T23:23:19.725 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:23:19.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:19 smithi005 ceph-mon[31201]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:23:19.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:19 smithi005 ceph-mon[31201]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-11T23:23:19.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:19 smithi005 ceph-mon[31201]: osdmap e34: 6 total, 5 up, 6 in 2024-09-11T23:23:19.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:19 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:23:19.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:19 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:23:19.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:19 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:19.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:19 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:19.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:19 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:23:19.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:19 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:23:19.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:19 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:19.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:19 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:23:19.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:19 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:23:19.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:19 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:20.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:19 smithi159 ceph-mon[34394]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:23:20.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:19 smithi159 ceph-mon[34394]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-11T23:23:20.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:19 smithi159 ceph-mon[34394]: osdmap e34: 6 total, 5 up, 6 in 2024-09-11T23:23:20.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:19 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:23:20.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:19 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:23:20.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:19 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:20.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:19 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:20.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:19 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:23:20.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:19 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:23:20.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:19 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:20.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:19 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:23:20.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:19 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:23:20.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:19 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:20.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:19 smithi172 ceph-mon[34855]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:23:20.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:19 smithi172 ceph-mon[34855]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-11T23:23:20.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:19 smithi172 ceph-mon[34855]: osdmap e34: 6 total, 5 up, 6 in 2024-09-11T23:23:20.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:19 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:23:20.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:19 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:23:20.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:19 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:20.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:19 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:20.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:19 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:23:20.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:19 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:23:20.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:19 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:20.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:19 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:23:20.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:19 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:23:20.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:19 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:20.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:20.192+0000 7f01f3ede640 1 -- 172.21.15.5:0/1834039486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01ec1026e0 msgr2=0x7f01ec104ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:20.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:20.192+0000 7f01f3ede640 1 --2- 172.21.15.5:0/1834039486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01ec1026e0 0x7f01ec104ad0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f01e0009900 tx=0x7f01e002a410 comp rx=0 tx=0).stop 2024-09-11T23:23:20.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:20.192+0000 7f01f3ede640 1 -- 172.21.15.5:0/1834039486 shutdown_connections 2024-09-11T23:23:20.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:20.192+0000 7f01f3ede640 1 --2- 172.21.15.5:0/1834039486 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01ec107940 0x7f01ec109d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:20.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:20.192+0000 7f01f3ede640 1 --2- 172.21.15.5:0/1834039486 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01ec105010 0x7f01ec107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:20.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:20.192+0000 7f01f3ede640 1 --2- 172.21.15.5:0/1834039486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01ec1026e0 0x7f01ec104ad0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:20.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:20.192+0000 7f01f3ede640 1 -- 172.21.15.5:0/1834039486 >> 172.21.15.5:0/1834039486 conn(0x7f01ec0fc280 msgr2=0x7f01ec0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:20.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:20.192+0000 7f01f3ede640 1 -- 172.21.15.5:0/1834039486 shutdown_connections 2024-09-11T23:23:20.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:20.192+0000 7f01f3ede640 1 -- 172.21.15.5:0/1834039486 wait complete. 2024-09-11T23:23:20.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:20.193+0000 7f01f3ede640 1 Processor -- start 2024-09-11T23:23:20.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:20.193+0000 7f01f3ede640 1 -- start start 2024-09-11T23:23:20.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:20.193+0000 7f01f3ede640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01ec1026e0 0x7f01ec19a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:20.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:20.193+0000 7f01f3ede640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01ec105010 0x7f01ec19a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:20.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:20.193+0000 7f01f3ede640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01ec107940 0x7f01ec1a15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:20.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:20.193+0000 7f01f3ede640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f01ec10d710 con 0x7f01ec107940 2024-09-11T23:23:20.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:20.193+0000 7f01f3ede640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f01ec10d590 con 0x7f01ec105010 2024-09-11T23:23:20.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:20.193+0000 7f01f3ede640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f01ec10d890 con 0x7f01ec1026e0 2024-09-11T23:23:20.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:20.193+0000 7f01f247b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01ec107940 0x7f01ec1a15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:20.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:20.193+0000 7f01f247b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01ec107940 0x7f01ec1a15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34678/0 (socket says 172.21.15.5:34678) 2024-09-11T23:23:20.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:20.193+0000 7f01f247b640 1 -- 172.21.15.5:0/914365440 learned_addr learned my addr 172.21.15.5:0/914365440 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:23:20.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:20.193+0000 7f01f1c7a640 1 --2- 172.21.15.5:0/914365440 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01ec1026e0 0x7f01ec19a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:20.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:20.193+0000 7f01f1479640 1 --2- 172.21.15.5:0/914365440 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01ec105010 0x7f01ec19a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:20.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:20.193+0000 7f01f247b640 1 -- 172.21.15.5:0/914365440 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01ec1026e0 msgr2=0x7f01ec19a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:20.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:20.193+0000 7f01f247b640 1 --2- 172.21.15.5:0/914365440 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01ec1026e0 0x7f01ec19a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:20.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:20.193+0000 7f01f247b640 1 -- 172.21.15.5:0/914365440 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01ec105010 msgr2=0x7f01ec19a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:20.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:20.193+0000 7f01f247b640 1 --2- 172.21.15.5:0/914365440 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01ec105010 0x7f01ec19a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:20.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:20.194+0000 7f01f247b640 1 -- 172.21.15.5:0/914365440 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01ec1a1c30 con 0x7f01ec107940 2024-09-11T23:23:20.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:20.194+0000 7f01f247b640 1 --2- 172.21.15.5:0/914365440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01ec107940 0x7f01ec1a15c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f01e400cad0 tx=0x7f01e400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:20.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:20.194+0000 7f01deffd640 1 -- 172.21.15.5:0/914365440 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e400ad60 con 0x7f01ec107940 2024-09-11T23:23:20.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:20.194+0000 7f01deffd640 1 -- 172.21.15.5:0/914365440 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f01e4005020 con 0x7f01ec107940 2024-09-11T23:23:20.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:20.194+0000 7f01f3ede640 1 -- 172.21.15.5:0/914365440 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01ec1a1f20 con 0x7f01ec107940 2024-09-11T23:23:20.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:20.194+0000 7f01deffd640 1 -- 172.21.15.5:0/914365440 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e400f6b0 con 0x7f01ec107940 2024-09-11T23:23:20.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:20.194+0000 7f01f3ede640 1 -- 172.21.15.5:0/914365440 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01ec1a23d0 con 0x7f01ec107940 2024-09-11T23:23:20.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:20.195+0000 7f01f3ede640 1 -- 172.21.15.5:0/914365440 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01ec109430 con 0x7f01ec107940 2024-09-11T23:23:20.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:20.196+0000 7f01deffd640 1 -- 172.21.15.5:0/914365440 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f01e40051d0 con 0x7f01ec107940 2024-09-11T23:23:20.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:20.197+0000 7f01deffd640 1 --2- 172.21.15.5:0/914365440 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f01d80a2c30 0x7f01d80a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:20.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:20.197+0000 7f01f1c7a640 1 --2- 172.21.15.5:0/914365440 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f01d80a2c30 0x7f01d80a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:20.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:20.197+0000 7f01deffd640 1 -- 172.21.15.5:0/914365440 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4562+0+0 (secure 0 0 0) 0x7f01e40ce420 con 0x7f01ec107940 2024-09-11T23:23:20.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:20.198+0000 7f01f1c7a640 1 --2- 172.21.15.5:0/914365440 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f01d80a2c30 0x7f01d80a50f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f01e0000c00 tx=0x7f01e0005e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:20.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:20.201+0000 7f01deffd640 1 -- 172.21.15.5:0/914365440 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f01e4014030 con 0x7f01ec107940 2024-09-11T23:23:20.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:20.385+0000 7f01f3ede640 1 -- 172.21.15.5:0/914365440 --> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f01ec062630 con 0x7f01d80a2c30 2024-09-11T23:23:21.015 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:20 smithi005 ceph-mon[31201]: purged_snaps scrub starts 2024-09-11T23:23:21.015 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:20 smithi005 ceph-mon[31201]: purged_snaps scrub ok 2024-09-11T23:23:21.015 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:20 smithi005 ceph-mon[31201]: Detected new or changed devices on smithi172 2024-09-11T23:23:21.016 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:20 smithi005 ceph-mon[31201]: Adjusting osd_memory_target on smithi172 to 8544M 2024-09-11T23:23:21.016 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:20 smithi005 ceph-mon[31201]: osd.5 [v2:172.21.15.172:6808/3742759000,v1:172.21.15.172:6809/3742759000] boot 2024-09-11T23:23:21.016 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:20 smithi005 ceph-mon[31201]: osdmap e35: 6 total, 6 up, 6 in 2024-09-11T23:23:21.016 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:20 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:23:21.016 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:20 smithi005 ceph-mon[31201]: osdmap e36: 6 total, 6 up, 6 in 2024-09-11T23:23:21.016 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:20 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:23:21.016 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:20 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:23:21.016 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:20 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:23:21.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:20 smithi159 ceph-mon[34394]: purged_snaps scrub starts 2024-09-11T23:23:21.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:20 smithi159 ceph-mon[34394]: purged_snaps scrub ok 2024-09-11T23:23:21.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:20 smithi159 ceph-mon[34394]: Detected new or changed devices on smithi172 2024-09-11T23:23:21.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:20 smithi159 ceph-mon[34394]: Adjusting osd_memory_target on smithi172 to 8544M 2024-09-11T23:23:21.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:20 smithi159 ceph-mon[34394]: osd.5 [v2:172.21.15.172:6808/3742759000,v1:172.21.15.172:6809/3742759000] boot 2024-09-11T23:23:21.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:20 smithi159 ceph-mon[34394]: osdmap e35: 6 total, 6 up, 6 in 2024-09-11T23:23:21.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:20 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:23:21.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:20 smithi159 ceph-mon[34394]: osdmap e36: 6 total, 6 up, 6 in 2024-09-11T23:23:21.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:20 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:23:21.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:20 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:23:21.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:20 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:23:21.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:20 smithi172 ceph-mon[34855]: purged_snaps scrub starts 2024-09-11T23:23:21.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:20 smithi172 ceph-mon[34855]: purged_snaps scrub ok 2024-09-11T23:23:21.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:20 smithi172 ceph-mon[34855]: Detected new or changed devices on smithi172 2024-09-11T23:23:21.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:20 smithi172 ceph-mon[34855]: Adjusting osd_memory_target on smithi172 to 8544M 2024-09-11T23:23:21.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:20 smithi172 ceph-mon[34855]: osd.5 [v2:172.21.15.172:6808/3742759000,v1:172.21.15.172:6809/3742759000] boot 2024-09-11T23:23:21.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:20 smithi172 ceph-mon[34855]: osdmap e35: 6 total, 6 up, 6 in 2024-09-11T23:23:21.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:20 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:23:21.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:20 smithi172 ceph-mon[34855]: osdmap e36: 6 total, 6 up, 6 in 2024-09-11T23:23:21.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:20 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:23:21.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:20 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:23:21.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:20 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:23:22.027 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:21 smithi005 ceph-mon[31201]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:23:22.027 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:21 smithi005 ceph-mon[31201]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:23:22.027 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:21 smithi005 ceph-mon[31201]: osdmap e37: 6 total, 6 up, 6 in 2024-09-11T23:23:22.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:21 smithi159 ceph-mon[34394]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:23:22.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:21 smithi159 ceph-mon[34394]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:23:22.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:21 smithi159 ceph-mon[34394]: osdmap e37: 6 total, 6 up, 6 in 2024-09-11T23:23:22.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:21 smithi172 ceph-mon[34855]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:23:22.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:21 smithi172 ceph-mon[34855]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:23:22.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:21 smithi172 ceph-mon[34855]: osdmap e37: 6 total, 6 up, 6 in 2024-09-11T23:23:23.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:22 smithi005 ceph-mon[31201]: osdmap e38: 6 total, 6 up, 6 in 2024-09-11T23:23:23.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:22 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/3938694405' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c3a2db6c-9189-4e42-aa1e-52189a9c4291"}]: dispatch 2024-09-11T23:23:23.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:22 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/3938694405' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c3a2db6c-9189-4e42-aa1e-52189a9c4291"}]': finished 2024-09-11T23:23:23.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:22 smithi005 ceph-mon[31201]: osdmap e39: 7 total, 6 up, 7 in 2024-09-11T23:23:23.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:22 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:23:23.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:22 smithi159 ceph-mon[34394]: osdmap e38: 6 total, 6 up, 6 in 2024-09-11T23:23:23.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:22 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/3938694405' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c3a2db6c-9189-4e42-aa1e-52189a9c4291"}]: dispatch 2024-09-11T23:23:23.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:22 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/3938694405' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c3a2db6c-9189-4e42-aa1e-52189a9c4291"}]': finished 2024-09-11T23:23:23.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:22 smithi159 ceph-mon[34394]: osdmap e39: 7 total, 6 up, 7 in 2024-09-11T23:23:23.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:22 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:23:23.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:22 smithi172 ceph-mon[34855]: osdmap e38: 6 total, 6 up, 6 in 2024-09-11T23:23:23.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:22 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/3938694405' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c3a2db6c-9189-4e42-aa1e-52189a9c4291"}]: dispatch 2024-09-11T23:23:23.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:22 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/3938694405' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c3a2db6c-9189-4e42-aa1e-52189a9c4291"}]': finished 2024-09-11T23:23:23.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:22 smithi172 ceph-mon[34855]: osdmap e39: 7 total, 6 up, 7 in 2024-09-11T23:23:23.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:22 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:23:24.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:23 smithi159 ceph-mon[34394]: pgmap v134: 1 pgs: 1 remapped+peering; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:23:24.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:23 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/665466890' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:23:24.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:23 smithi172 ceph-mon[34855]: pgmap v134: 1 pgs: 1 remapped+peering; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:23:24.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:23 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/665466890' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:23:24.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:23 smithi005 ceph-mon[31201]: pgmap v134: 1 pgs: 1 remapped+peering; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:23:24.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:23 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/665466890' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:23:26.277 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:25 smithi005 ceph-mon[31201]: pgmap v136: 1 pgs: 1 remapped+peering; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:23:26.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:25 smithi159 ceph-mon[34394]: pgmap v136: 1 pgs: 1 remapped+peering; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:23:26.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:25 smithi172 ceph-mon[34855]: pgmap v136: 1 pgs: 1 remapped+peering; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:23:28.195 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:27 smithi005 ceph-mon[31201]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T23:23:28.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:27 smithi159 ceph-mon[34394]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T23:23:28.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:27 smithi172 ceph-mon[34855]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T23:23:30.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:29 smithi005 ceph-mon[31201]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-11T23:23:30.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:29 smithi159 ceph-mon[34394]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-11T23:23:30.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:29 smithi172 ceph-mon[34855]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-11T23:23:31.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:30 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-11T23:23:31.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:30 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:23:31.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:30 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-11T23:23:31.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:30 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:23:31.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:30 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-11T23:23:31.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:30 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:23:32.282 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:31 smithi005 ceph-mon[31201]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-11T23:23:32.283 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:31 smithi005 ceph-mon[31201]: Deploying daemon osd.6 on smithi005 2024-09-11T23:23:32.285 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:31 smithi172 ceph-mon[34855]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-11T23:23:32.285 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:31 smithi172 ceph-mon[34855]: Deploying daemon osd.6 on smithi005 2024-09-11T23:23:32.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:31 smithi159 ceph-mon[34394]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-11T23:23:32.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:31 smithi159 ceph-mon[34394]: Deploying daemon osd.6 on smithi005 2024-09-11T23:23:34.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:33 smithi005 ceph-mon[31201]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T23:23:34.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:33 smithi159 ceph-mon[34394]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T23:23:34.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:34 smithi172 ceph-mon[34855]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T23:23:36.291 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:36 smithi005 ceph-mon[31201]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-11T23:23:36.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:36 smithi159 ceph-mon[34394]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-11T23:23:36.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:36 smithi172 ceph-mon[34855]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-11T23:23:37.342 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:37 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:23:37.342 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:37 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:37.343 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:37 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:37.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:37 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:23:37.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:37 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:37.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:37 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:37.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:37 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:23:37.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:37 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:37.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:37 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:38.268 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:38 smithi005 ceph-mon[31201]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T23:23:38.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:38 smithi159 ceph-mon[34394]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T23:23:38.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:38 smithi172 ceph-mon[34855]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T23:23:40.204 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:40 smithi005 ceph-mon[31201]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:23:40.204 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:40 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:40.204 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:40 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:40.204 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:40 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:23:40.204 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:40 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:23:40.204 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:40 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:40.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:40 smithi159 ceph-mon[34394]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:23:40.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:40 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:40.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:40 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:40.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:40 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:23:40.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:40 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:23:40.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:40 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:40.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:40 smithi172 ceph-mon[34855]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:23:40.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:40 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:40.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:40 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:40.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:40 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:23:40.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:40 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:23:40.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:40 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:40.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:40.504+0000 7f01deffd640 1 -- 172.21.15.5:0/914365440 <== mgr.14148 v2:172.21.15.5:6800/2285128668 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f01ec062630 con 0x7f01d80a2c30 2024-09-11T23:23:40.505 INFO:teuthology.orchestra.run.smithi005.stdout:Created osd(s) 6 on host 'smithi005' 2024-09-11T23:23:40.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:40.506+0000 7f01f3ede640 1 -- 172.21.15.5:0/914365440 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f01d80a2c30 msgr2=0x7f01d80a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:40.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:40.506+0000 7f01f3ede640 1 --2- 172.21.15.5:0/914365440 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f01d80a2c30 0x7f01d80a50f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f01e0000c00 tx=0x7f01e0005e40 comp rx=0 tx=0).stop 2024-09-11T23:23:40.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:40.506+0000 7f01f3ede640 1 -- 172.21.15.5:0/914365440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01ec107940 msgr2=0x7f01ec1a15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:40.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:40.506+0000 7f01f3ede640 1 --2- 172.21.15.5:0/914365440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01ec107940 0x7f01ec1a15c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f01e400cad0 tx=0x7f01e400ced0 comp rx=0 tx=0).stop 2024-09-11T23:23:40.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:40.506+0000 7f01f3ede640 1 -- 172.21.15.5:0/914365440 shutdown_connections 2024-09-11T23:23:40.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:40.506+0000 7f01f3ede640 1 --2- 172.21.15.5:0/914365440 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f01d80a2c30 0x7f01d80a50f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:40.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:40.506+0000 7f01f3ede640 1 --2- 172.21.15.5:0/914365440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01ec107940 0x7f01ec1a15c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:40.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:40.506+0000 7f01f3ede640 1 --2- 172.21.15.5:0/914365440 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01ec105010 0x7f01ec19a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:40.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:40.506+0000 7f01f3ede640 1 --2- 172.21.15.5:0/914365440 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01ec1026e0 0x7f01ec19a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:40.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:40.506+0000 7f01f3ede640 1 -- 172.21.15.5:0/914365440 >> 172.21.15.5:0/914365440 conn(0x7f01ec0fc280 msgr2=0x7f01ec101cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:40.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:40.506+0000 7f01f3ede640 1 -- 172.21.15.5:0/914365440 shutdown_connections 2024-09-11T23:23:40.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:23:40.506+0000 7f01f3ede640 1 -- 172.21.15.5:0/914365440 wait complete. 2024-09-11T23:23:41.122 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:41 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:23:41.122 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:41 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:41.122 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:41 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:41.151 DEBUG:teuthology.orchestra.run.smithi005:osd.6> sudo journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@osd.6.service 2024-09-11T23:23:41.153 INFO:tasks.cephadm:Deploying osd.7 on smithi159 with /dev/vg_nvme/lv_2... 2024-09-11T23:23:41.153 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-11T23:23:41.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:41 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:23:41.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:41 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:41.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:41 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:41.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:41 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:23:41.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:41 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:41.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:41 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:41.410 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T23:23:42.366 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:42 smithi005 ceph-mon[31201]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:23:42.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:42 smithi159 ceph-mon[34394]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:23:42.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:42 smithi172 ceph-mon[34855]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:23:42.975 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:23:42 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:23:42.697+0000 7f0b43299640 -1 osd.6 0 log_to_monitors true 2024-09-11T23:23:43.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:43 smithi159 ceph-mon[34394]: from='osd.6 [v2:172.21.15.5:6818/4156823423,v1:172.21.15.5:6819/4156823423]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-11T23:23:43.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:43 smithi172 ceph-mon[34855]: from='osd.6 [v2:172.21.15.5:6818/4156823423,v1:172.21.15.5:6819/4156823423]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-11T23:23:43.384 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:43 smithi005 ceph-mon[31201]: from='osd.6 [v2:172.21.15.5:6818/4156823423,v1:172.21.15.5:6819/4156823423]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-11T23:23:43.937 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-11T23:23:43.965 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi159:vg_nvme/lv_2 2024-09-11T23:23:44.222 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T23:23:44.343 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:44 smithi159 ceph-mon[34394]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:23:44.343 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:44 smithi159 ceph-mon[34394]: from='osd.6 [v2:172.21.15.5:6818/4156823423,v1:172.21.15.5:6819/4156823423]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-11T23:23:44.344 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:44 smithi159 ceph-mon[34394]: osdmap e40: 7 total, 6 up, 7 in 2024-09-11T23:23:44.344 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:44 smithi159 ceph-mon[34394]: from='osd.6 [v2:172.21.15.5:6818/4156823423,v1:172.21.15.5:6819/4156823423]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-09-11T23:23:44.344 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:44 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:23:44.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:44 smithi172 ceph-mon[34855]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:23:44.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:44 smithi172 ceph-mon[34855]: from='osd.6 [v2:172.21.15.5:6818/4156823423,v1:172.21.15.5:6819/4156823423]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-11T23:23:44.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:44 smithi172 ceph-mon[34855]: osdmap e40: 7 total, 6 up, 7 in 2024-09-11T23:23:44.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:44 smithi172 ceph-mon[34855]: from='osd.6 [v2:172.21.15.5:6818/4156823423,v1:172.21.15.5:6819/4156823423]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-09-11T23:23:44.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:44 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:23:44.470 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:44 smithi005 ceph-mon[31201]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:23:44.470 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:44 smithi005 ceph-mon[31201]: from='osd.6 [v2:172.21.15.5:6818/4156823423,v1:172.21.15.5:6819/4156823423]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-11T23:23:44.470 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:44 smithi005 ceph-mon[31201]: osdmap e40: 7 total, 6 up, 7 in 2024-09-11T23:23:44.470 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:44 smithi005 ceph-mon[31201]: from='osd.6 [v2:172.21.15.5:6818/4156823423,v1:172.21.15.5:6819/4156823423]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-09-11T23:23:44.470 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:44 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:23:44.724 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:23:44 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:23:44.470+0000 7f0b3f21c640 -1 osd.6 0 waiting for initial osdmap 2024-09-11T23:23:44.724 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:23:44 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:23:44.478+0000 7f0b3703c640 -1 osd.6 41 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:23:44.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:23:44.706+0000 7fcf534fc640 1 -- 172.21.15.159:0/3435503992 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf4c102e00 msgr2=0x7fcf4c103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:44.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:23:44.706+0000 7fcf534fc640 1 --2- 172.21.15.159:0/3435503992 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf4c102e00 0x7fcf4c103280 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c009900 tx=0x7fcf3c02a410 comp rx=0 tx=0).stop 2024-09-11T23:23:44.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:23:44.706+0000 7fcf534fc640 1 -- 172.21.15.159:0/3435503992 shutdown_connections 2024-09-11T23:23:44.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:23:44.706+0000 7fcf534fc640 1 --2- 172.21.15.159:0/3435503992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf4c1037c0 0x7fcf4c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:44.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:23:44.706+0000 7fcf534fc640 1 --2- 172.21.15.159:0/3435503992 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf4c102e00 0x7fcf4c103280 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:44.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:23:44.706+0000 7fcf534fc640 1 --2- 172.21.15.159:0/3435503992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf4c101c00 0x7fcf4c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:44.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:23:44.706+0000 7fcf534fc640 1 -- 172.21.15.159:0/3435503992 >> 172.21.15.159:0/3435503992 conn(0x7fcf4c0fd390 msgr2=0x7fcf4c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:44.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:23:44.706+0000 7fcf534fc640 1 -- 172.21.15.159:0/3435503992 shutdown_connections 2024-09-11T23:23:44.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:23:44.706+0000 7fcf534fc640 1 -- 172.21.15.159:0/3435503992 wait complete. 2024-09-11T23:23:44.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:23:44.707+0000 7fcf534fc640 1 Processor -- start 2024-09-11T23:23:44.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:23:44.707+0000 7fcf534fc640 1 -- start start 2024-09-11T23:23:44.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:23:44.707+0000 7fcf534fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf4c101c00 0x7fcf4c197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:44.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:23:44.707+0000 7fcf534fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf4c102e00 0x7fcf4c198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:44.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:23:44.707+0000 7fcf534fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf4c1037c0 0x7fcf4c19f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:44.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:23:44.707+0000 7fcf534fc640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcf4c10d730 con 0x7fcf4c101c00 2024-09-11T23:23:44.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:23:44.707+0000 7fcf534fc640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fcf4c10d5b0 con 0x7fcf4c102e00 2024-09-11T23:23:44.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:23:44.707+0000 7fcf534fc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcf4c10d8b0 con 0x7fcf4c1037c0 2024-09-11T23:23:44.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:23:44.707+0000 7fcf50a97640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf4c102e00 0x7fcf4c198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:44.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:23:44.707+0000 7fcf50a97640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf4c102e00 0x7fcf4c198320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:52908/0 (socket says 172.21.15.159:52908) 2024-09-11T23:23:44.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:23:44.707+0000 7fcf50a97640 1 -- 172.21.15.159:0/1048499442 learned_addr learned my addr 172.21.15.159:0/1048499442 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-11T23:23:44.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:23:44.707+0000 7fcf51298640 1 --2- 172.21.15.159:0/1048499442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf4c101c00 0x7fcf4c197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:44.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:23:44.707+0000 7fcf51a99640 1 --2- 172.21.15.159:0/1048499442 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf4c1037c0 0x7fcf4c19f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:44.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:23:44.707+0000 7fcf50a97640 1 -- 172.21.15.159:0/1048499442 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf4c1037c0 msgr2=0x7fcf4c19f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:44.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:23:44.708+0000 7fcf50a97640 1 --2- 172.21.15.159:0/1048499442 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf4c1037c0 0x7fcf4c19f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:44.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:23:44.708+0000 7fcf50a97640 1 -- 172.21.15.159:0/1048499442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf4c101c00 msgr2=0x7fcf4c197de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:44.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:23:44.708+0000 7fcf50a97640 1 --2- 172.21.15.159:0/1048499442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf4c101c00 0x7fcf4c197de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:44.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:23:44.708+0000 7fcf50a97640 1 -- 172.21.15.159:0/1048499442 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf4c19fa10 con 0x7fcf4c102e00 2024-09-11T23:23:44.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:23:44.708+0000 7fcf51298640 1 --2- 172.21.15.159:0/1048499442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf4c101c00 0x7fcf4c197de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:23:44.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:23:44.708+0000 7fcf50a97640 1 --2- 172.21.15.159:0/1048499442 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf4c102e00 0x7fcf4c198320 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c005940 tx=0x7fcf3c004430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:44.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:23:44.708+0000 7fcf427fc640 1 -- 172.21.15.159:0/1048499442 <== mon.2 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c03f030 con 0x7fcf4c102e00 2024-09-11T23:23:44.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:23:44.708+0000 7fcf534fc640 1 -- 172.21.15.159:0/1048499442 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf4c19fca0 con 0x7fcf4c102e00 2024-09-11T23:23:44.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:23:44.708+0000 7fcf427fc640 1 -- 172.21.15.159:0/1048499442 <== mon.2 v2:172.21.15.159:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcf3c003cb0 con 0x7fcf4c102e00 2024-09-11T23:23:44.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:23:44.708+0000 7fcf427fc640 1 -- 172.21.15.159:0/1048499442 <== mon.2 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c035070 con 0x7fcf4c102e00 2024-09-11T23:23:44.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:23:44.708+0000 7fcf534fc640 1 -- 172.21.15.159:0/1048499442 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf4c1a0180 con 0x7fcf4c102e00 2024-09-11T23:23:44.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:23:44.709+0000 7fcf534fc640 1 -- 172.21.15.159:0/1048499442 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf4c109050 con 0x7fcf4c102e00 2024-09-11T23:23:44.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:23:44.710+0000 7fcf427fc640 1 -- 172.21.15.159:0/1048499442 <== mon.2 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fcf3c042030 con 0x7fcf4c102e00 2024-09-11T23:23:44.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:23:44.711+0000 7fcf427fc640 1 --2- 172.21.15.159:0/1048499442 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fcf380a2bb0 0x7fcf380a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:44.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:23:44.711+0000 7fcf427fc640 1 -- 172.21.15.159:0/1048499442 <== mon.2 v2:172.21.15.159:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4685+0+0 (secure 0 0 0) 0x7fcf3c0ee840 con 0x7fcf4c102e00 2024-09-11T23:23:44.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:23:44.711+0000 7fcf51298640 1 --2- 172.21.15.159:0/1048499442 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fcf380a2bb0 0x7fcf380a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:44.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:23:44.712+0000 7fcf51298640 1 --2- 172.21.15.159:0/1048499442 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fcf380a2bb0 0x7fcf380a5070 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcf480058c0 tx=0x7fcf4800a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:44.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:23:44.715+0000 7fcf427fc640 1 -- 172.21.15.159:0/1048499442 <== mon.2 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcf3c0bbf80 con 0x7fcf4c102e00 2024-09-11T23:23:44.891 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:23:44.891+0000 7fcf534fc640 1 -- 172.21.15.159:0/1048499442 --> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fcf4c062630 con 0x7fcf380a2bb0 2024-09-11T23:23:45.298 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:45 smithi159 ceph-mon[34394]: from='osd.6 [v2:172.21.15.5:6818/4156823423,v1:172.21.15.5:6819/4156823423]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-09-11T23:23:45.298 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:45 smithi159 ceph-mon[34394]: osdmap e41: 7 total, 6 up, 7 in 2024-09-11T23:23:45.298 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:45 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:23:45.298 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:45 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:23:45.298 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:45 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:45.298 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:45 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:45.298 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:45 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:23:45.298 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:45 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:23:45.298 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:45 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:23:45.298 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:45 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:45.299 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:45 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:23:45.299 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:45 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:23:45.299 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:45 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:45.299 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:45 smithi159 ceph-mon[34394]: from='osd.6 [v2:172.21.15.5:6818/4156823423,v1:172.21.15.5:6819/4156823423]' entity='osd.6' 2024-09-11T23:23:45.299 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:45 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:23:45.299 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:45 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:23:45.299 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:45 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:23:45.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:45 smithi172 ceph-mon[34855]: from='osd.6 [v2:172.21.15.5:6818/4156823423,v1:172.21.15.5:6819/4156823423]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-09-11T23:23:45.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:45 smithi172 ceph-mon[34855]: osdmap e41: 7 total, 6 up, 7 in 2024-09-11T23:23:45.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:45 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:23:45.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:45 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:23:45.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:45 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:45.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:45 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:45.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:45 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:23:45.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:45 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:23:45.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:45 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:23:45.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:45 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:45.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:45 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:23:45.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:45 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:23:45.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:45 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:45.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:45 smithi172 ceph-mon[34855]: from='osd.6 [v2:172.21.15.5:6818/4156823423,v1:172.21.15.5:6819/4156823423]' entity='osd.6' 2024-09-11T23:23:45.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:45 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:23:45.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:45 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:23:45.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:45 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:23:45.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:45 smithi005 ceph-mon[31201]: from='osd.6 [v2:172.21.15.5:6818/4156823423,v1:172.21.15.5:6819/4156823423]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-09-11T23:23:45.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:45 smithi005 ceph-mon[31201]: osdmap e41: 7 total, 6 up, 7 in 2024-09-11T23:23:45.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:45 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:23:45.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:45 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:23:45.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:45 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:45.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:45 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:45.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:45 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:23:45.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:45 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:23:45.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:45 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:23:45.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:45 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:45.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:45 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:23:45.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:45 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:23:45.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:45 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:23:45.476 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:45 smithi005 ceph-mon[31201]: from='osd.6 [v2:172.21.15.5:6818/4156823423,v1:172.21.15.5:6819/4156823423]' entity='osd.6' 2024-09-11T23:23:45.476 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:45 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:23:45.476 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:45 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:23:45.476 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:45 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:23:46.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:46 smithi159 ceph-mon[34394]: purged_snaps scrub starts 2024-09-11T23:23:46.446 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:46 smithi159 ceph-mon[34394]: purged_snaps scrub ok 2024-09-11T23:23:46.446 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:46 smithi159 ceph-mon[34394]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:23:46.446 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:46 smithi159 ceph-mon[34394]: Detected new or changed devices on smithi005 2024-09-11T23:23:46.446 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:46 smithi159 ceph-mon[34394]: Adjusting osd_memory_target on smithi005 to 5697M 2024-09-11T23:23:46.446 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:46 smithi159 ceph-mon[34394]: from='client.24266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:23:46.446 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:46 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:23:46.446 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:46 smithi159 ceph-mon[34394]: osd.6 [v2:172.21.15.5:6818/4156823423,v1:172.21.15.5:6819/4156823423] boot 2024-09-11T23:23:46.446 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:46 smithi159 ceph-mon[34394]: osdmap e42: 7 total, 7 up, 7 in 2024-09-11T23:23:46.446 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:46 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:23:46.447 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:46 smithi172 ceph-mon[34855]: purged_snaps scrub starts 2024-09-11T23:23:46.447 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:46 smithi172 ceph-mon[34855]: purged_snaps scrub ok 2024-09-11T23:23:46.447 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:46 smithi172 ceph-mon[34855]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:23:46.447 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:46 smithi172 ceph-mon[34855]: Detected new or changed devices on smithi005 2024-09-11T23:23:46.447 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:46 smithi172 ceph-mon[34855]: Adjusting osd_memory_target on smithi005 to 5697M 2024-09-11T23:23:46.448 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:46 smithi172 ceph-mon[34855]: from='client.24266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:23:46.448 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:46 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:23:46.448 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:46 smithi172 ceph-mon[34855]: osd.6 [v2:172.21.15.5:6818/4156823423,v1:172.21.15.5:6819/4156823423] boot 2024-09-11T23:23:46.448 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:46 smithi172 ceph-mon[34855]: osdmap e42: 7 total, 7 up, 7 in 2024-09-11T23:23:46.448 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:46 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:23:46.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:46 smithi005 ceph-mon[31201]: purged_snaps scrub starts 2024-09-11T23:23:46.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:46 smithi005 ceph-mon[31201]: purged_snaps scrub ok 2024-09-11T23:23:46.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:46 smithi005 ceph-mon[31201]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:23:46.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:46 smithi005 ceph-mon[31201]: Detected new or changed devices on smithi005 2024-09-11T23:23:46.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:46 smithi005 ceph-mon[31201]: Adjusting osd_memory_target on smithi005 to 5697M 2024-09-11T23:23:46.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:46 smithi005 ceph-mon[31201]: from='client.24266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:23:46.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:46 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:23:46.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:46 smithi005 ceph-mon[31201]: osd.6 [v2:172.21.15.5:6818/4156823423,v1:172.21.15.5:6819/4156823423] boot 2024-09-11T23:23:46.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:46 smithi005 ceph-mon[31201]: osdmap e42: 7 total, 7 up, 7 in 2024-09-11T23:23:46.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:46 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:23:47.745 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:47 smithi159 ceph-mon[34394]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:23:47.745 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:47 smithi159 ceph-mon[34394]: osdmap e43: 7 total, 7 up, 7 in 2024-09-11T23:23:47.745 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:47 smithi159 ceph-mon[34394]: from='client.? 172.21.15.159:0/974221146' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dfaadf28-74ab-4cda-8647-dcb58beb7cc9"}]: dispatch 2024-09-11T23:23:47.746 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:47 smithi159 ceph-mon[34394]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dfaadf28-74ab-4cda-8647-dcb58beb7cc9"}]: dispatch 2024-09-11T23:23:47.746 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:47 smithi159 ceph-mon[34394]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dfaadf28-74ab-4cda-8647-dcb58beb7cc9"}]': finished 2024-09-11T23:23:47.746 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:47 smithi159 ceph-mon[34394]: osdmap e44: 8 total, 7 up, 8 in 2024-09-11T23:23:47.746 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:47 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:23:47.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:47 smithi172 ceph-mon[34855]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:23:47.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:47 smithi172 ceph-mon[34855]: osdmap e43: 7 total, 7 up, 7 in 2024-09-11T23:23:47.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:47 smithi172 ceph-mon[34855]: from='client.? 172.21.15.159:0/974221146' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dfaadf28-74ab-4cda-8647-dcb58beb7cc9"}]: dispatch 2024-09-11T23:23:47.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:47 smithi172 ceph-mon[34855]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dfaadf28-74ab-4cda-8647-dcb58beb7cc9"}]: dispatch 2024-09-11T23:23:47.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:47 smithi172 ceph-mon[34855]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dfaadf28-74ab-4cda-8647-dcb58beb7cc9"}]': finished 2024-09-11T23:23:47.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:47 smithi172 ceph-mon[34855]: osdmap e44: 8 total, 7 up, 8 in 2024-09-11T23:23:47.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:47 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:23:47.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:47 smithi005 ceph-mon[31201]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:23:47.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:47 smithi005 ceph-mon[31201]: osdmap e43: 7 total, 7 up, 7 in 2024-09-11T23:23:47.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:47 smithi005 ceph-mon[31201]: from='client.? 172.21.15.159:0/974221146' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dfaadf28-74ab-4cda-8647-dcb58beb7cc9"}]: dispatch 2024-09-11T23:23:47.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:47 smithi005 ceph-mon[31201]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dfaadf28-74ab-4cda-8647-dcb58beb7cc9"}]: dispatch 2024-09-11T23:23:47.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:47 smithi005 ceph-mon[31201]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dfaadf28-74ab-4cda-8647-dcb58beb7cc9"}]': finished 2024-09-11T23:23:47.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:47 smithi005 ceph-mon[31201]: osdmap e44: 8 total, 7 up, 8 in 2024-09-11T23:23:47.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:47 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:23:48.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:48 smithi159 ceph-mon[34394]: from='client.? 172.21.15.159:0/3044138525' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:23:48.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:48 smithi172 ceph-mon[34855]: from='client.? 172.21.15.159:0/3044138525' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:23:48.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:48 smithi005 ceph-mon[31201]: from='client.? 172.21.15.159:0/3044138525' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:23:49.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:49 smithi159 ceph-mon[34394]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:23:49.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:49 smithi172 ceph-mon[34855]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:23:49.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:49 smithi005 ceph-mon[31201]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:23:51.877 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:51 smithi159 ceph-mon[34394]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:23:51.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:51 smithi172 ceph-mon[34855]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:23:51.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:51 smithi005 ceph-mon[31201]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:23:53.787 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:53 smithi159 ceph-mon[34394]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:23:53.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:53 smithi172 ceph-mon[34855]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:23:53.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:53 smithi005 ceph-mon[31201]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:23:55.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:55 smithi159 ceph-mon[34394]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:23:55.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:55 smithi172 ceph-mon[34855]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:23:55.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:55 smithi005 ceph-mon[31201]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:23:56.789 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:56 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-11T23:23:56.789 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:56 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:23:56.875 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:56 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-11T23:23:56.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:56 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:23:56.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:56 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-11T23:23:56.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:56 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:23:57.855 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:57 smithi159 ceph-mon[34394]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:23:57.855 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:57 smithi159 ceph-mon[34394]: Deploying daemon osd.7 on smithi159 2024-09-11T23:23:57.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:57 smithi172 ceph-mon[34855]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:23:57.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:57 smithi172 ceph-mon[34855]: Deploying daemon osd.7 on smithi159 2024-09-11T23:23:57.889 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:57 smithi005 ceph-mon[31201]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:23:57.890 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:57 smithi005 ceph-mon[31201]: Deploying daemon osd.7 on smithi159 2024-09-11T23:23:59.620 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:23:59 smithi159 ceph-mon[34394]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:23:59.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:23:59 smithi172 ceph-mon[34855]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:23:59.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:23:59 smithi005 ceph-mon[31201]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:24:01.770 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:01 smithi159 ceph-mon[34394]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:24:01.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:01 smithi172 ceph-mon[34855]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:24:01.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:01 smithi005 ceph-mon[31201]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:24:02.638 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:02 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:24:02.638 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:02 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:02.638 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:02 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:02.785 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:02 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:24:02.785 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:02 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:02.785 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:02 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:02.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:02 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:24:02.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:02 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:02.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:02 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:03.859 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:03 smithi159 ceph-mon[34394]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:24:03.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:03 smithi172 ceph-mon[34855]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:24:03.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:03 smithi005 ceph-mon[31201]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:24:05.891 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:24:05.891+0000 7fcf427fc640 1 -- 172.21.15.159:0/1048499442 <== mgr.14148 v2:172.21.15.5:6800/2285128668 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fcf4c062630 con 0x7fcf380a2bb0 2024-09-11T23:24:05.891 INFO:teuthology.orchestra.run.smithi159.stdout:Created osd(s) 7 on host 'smithi159' 2024-09-11T23:24:05.893 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:24:05.893+0000 7fcf534fc640 1 -- 172.21.15.159:0/1048499442 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fcf380a2bb0 msgr2=0x7fcf380a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:05.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:24:05.893+0000 7fcf534fc640 1 --2- 172.21.15.159:0/1048499442 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fcf380a2bb0 0x7fcf380a5070 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcf480058c0 tx=0x7fcf4800a2d0 comp rx=0 tx=0).stop 2024-09-11T23:24:05.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:24:05.893+0000 7fcf534fc640 1 -- 172.21.15.159:0/1048499442 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf4c102e00 msgr2=0x7fcf4c198320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:05.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:24:05.893+0000 7fcf534fc640 1 --2- 172.21.15.159:0/1048499442 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf4c102e00 0x7fcf4c198320 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c005940 tx=0x7fcf3c004430 comp rx=0 tx=0).stop 2024-09-11T23:24:05.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:24:05.893+0000 7fcf534fc640 1 -- 172.21.15.159:0/1048499442 shutdown_connections 2024-09-11T23:24:05.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:24:05.894+0000 7fcf534fc640 1 --2- 172.21.15.159:0/1048499442 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fcf380a2bb0 0x7fcf380a5070 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:05.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:24:05.894+0000 7fcf534fc640 1 --2- 172.21.15.159:0/1048499442 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf4c1037c0 0x7fcf4c19f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:05.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:24:05.894+0000 7fcf534fc640 1 --2- 172.21.15.159:0/1048499442 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf4c102e00 0x7fcf4c198320 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:05.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:24:05.894+0000 7fcf534fc640 1 --2- 172.21.15.159:0/1048499442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf4c101c00 0x7fcf4c197de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:05.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:24:05.894+0000 7fcf534fc640 1 -- 172.21.15.159:0/1048499442 >> 172.21.15.159:0/1048499442 conn(0x7fcf4c0fd390 msgr2=0x7fcf4c106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:05.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:24:05.894+0000 7fcf534fc640 1 -- 172.21.15.159:0/1048499442 shutdown_connections 2024-09-11T23:24:05.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:24:05.894+0000 7fcf534fc640 1 -- 172.21.15.159:0/1048499442 wait complete. 2024-09-11T23:24:06.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:05 smithi159 ceph-mon[34394]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:24:06.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:05 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:06.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:05 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:06.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:05 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:24:06.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:05 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:24:06.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:05 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:06.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:05 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:24:06.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:05 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:06.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:05 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:06.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:05 smithi005 ceph-mon[31201]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:24:06.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:05 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:06.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:05 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:06.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:05 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:24:06.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:05 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:24:06.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:05 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:06.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:05 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:24:06.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:05 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:06.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:05 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:06.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:05 smithi172 ceph-mon[34855]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:24:06.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:05 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:06.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:05 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:06.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:05 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:24:06.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:05 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:24:06.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:05 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:06.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:05 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:24:06.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:05 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:06.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:05 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:06.561 DEBUG:teuthology.orchestra.run.smithi159:osd.7> sudo journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@osd.7.service 2024-09-11T23:24:06.563 INFO:tasks.cephadm:Deploying osd.8 on smithi172 with /dev/vg_nvme/lv_2... 2024-09-11T23:24:06.563 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-11T23:24:06.818 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:24:08.067 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:07 smithi159 ceph-mon[34394]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:24:08.067 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:24:08 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:24:08.006+0000 7f41d362d640 -1 osd.7 0 log_to_monitors true 2024-09-11T23:24:08.170 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:07 smithi172 ceph-mon[34855]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:24:08.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:07 smithi005 ceph-mon[31201]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:24:09.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:08 smithi159 ceph-mon[34394]: from='osd.7 [v2:172.21.15.159:6816/4222571927,v1:172.21.15.159:6817/4222571927]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-11T23:24:09.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:08 smithi159 ceph-mon[34394]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-11T23:24:09.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:08 smithi172 ceph-mon[34855]: from='osd.7 [v2:172.21.15.159:6816/4222571927,v1:172.21.15.159:6817/4222571927]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-11T23:24:09.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:08 smithi172 ceph-mon[34855]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-11T23:24:09.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:08 smithi005 ceph-mon[31201]: from='osd.7 [v2:172.21.15.159:6816/4222571927,v1:172.21.15.159:6817/4222571927]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-11T23:24:09.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:08 smithi005 ceph-mon[31201]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-11T23:24:09.458 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-11T23:24:09.486 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi172:vg_nvme/lv_2 2024-09-11T23:24:09.748 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:24:10.021 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:09 smithi172 ceph-mon[34855]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:24:10.021 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:09 smithi172 ceph-mon[34855]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-11T23:24:10.021 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:09 smithi172 ceph-mon[34855]: osdmap e45: 8 total, 7 up, 8 in 2024-09-11T23:24:10.021 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:09 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:24:10.021 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:09 smithi172 ceph-mon[34855]: from='osd.7 [v2:172.21.15.159:6816/4222571927,v1:172.21.15.159:6817/4222571927]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-11T23:24:10.021 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:09 smithi172 ceph-mon[34855]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-11T23:24:10.021 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:09 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:10.021 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:09 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:10.021 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:09 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:24:10.021 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:09 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:24:10.021 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:09 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:24:10.022 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:09 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:10.022 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:09 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:24:10.022 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:09 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:24:10.022 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:09 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:10.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:09 smithi005 ceph-mon[31201]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:24:10.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:09 smithi005 ceph-mon[31201]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-11T23:24:10.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:09 smithi005 ceph-mon[31201]: osdmap e45: 8 total, 7 up, 8 in 2024-09-11T23:24:10.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:09 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:24:10.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:09 smithi005 ceph-mon[31201]: from='osd.7 [v2:172.21.15.159:6816/4222571927,v1:172.21.15.159:6817/4222571927]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-11T23:24:10.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:09 smithi005 ceph-mon[31201]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-11T23:24:10.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:09 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:10.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:09 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:10.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:09 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:24:10.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:09 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:24:10.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:09 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:24:10.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:09 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:10.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:09 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:24:10.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:09 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:24:10.226 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:09 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:10.233 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:10.210+0000 7fe1a731f640 1 -- 172.21.15.172:0/2953326519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1a01078c0 msgr2=0x7fe1a0109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:10.233 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:10.210+0000 7fe1a731f640 1 --2- 172.21.15.172:0/2953326519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1a01078c0 0x7fe1a0109d10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe198009ca0 tx=0x7fe19802a8c0 comp rx=0 tx=0).stop 2024-09-11T23:24:10.233 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:10.211+0000 7fe1a731f640 1 -- 172.21.15.172:0/2953326519 shutdown_connections 2024-09-11T23:24:10.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:10.211+0000 7fe1a731f640 1 --2- 172.21.15.172:0/2953326519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1a01078c0 0x7fe1a0109d10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:10.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:10.211+0000 7fe1a731f640 1 --2- 172.21.15.172:0/2953326519 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1a0104f90 0x7fe1a0107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:10.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:10.211+0000 7fe1a731f640 1 --2- 172.21.15.172:0/2953326519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1a0102660 0x7fe1a0104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:10.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:10.211+0000 7fe1a731f640 1 -- 172.21.15.172:0/2953326519 >> 172.21.15.172:0/2953326519 conn(0x7fe1a00fc280 msgr2=0x7fe1a00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:10.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:10.211+0000 7fe1a731f640 1 -- 172.21.15.172:0/2953326519 shutdown_connections 2024-09-11T23:24:10.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:10.211+0000 7fe1a731f640 1 -- 172.21.15.172:0/2953326519 wait complete. 2024-09-11T23:24:10.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:10.211+0000 7fe1a731f640 1 Processor -- start 2024-09-11T23:24:10.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:10.211+0000 7fe1a731f640 1 -- start start 2024-09-11T23:24:10.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:10.212+0000 7fe1a731f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1a0102660 0x7fe1a0197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:10.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:10.212+0000 7fe1a731f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1a0104f90 0x7fe1a01982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:10.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:10.212+0000 7fe1a731f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1a01078c0 0x7fe1a019f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:10.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:10.212+0000 7fe1a731f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a010d710 con 0x7fe1a01078c0 2024-09-11T23:24:10.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:10.212+0000 7fe1a731f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a010d590 con 0x7fe1a0104f90 2024-09-11T23:24:10.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:10.212+0000 7fe1a731f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a010d890 con 0x7fe1a0102660 2024-09-11T23:24:10.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:10.212+0000 7fe1a50bb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1a0102660 0x7fe1a0197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:10.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:10.212+0000 7fe1a50bb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1a0102660 0x7fe1a0197d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36978/0 (socket says 172.21.15.172:36978) 2024-09-11T23:24:10.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:10.212+0000 7fe1a50bb640 1 -- 172.21.15.172:0/3440378523 learned_addr learned my addr 172.21.15.172:0/3440378523 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-11T23:24:10.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:10.212+0000 7fe1a48ba640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1a0104f90 0x7fe1a01982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:10.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:10.212+0000 7fe1a58bc640 1 --2- 172.21.15.172:0/3440378523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1a01078c0 0x7fe1a019f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:10.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:10.212+0000 7fe1a50bb640 1 -- 172.21.15.172:0/3440378523 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1a0104f90 msgr2=0x7fe1a01982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:10.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:10.212+0000 7fe1a50bb640 1 --2- 172.21.15.172:0/3440378523 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1a0104f90 0x7fe1a01982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:10.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:10.212+0000 7fe1a50bb640 1 -- 172.21.15.172:0/3440378523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1a01078c0 msgr2=0x7fe1a019f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:10.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:10.212+0000 7fe1a50bb640 1 --2- 172.21.15.172:0/3440378523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1a01078c0 0x7fe1a019f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:10.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:10.212+0000 7fe1a50bb640 1 -- 172.21.15.172:0/3440378523 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1a019f990 con 0x7fe1a0102660 2024-09-11T23:24:10.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:10.212+0000 7fe1a58bc640 1 --2- 172.21.15.172:0/3440378523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1a01078c0 0x7fe1a019f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:10.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:10.212+0000 7fe1a50bb640 1 --2- 172.21.15.172:0/3440378523 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1a0102660 0x7fe1a0197d60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe19c00c920 tx=0x7fe19c00cde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:10.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:10.212+0000 7fe1967fc640 1 -- 172.21.15.172:0/3440378523 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe19c007c70 con 0x7fe1a0102660 2024-09-11T23:24:10.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:10.212+0000 7fe1967fc640 1 -- 172.21.15.172:0/3440378523 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe19c007e10 con 0x7fe1a0102660 2024-09-11T23:24:10.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:10.212+0000 7fe1967fc640 1 -- 172.21.15.172:0/3440378523 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe19c018820 con 0x7fe1a0102660 2024-09-11T23:24:10.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:10.212+0000 7fe1a731f640 1 -- 172.21.15.172:0/3440378523 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1a019fc80 con 0x7fe1a0102660 2024-09-11T23:24:10.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:10.212+0000 7fe1a731f640 1 -- 172.21.15.172:0/3440378523 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1a01a01c0 con 0x7fe1a0102660 2024-09-11T23:24:10.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:10.213+0000 7fe1a731f640 1 -- 172.21.15.172:0/3440378523 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1a00fdd70 con 0x7fe1a0102660 2024-09-11T23:24:10.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:10.215+0000 7fe1967fc640 1 -- 172.21.15.172:0/3440378523 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fe19c0189c0 con 0x7fe1a0102660 2024-09-11T23:24:10.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:10.216+0000 7fe1967fc640 1 --2- 172.21.15.172:0/3440378523 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe18c0a2c30 0x7fe18c0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:10.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:10.216+0000 7fe1967fc640 1 -- 172.21.15.172:0/3440378523 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5150+0+0 (secure 0 0 0) 0x7fe19c0ce7e0 con 0x7fe1a0102660 2024-09-11T23:24:10.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:10.216+0000 7fe1a48ba640 1 --2- 172.21.15.172:0/3440378523 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe18c0a2c30 0x7fe18c0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:10.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:10.217+0000 7fe1a48ba640 1 --2- 172.21.15.172:0/3440378523 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe18c0a2c30 0x7fe18c0a50f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe1a0199280 tx=0x7fe190005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:10.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:10.219+0000 7fe1967fc640 1 -- 172.21.15.172:0/3440378523 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe19c014030 con 0x7fe1a0102660 2024-09-11T23:24:10.298 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:09 smithi159 ceph-mon[34394]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:24:10.299 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:09 smithi159 ceph-mon[34394]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-11T23:24:10.299 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:09 smithi159 ceph-mon[34394]: osdmap e45: 8 total, 7 up, 8 in 2024-09-11T23:24:10.299 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:09 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:24:10.299 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:09 smithi159 ceph-mon[34394]: from='osd.7 [v2:172.21.15.159:6816/4222571927,v1:172.21.15.159:6817/4222571927]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-11T23:24:10.299 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:09 smithi159 ceph-mon[34394]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-11T23:24:10.299 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:09 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:10.299 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:09 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:10.299 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:09 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:24:10.299 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:09 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:24:10.299 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:09 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:24:10.299 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:09 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:10.299 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:09 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:24:10.299 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:09 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:24:10.300 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:09 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:10.403 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:10.402+0000 7fe1a731f640 1 -- 172.21.15.172:0/3440378523 --> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fe1a0062630 con 0x7fe18c0a2c30 2024-09-11T23:24:10.626 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:24:10 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:24:10.297+0000 7f41cfdc4640 -1 osd.7 0 waiting for initial osdmap 2024-09-11T23:24:10.626 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:24:10 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:24:10.305+0000 7f41c73d0640 -1 osd.7 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:24:11.112 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:10 smithi172 ceph-mon[34855]: Detected new or changed devices on smithi159 2024-09-11T23:24:11.112 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:10 smithi172 ceph-mon[34855]: Adjusting osd_memory_target on smithi159 to 5696M 2024-09-11T23:24:11.112 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:10 smithi172 ceph-mon[34855]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-11T23:24:11.112 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:10 smithi172 ceph-mon[34855]: osdmap e46: 8 total, 7 up, 8 in 2024-09-11T23:24:11.112 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:10 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:24:11.112 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:10 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:24:11.112 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:10 smithi172 ceph-mon[34855]: osdmap e47: 8 total, 7 up, 8 in 2024-09-11T23:24:11.113 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:10 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:24:11.113 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:10 smithi172 ceph-mon[34855]: from='osd.7 ' entity='osd.7' 2024-09-11T23:24:11.113 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:10 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:24:11.113 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:10 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:24:11.113 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:10 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:24:11.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:10 smithi005 ceph-mon[31201]: Detected new or changed devices on smithi159 2024-09-11T23:24:11.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:10 smithi005 ceph-mon[31201]: Adjusting osd_memory_target on smithi159 to 5696M 2024-09-11T23:24:11.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:10 smithi005 ceph-mon[31201]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-11T23:24:11.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:10 smithi005 ceph-mon[31201]: osdmap e46: 8 total, 7 up, 8 in 2024-09-11T23:24:11.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:10 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:24:11.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:10 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:24:11.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:10 smithi005 ceph-mon[31201]: osdmap e47: 8 total, 7 up, 8 in 2024-09-11T23:24:11.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:10 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:24:11.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:10 smithi005 ceph-mon[31201]: from='osd.7 ' entity='osd.7' 2024-09-11T23:24:11.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:10 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:24:11.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:10 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:24:11.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:10 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:24:11.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:10 smithi159 ceph-mon[34394]: Detected new or changed devices on smithi159 2024-09-11T23:24:11.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:10 smithi159 ceph-mon[34394]: Adjusting osd_memory_target on smithi159 to 5696M 2024-09-11T23:24:11.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:10 smithi159 ceph-mon[34394]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-11T23:24:11.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:10 smithi159 ceph-mon[34394]: osdmap e46: 8 total, 7 up, 8 in 2024-09-11T23:24:11.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:10 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:24:11.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:10 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:24:11.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:10 smithi159 ceph-mon[34394]: osdmap e47: 8 total, 7 up, 8 in 2024-09-11T23:24:11.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:10 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:24:11.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:10 smithi159 ceph-mon[34394]: from='osd.7 ' entity='osd.7' 2024-09-11T23:24:11.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:10 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:24:11.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:10 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:24:11.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:10 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:24:12.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:11 smithi172 ceph-mon[34855]: purged_snaps scrub starts 2024-09-11T23:24:12.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:11 smithi172 ceph-mon[34855]: purged_snaps scrub ok 2024-09-11T23:24:12.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:11 smithi172 ceph-mon[34855]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:24:12.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:11 smithi172 ceph-mon[34855]: from='client.24295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:24:12.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:11 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:24:12.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:11 smithi172 ceph-mon[34855]: osd.7 [v2:172.21.15.159:6816/4222571927,v1:172.21.15.159:6817/4222571927] boot 2024-09-11T23:24:12.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:11 smithi172 ceph-mon[34855]: osdmap e48: 8 total, 8 up, 8 in 2024-09-11T23:24:12.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:11 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:24:12.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:11 smithi005 ceph-mon[31201]: purged_snaps scrub starts 2024-09-11T23:24:12.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:11 smithi005 ceph-mon[31201]: purged_snaps scrub ok 2024-09-11T23:24:12.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:11 smithi005 ceph-mon[31201]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:24:12.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:11 smithi005 ceph-mon[31201]: from='client.24295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:24:12.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:11 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:24:12.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:11 smithi005 ceph-mon[31201]: osd.7 [v2:172.21.15.159:6816/4222571927,v1:172.21.15.159:6817/4222571927] boot 2024-09-11T23:24:12.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:11 smithi005 ceph-mon[31201]: osdmap e48: 8 total, 8 up, 8 in 2024-09-11T23:24:12.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:11 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:24:12.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:11 smithi159 ceph-mon[34394]: purged_snaps scrub starts 2024-09-11T23:24:12.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:11 smithi159 ceph-mon[34394]: purged_snaps scrub ok 2024-09-11T23:24:12.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:11 smithi159 ceph-mon[34394]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:24:12.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:11 smithi159 ceph-mon[34394]: from='client.24295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:24:12.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:11 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:24:12.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:11 smithi159 ceph-mon[34394]: osd.7 [v2:172.21.15.159:6816/4222571927,v1:172.21.15.159:6817/4222571927] boot 2024-09-11T23:24:12.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:11 smithi159 ceph-mon[34394]: osdmap e48: 8 total, 8 up, 8 in 2024-09-11T23:24:12.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:11 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:24:13.265 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:12 smithi172 ceph-mon[34855]: osdmap e49: 8 total, 8 up, 8 in 2024-09-11T23:24:13.265 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:12 smithi172 ceph-mon[34855]: from='client.? 172.21.15.172:0/2288772165' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "47f66651-614c-4613-9793-69c140dbf705"}]: dispatch 2024-09-11T23:24:13.265 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:12 smithi172 ceph-mon[34855]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "47f66651-614c-4613-9793-69c140dbf705"}]: dispatch 2024-09-11T23:24:13.265 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:12 smithi172 ceph-mon[34855]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "47f66651-614c-4613-9793-69c140dbf705"}]': finished 2024-09-11T23:24:13.265 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:12 smithi172 ceph-mon[34855]: osdmap e50: 9 total, 8 up, 9 in 2024-09-11T23:24:13.265 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:12 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:24:13.270 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:12 smithi159 ceph-mon[34394]: osdmap e49: 8 total, 8 up, 8 in 2024-09-11T23:24:13.271 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:12 smithi159 ceph-mon[34394]: from='client.? 172.21.15.172:0/2288772165' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "47f66651-614c-4613-9793-69c140dbf705"}]: dispatch 2024-09-11T23:24:13.271 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:12 smithi159 ceph-mon[34394]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "47f66651-614c-4613-9793-69c140dbf705"}]: dispatch 2024-09-11T23:24:13.271 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:12 smithi159 ceph-mon[34394]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "47f66651-614c-4613-9793-69c140dbf705"}]': finished 2024-09-11T23:24:13.271 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:12 smithi159 ceph-mon[34394]: osdmap e50: 9 total, 8 up, 9 in 2024-09-11T23:24:13.271 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:12 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:24:13.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:12 smithi005 ceph-mon[31201]: osdmap e49: 8 total, 8 up, 8 in 2024-09-11T23:24:13.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:12 smithi005 ceph-mon[31201]: from='client.? 172.21.15.172:0/2288772165' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "47f66651-614c-4613-9793-69c140dbf705"}]: dispatch 2024-09-11T23:24:13.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:12 smithi005 ceph-mon[31201]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "47f66651-614c-4613-9793-69c140dbf705"}]: dispatch 2024-09-11T23:24:13.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:12 smithi005 ceph-mon[31201]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "47f66651-614c-4613-9793-69c140dbf705"}]': finished 2024-09-11T23:24:13.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:12 smithi005 ceph-mon[31201]: osdmap e50: 9 total, 8 up, 9 in 2024-09-11T23:24:13.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:12 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:24:14.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:13 smithi159 ceph-mon[34394]: pgmap v170: 1 pgs: 1 remapped+peering; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:24:14.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:13 smithi159 ceph-mon[34394]: from='client.? 172.21.15.172:0/1488317528' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:24:14.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:13 smithi159 ceph-mon[34394]: osdmap e51: 9 total, 8 up, 9 in 2024-09-11T23:24:14.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:13 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:24:14.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:13 smithi172 ceph-mon[34855]: pgmap v170: 1 pgs: 1 remapped+peering; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:24:14.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:13 smithi172 ceph-mon[34855]: from='client.? 172.21.15.172:0/1488317528' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:24:14.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:13 smithi172 ceph-mon[34855]: osdmap e51: 9 total, 8 up, 9 in 2024-09-11T23:24:14.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:13 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:24:14.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:13 smithi005 ceph-mon[31201]: pgmap v170: 1 pgs: 1 remapped+peering; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:24:14.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:13 smithi005 ceph-mon[31201]: from='client.? 172.21.15.172:0/1488317528' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:24:14.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:13 smithi005 ceph-mon[31201]: osdmap e51: 9 total, 8 up, 9 in 2024-09-11T23:24:14.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:13 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:24:16.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:15 smithi005 ceph-mon[31201]: pgmap v173: 1 pgs: 1 remapped+peering; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:24:16.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:15 smithi005 ceph-mon[31201]: osdmap e52: 9 total, 8 up, 9 in 2024-09-11T23:24:16.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:15 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:24:16.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:15 smithi159 ceph-mon[34394]: pgmap v173: 1 pgs: 1 remapped+peering; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:24:16.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:15 smithi159 ceph-mon[34394]: osdmap e52: 9 total, 8 up, 9 in 2024-09-11T23:24:16.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:15 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:24:16.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:15 smithi172 ceph-mon[34855]: pgmap v173: 1 pgs: 1 remapped+peering; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:24:16.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:15 smithi172 ceph-mon[34855]: osdmap e52: 9 total, 8 up, 9 in 2024-09-11T23:24:16.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:15 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:24:18.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:17 smithi172 ceph-mon[34855]: pgmap v175: 1 pgs: 1 remapped+peering; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:24:18.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:17 smithi005 ceph-mon[31201]: pgmap v175: 1 pgs: 1 remapped+peering; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:24:18.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:17 smithi159 ceph-mon[34394]: pgmap v175: 1 pgs: 1 remapped+peering; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:24:20.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:19 smithi005 ceph-mon[31201]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:24:20.242 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:19 smithi172 ceph-mon[34855]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:24:20.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:19 smithi159 ceph-mon[34394]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:24:22.028 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:21 smithi172 ceph-mon[34855]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:24:22.028 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:21 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-11T23:24:22.028 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:21 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:24:22.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:21 smithi005 ceph-mon[31201]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:24:22.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:21 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-11T23:24:22.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:21 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:24:22.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:21 smithi159 ceph-mon[34394]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:24:22.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:21 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-11T23:24:22.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:21 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:24:23.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:22 smithi005 ceph-mon[31201]: Deploying daemon osd.8 on smithi172 2024-09-11T23:24:23.227 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:22 smithi172 ceph-mon[34855]: Deploying daemon osd.8 on smithi172 2024-09-11T23:24:23.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:22 smithi159 ceph-mon[34394]: Deploying daemon osd.8 on smithi172 2024-09-11T23:24:24.088 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:23 smithi172 ceph-mon[34855]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:24:24.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:23 smithi005 ceph-mon[31201]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:24:24.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:23 smithi159 ceph-mon[34394]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:24:26.079 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:25 smithi172 ceph-mon[34855]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:24:26.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:25 smithi005 ceph-mon[31201]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:24:26.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:25 smithi159 ceph-mon[34394]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:24:28.124 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:27 smithi172 ceph-mon[34855]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:24:28.124 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:27 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:24:28.125 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:27 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:28.125 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:27 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:28.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:27 smithi005 ceph-mon[31201]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:24:28.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:27 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:24:28.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:27 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:28.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:27 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:28.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:27 smithi159 ceph-mon[34394]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:24:28.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:27 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:24:28.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:27 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:28.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:27 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:30.084 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:29 smithi172 ceph-mon[34855]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:24:30.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:29 smithi005 ceph-mon[31201]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:24:30.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:29 smithi159 ceph-mon[34394]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:24:30.788 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 8 on host 'smithi172' 2024-09-11T23:24:30.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:30.788+0000 7fe1967fc640 1 -- 172.21.15.172:0/3440378523 <== mgr.14148 v2:172.21.15.5:6800/2285128668 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe1a0062630 con 0x7fe18c0a2c30 2024-09-11T23:24:30.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:30.791+0000 7fe1a731f640 1 -- 172.21.15.172:0/3440378523 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe18c0a2c30 msgr2=0x7fe18c0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:30.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:30.791+0000 7fe1a731f640 1 --2- 172.21.15.172:0/3440378523 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe18c0a2c30 0x7fe18c0a50f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe1a0199280 tx=0x7fe190005f90 comp rx=0 tx=0).stop 2024-09-11T23:24:30.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:30.791+0000 7fe1a731f640 1 -- 172.21.15.172:0/3440378523 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1a0102660 msgr2=0x7fe1a0197d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:30.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:30.791+0000 7fe1a731f640 1 --2- 172.21.15.172:0/3440378523 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1a0102660 0x7fe1a0197d60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe19c00c920 tx=0x7fe19c00cde0 comp rx=0 tx=0).stop 2024-09-11T23:24:30.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:30.791+0000 7fe1a731f640 1 -- 172.21.15.172:0/3440378523 shutdown_connections 2024-09-11T23:24:30.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:30.791+0000 7fe1a731f640 1 --2- 172.21.15.172:0/3440378523 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe18c0a2c30 0x7fe18c0a50f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:30.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:30.791+0000 7fe1a731f640 1 --2- 172.21.15.172:0/3440378523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1a01078c0 0x7fe1a019f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:30.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:30.791+0000 7fe1a731f640 1 --2- 172.21.15.172:0/3440378523 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1a0104f90 0x7fe1a01982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:30.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:30.791+0000 7fe1a731f640 1 --2- 172.21.15.172:0/3440378523 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1a0102660 0x7fe1a0197d60 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:30.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:30.791+0000 7fe1a731f640 1 -- 172.21.15.172:0/3440378523 >> 172.21.15.172:0/3440378523 conn(0x7fe1a00fc280 msgr2=0x7fe1a0102f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:30.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:30.791+0000 7fe1a731f640 1 -- 172.21.15.172:0/3440378523 shutdown_connections 2024-09-11T23:24:30.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:24:30.791+0000 7fe1a731f640 1 -- 172.21.15.172:0/3440378523 wait complete. 2024-09-11T23:24:31.435 DEBUG:teuthology.orchestra.run.smithi172:osd.8> sudo journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@osd.8.service 2024-09-11T23:24:31.438 INFO:tasks.cephadm:Deploying osd.9 on smithi005 with /dev/vg_nvme/lv_1... 2024-09-11T23:24:31.438 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-11T23:24:31.705 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:24:32.094 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:31 smithi005 ceph-mon[31201]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:24:32.094 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:31 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:32.095 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:31 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:32.095 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:31 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:32.095 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:31 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:32.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:31 smithi159 ceph-mon[34394]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:24:32.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:31 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:32.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:31 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:32.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:31 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:32.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:31 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:32.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:31 smithi172 ceph-mon[34855]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:24:32.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:31 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:32.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:31 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:32.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:31 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:32.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:31 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:33.785 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:24:33 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:24:33.417+0000 7f7398b07640 -1 osd.8 0 log_to_monitors true 2024-09-11T23:24:34.096 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:33 smithi172 ceph-mon[34855]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:24:34.096 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:33 smithi172 ceph-mon[34855]: from='osd.8 [v2:172.21.15.172:6816/3661505951,v1:172.21.15.172:6817/3661505951]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-11T23:24:34.096 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:33 smithi172 ceph-mon[34855]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-11T23:24:34.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:33 smithi159 ceph-mon[34394]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:24:34.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:33 smithi159 ceph-mon[34394]: from='osd.8 [v2:172.21.15.172:6816/3661505951,v1:172.21.15.172:6817/3661505951]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-11T23:24:34.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:33 smithi159 ceph-mon[34394]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-11T23:24:34.182 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:33 smithi005 ceph-mon[31201]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:24:34.182 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:33 smithi005 ceph-mon[31201]: from='osd.8 [v2:172.21.15.172:6816/3661505951,v1:172.21.15.172:6817/3661505951]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-11T23:24:34.182 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:33 smithi005 ceph-mon[31201]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-11T23:24:34.503 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:24:34.527 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi005:vg_nvme/lv_1 2024-09-11T23:24:34.782 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:24:35.061 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:34 smithi005 ceph-mon[31201]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-11T23:24:35.061 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:34 smithi005 ceph-mon[31201]: osdmap e53: 9 total, 8 up, 9 in 2024-09-11T23:24:35.061 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:34 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:24:35.061 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:34 smithi005 ceph-mon[31201]: from='osd.8 [v2:172.21.15.172:6816/3661505951,v1:172.21.15.172:6817/3661505951]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-11T23:24:35.061 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:34 smithi005 ceph-mon[31201]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-11T23:24:35.061 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:34 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:35.062 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:34 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:35.062 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:34 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:24:35.062 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:34 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:24:35.062 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:34 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:24:35.062 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:34 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:35.062 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:34 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:24:35.062 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:34 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:24:35.062 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:34 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:35.062 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:34 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:24:35.062 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:34 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:24:35.062 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:34 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:24:35.062 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:34 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:35.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:34 smithi159 ceph-mon[34394]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-11T23:24:35.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:34 smithi159 ceph-mon[34394]: osdmap e53: 9 total, 8 up, 9 in 2024-09-11T23:24:35.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:34 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:24:35.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:34 smithi159 ceph-mon[34394]: from='osd.8 [v2:172.21.15.172:6816/3661505951,v1:172.21.15.172:6817/3661505951]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-11T23:24:35.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:34 smithi159 ceph-mon[34394]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-11T23:24:35.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:34 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:35.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:34 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:35.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:34 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:24:35.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:34 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:24:35.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:34 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:24:35.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:34 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:35.128 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:34 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:24:35.128 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:34 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:24:35.128 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:34 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:35.128 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:34 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:24:35.128 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:34 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:24:35.128 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:34 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:24:35.128 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:34 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:35.134 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:24:34 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:24:34.803+0000 7f7394a8a640 -1 osd.8 0 waiting for initial osdmap 2024-09-11T23:24:35.134 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:24:34 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:24:34.812+0000 7f73908b2640 -1 osd.8 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:24:35.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:34 smithi172 ceph-mon[34855]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-11T23:24:35.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:34 smithi172 ceph-mon[34855]: osdmap e53: 9 total, 8 up, 9 in 2024-09-11T23:24:35.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:34 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:24:35.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:34 smithi172 ceph-mon[34855]: from='osd.8 [v2:172.21.15.172:6816/3661505951,v1:172.21.15.172:6817/3661505951]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-11T23:24:35.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:34 smithi172 ceph-mon[34855]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-11T23:24:35.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:34 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:35.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:34 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:35.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:34 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:24:35.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:34 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:24:35.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:34 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:24:35.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:34 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:35.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:34 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:24:35.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:34 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:24:35.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:34 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:35.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:34 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:24:35.136 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:34 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:24:35.136 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:34 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:24:35.136 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:34 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:35.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:35.256+0000 7ff02213f640 1 -- 172.21.15.5:0/1921967089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff01c102e00 msgr2=0x7ff01c103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:35.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:35.256+0000 7ff02213f640 1 --2- 172.21.15.5:0/1921967089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff01c102e00 0x7ff01c103280 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff010009900 tx=0x7ff01002a410 comp rx=0 tx=0).stop 2024-09-11T23:24:35.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:35.256+0000 7ff02213f640 1 -- 172.21.15.5:0/1921967089 shutdown_connections 2024-09-11T23:24:35.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:35.256+0000 7ff02213f640 1 --2- 172.21.15.5:0/1921967089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff01c1037c0 0x7ff01c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:35.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:35.256+0000 7ff02213f640 1 --2- 172.21.15.5:0/1921967089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff01c102e00 0x7ff01c103280 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:35.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:35.256+0000 7ff02213f640 1 --2- 172.21.15.5:0/1921967089 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff01c101c00 0x7ff01c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:35.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:35.256+0000 7ff02213f640 1 -- 172.21.15.5:0/1921967089 >> 172.21.15.5:0/1921967089 conn(0x7ff01c0fd390 msgr2=0x7ff01c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:35.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:35.256+0000 7ff02213f640 1 -- 172.21.15.5:0/1921967089 shutdown_connections 2024-09-11T23:24:35.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:35.256+0000 7ff02213f640 1 -- 172.21.15.5:0/1921967089 wait complete. 2024-09-11T23:24:35.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:35.257+0000 7ff02213f640 1 Processor -- start 2024-09-11T23:24:35.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:35.257+0000 7ff02213f640 1 -- start start 2024-09-11T23:24:35.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:35.257+0000 7ff02213f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff01c101c00 0x7ff01c197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:35.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:35.257+0000 7ff02213f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff01c102e00 0x7ff01c198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:35.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:35.257+0000 7ff02213f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff01c1037c0 0x7ff01c19f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:35.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:35.257+0000 7ff02213f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff01c10d710 con 0x7ff01c1037c0 2024-09-11T23:24:35.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:35.257+0000 7ff02213f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff01c10d590 con 0x7ff01c101c00 2024-09-11T23:24:35.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:35.257+0000 7ff02213f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff01c10d890 con 0x7ff01c102e00 2024-09-11T23:24:35.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:35.257+0000 7ff01bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff01c1037c0 0x7ff01c19f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:35.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:35.257+0000 7ff01bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff01c1037c0 0x7ff01c19f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42684/0 (socket says 172.21.15.5:42684) 2024-09-11T23:24:35.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:35.257+0000 7ff01bfff640 1 -- 172.21.15.5:0/4243517639 learned_addr learned my addr 172.21.15.5:0/4243517639 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:24:35.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:35.257+0000 7ff01b7fe640 1 --2- 172.21.15.5:0/4243517639 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff01c101c00 0x7ff01c197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:35.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:35.257+0000 7ff01affd640 1 --2- 172.21.15.5:0/4243517639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff01c102e00 0x7ff01c198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:35.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:35.258+0000 7ff01bfff640 1 -- 172.21.15.5:0/4243517639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff01c102e00 msgr2=0x7ff01c198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:35.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:35.258+0000 7ff01bfff640 1 --2- 172.21.15.5:0/4243517639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff01c102e00 0x7ff01c198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:35.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:35.258+0000 7ff01bfff640 1 -- 172.21.15.5:0/4243517639 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff01c101c00 msgr2=0x7ff01c197e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:35.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:35.258+0000 7ff01bfff640 1 --2- 172.21.15.5:0/4243517639 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff01c101c00 0x7ff01c197e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:35.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:35.258+0000 7ff01bfff640 1 -- 172.21.15.5:0/4243517639 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff01c19fa80 con 0x7ff01c1037c0 2024-09-11T23:24:35.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:35.258+0000 7ff01bfff640 1 --2- 172.21.15.5:0/4243517639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff01c1037c0 0x7ff01c19f410 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff014009fd0 tx=0x7ff01400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:35.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:35.258+0000 7ff018ff9640 1 -- 172.21.15.5:0/4243517639 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff014017070 con 0x7ff01c1037c0 2024-09-11T23:24:35.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:35.258+0000 7ff02213f640 1 -- 172.21.15.5:0/4243517639 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff01c19fd70 con 0x7ff01c1037c0 2024-09-11T23:24:35.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:35.258+0000 7ff018ff9640 1 -- 172.21.15.5:0/4243517639 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff014003e20 con 0x7ff01c1037c0 2024-09-11T23:24:35.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:35.258+0000 7ff018ff9640 1 -- 172.21.15.5:0/4243517639 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff014010460 con 0x7ff01c1037c0 2024-09-11T23:24:35.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:35.258+0000 7ff02213f640 1 -- 172.21.15.5:0/4243517639 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff01c1a0200 con 0x7ff01c1037c0 2024-09-11T23:24:35.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:35.259+0000 7ff02213f640 1 -- 172.21.15.5:0/4243517639 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff01c109090 con 0x7ff01c1037c0 2024-09-11T23:24:35.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:35.260+0000 7ff018ff9640 1 -- 172.21.15.5:0/4243517639 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7ff014003970 con 0x7ff01c1037c0 2024-09-11T23:24:35.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:35.261+0000 7ff018ff9640 1 --2- 172.21.15.5:0/4243517639 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7ff0040a2bb0 0x7ff0040a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:35.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:35.261+0000 7ff01b7fe640 1 --2- 172.21.15.5:0/4243517639 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7ff0040a2bb0 0x7ff0040a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:35.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:35.261+0000 7ff018ff9640 1 -- 172.21.15.5:0/4243517639 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5862+0+0 (secure 0 0 0) 0x7ff0140ce510 con 0x7ff01c1037c0 2024-09-11T23:24:35.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:35.261+0000 7ff01b7fe640 1 --2- 172.21.15.5:0/4243517639 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7ff0040a2bb0 0x7ff0040a5070 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff01c102c60 tx=0x7ff00c00b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:35.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:35.264+0000 7ff018ff9640 1 -- 172.21.15.5:0/4243517639 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff01409bd60 con 0x7ff01c1037c0 2024-09-11T23:24:35.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:35.453+0000 7ff02213f640 1 -- 172.21.15.5:0/4243517639 --> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7ff01c062630 con 0x7ff0040a2bb0 2024-09-11T23:24:36.099 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:35 smithi005 ceph-mon[31201]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:24:36.099 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:35 smithi005 ceph-mon[31201]: Detected new or changed devices on smithi172 2024-09-11T23:24:36.099 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:35 smithi005 ceph-mon[31201]: Adjusting osd_memory_target on smithi172 to 5696M 2024-09-11T23:24:36.099 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:35 smithi005 ceph-mon[31201]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-11T23:24:36.099 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:35 smithi005 ceph-mon[31201]: osdmap e54: 9 total, 8 up, 9 in 2024-09-11T23:24:36.099 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:35 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:24:36.100 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:35 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:24:36.100 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:35 smithi005 ceph-mon[31201]: osd.8 [v2:172.21.15.172:6816/3661505951,v1:172.21.15.172:6817/3661505951] boot 2024-09-11T23:24:36.100 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:35 smithi005 ceph-mon[31201]: osdmap e55: 9 total, 9 up, 9 in 2024-09-11T23:24:36.100 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:35 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:24:36.100 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:35 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:24:36.100 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:35 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:24:36.100 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:35 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:24:36.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:35 smithi159 ceph-mon[34394]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:24:36.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:35 smithi159 ceph-mon[34394]: Detected new or changed devices on smithi172 2024-09-11T23:24:36.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:35 smithi159 ceph-mon[34394]: Adjusting osd_memory_target on smithi172 to 5696M 2024-09-11T23:24:36.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:35 smithi159 ceph-mon[34394]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-11T23:24:36.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:35 smithi159 ceph-mon[34394]: osdmap e54: 9 total, 8 up, 9 in 2024-09-11T23:24:36.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:35 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:24:36.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:35 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:24:36.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:35 smithi159 ceph-mon[34394]: osd.8 [v2:172.21.15.172:6816/3661505951,v1:172.21.15.172:6817/3661505951] boot 2024-09-11T23:24:36.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:35 smithi159 ceph-mon[34394]: osdmap e55: 9 total, 9 up, 9 in 2024-09-11T23:24:36.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:35 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:24:36.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:35 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:24:36.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:35 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:24:36.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:35 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:24:36.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:35 smithi172 ceph-mon[34855]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:24:36.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:35 smithi172 ceph-mon[34855]: Detected new or changed devices on smithi172 2024-09-11T23:24:36.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:35 smithi172 ceph-mon[34855]: Adjusting osd_memory_target on smithi172 to 5696M 2024-09-11T23:24:36.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:35 smithi172 ceph-mon[34855]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-11T23:24:36.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:35 smithi172 ceph-mon[34855]: osdmap e54: 9 total, 8 up, 9 in 2024-09-11T23:24:36.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:35 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:24:36.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:35 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:24:36.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:35 smithi172 ceph-mon[34855]: osd.8 [v2:172.21.15.172:6816/3661505951,v1:172.21.15.172:6817/3661505951] boot 2024-09-11T23:24:36.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:35 smithi172 ceph-mon[34855]: osdmap e55: 9 total, 9 up, 9 in 2024-09-11T23:24:36.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:35 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:24:36.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:35 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:24:36.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:35 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:24:36.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:35 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:24:37.284 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:36 smithi005 ceph-mon[31201]: purged_snaps scrub starts 2024-09-11T23:24:37.284 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:36 smithi005 ceph-mon[31201]: purged_snaps scrub ok 2024-09-11T23:24:37.284 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:36 smithi005 ceph-mon[31201]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:24:37.284 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:36 smithi005 ceph-mon[31201]: osdmap e56: 9 total, 9 up, 9 in 2024-09-11T23:24:37.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:36 smithi159 ceph-mon[34394]: purged_snaps scrub starts 2024-09-11T23:24:37.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:36 smithi159 ceph-mon[34394]: purged_snaps scrub ok 2024-09-11T23:24:37.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:36 smithi159 ceph-mon[34394]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:24:37.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:36 smithi159 ceph-mon[34394]: osdmap e56: 9 total, 9 up, 9 in 2024-09-11T23:24:37.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:36 smithi172 ceph-mon[34855]: purged_snaps scrub starts 2024-09-11T23:24:37.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:36 smithi172 ceph-mon[34855]: purged_snaps scrub ok 2024-09-11T23:24:37.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:36 smithi172 ceph-mon[34855]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:24:37.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:36 smithi172 ceph-mon[34855]: osdmap e56: 9 total, 9 up, 9 in 2024-09-11T23:24:38.254 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:37 smithi005 ceph-mon[31201]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:24:38.254 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:37 smithi005 ceph-mon[31201]: osdmap e57: 9 total, 9 up, 9 in 2024-09-11T23:24:38.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:38 smithi159 ceph-mon[34394]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:24:38.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:38 smithi159 ceph-mon[34394]: osdmap e57: 9 total, 9 up, 9 in 2024-09-11T23:24:38.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:37 smithi172 ceph-mon[34855]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:24:38.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:37 smithi172 ceph-mon[34855]: osdmap e57: 9 total, 9 up, 9 in 2024-09-11T23:24:39.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:39 smithi159 ceph-mon[34394]: osdmap e58: 9 total, 9 up, 9 in 2024-09-11T23:24:39.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:39 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/654626780' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c97b8221-8cf9-4fab-9e27-ff7f3bd98152"}]: dispatch 2024-09-11T23:24:39.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:39 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/654626780' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c97b8221-8cf9-4fab-9e27-ff7f3bd98152"}]': finished 2024-09-11T23:24:39.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:39 smithi159 ceph-mon[34394]: osdmap e59: 10 total, 9 up, 10 in 2024-09-11T23:24:39.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:39 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:24:39.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:39 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/1478543057' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:24:39.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:39 smithi172 ceph-mon[34855]: osdmap e58: 9 total, 9 up, 9 in 2024-09-11T23:24:39.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:39 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/654626780' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c97b8221-8cf9-4fab-9e27-ff7f3bd98152"}]: dispatch 2024-09-11T23:24:39.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:39 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/654626780' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c97b8221-8cf9-4fab-9e27-ff7f3bd98152"}]': finished 2024-09-11T23:24:39.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:39 smithi172 ceph-mon[34855]: osdmap e59: 10 total, 9 up, 10 in 2024-09-11T23:24:39.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:39 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:24:39.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:39 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/1478543057' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:24:39.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:39 smithi005 ceph-mon[31201]: osdmap e58: 9 total, 9 up, 9 in 2024-09-11T23:24:39.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:39 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/654626780' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c97b8221-8cf9-4fab-9e27-ff7f3bd98152"}]: dispatch 2024-09-11T23:24:39.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:39 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/654626780' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c97b8221-8cf9-4fab-9e27-ff7f3bd98152"}]': finished 2024-09-11T23:24:39.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:39 smithi005 ceph-mon[31201]: osdmap e59: 10 total, 9 up, 10 in 2024-09-11T23:24:39.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:39 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:24:39.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:39 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/1478543057' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:24:40.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:40 smithi159 ceph-mon[34394]: pgmap v193: 1 pgs: 1 remapped+peering; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:24:40.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:40 smithi172 ceph-mon[34855]: pgmap v193: 1 pgs: 1 remapped+peering; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:24:40.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:40 smithi005 ceph-mon[31201]: pgmap v193: 1 pgs: 1 remapped+peering; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:24:42.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:42 smithi159 ceph-mon[34394]: pgmap v194: 1 pgs: 1 remapped+peering; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:24:42.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:42 smithi172 ceph-mon[34855]: pgmap v194: 1 pgs: 1 remapped+peering; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:24:42.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:42 smithi005 ceph-mon[31201]: pgmap v194: 1 pgs: 1 remapped+peering; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:24:44.321 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:44 smithi005 ceph-mon[31201]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T23:24:44.366 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:44 smithi172 ceph-mon[34855]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T23:24:44.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:44 smithi159 ceph-mon[34394]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T23:24:46.327 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:46 smithi005 ceph-mon[31201]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-11T23:24:46.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:46 smithi159 ceph-mon[34394]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-11T23:24:46.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:46 smithi172 ceph-mon[34855]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-11T23:24:48.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:48 smithi005 ceph-mon[31201]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-11T23:24:48.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:48 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-11T23:24:48.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:48 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:24:48.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:48 smithi159 ceph-mon[34394]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-11T23:24:48.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:48 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-11T23:24:48.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:48 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:24:48.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:48 smithi172 ceph-mon[34855]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-11T23:24:48.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:48 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-11T23:24:48.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:48 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:24:49.091 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:49 smithi005 ceph-mon[31201]: Deploying daemon osd.9 on smithi005 2024-09-11T23:24:49.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:49 smithi159 ceph-mon[34394]: Deploying daemon osd.9 on smithi005 2024-09-11T23:24:49.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:49 smithi172 ceph-mon[34855]: Deploying daemon osd.9 on smithi005 2024-09-11T23:24:50.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:50 smithi159 ceph-mon[34394]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-11T23:24:50.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:50 smithi172 ceph-mon[34855]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-11T23:24:50.387 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:50 smithi005 ceph-mon[31201]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-11T23:24:52.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:52 smithi005 ceph-mon[31201]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T23:24:52.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:52 smithi159 ceph-mon[34394]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T23:24:52.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:52 smithi172 ceph-mon[34855]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T23:24:54.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:54 smithi159 ceph-mon[34394]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T23:24:54.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:54 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:24:54.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:54 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:54.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:54 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:54.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:54 smithi172 ceph-mon[34855]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T23:24:54.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:54 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:24:54.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:54 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:54.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:54 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:54.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:54 smithi005 ceph-mon[31201]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T23:24:54.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:54 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:24:54.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:54 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:54.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:54 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:56.211 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:56 smithi005 ceph-mon[31201]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:24:56.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:56 smithi159 ceph-mon[34394]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:24:56.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:56 smithi172 ceph-mon[34855]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:24:56.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:56.963+0000 7ff018ff9640 1 -- 172.21.15.5:0/4243517639 <== mgr.14148 v2:172.21.15.5:6800/2285128668 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff01c062630 con 0x7ff0040a2bb0 2024-09-11T23:24:56.964 INFO:teuthology.orchestra.run.smithi005.stdout:Created osd(s) 9 on host 'smithi005' 2024-09-11T23:24:56.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:56.965+0000 7ff02213f640 1 -- 172.21.15.5:0/4243517639 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7ff0040a2bb0 msgr2=0x7ff0040a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:56.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:56.965+0000 7ff02213f640 1 --2- 172.21.15.5:0/4243517639 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7ff0040a2bb0 0x7ff0040a5070 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff01c102c60 tx=0x7ff00c00b390 comp rx=0 tx=0).stop 2024-09-11T23:24:56.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:56.965+0000 7ff02213f640 1 -- 172.21.15.5:0/4243517639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff01c1037c0 msgr2=0x7ff01c19f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:56.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:56.965+0000 7ff02213f640 1 --2- 172.21.15.5:0/4243517639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff01c1037c0 0x7ff01c19f410 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff014009fd0 tx=0x7ff01400b260 comp rx=0 tx=0).stop 2024-09-11T23:24:56.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:56.965+0000 7ff02213f640 1 -- 172.21.15.5:0/4243517639 shutdown_connections 2024-09-11T23:24:56.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:56.965+0000 7ff02213f640 1 --2- 172.21.15.5:0/4243517639 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7ff0040a2bb0 0x7ff0040a5070 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:56.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:56.965+0000 7ff02213f640 1 --2- 172.21.15.5:0/4243517639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff01c1037c0 0x7ff01c19f410 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:56.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:56.965+0000 7ff02213f640 1 --2- 172.21.15.5:0/4243517639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff01c102e00 0x7ff01c198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:56.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:56.965+0000 7ff02213f640 1 --2- 172.21.15.5:0/4243517639 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff01c101c00 0x7ff01c197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:56.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:56.965+0000 7ff02213f640 1 -- 172.21.15.5:0/4243517639 >> 172.21.15.5:0/4243517639 conn(0x7ff01c0fd390 msgr2=0x7ff01c106260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:56.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:56.966+0000 7ff02213f640 1 -- 172.21.15.5:0/4243517639 shutdown_connections 2024-09-11T23:24:56.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:24:56.966+0000 7ff02213f640 1 -- 172.21.15.5:0/4243517639 wait complete. 2024-09-11T23:24:57.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:57 smithi005 ceph-mon[31201]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:24:57.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:57 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:57.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:57 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:57.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:57 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:24:57.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:57 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:24:57.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:57 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:57.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:57 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:24:57.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:57 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:57.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:57 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:57.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:57 smithi159 ceph-mon[34394]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:24:57.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:57 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:57.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:57 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:57.627 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:57 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:24:57.627 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:57 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:24:57.627 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:57 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:57.627 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:57 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:24:57.627 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:57 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:57.627 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:57 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:57.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:57 smithi172 ceph-mon[34855]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:24:57.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:57 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:57.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:57 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:57.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:57 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:24:57.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:57 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:24:57.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:57 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:57.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:57 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:24:57.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:57 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:57.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:57 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:24:57.737 DEBUG:teuthology.orchestra.run.smithi005:osd.9> sudo journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@osd.9.service 2024-09-11T23:24:57.739 INFO:tasks.cephadm:Deploying osd.10 on smithi159 with /dev/vg_nvme/lv_1... 2024-09-11T23:24:57.740 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-11T23:24:57.998 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T23:24:59.323 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:59 smithi005 ceph-mon[31201]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:24:59.323 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:24:59 smithi005 ceph-mon[31201]: from='osd.9 [v2:172.21.15.5:6826/72036667,v1:172.21.15.5:6827/72036667]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-11T23:24:59.323 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:24:59 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:24:59.136+0000 7f7b997ed640 -1 osd.9 0 log_to_monitors true 2024-09-11T23:24:59.470 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:59 smithi159 ceph-mon[34394]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:24:59.470 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:24:59 smithi159 ceph-mon[34394]: from='osd.9 [v2:172.21.15.5:6826/72036667,v1:172.21.15.5:6827/72036667]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-11T23:24:59.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:59 smithi172 ceph-mon[34855]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:24:59.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:24:59 smithi172 ceph-mon[34855]: from='osd.9 [v2:172.21.15.5:6826/72036667,v1:172.21.15.5:6827/72036667]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-11T23:25:00.383 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:00 smithi005 ceph-mon[31201]: from='osd.9 [v2:172.21.15.5:6826/72036667,v1:172.21.15.5:6827/72036667]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-11T23:25:00.383 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:00 smithi005 ceph-mon[31201]: osdmap e60: 10 total, 9 up, 10 in 2024-09-11T23:25:00.384 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:00 smithi005 ceph-mon[31201]: from='osd.9 [v2:172.21.15.5:6826/72036667,v1:172.21.15.5:6827/72036667]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-09-11T23:25:00.384 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:00 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:25:00.384 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:00 smithi005 ceph-mon[31201]: from='osd.9 [v2:172.21.15.5:6826/72036667,v1:172.21.15.5:6827/72036667]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-09-11T23:25:00.593 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:00 smithi159 ceph-mon[34394]: from='osd.9 [v2:172.21.15.5:6826/72036667,v1:172.21.15.5:6827/72036667]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-11T23:25:00.593 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:00 smithi159 ceph-mon[34394]: osdmap e60: 10 total, 9 up, 10 in 2024-09-11T23:25:00.594 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:00 smithi159 ceph-mon[34394]: from='osd.9 [v2:172.21.15.5:6826/72036667,v1:172.21.15.5:6827/72036667]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-09-11T23:25:00.594 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:00 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:25:00.594 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:00 smithi159 ceph-mon[34394]: from='osd.9 [v2:172.21.15.5:6826/72036667,v1:172.21.15.5:6827/72036667]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-09-11T23:25:00.596 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-11T23:25:00.623 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi159:vg_nvme/lv_1 2024-09-11T23:25:00.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:00 smithi172 ceph-mon[34855]: from='osd.9 [v2:172.21.15.5:6826/72036667,v1:172.21.15.5:6827/72036667]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-11T23:25:00.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:00 smithi172 ceph-mon[34855]: osdmap e60: 10 total, 9 up, 10 in 2024-09-11T23:25:00.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:00 smithi172 ceph-mon[34855]: from='osd.9 [v2:172.21.15.5:6826/72036667,v1:172.21.15.5:6827/72036667]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-09-11T23:25:00.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:00 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:25:00.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:00 smithi172 ceph-mon[34855]: from='osd.9 [v2:172.21.15.5:6826/72036667,v1:172.21.15.5:6827/72036667]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-09-11T23:25:00.724 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:25:00 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:25:00.616+0000 7f7b95770640 -1 osd.9 0 waiting for initial osdmap 2024-09-11T23:25:00.724 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:25:00 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:25:00.626+0000 7f7b8d590640 -1 osd.9 61 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:25:00.882 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T23:25:01.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:01.358+0000 7f6a018dc640 1 -- 172.21.15.159:0/3548971242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69fc102660 msgr2=0x7f69fc104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:01.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:01.358+0000 7f6a018dc640 1 --2- 172.21.15.159:0/3548971242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69fc102660 0x7f69fc104a50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f69ec009900 tx=0x7f69ec02a410 comp rx=0 tx=0).stop 2024-09-11T23:25:01.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:01.358+0000 7f6a018dc640 1 -- 172.21.15.159:0/3548971242 shutdown_connections 2024-09-11T23:25:01.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:01.358+0000 7f6a018dc640 1 --2- 172.21.15.159:0/3548971242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69fc1078c0 0x7f69fc109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:01.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:01.358+0000 7f6a018dc640 1 --2- 172.21.15.159:0/3548971242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69fc104f90 0x7f69fc107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:01.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:01.358+0000 7f6a018dc640 1 --2- 172.21.15.159:0/3548971242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69fc102660 0x7f69fc104a50 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:01.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:01.358+0000 7f6a018dc640 1 -- 172.21.15.159:0/3548971242 >> 172.21.15.159:0/3548971242 conn(0x7f69fc0fc280 msgr2=0x7f69fc0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:01.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:01.358+0000 7f6a018dc640 1 -- 172.21.15.159:0/3548971242 shutdown_connections 2024-09-11T23:25:01.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:01.358+0000 7f6a018dc640 1 -- 172.21.15.159:0/3548971242 wait complete. 2024-09-11T23:25:01.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:01.359+0000 7f6a018dc640 1 Processor -- start 2024-09-11T23:25:01.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:01.359+0000 7f6a018dc640 1 -- start start 2024-09-11T23:25:01.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:01.359+0000 7f6a018dc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69fc102660 0x7f69fc197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:01.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:01.359+0000 7f6a018dc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69fc104f90 0x7f69fc198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:01.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:01.359+0000 7f6a018dc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69fc1078c0 0x7f69fc19f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:01.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:01.359+0000 7f6a018dc640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f69fc10d720 con 0x7f69fc1078c0 2024-09-11T23:25:01.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:01.359+0000 7f6a018dc640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f69fc10d5a0 con 0x7f69fc104f90 2024-09-11T23:25:01.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:01.359+0000 7f6a018dc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f69fc10d8a0 con 0x7f69fc102660 2024-09-11T23:25:01.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:01.359+0000 7f69fa7fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69fc104f90 0x7f69fc198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:01.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:01.359+0000 7f69fa7fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69fc104f90 0x7f69fc198350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:54450/0 (socket says 172.21.15.159:54450) 2024-09-11T23:25:01.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:01.359+0000 7f69fa7fc640 1 -- 172.21.15.159:0/989257024 learned_addr learned my addr 172.21.15.159:0/989257024 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-11T23:25:01.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:01.359+0000 7f69faffd640 1 --2- 172.21.15.159:0/989257024 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69fc102660 0x7f69fc197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:01.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:01.359+0000 7f69fb7fe640 1 --2- 172.21.15.159:0/989257024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69fc1078c0 0x7f69fc19f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:01.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:01.360+0000 7f69fa7fc640 1 -- 172.21.15.159:0/989257024 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69fc102660 msgr2=0x7f69fc197e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:01.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:01.360+0000 7f69fa7fc640 1 --2- 172.21.15.159:0/989257024 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69fc102660 0x7f69fc197e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:01.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:01.360+0000 7f69fa7fc640 1 -- 172.21.15.159:0/989257024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69fc1078c0 msgr2=0x7f69fc19f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:01.363 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:01.360+0000 7f69fa7fc640 1 --2- 172.21.15.159:0/989257024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69fc1078c0 0x7f69fc19f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:01.363 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:01.360+0000 7f69fa7fc640 1 -- 172.21.15.159:0/989257024 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69fc19fa40 con 0x7f69fc104f90 2024-09-11T23:25:01.363 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:01.360+0000 7f69fb7fe640 1 --2- 172.21.15.159:0/989257024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69fc1078c0 0x7f69fc19f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:25:01.363 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:01.360+0000 7f69fa7fc640 1 --2- 172.21.15.159:0/989257024 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69fc104f90 0x7f69fc198350 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f69f000e9c0 tx=0x7f69f000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:01.363 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:01.360+0000 7f6a008da640 1 -- 172.21.15.159:0/989257024 <== mon.2 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f000cd80 con 0x7f69fc104f90 2024-09-11T23:25:01.363 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:01.360+0000 7f6a008da640 1 -- 172.21.15.159:0/989257024 <== mon.2 v2:172.21.15.159:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f69f00054d0 con 0x7f69fc104f90 2024-09-11T23:25:01.363 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:01.360+0000 7f6a018dc640 1 -- 172.21.15.159:0/989257024 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69fc19fd30 con 0x7f69fc104f90 2024-09-11T23:25:01.363 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:01.360+0000 7f6a008da640 1 -- 172.21.15.159:0/989257024 <== mon.2 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f0010430 con 0x7f69fc104f90 2024-09-11T23:25:01.363 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:01.360+0000 7f6a018dc640 1 -- 172.21.15.159:0/989257024 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69fc1a0260 con 0x7f69fc104f90 2024-09-11T23:25:01.363 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:01.361+0000 7f6a018dc640 1 -- 172.21.15.159:0/989257024 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69fc0fdd70 con 0x7f69fc104f90 2024-09-11T23:25:01.364 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:01.363+0000 7f6a008da640 1 -- 172.21.15.159:0/989257024 <== mon.2 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f69f0004f90 con 0x7f69fc104f90 2024-09-11T23:25:01.364 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:01.364+0000 7f6a008da640 1 --2- 172.21.15.159:0/989257024 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f69e40a2c30 0x7f69e40a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:01.364 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:01.364+0000 7f6a008da640 1 -- 172.21.15.159:0/989257024 <== mon.2 v2:172.21.15.159:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5981+0+0 (secure 0 0 0) 0x7f69f00ceb10 con 0x7f69fc104f90 2024-09-11T23:25:01.364 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:01.364+0000 7f69faffd640 1 --2- 172.21.15.159:0/989257024 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f69e40a2c30 0x7f69e40a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:01.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:01.365+0000 7f69faffd640 1 --2- 172.21.15.159:0/989257024 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f69e40a2c30 0x7f69e40a50f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f69ec006010 tx=0x7f69ec000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:01.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:01.368+0000 7f6a008da640 1 -- 172.21.15.159:0/989257024 <== mon.2 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f69f009c390 con 0x7f69fc104f90 2024-09-11T23:25:01.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:01 smithi005 ceph-mon[31201]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:25:01.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:01 smithi005 ceph-mon[31201]: osdmap e61: 10 total, 9 up, 10 in 2024-09-11T23:25:01.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:01 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:25:01.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:01 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:25:01.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:01 smithi005 ceph-mon[31201]: from='osd.9 [v2:172.21.15.5:6826/72036667,v1:172.21.15.5:6827/72036667]' entity='osd.9' 2024-09-11T23:25:01.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:01 smithi005 ceph-mon[31201]: Detected new or changed devices on smithi005 2024-09-11T23:25:01.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:01 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:01.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:01 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:01.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:01 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:01.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:01 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:01.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:01 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:01.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:01 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:01.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:01 smithi005 ceph-mon[31201]: Adjusting osd_memory_target on smithi005 to 4273M 2024-09-11T23:25:01.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:01 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:01.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:01 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:25:01.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:01 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:25:01.476 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:01 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:01.476 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:01 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:25:01.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:01.549+0000 7f6a018dc640 1 -- 172.21.15.159:0/989257024 --> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f69fc062630 con 0x7f69e40a2c30 2024-09-11T23:25:01.549 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:01 smithi159 ceph-mon[34394]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:25:01.550 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:01 smithi159 ceph-mon[34394]: osdmap e61: 10 total, 9 up, 10 in 2024-09-11T23:25:01.550 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:01 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:25:01.550 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:01 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:25:01.550 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:01 smithi159 ceph-mon[34394]: from='osd.9 [v2:172.21.15.5:6826/72036667,v1:172.21.15.5:6827/72036667]' entity='osd.9' 2024-09-11T23:25:01.550 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:01 smithi159 ceph-mon[34394]: Detected new or changed devices on smithi005 2024-09-11T23:25:01.550 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:01 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:01.550 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:01 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:01.550 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:01 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:01.550 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:01 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:01.550 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:01 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:01.550 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:01 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:01.550 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:01 smithi159 ceph-mon[34394]: Adjusting osd_memory_target on smithi005 to 4273M 2024-09-11T23:25:01.550 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:01 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:01.551 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:01 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:25:01.551 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:01 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:25:01.551 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:01 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:01.551 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:01 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:25:01.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:01 smithi172 ceph-mon[34855]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:25:01.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:01 smithi172 ceph-mon[34855]: osdmap e61: 10 total, 9 up, 10 in 2024-09-11T23:25:01.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:01 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:25:01.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:01 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:25:01.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:01 smithi172 ceph-mon[34855]: from='osd.9 [v2:172.21.15.5:6826/72036667,v1:172.21.15.5:6827/72036667]' entity='osd.9' 2024-09-11T23:25:01.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:01 smithi172 ceph-mon[34855]: Detected new or changed devices on smithi005 2024-09-11T23:25:01.635 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:01 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:01.635 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:01 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:01.635 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:01 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:01.635 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:01 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:01.635 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:01 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:01.635 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:01 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:01.635 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:01 smithi172 ceph-mon[34855]: Adjusting osd_memory_target on smithi005 to 4273M 2024-09-11T23:25:01.635 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:01 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:01.635 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:01 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:25:01.635 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:01 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:25:01.635 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:01 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:01.635 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:01 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:25:02.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:02 smithi005 ceph-mon[31201]: purged_snaps scrub starts 2024-09-11T23:25:02.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:02 smithi005 ceph-mon[31201]: purged_snaps scrub ok 2024-09-11T23:25:02.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:02 smithi005 ceph-mon[31201]: from='client.24344 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:25:02.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:02 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:25:02.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:02 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:25:02.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:02 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:25:02.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:02 smithi005 ceph-mon[31201]: osd.9 [v2:172.21.15.5:6826/72036667,v1:172.21.15.5:6827/72036667] boot 2024-09-11T23:25:02.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:02 smithi005 ceph-mon[31201]: osdmap e62: 10 total, 10 up, 10 in 2024-09-11T23:25:02.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:02 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:25:02.535 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:02 smithi172 ceph-mon[34855]: purged_snaps scrub starts 2024-09-11T23:25:02.536 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:02 smithi172 ceph-mon[34855]: purged_snaps scrub ok 2024-09-11T23:25:02.536 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:02 smithi172 ceph-mon[34855]: from='client.24344 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:25:02.536 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:02 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:25:02.536 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:02 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:25:02.536 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:02 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:25:02.536 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:02 smithi172 ceph-mon[34855]: osd.9 [v2:172.21.15.5:6826/72036667,v1:172.21.15.5:6827/72036667] boot 2024-09-11T23:25:02.536 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:02 smithi172 ceph-mon[34855]: osdmap e62: 10 total, 10 up, 10 in 2024-09-11T23:25:02.536 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:02 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:25:02.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:02 smithi159 ceph-mon[34394]: purged_snaps scrub starts 2024-09-11T23:25:02.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:02 smithi159 ceph-mon[34394]: purged_snaps scrub ok 2024-09-11T23:25:02.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:02 smithi159 ceph-mon[34394]: from='client.24344 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:25:02.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:02 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:25:02.627 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:02 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:25:02.627 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:02 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:25:02.627 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:02 smithi159 ceph-mon[34394]: osd.9 [v2:172.21.15.5:6826/72036667,v1:172.21.15.5:6827/72036667] boot 2024-09-11T23:25:02.627 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:02 smithi159 ceph-mon[34394]: osdmap e62: 10 total, 10 up, 10 in 2024-09-11T23:25:02.627 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:02 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:25:03.812 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:03 smithi159 ceph-mon[34394]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:25:03.812 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:03 smithi159 ceph-mon[34394]: osdmap e63: 10 total, 10 up, 10 in 2024-09-11T23:25:03.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:03 smithi172 ceph-mon[34855]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:25:03.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:03 smithi172 ceph-mon[34855]: osdmap e63: 10 total, 10 up, 10 in 2024-09-11T23:25:03.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:03 smithi005 ceph-mon[31201]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:25:03.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:03 smithi005 ceph-mon[31201]: osdmap e63: 10 total, 10 up, 10 in 2024-09-11T23:25:04.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:04 smithi172 ceph-mon[34855]: from='client.? 172.21.15.159:0/3253968810' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "143376c1-f3f1-4df4-bcd3-a9b46fad8c1b"}]: dispatch 2024-09-11T23:25:04.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:04 smithi172 ceph-mon[34855]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "143376c1-f3f1-4df4-bcd3-a9b46fad8c1b"}]: dispatch 2024-09-11T23:25:04.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:04 smithi172 ceph-mon[34855]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "143376c1-f3f1-4df4-bcd3-a9b46fad8c1b"}]': finished 2024-09-11T23:25:04.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:04 smithi172 ceph-mon[34855]: osdmap e64: 11 total, 10 up, 11 in 2024-09-11T23:25:04.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:04 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:25:04.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:04 smithi005 ceph-mon[31201]: from='client.? 172.21.15.159:0/3253968810' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "143376c1-f3f1-4df4-bcd3-a9b46fad8c1b"}]: dispatch 2024-09-11T23:25:04.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:04 smithi005 ceph-mon[31201]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "143376c1-f3f1-4df4-bcd3-a9b46fad8c1b"}]: dispatch 2024-09-11T23:25:04.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:04 smithi005 ceph-mon[31201]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "143376c1-f3f1-4df4-bcd3-a9b46fad8c1b"}]': finished 2024-09-11T23:25:04.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:04 smithi005 ceph-mon[31201]: osdmap e64: 11 total, 10 up, 11 in 2024-09-11T23:25:04.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:04 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:25:05.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:04 smithi159 ceph-mon[34394]: from='client.? 172.21.15.159:0/3253968810' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "143376c1-f3f1-4df4-bcd3-a9b46fad8c1b"}]: dispatch 2024-09-11T23:25:05.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:04 smithi159 ceph-mon[34394]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "143376c1-f3f1-4df4-bcd3-a9b46fad8c1b"}]: dispatch 2024-09-11T23:25:05.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:04 smithi159 ceph-mon[34394]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "143376c1-f3f1-4df4-bcd3-a9b46fad8c1b"}]': finished 2024-09-11T23:25:05.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:04 smithi159 ceph-mon[34394]: osdmap e64: 11 total, 10 up, 11 in 2024-09-11T23:25:05.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:04 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:25:05.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:05 smithi172 ceph-mon[34855]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:25:05.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:05 smithi172 ceph-mon[34855]: from='client.? 172.21.15.159:0/928368767' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:25:05.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:05 smithi005 ceph-mon[31201]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:25:05.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:05 smithi005 ceph-mon[31201]: from='client.? 172.21.15.159:0/928368767' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:25:06.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:05 smithi159 ceph-mon[34394]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:25:06.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:05 smithi159 ceph-mon[34394]: from='client.? 172.21.15.159:0/928368767' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:25:07.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:07 smithi005 ceph-mon[31201]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:25:08.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:07 smithi159 ceph-mon[34394]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:25:08.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:07 smithi172 ceph-mon[34855]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:25:09.800 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:09 smithi159 ceph-mon[34394]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:25:09.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:09 smithi005 ceph-mon[31201]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:25:10.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:09 smithi172 ceph-mon[34855]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:25:11.913 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:11 smithi159 ceph-mon[34394]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:25:11.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:11 smithi005 ceph-mon[31201]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:25:12.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:11 smithi172 ceph-mon[34855]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:25:13.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:13 smithi005 ceph-mon[31201]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:25:13.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:13 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-11T23:25:13.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:13 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:25:13.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:13 smithi005 ceph-mon[31201]: Deploying daemon osd.10 on smithi159 2024-09-11T23:25:14.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:13 smithi159 ceph-mon[34394]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:25:14.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:13 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-11T23:25:14.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:13 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:25:14.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:13 smithi159 ceph-mon[34394]: Deploying daemon osd.10 on smithi159 2024-09-11T23:25:14.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:13 smithi172 ceph-mon[34855]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:25:14.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:13 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-11T23:25:14.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:13 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:25:14.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:13 smithi172 ceph-mon[34855]: Deploying daemon osd.10 on smithi159 2024-09-11T23:25:15.929 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:15 smithi159 ceph-mon[34394]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:25:15.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:15 smithi005 ceph-mon[31201]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:25:16.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:15 smithi172 ceph-mon[34855]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:25:17.911 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:17 smithi159 ceph-mon[34394]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:25:17.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:17 smithi005 ceph-mon[31201]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:25:18.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:17 smithi172 ceph-mon[34855]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:25:18.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:18 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:25:18.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:18 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:18.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:18 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:18.988 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:18 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:25:18.989 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:18 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:18.989 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:18 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:19.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:18 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:25:19.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:18 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:19.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:18 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:19.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:19 smithi005 ceph-mon[31201]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:25:19.977 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:19 smithi159 ceph-mon[34394]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:25:20.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:19 smithi172 ceph-mon[34855]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:25:21.869 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:21 smithi159 ceph-mon[34394]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:25:21.869 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:21 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:21.869 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:21 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:21.869 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:21 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:25:21.869 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:21 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:25:21.869 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:21 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:21.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:21 smithi005 ceph-mon[31201]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:25:21.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:21 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:21.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:21 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:21.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:21 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:25:21.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:21 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:25:21.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:21 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:22.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:21 smithi172 ceph-mon[34855]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:25:22.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:21 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:22.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:21 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:22.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:21 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:25:22.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:21 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:25:22.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:21 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:22.203 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:22.203+0000 7f6a008da640 1 -- 172.21.15.159:0/989257024 <== mgr.14148 v2:172.21.15.5:6800/2285128668 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f69fc062630 con 0x7f69e40a2c30 2024-09-11T23:25:22.203 INFO:teuthology.orchestra.run.smithi159.stdout:Created osd(s) 10 on host 'smithi159' 2024-09-11T23:25:22.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:22.205+0000 7f6a018dc640 1 -- 172.21.15.159:0/989257024 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f69e40a2c30 msgr2=0x7f69e40a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:22.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:22.205+0000 7f6a018dc640 1 --2- 172.21.15.159:0/989257024 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f69e40a2c30 0x7f69e40a50f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f69ec006010 tx=0x7f69ec000bc0 comp rx=0 tx=0).stop 2024-09-11T23:25:22.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:22.205+0000 7f6a018dc640 1 -- 172.21.15.159:0/989257024 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69fc104f90 msgr2=0x7f69fc198350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:22.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:22.205+0000 7f6a018dc640 1 --2- 172.21.15.159:0/989257024 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69fc104f90 0x7f69fc198350 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f69f000e9c0 tx=0x7f69f000ee80 comp rx=0 tx=0).stop 2024-09-11T23:25:22.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:22.205+0000 7f6a018dc640 1 -- 172.21.15.159:0/989257024 shutdown_connections 2024-09-11T23:25:22.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:22.205+0000 7f6a018dc640 1 --2- 172.21.15.159:0/989257024 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f69e40a2c30 0x7f69e40a50f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:22.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:22.205+0000 7f6a018dc640 1 --2- 172.21.15.159:0/989257024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69fc1078c0 0x7f69fc19f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:22.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:22.205+0000 7f6a018dc640 1 --2- 172.21.15.159:0/989257024 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69fc104f90 0x7f69fc198350 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:22.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:22.205+0000 7f6a018dc640 1 --2- 172.21.15.159:0/989257024 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69fc102660 0x7f69fc197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:22.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:22.205+0000 7f6a018dc640 1 -- 172.21.15.159:0/989257024 >> 172.21.15.159:0/989257024 conn(0x7f69fc0fc280 msgr2=0x7f69fc102f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:22.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:22.205+0000 7f6a018dc640 1 -- 172.21.15.159:0/989257024 shutdown_connections 2024-09-11T23:25:22.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-11T23:25:22.205+0000 7f6a018dc640 1 -- 172.21.15.159:0/989257024 wait complete. 2024-09-11T23:25:22.874 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:22 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:25:22.875 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:22 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:22.875 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:22 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:22.902 DEBUG:teuthology.orchestra.run.smithi159:osd.10> sudo journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@osd.10.service 2024-09-11T23:25:22.905 INFO:tasks.cephadm:Deploying osd.11 on smithi172 with /dev/vg_nvme/lv_1... 2024-09-11T23:25:22.905 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-11T23:25:22.933 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:22 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:25:22.933 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:22 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:22.933 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:22 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:22.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:22 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:25:22.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:22 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:22.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:22 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:23.162 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:25:23.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:23 smithi172 ceph-mon[34855]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:25:23.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:23 smithi005 ceph-mon[31201]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:25:24.058 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:23 smithi159 ceph-mon[34394]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:25:24.596 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:25:24 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:25:24.335+0000 7f49c5773640 -1 osd.10 0 log_to_monitors true 2024-09-11T23:25:24.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:24 smithi159 ceph-mon[34394]: from='osd.10 [v2:172.21.15.159:6824/3334483164,v1:172.21.15.159:6825/3334483164]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-11T23:25:24.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:24 smithi159 ceph-mon[34394]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-11T23:25:24.964 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:24 smithi172 ceph-mon[34855]: from='osd.10 [v2:172.21.15.159:6824/3334483164,v1:172.21.15.159:6825/3334483164]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-11T23:25:24.964 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:24 smithi172 ceph-mon[34855]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-11T23:25:24.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:24 smithi005 ceph-mon[31201]: from='osd.10 [v2:172.21.15.159:6824/3334483164,v1:172.21.15.159:6825/3334483164]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-11T23:25:24.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:24 smithi005 ceph-mon[31201]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-11T23:25:25.695 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:25:25 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:25:25.684+0000 7f49c16f6640 -1 osd.10 0 waiting for initial osdmap 2024-09-11T23:25:25.695 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:25 smithi159 ceph-mon[34394]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:25:25.695 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:25 smithi159 ceph-mon[34394]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-11T23:25:25.695 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:25 smithi159 ceph-mon[34394]: osdmap e65: 11 total, 10 up, 11 in 2024-09-11T23:25:25.696 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:25 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:25:25.696 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:25 smithi159 ceph-mon[34394]: from='osd.10 [v2:172.21.15.159:6824/3334483164,v1:172.21.15.159:6825/3334483164]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-11T23:25:25.696 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:25 smithi159 ceph-mon[34394]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-11T23:25:25.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:25 smithi005 ceph-mon[31201]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:25:25.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:25 smithi005 ceph-mon[31201]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-11T23:25:25.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:25 smithi005 ceph-mon[31201]: osdmap e65: 11 total, 10 up, 11 in 2024-09-11T23:25:25.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:25 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:25:25.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:25 smithi005 ceph-mon[31201]: from='osd.10 [v2:172.21.15.159:6824/3334483164,v1:172.21.15.159:6825/3334483164]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-11T23:25:25.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:25 smithi005 ceph-mon[31201]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-11T23:25:26.107 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:25 smithi172 ceph-mon[34855]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:25:26.107 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:25 smithi172 ceph-mon[34855]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-11T23:25:26.107 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:25 smithi172 ceph-mon[34855]: osdmap e65: 11 total, 10 up, 11 in 2024-09-11T23:25:26.107 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:25 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:25:26.107 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:25 smithi172 ceph-mon[34855]: from='osd.10 [v2:172.21.15.159:6824/3334483164,v1:172.21.15.159:6825/3334483164]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-11T23:25:26.107 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:25 smithi172 ceph-mon[34855]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-11T23:25:26.113 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-11T23:25:26.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:25:25 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:25:25.695+0000 7f49bd51e640 -1 osd.10 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:25:26.138 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi172:vg_nvme/lv_1 2024-09-11T23:25:26.426 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:25:26.870 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:26 smithi172 ceph-mon[34855]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-11T23:25:26.870 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:26 smithi172 ceph-mon[34855]: osdmap e66: 11 total, 10 up, 11 in 2024-09-11T23:25:26.870 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:26 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:25:26.870 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:26 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:25:26.870 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:26 smithi172 ceph-mon[34855]: Detected new or changed devices on smithi159 2024-09-11T23:25:26.870 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:26 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:26.870 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:26 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:26.870 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:26 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:26.870 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:26 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:26.870 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:26 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:26.870 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:26 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:26.871 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:26 smithi172 ceph-mon[34855]: Adjusting osd_memory_target on smithi159 to 4272M 2024-09-11T23:25:26.871 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:26 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:26.871 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:26 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:25:26.871 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:26 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:25:26.871 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:26 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:26.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:26.869+0000 7f5cbb828640 1 -- 172.21.15.172:0/2422460309 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5cb4100b10 msgr2=0x7f5cb4100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:26.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:26.869+0000 7f5cbb828640 1 --2- 172.21.15.172:0/2422460309 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5cb4100b10 0x7f5cb4100f10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5ca8009900 tx=0x7f5ca802a410 comp rx=0 tx=0).stop 2024-09-11T23:25:26.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:26.869+0000 7f5cbb828640 1 -- 172.21.15.172:0/2422460309 shutdown_connections 2024-09-11T23:25:26.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:26.869+0000 7f5cbb828640 1 --2- 172.21.15.172:0/2422460309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cb41026d0 0x7f5cb4108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:26.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:26.869+0000 7f5cbb828640 1 --2- 172.21.15.172:0/2422460309 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cb4101d10 0x7f5cb4102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:26.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:26.869+0000 7f5cbb828640 1 --2- 172.21.15.172:0/2422460309 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5cb4100b10 0x7f5cb4100f10 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:26.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:26.869+0000 7f5cbb828640 1 -- 172.21.15.172:0/2422460309 >> 172.21.15.172:0/2422460309 conn(0x7f5cb40fc2a0 msgr2=0x7f5cb40fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:26.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:26.869+0000 7f5cbb828640 1 -- 172.21.15.172:0/2422460309 shutdown_connections 2024-09-11T23:25:26.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:26.869+0000 7f5cbb828640 1 -- 172.21.15.172:0/2422460309 wait complete. 2024-09-11T23:25:26.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:26.870+0000 7f5cbb828640 1 Processor -- start 2024-09-11T23:25:26.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:26.870+0000 7f5cbb828640 1 -- start start 2024-09-11T23:25:26.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:26.870+0000 7f5cbb828640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cb4100b10 0x7f5cb4195690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:26.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:26.870+0000 7f5cbb828640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cb4101d10 0x7f5cb4195bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:26.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:26.870+0000 7f5cbb828640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5cb41026d0 0x7f5cb41921f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:26.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:26.870+0000 7f5cbb828640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb410c640 con 0x7f5cb4101d10 2024-09-11T23:25:26.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:26.870+0000 7f5cbb828640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb410c4c0 con 0x7f5cb4100b10 2024-09-11T23:25:26.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:26.870+0000 7f5cbb828640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb410c7c0 con 0x7f5cb41026d0 2024-09-11T23:25:26.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:26.870+0000 7f5cb9dc5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5cb41026d0 0x7f5cb41921f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:26.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:26.870+0000 7f5cb9dc5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5cb41026d0 0x7f5cb41921f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54390/0 (socket says 172.21.15.172:54390) 2024-09-11T23:25:26.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:26.870+0000 7f5cb9dc5640 1 -- 172.21.15.172:0/4193058286 learned_addr learned my addr 172.21.15.172:0/4193058286 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-11T23:25:26.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:26.871+0000 7f5cb8dc3640 1 --2- 172.21.15.172:0/4193058286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cb4101d10 0x7f5cb4195bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:26.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:26.871+0000 7f5cb95c4640 1 --2- 172.21.15.172:0/4193058286 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cb4100b10 0x7f5cb4195690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:26.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:26.871+0000 7f5cb9dc5640 1 -- 172.21.15.172:0/4193058286 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cb4100b10 msgr2=0x7f5cb4195690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:26.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:26.871+0000 7f5cb9dc5640 1 --2- 172.21.15.172:0/4193058286 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cb4100b10 0x7f5cb4195690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:26.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:26.871+0000 7f5cb9dc5640 1 -- 172.21.15.172:0/4193058286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cb4101d10 msgr2=0x7f5cb4195bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:26.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:26.871+0000 7f5cb9dc5640 1 --2- 172.21.15.172:0/4193058286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cb4101d10 0x7f5cb4195bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:26.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:26.871+0000 7f5cb9dc5640 1 -- 172.21.15.172:0/4193058286 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cb4192ab0 con 0x7f5cb41026d0 2024-09-11T23:25:26.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:26.871+0000 7f5cb8dc3640 1 --2- 172.21.15.172:0/4193058286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cb4101d10 0x7f5cb4195bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:25:26.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:26.871+0000 7f5cb9dc5640 1 --2- 172.21.15.172:0/4193058286 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5cb41026d0 0x7f5cb41921f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5cac009fd0 tx=0x7f5cac00b260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:26.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:26.871+0000 7f5ca67fc640 1 -- 172.21.15.172:0/4193058286 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cac017070 con 0x7f5cb41026d0 2024-09-11T23:25:26.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:26.871+0000 7f5ca67fc640 1 -- 172.21.15.172:0/4193058286 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5cac003e20 con 0x7f5cb41026d0 2024-09-11T23:25:26.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:26.871+0000 7f5ca67fc640 1 -- 172.21.15.172:0/4193058286 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cac010460 con 0x7f5cb41026d0 2024-09-11T23:25:26.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:26.871+0000 7f5cbb828640 1 -- 172.21.15.172:0/4193058286 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cb41a64e0 con 0x7f5cb41026d0 2024-09-11T23:25:26.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:26.871+0000 7f5cbb828640 1 -- 172.21.15.172:0/4193058286 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cb41a6880 con 0x7f5cb41026d0 2024-09-11T23:25:26.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:26.872+0000 7f5cbb828640 1 -- 172.21.15.172:0/4193058286 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cb4100f10 con 0x7f5cb41026d0 2024-09-11T23:25:26.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:26.873+0000 7f5ca67fc640 1 -- 172.21.15.172:0/4193058286 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f5cac003970 con 0x7f5cb41026d0 2024-09-11T23:25:26.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:26.874+0000 7f5ca67fc640 1 --2- 172.21.15.172:0/4193058286 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f5ca00a2b80 0x7f5ca00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:26.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:26.874+0000 7f5ca67fc640 1 -- 172.21.15.172:0/4193058286 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6727+0+0 (secure 0 0 0) 0x7f5cac0ce910 con 0x7f5cb41026d0 2024-09-11T23:25:26.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:26.874+0000 7f5cb95c4640 1 --2- 172.21.15.172:0/4193058286 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f5ca00a2b80 0x7f5ca00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:26.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:26.875+0000 7f5cb95c4640 1 --2- 172.21.15.172:0/4193058286 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f5ca00a2b80 0x7f5ca00a5040 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5ca8000c00 tx=0x7f5ca80314a0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:26.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:26.879+0000 7f5ca67fc640 1 -- 172.21.15.172:0/4193058286 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5cac09bea0 con 0x7f5cb41026d0 2024-09-11T23:25:26.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:26 smithi005 ceph-mon[31201]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-11T23:25:26.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:26 smithi005 ceph-mon[31201]: osdmap e66: 11 total, 10 up, 11 in 2024-09-11T23:25:26.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:26 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:25:26.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:26 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:25:26.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:26 smithi005 ceph-mon[31201]: Detected new or changed devices on smithi159 2024-09-11T23:25:26.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:26 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:26.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:26 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:26.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:26 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:26.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:26 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:26.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:26 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:26.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:26 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:26.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:26 smithi005 ceph-mon[31201]: Adjusting osd_memory_target on smithi159 to 4272M 2024-09-11T23:25:26.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:26 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:26.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:26 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:25:26.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:26 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:25:26.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:26 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:27.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:27.057+0000 7f5cbb828640 1 -- 172.21.15.172:0/4193058286 --> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f5cb406af50 con 0x7f5ca00a2b80 2024-09-11T23:25:27.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:26 smithi159 ceph-mon[34394]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-11T23:25:27.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:26 smithi159 ceph-mon[34394]: osdmap e66: 11 total, 10 up, 11 in 2024-09-11T23:25:27.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:26 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:25:27.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:26 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:25:27.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:26 smithi159 ceph-mon[34394]: Detected new or changed devices on smithi159 2024-09-11T23:25:27.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:26 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:27.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:26 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:27.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:26 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:27.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:26 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:27.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:26 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:27.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:26 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:27.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:26 smithi159 ceph-mon[34394]: Adjusting osd_memory_target on smithi159 to 4272M 2024-09-11T23:25:27.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:26 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:27.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:26 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:25:27.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:26 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:25:27.128 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:26 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:27.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:27 smithi172 ceph-mon[34855]: purged_snaps scrub starts 2024-09-11T23:25:27.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:27 smithi172 ceph-mon[34855]: purged_snaps scrub ok 2024-09-11T23:25:27.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:27 smithi172 ceph-mon[34855]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:25:27.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:27 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:25:27.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:27 smithi172 ceph-mon[34855]: osd.10 [v2:172.21.15.159:6824/3334483164,v1:172.21.15.159:6825/3334483164] boot 2024-09-11T23:25:27.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:27 smithi172 ceph-mon[34855]: osdmap e67: 11 total, 11 up, 11 in 2024-09-11T23:25:27.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:27 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:25:27.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:27 smithi172 ceph-mon[34855]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:25:27.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:27 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:25:27.809 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:27 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:25:27.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:27 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:25:27.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:27 smithi005 ceph-mon[31201]: purged_snaps scrub starts 2024-09-11T23:25:27.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:27 smithi005 ceph-mon[31201]: purged_snaps scrub ok 2024-09-11T23:25:27.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:27 smithi005 ceph-mon[31201]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:25:27.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:27 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:25:27.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:27 smithi005 ceph-mon[31201]: osd.10 [v2:172.21.15.159:6824/3334483164,v1:172.21.15.159:6825/3334483164] boot 2024-09-11T23:25:27.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:27 smithi005 ceph-mon[31201]: osdmap e67: 11 total, 11 up, 11 in 2024-09-11T23:25:27.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:27 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:25:27.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:27 smithi005 ceph-mon[31201]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:25:27.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:27 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:25:27.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:27 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:25:27.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:27 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:25:28.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:27 smithi159 ceph-mon[34394]: purged_snaps scrub starts 2024-09-11T23:25:28.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:27 smithi159 ceph-mon[34394]: purged_snaps scrub ok 2024-09-11T23:25:28.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:27 smithi159 ceph-mon[34394]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:25:28.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:27 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:25:28.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:27 smithi159 ceph-mon[34394]: osd.10 [v2:172.21.15.159:6824/3334483164,v1:172.21.15.159:6825/3334483164] boot 2024-09-11T23:25:28.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:27 smithi159 ceph-mon[34394]: osdmap e67: 11 total, 11 up, 11 in 2024-09-11T23:25:28.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:27 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:25:28.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:27 smithi159 ceph-mon[34394]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:25:28.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:27 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:25:28.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:27 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:25:28.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:27 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:25:28.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:28 smithi005 ceph-mon[31201]: osdmap e68: 11 total, 11 up, 11 in 2024-09-11T23:25:29.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:28 smithi172 ceph-mon[34855]: osdmap e68: 11 total, 11 up, 11 in 2024-09-11T23:25:29.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:28 smithi159 ceph-mon[34394]: osdmap e68: 11 total, 11 up, 11 in 2024-09-11T23:25:29.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:29 smithi005 ceph-mon[31201]: pgmap v227: 1 pgs: 1 remapped+peering; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:25:29.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:29 smithi005 ceph-mon[31201]: osdmap e69: 11 total, 11 up, 11 in 2024-09-11T23:25:29.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:29 smithi005 ceph-mon[31201]: from='client.? 172.21.15.172:0/2280611077' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5cc91ff9-fc0f-4e7a-8e4d-87df0e7efbeb"}]: dispatch 2024-09-11T23:25:29.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:29 smithi005 ceph-mon[31201]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5cc91ff9-fc0f-4e7a-8e4d-87df0e7efbeb"}]: dispatch 2024-09-11T23:25:29.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:29 smithi005 ceph-mon[31201]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5cc91ff9-fc0f-4e7a-8e4d-87df0e7efbeb"}]': finished 2024-09-11T23:25:29.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:29 smithi005 ceph-mon[31201]: osdmap e70: 12 total, 11 up, 12 in 2024-09-11T23:25:29.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:29 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:25:30.002 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:29 smithi172 ceph-mon[34855]: pgmap v227: 1 pgs: 1 remapped+peering; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:25:30.002 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:29 smithi172 ceph-mon[34855]: osdmap e69: 11 total, 11 up, 11 in 2024-09-11T23:25:30.002 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:29 smithi172 ceph-mon[34855]: from='client.? 172.21.15.172:0/2280611077' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5cc91ff9-fc0f-4e7a-8e4d-87df0e7efbeb"}]: dispatch 2024-09-11T23:25:30.002 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:29 smithi172 ceph-mon[34855]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5cc91ff9-fc0f-4e7a-8e4d-87df0e7efbeb"}]: dispatch 2024-09-11T23:25:30.002 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:29 smithi172 ceph-mon[34855]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5cc91ff9-fc0f-4e7a-8e4d-87df0e7efbeb"}]': finished 2024-09-11T23:25:30.002 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:29 smithi172 ceph-mon[34855]: osdmap e70: 12 total, 11 up, 12 in 2024-09-11T23:25:30.002 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:29 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:25:30.027 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:29 smithi159 ceph-mon[34394]: pgmap v227: 1 pgs: 1 remapped+peering; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:25:30.027 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:29 smithi159 ceph-mon[34394]: osdmap e69: 11 total, 11 up, 11 in 2024-09-11T23:25:30.027 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:29 smithi159 ceph-mon[34394]: from='client.? 172.21.15.172:0/2280611077' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5cc91ff9-fc0f-4e7a-8e4d-87df0e7efbeb"}]: dispatch 2024-09-11T23:25:30.027 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:29 smithi159 ceph-mon[34394]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5cc91ff9-fc0f-4e7a-8e4d-87df0e7efbeb"}]: dispatch 2024-09-11T23:25:30.027 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:29 smithi159 ceph-mon[34394]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5cc91ff9-fc0f-4e7a-8e4d-87df0e7efbeb"}]': finished 2024-09-11T23:25:30.027 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:29 smithi159 ceph-mon[34394]: osdmap e70: 12 total, 11 up, 12 in 2024-09-11T23:25:30.028 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:29 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:25:30.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:30 smithi005 ceph-mon[31201]: from='client.? 172.21.15.172:0/2423147279' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:25:30.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:30 smithi005 ceph-mon[31201]: osdmap e71: 12 total, 11 up, 12 in 2024-09-11T23:25:30.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:30 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:25:31.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:30 smithi159 ceph-mon[34394]: from='client.? 172.21.15.172:0/2423147279' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:25:31.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:30 smithi159 ceph-mon[34394]: osdmap e71: 12 total, 11 up, 12 in 2024-09-11T23:25:31.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:30 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:25:31.133 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:30 smithi172 ceph-mon[34855]: from='client.? 172.21.15.172:0/2423147279' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:25:31.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:30 smithi172 ceph-mon[34855]: osdmap e71: 12 total, 11 up, 12 in 2024-09-11T23:25:31.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:30 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:25:31.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:31 smithi005 ceph-mon[31201]: pgmap v230: 1 pgs: 1 remapped+peering; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:25:32.035 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:31 smithi172 ceph-mon[34855]: pgmap v230: 1 pgs: 1 remapped+peering; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:25:32.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:31 smithi159 ceph-mon[34394]: pgmap v230: 1 pgs: 1 remapped+peering; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:25:33.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:33 smithi005 ceph-mon[31201]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 131 KiB/s, 0 objects/s recovering 2024-09-11T23:25:34.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:33 smithi159 ceph-mon[34394]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 131 KiB/s, 0 objects/s recovering 2024-09-11T23:25:34.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:33 smithi172 ceph-mon[34855]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 131 KiB/s, 0 objects/s recovering 2024-09-11T23:25:35.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:35 smithi005 ceph-mon[31201]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T23:25:36.032 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:35 smithi172 ceph-mon[34855]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T23:25:36.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:35 smithi159 ceph-mon[34394]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T23:25:37.810 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:37 smithi172 ceph-mon[34855]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-11T23:25:37.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:37 smithi005 ceph-mon[31201]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-11T23:25:38.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:37 smithi159 ceph-mon[34394]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-11T23:25:38.873 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:38 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-11T23:25:38.873 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:38 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:25:38.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:38 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-11T23:25:38.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:38 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:25:39.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:38 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-11T23:25:39.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:38 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:25:39.835 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:39 smithi172 ceph-mon[34855]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-11T23:25:39.835 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:39 smithi172 ceph-mon[34855]: Deploying daemon osd.11 on smithi172 2024-09-11T23:25:39.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:39 smithi005 ceph-mon[31201]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-11T23:25:39.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:39 smithi005 ceph-mon[31201]: Deploying daemon osd.11 on smithi172 2024-09-11T23:25:40.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:39 smithi159 ceph-mon[34394]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-11T23:25:40.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:39 smithi159 ceph-mon[34394]: Deploying daemon osd.11 on smithi172 2024-09-11T23:25:41.974 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:41 smithi172 ceph-mon[34855]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T23:25:41.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:41 smithi005 ceph-mon[31201]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T23:25:42.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:41 smithi159 ceph-mon[34394]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T23:25:43.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:43 smithi005 ceph-mon[31201]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-11T23:25:43.976 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:43 smithi172 ceph-mon[34855]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-11T23:25:44.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:43 smithi159 ceph-mon[34394]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-11T23:25:44.944 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:44 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:25:44.945 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:44 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:44.945 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:44 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:45.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:44 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:25:45.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:44 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:45.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:44 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:45.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:44 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:25:45.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:44 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:45.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:44 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:45.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:45 smithi172 ceph-mon[34855]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:25:46.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:45 smithi159 ceph-mon[34394]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:25:46.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:45 smithi005 ceph-mon[31201]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:25:47.990 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:47 smithi172 ceph-mon[34855]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:25:47.990 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:47 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:47.990 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:47 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:47.990 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:47 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:25:47.990 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:47 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:25:47.990 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:47 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:48.031 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:48.031+0000 7f5ca67fc640 1 -- 172.21.15.172:0/4193058286 <== mgr.14148 v2:172.21.15.5:6800/2285128668 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f5cb406af50 con 0x7f5ca00a2b80 2024-09-11T23:25:48.031 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 11 on host 'smithi172' 2024-09-11T23:25:48.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:48.033+0000 7f5cbb828640 1 -- 172.21.15.172:0/4193058286 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f5ca00a2b80 msgr2=0x7f5ca00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:48.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:48.033+0000 7f5cbb828640 1 --2- 172.21.15.172:0/4193058286 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f5ca00a2b80 0x7f5ca00a5040 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5ca8000c00 tx=0x7f5ca80314a0 comp rx=0 tx=0).stop 2024-09-11T23:25:48.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:48.033+0000 7f5cbb828640 1 -- 172.21.15.172:0/4193058286 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5cb41026d0 msgr2=0x7f5cb41921f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:48.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:48.033+0000 7f5cbb828640 1 --2- 172.21.15.172:0/4193058286 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5cb41026d0 0x7f5cb41921f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5cac009fd0 tx=0x7f5cac00b260 comp rx=0 tx=0).stop 2024-09-11T23:25:48.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:48.033+0000 7f5cbb828640 1 -- 172.21.15.172:0/4193058286 shutdown_connections 2024-09-11T23:25:48.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:48.033+0000 7f5cbb828640 1 --2- 172.21.15.172:0/4193058286 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f5ca00a2b80 0x7f5ca00a5040 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:48.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:48.033+0000 7f5cbb828640 1 --2- 172.21.15.172:0/4193058286 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5cb41026d0 0x7f5cb41921f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:48.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:48.033+0000 7f5cbb828640 1 --2- 172.21.15.172:0/4193058286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cb4101d10 0x7f5cb4195bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:48.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:48.033+0000 7f5cbb828640 1 --2- 172.21.15.172:0/4193058286 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cb4100b10 0x7f5cb4195690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:48.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:48.033+0000 7f5cbb828640 1 -- 172.21.15.172:0/4193058286 >> 172.21.15.172:0/4193058286 conn(0x7f5cb40fc2a0 msgr2=0x7f5cb406a840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:48.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:48.033+0000 7f5cbb828640 1 -- 172.21.15.172:0/4193058286 shutdown_connections 2024-09-11T23:25:48.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:48.033+0000 7f5cbb828640 1 -- 172.21.15.172:0/4193058286 wait complete. 2024-09-11T23:25:48.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:47 smithi159 ceph-mon[34394]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:25:48.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:47 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:48.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:47 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:48.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:47 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:25:48.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:47 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:25:48.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:47 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:48.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:47 smithi005 ceph-mon[31201]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:25:48.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:47 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:48.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:47 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:48.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:47 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:25:48.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:47 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:25:48.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:47 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:48.669 DEBUG:teuthology.orchestra.run.smithi172:osd.11> sudo journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@osd.11.service 2024-09-11T23:25:48.671 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-11T23:25:48.671 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-11T23:25:48.909 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:48 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:25:48.910 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:48 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:48.910 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:48 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:48.940 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:25:48.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:48 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:25:48.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:48 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:48.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:48 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:49.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:48 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:25:49.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:48 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:49.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:48 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:49.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.578+0000 7fe3e9869640 1 -- 172.21.15.5:0/400922731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3e4101770 msgr2=0x7fe3e4101c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:49.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.578+0000 7fe3e9869640 1 --2- 172.21.15.5:0/400922731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3e4101770 0x7fe3e4101c20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc009ca0 tx=0x7fe3dc02a8c0 comp rx=0 tx=0).stop 2024-09-11T23:25:49.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.578+0000 7fe3e9869640 1 -- 172.21.15.5:0/400922731 shutdown_connections 2024-09-11T23:25:49.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.578+0000 7fe3e9869640 1 --2- 172.21.15.5:0/400922731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3e4101770 0x7fe3e4101c20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:49.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.578+0000 7fe3e9869640 1 --2- 172.21.15.5:0/400922731 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3e4100dd0 0x7fe3e4101230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:49.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.578+0000 7fe3e9869640 1 --2- 172.21.15.5:0/400922731 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe3e4100490 0x7fe3e4100890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:49.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.578+0000 7fe3e9869640 1 -- 172.21.15.5:0/400922731 >> 172.21.15.5:0/400922731 conn(0x7fe3e40fc2a0 msgr2=0x7fe3e40fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:49.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.578+0000 7fe3e9869640 1 -- 172.21.15.5:0/400922731 shutdown_connections 2024-09-11T23:25:49.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.578+0000 7fe3e9869640 1 -- 172.21.15.5:0/400922731 wait complete. 2024-09-11T23:25:49.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.579+0000 7fe3e9869640 1 Processor -- start 2024-09-11T23:25:49.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.579+0000 7fe3e9869640 1 -- start start 2024-09-11T23:25:49.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.579+0000 7fe3e9869640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3e4100490 0x7fe3e4199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:49.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.579+0000 7fe3e9869640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe3e4100dd0 0x7fe3e419a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:49.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.579+0000 7fe3e9869640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3e4101770 0x7fe3e41a1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:49.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.579+0000 7fe3e9869640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e410f950 con 0x7fe3e4101770 2024-09-11T23:25:49.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.579+0000 7fe3e9869640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e410f7d0 con 0x7fe3e4100dd0 2024-09-11T23:25:49.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.579+0000 7fe3e9869640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e410fad0 con 0x7fe3e4100490 2024-09-11T23:25:49.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.579+0000 7fe3e37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3e4101770 0x7fe3e41a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:49.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.579+0000 7fe3e37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3e4101770 0x7fe3e41a1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48036/0 (socket says 172.21.15.5:48036) 2024-09-11T23:25:49.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.579+0000 7fe3e37fe640 1 -- 172.21.15.5:0/4291719879 learned_addr learned my addr 172.21.15.5:0/4291719879 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:25:49.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.580+0000 7fe3e2ffd640 1 --2- 172.21.15.5:0/4291719879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3e4100490 0x7fe3e4199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:49.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.580+0000 7fe3e27fc640 1 --2- 172.21.15.5:0/4291719879 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe3e4100dd0 0x7fe3e419a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:49.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.580+0000 7fe3e37fe640 1 -- 172.21.15.5:0/4291719879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3e4100490 msgr2=0x7fe3e4199fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:49.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.580+0000 7fe3e37fe640 1 --2- 172.21.15.5:0/4291719879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3e4100490 0x7fe3e4199fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:49.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.580+0000 7fe3e37fe640 1 -- 172.21.15.5:0/4291719879 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe3e4100dd0 msgr2=0x7fe3e419a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:49.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.580+0000 7fe3e37fe640 1 --2- 172.21.15.5:0/4291719879 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe3e4100dd0 0x7fe3e419a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:49.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.580+0000 7fe3e37fe640 1 -- 172.21.15.5:0/4291719879 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3e41a1bf0 con 0x7fe3e4101770 2024-09-11T23:25:49.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.580+0000 7fe3e27fc640 1 --2- 172.21.15.5:0/4291719879 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe3e4100dd0 0x7fe3e419a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:25:49.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.580+0000 7fe3e37fe640 1 --2- 172.21.15.5:0/4291719879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3e4101770 0x7fe3e41a1580 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc009dc0 tx=0x7fe3dc003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:49.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.580+0000 7fe3e8867640 1 -- 172.21.15.5:0/4291719879 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3dc032ec0 con 0x7fe3e4101770 2024-09-11T23:25:49.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.580+0000 7fe3e8867640 1 -- 172.21.15.5:0/4291719879 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe3dc0044f0 con 0x7fe3e4101770 2024-09-11T23:25:49.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.580+0000 7fe3e9869640 1 -- 172.21.15.5:0/4291719879 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3e41a1e80 con 0x7fe3e4101770 2024-09-11T23:25:49.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.580+0000 7fe3e8867640 1 -- 172.21.15.5:0/4291719879 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3dc030d40 con 0x7fe3e4101770 2024-09-11T23:25:49.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.580+0000 7fe3e9869640 1 -- 172.21.15.5:0/4291719879 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3e41a2380 con 0x7fe3e4101770 2024-09-11T23:25:49.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.581+0000 7fe3e9869640 1 -- 172.21.15.5:0/4291719879 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3e410b1e0 con 0x7fe3e4101770 2024-09-11T23:25:49.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.582+0000 7fe3e8867640 1 -- 172.21.15.5:0/4291719879 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fe3dc004040 con 0x7fe3e4101770 2024-09-11T23:25:49.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.583+0000 7fe3e8867640 1 --2- 172.21.15.5:0/4291719879 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe3cc0a2dd0 0x7fe3cc0a5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:49.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.584+0000 7fe3e2ffd640 1 --2- 172.21.15.5:0/4291719879 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe3cc0a2dd0 0x7fe3cc0a5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:49.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.584+0000 7fe3e8867640 1 -- 172.21.15.5:0/4291719879 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6809+0+0 (secure 0 0 0) 0x7fe3dc0f0160 con 0x7fe3e4101770 2024-09-11T23:25:49.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.584+0000 7fe3e2ffd640 1 --2- 172.21.15.5:0/4291719879 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe3cc0a2dd0 0x7fe3cc0a5290 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe3d40058c0 tx=0x7fe3d400a250 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:49.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.587+0000 7fe3e8867640 1 -- 172.21.15.5:0/4291719879 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe3dc0bd600 con 0x7fe3e4101770 2024-09-11T23:25:49.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.768+0000 7fe3e9869640 1 -- 172.21.15.5:0/4291719879 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fe3e4062e90 con 0x7fe3e4101770 2024-09-11T23:25:49.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.769+0000 7fe3e8867640 1 -- 172.21.15.5:0/4291719879 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v71) ==== 74+0+133 (secure 0 0 0) 0x7fe3dc0bcf00 con 0x7fe3e4101770 2024-09-11T23:25:49.770 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:25:49.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.771+0000 7fe3e9869640 1 -- 172.21.15.5:0/4291719879 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe3cc0a2dd0 msgr2=0x7fe3cc0a5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:49.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.771+0000 7fe3e9869640 1 --2- 172.21.15.5:0/4291719879 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe3cc0a2dd0 0x7fe3cc0a5290 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe3d40058c0 tx=0x7fe3d400a250 comp rx=0 tx=0).stop 2024-09-11T23:25:49.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.771+0000 7fe3e9869640 1 -- 172.21.15.5:0/4291719879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3e4101770 msgr2=0x7fe3e41a1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:49.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.771+0000 7fe3e9869640 1 --2- 172.21.15.5:0/4291719879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3e4101770 0x7fe3e41a1580 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc009dc0 tx=0x7fe3dc003ba0 comp rx=0 tx=0).stop 2024-09-11T23:25:49.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.771+0000 7fe3e9869640 1 -- 172.21.15.5:0/4291719879 shutdown_connections 2024-09-11T23:25:49.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.771+0000 7fe3e9869640 1 --2- 172.21.15.5:0/4291719879 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe3cc0a2dd0 0x7fe3cc0a5290 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:49.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.771+0000 7fe3e9869640 1 --2- 172.21.15.5:0/4291719879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3e4101770 0x7fe3e41a1580 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:49.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.771+0000 7fe3e9869640 1 --2- 172.21.15.5:0/4291719879 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe3e4100dd0 0x7fe3e419a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:49.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.771+0000 7fe3e9869640 1 --2- 172.21.15.5:0/4291719879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3e4100490 0x7fe3e4199fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:49.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.771+0000 7fe3e9869640 1 -- 172.21.15.5:0/4291719879 >> 172.21.15.5:0/4291719879 conn(0x7fe3e40fc2a0 msgr2=0x7fe3e40fdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:49.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.771+0000 7fe3e9869640 1 -- 172.21.15.5:0/4291719879 shutdown_connections 2024-09-11T23:25:49.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:49.771+0000 7fe3e9869640 1 -- 172.21.15.5:0/4291719879 wait complete. 2024-09-11T23:25:50.235 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:50 smithi172 ceph-mon[34855]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:25:50.235 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:50 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/4291719879' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T23:25:50.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:50 smithi159 ceph-mon[34394]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:25:50.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:50 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/4291719879' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T23:25:50.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:50 smithi005 ceph-mon[31201]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:25:50.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:50 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/4291719879' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T23:25:50.578 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":71,"num_osds":12,"num_up_osds":11,"osd_up_since":1726097126,"num_in_osds":12,"osd_in_since":1726097129,"num_remapped_pgs":0} 2024-09-11T23:25:50.634 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:25:50 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:25:50.471+0000 7f2d75959640 -1 osd.11 0 log_to_monitors true 2024-09-11T23:25:51.225 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:51 smithi172 ceph-mon[34855]: from='osd.11 [v2:172.21.15.172:6824/1965415663,v1:172.21.15.172:6825/1965415663]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-11T23:25:51.225 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:51 smithi172 ceph-mon[34855]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-11T23:25:51.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:51 smithi159 ceph-mon[34394]: from='osd.11 [v2:172.21.15.172:6824/1965415663,v1:172.21.15.172:6825/1965415663]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-11T23:25:51.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:51 smithi159 ceph-mon[34394]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-11T23:25:51.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:51 smithi005 ceph-mon[31201]: from='osd.11 [v2:172.21.15.172:6824/1965415663,v1:172.21.15.172:6825/1965415663]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-11T23:25:51.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:51 smithi005 ceph-mon[31201]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-11T23:25:51.580 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-11T23:25:51.838 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:25:52.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:52 smithi005 ceph-mon[31201]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:25:52.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:52 smithi005 ceph-mon[31201]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-11T23:25:52.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:52 smithi005 ceph-mon[31201]: osdmap e72: 12 total, 11 up, 12 in 2024-09-11T23:25:52.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:52 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:25:52.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:52 smithi005 ceph-mon[31201]: from='osd.11 [v2:172.21.15.172:6824/1965415663,v1:172.21.15.172:6825/1965415663]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-11T23:25:52.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:52 smithi005 ceph-mon[31201]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-11T23:25:52.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:52 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:52.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:52 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:52.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:52 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:52.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:52 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:52.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:52 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:52.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:52 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:52.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:52 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:52.226 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:52 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:25:52.226 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:52 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:25:52.226 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:52 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:52.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.329+0000 7fb055b71640 1 -- 172.21.15.5:0/987207784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb050101d10 msgr2=0x7fb050102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:52.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.329+0000 7fb055b71640 1 --2- 172.21.15.5:0/987207784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb050101d10 0x7fb050102190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb038009900 tx=0x7fb03802a410 comp rx=0 tx=0).stop 2024-09-11T23:25:52.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.329+0000 7fb055b71640 1 -- 172.21.15.5:0/987207784 shutdown_connections 2024-09-11T23:25:52.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.329+0000 7fb055b71640 1 --2- 172.21.15.5:0/987207784 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0501026d0 0x7fb050108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:52.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.329+0000 7fb055b71640 1 --2- 172.21.15.5:0/987207784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb050101d10 0x7fb050102190 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:52.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.329+0000 7fb055b71640 1 --2- 172.21.15.5:0/987207784 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb050100b10 0x7fb050100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:52.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.329+0000 7fb055b71640 1 -- 172.21.15.5:0/987207784 >> 172.21.15.5:0/987207784 conn(0x7fb0500fc2a0 msgr2=0x7fb0500fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:52.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.329+0000 7fb055b71640 1 -- 172.21.15.5:0/987207784 shutdown_connections 2024-09-11T23:25:52.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.329+0000 7fb055b71640 1 -- 172.21.15.5:0/987207784 wait complete. 2024-09-11T23:25:52.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.329+0000 7fb055b71640 1 Processor -- start 2024-09-11T23:25:52.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.329+0000 7fb055b71640 1 -- start start 2024-09-11T23:25:52.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.329+0000 7fb055b71640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb050100b10 0x7fb050104aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:52.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.329+0000 7fb055b71640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb050101d10 0x7fb0501030f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:52.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.330+0000 7fb055b71640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0501026d0 0x7fb050103630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:52.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.330+0000 7fb055b71640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb05010c690 con 0x7fb0501026d0 2024-09-11T23:25:52.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.330+0000 7fb055b71640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb05010c510 con 0x7fb050100b10 2024-09-11T23:25:52.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.330+0000 7fb055b71640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb05010c810 con 0x7fb050101d10 2024-09-11T23:25:52.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.330+0000 7fb04ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0501026d0 0x7fb050103630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:52.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.330+0000 7fb047fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb050101d10 0x7fb0501030f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:52.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.330+0000 7fb04ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0501026d0 0x7fb050103630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48056/0 (socket says 172.21.15.5:48056) 2024-09-11T23:25:52.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.330+0000 7fb04ffff640 1 -- 172.21.15.5:0/4085194381 learned_addr learned my addr 172.21.15.5:0/4085194381 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:25:52.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.330+0000 7fb04f7fe640 1 --2- 172.21.15.5:0/4085194381 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb050100b10 0x7fb050104aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:52.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.330+0000 7fb04ffff640 1 -- 172.21.15.5:0/4085194381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb050101d10 msgr2=0x7fb0501030f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:52.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.330+0000 7fb04ffff640 1 --2- 172.21.15.5:0/4085194381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb050101d10 0x7fb0501030f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:52.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.330+0000 7fb04ffff640 1 -- 172.21.15.5:0/4085194381 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb050100b10 msgr2=0x7fb050104aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:52.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.330+0000 7fb04ffff640 1 --2- 172.21.15.5:0/4085194381 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb050100b10 0x7fb050104aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:52.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.330+0000 7fb04ffff640 1 -- 172.21.15.5:0/4085194381 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb050103ef0 con 0x7fb0501026d0 2024-09-11T23:25:52.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.330+0000 7fb04f7fe640 1 --2- 172.21.15.5:0/4085194381 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb050100b10 0x7fb050104aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:25:52.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.330+0000 7fb04ffff640 1 --2- 172.21.15.5:0/4085194381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0501026d0 0x7fb050103630 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb04800cad0 tx=0x7fb04800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:52.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.330+0000 7fb04d7fa640 1 -- 172.21.15.5:0/4085194381 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04800ae20 con 0x7fb0501026d0 2024-09-11T23:25:52.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.330+0000 7fb04d7fa640 1 -- 172.21.15.5:0/4085194381 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb048005020 con 0x7fb0501026d0 2024-09-11T23:25:52.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.330+0000 7fb055b71640 1 -- 172.21.15.5:0/4085194381 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0501a1ff0 con 0x7fb0501026d0 2024-09-11T23:25:52.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.330+0000 7fb04d7fa640 1 -- 172.21.15.5:0/4085194381 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04800f6b0 con 0x7fb0501026d0 2024-09-11T23:25:52.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.330+0000 7fb055b71640 1 -- 172.21.15.5:0/4085194381 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0501a24b0 con 0x7fb0501026d0 2024-09-11T23:25:52.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.331+0000 7fb055b71640 1 -- 172.21.15.5:0/4085194381 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0501a2740 con 0x7fb0501026d0 2024-09-11T23:25:52.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.333+0000 7fb04d7fa640 1 -- 172.21.15.5:0/4085194381 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fb0480051d0 con 0x7fb0501026d0 2024-09-11T23:25:52.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.334+0000 7fb04d7fa640 1 --2- 172.21.15.5:0/4085194381 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fb03c0a2b80 0x7fb03c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:52.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.334+0000 7fb04d7fa640 1 -- 172.21.15.5:0/4085194381 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6847+0+0 (secure 0 0 0) 0x7fb0480cee90 con 0x7fb0501026d0 2024-09-11T23:25:52.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.334+0000 7fb04f7fe640 1 --2- 172.21.15.5:0/4085194381 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fb03c0a2b80 0x7fb03c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:52.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.334+0000 7fb04f7fe640 1 --2- 172.21.15.5:0/4085194381 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fb03c0a2b80 0x7fb03c0a5040 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb050101b70 tx=0x7fb040005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:52.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.337+0000 7fb04d7fa640 1 -- 172.21.15.5:0/4085194381 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb048014030 con 0x7fb0501026d0 2024-09-11T23:25:52.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:52 smithi159 ceph-mon[34394]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:25:52.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:52 smithi159 ceph-mon[34394]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-11T23:25:52.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:52 smithi159 ceph-mon[34394]: osdmap e72: 12 total, 11 up, 12 in 2024-09-11T23:25:52.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:52 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:25:52.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:52 smithi159 ceph-mon[34394]: from='osd.11 [v2:172.21.15.172:6824/1965415663,v1:172.21.15.172:6825/1965415663]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-11T23:25:52.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:52 smithi159 ceph-mon[34394]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-11T23:25:52.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:52 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:52.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:52 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:52.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:52 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:52.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:52 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:52.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:52 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:52.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:52 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:52.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:52 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:52.378 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:52 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:25:52.378 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:52 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:25:52.378 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:52 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:52.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:52 smithi172 ceph-mon[34855]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:25:52.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:52 smithi172 ceph-mon[34855]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-11T23:25:52.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:52 smithi172 ceph-mon[34855]: osdmap e72: 12 total, 11 up, 12 in 2024-09-11T23:25:52.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:52 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:25:52.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:52 smithi172 ceph-mon[34855]: from='osd.11 [v2:172.21.15.172:6824/1965415663,v1:172.21.15.172:6825/1965415663]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-11T23:25:52.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:52 smithi172 ceph-mon[34855]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-11T23:25:52.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:52 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:52.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:52 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:52.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:52 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:52.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:52 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:52.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:52 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:52.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:52 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:25:52.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:52 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:52.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:52 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:25:52.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:52 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:25:52.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:52 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:25:52.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.516+0000 7fb055b71640 1 -- 172.21.15.5:0/4085194381 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fb0501a2e30 con 0x7fb0501026d0 2024-09-11T23:25:52.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.516+0000 7fb04d7fa640 1 -- 172.21.15.5:0/4085194381 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v73) ==== 74+0+133 (secure 0 0 0) 0x7fb04809c390 con 0x7fb0501026d0 2024-09-11T23:25:52.517 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:25:52.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.518+0000 7fb055b71640 1 -- 172.21.15.5:0/4085194381 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fb03c0a2b80 msgr2=0x7fb03c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:52.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.518+0000 7fb055b71640 1 --2- 172.21.15.5:0/4085194381 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fb03c0a2b80 0x7fb03c0a5040 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb050101b70 tx=0x7fb040005f90 comp rx=0 tx=0).stop 2024-09-11T23:25:52.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.518+0000 7fb055b71640 1 -- 172.21.15.5:0/4085194381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0501026d0 msgr2=0x7fb050103630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:52.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.518+0000 7fb055b71640 1 --2- 172.21.15.5:0/4085194381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0501026d0 0x7fb050103630 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb04800cad0 tx=0x7fb04800cf90 comp rx=0 tx=0).stop 2024-09-11T23:25:52.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.518+0000 7fb055b71640 1 -- 172.21.15.5:0/4085194381 shutdown_connections 2024-09-11T23:25:52.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.518+0000 7fb055b71640 1 --2- 172.21.15.5:0/4085194381 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fb03c0a2b80 0x7fb03c0a5040 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:52.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.518+0000 7fb055b71640 1 --2- 172.21.15.5:0/4085194381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0501026d0 0x7fb050103630 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:52.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.518+0000 7fb055b71640 1 --2- 172.21.15.5:0/4085194381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb050101d10 0x7fb0501030f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:52.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.518+0000 7fb055b71640 1 --2- 172.21.15.5:0/4085194381 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb050100b10 0x7fb050104aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:52.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.518+0000 7fb055b71640 1 -- 172.21.15.5:0/4085194381 >> 172.21.15.5:0/4085194381 conn(0x7fb0500fc2a0 msgr2=0x7fb05006a880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:52.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.518+0000 7fb055b71640 1 -- 172.21.15.5:0/4085194381 shutdown_connections 2024-09-11T23:25:52.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:52.518+0000 7fb055b71640 1 -- 172.21.15.5:0/4085194381 wait complete. 2024-09-11T23:25:52.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:25:52 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:25:52.430+0000 7f2d718dc640 -1 osd.11 0 waiting for initial osdmap 2024-09-11T23:25:52.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:25:52 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:25:52.446+0000 7f2d696fc640 -1 osd.11 73 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:25:53.148 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":73,"num_osds":12,"num_up_osds":11,"osd_up_since":1726097126,"num_in_osds":12,"osd_in_since":1726097129,"num_remapped_pgs":0} 2024-09-11T23:25:53.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:53 smithi159 ceph-mon[34394]: Detected new or changed devices on smithi172 2024-09-11T23:25:53.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:53 smithi159 ceph-mon[34394]: Adjusting osd_memory_target on smithi172 to 4272M 2024-09-11T23:25:53.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:53 smithi159 ceph-mon[34394]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-11T23:25:53.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:53 smithi159 ceph-mon[34394]: osdmap e73: 12 total, 11 up, 12 in 2024-09-11T23:25:53.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:53 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:25:53.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:53 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:25:53.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:53 smithi159 ceph-mon[34394]: from='osd.11 ' entity='osd.11' 2024-09-11T23:25:53.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:53 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/4085194381' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T23:25:53.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:53 smithi172 ceph-mon[34855]: Detected new or changed devices on smithi172 2024-09-11T23:25:53.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:53 smithi172 ceph-mon[34855]: Adjusting osd_memory_target on smithi172 to 4272M 2024-09-11T23:25:53.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:53 smithi172 ceph-mon[34855]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-11T23:25:53.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:53 smithi172 ceph-mon[34855]: osdmap e73: 12 total, 11 up, 12 in 2024-09-11T23:25:53.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:53 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:25:53.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:53 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:25:53.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:53 smithi172 ceph-mon[34855]: from='osd.11 ' entity='osd.11' 2024-09-11T23:25:53.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:53 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/4085194381' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T23:25:53.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:53 smithi005 ceph-mon[31201]: Detected new or changed devices on smithi172 2024-09-11T23:25:53.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:53 smithi005 ceph-mon[31201]: Adjusting osd_memory_target on smithi172 to 4272M 2024-09-11T23:25:53.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:53 smithi005 ceph-mon[31201]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-11T23:25:53.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:53 smithi005 ceph-mon[31201]: osdmap e73: 12 total, 11 up, 12 in 2024-09-11T23:25:53.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:53 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:25:53.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:53 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:25:53.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:53 smithi005 ceph-mon[31201]: from='osd.11 ' entity='osd.11' 2024-09-11T23:25:53.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:53 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/4085194381' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T23:25:54.149 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-11T23:25:54.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:54 smithi159 ceph-mon[34394]: purged_snaps scrub starts 2024-09-11T23:25:54.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:54 smithi159 ceph-mon[34394]: purged_snaps scrub ok 2024-09-11T23:25:54.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:54 smithi159 ceph-mon[34394]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:25:54.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:54 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:25:54.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:54 smithi159 ceph-mon[34394]: osd.11 [v2:172.21.15.172:6824/1965415663,v1:172.21.15.172:6825/1965415663] boot 2024-09-11T23:25:54.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:54 smithi159 ceph-mon[34394]: osdmap e74: 12 total, 12 up, 12 in 2024-09-11T23:25:54.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:54 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:25:54.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:54 smithi172 ceph-mon[34855]: purged_snaps scrub starts 2024-09-11T23:25:54.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:54 smithi172 ceph-mon[34855]: purged_snaps scrub ok 2024-09-11T23:25:54.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:54 smithi172 ceph-mon[34855]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:25:54.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:54 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:25:54.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:54 smithi172 ceph-mon[34855]: osd.11 [v2:172.21.15.172:6824/1965415663,v1:172.21.15.172:6825/1965415663] boot 2024-09-11T23:25:54.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:54 smithi172 ceph-mon[34855]: osdmap e74: 12 total, 12 up, 12 in 2024-09-11T23:25:54.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:54 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:25:54.414 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:25:54.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:54 smithi005 ceph-mon[31201]: purged_snaps scrub starts 2024-09-11T23:25:54.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:54 smithi005 ceph-mon[31201]: purged_snaps scrub ok 2024-09-11T23:25:54.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:54 smithi005 ceph-mon[31201]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:25:54.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:54 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:25:54.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:54 smithi005 ceph-mon[31201]: osd.11 [v2:172.21.15.172:6824/1965415663,v1:172.21.15.172:6825/1965415663] boot 2024-09-11T23:25:54.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:54 smithi005 ceph-mon[31201]: osdmap e74: 12 total, 12 up, 12 in 2024-09-11T23:25:54.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:54 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:25:54.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:54.878+0000 7f911a15c640 1 -- 172.21.15.5:0/925846927 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9114101d10 msgr2=0x7f9114102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:54.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:54.878+0000 7f911a15c640 1 --2- 172.21.15.5:0/925846927 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9114101d10 0x7f9114102190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f90fc009900 tx=0x7f90fc02a410 comp rx=0 tx=0).stop 2024-09-11T23:25:54.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:54.878+0000 7f911a15c640 1 -- 172.21.15.5:0/925846927 shutdown_connections 2024-09-11T23:25:54.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:54.878+0000 7f911a15c640 1 --2- 172.21.15.5:0/925846927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91141026d0 0x7f9114108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:54.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:54.878+0000 7f911a15c640 1 --2- 172.21.15.5:0/925846927 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9114101d10 0x7f9114102190 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:54.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:54.878+0000 7f911a15c640 1 --2- 172.21.15.5:0/925846927 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9114100b10 0x7f9114100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:54.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:54.878+0000 7f911a15c640 1 -- 172.21.15.5:0/925846927 >> 172.21.15.5:0/925846927 conn(0x7f91140fc2a0 msgr2=0x7f91140fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:54.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:54.878+0000 7f911a15c640 1 -- 172.21.15.5:0/925846927 shutdown_connections 2024-09-11T23:25:54.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:54.878+0000 7f911a15c640 1 -- 172.21.15.5:0/925846927 wait complete. 2024-09-11T23:25:54.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:54.879+0000 7f911a15c640 1 Processor -- start 2024-09-11T23:25:54.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:54.879+0000 7f911a15c640 1 -- start start 2024-09-11T23:25:54.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:54.879+0000 7f911a15c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9114100b10 0x7f911406b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:54.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:54.879+0000 7f911a15c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9114101d10 0x7f911419cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:54.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:54.879+0000 7f911a15c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91141026d0 0x7f911419f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:54.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:54.879+0000 7f911a15c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f911410c6a0 con 0x7f91141026d0 2024-09-11T23:25:54.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:54.879+0000 7f911a15c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f911410c520 con 0x7f9114100b10 2024-09-11T23:25:54.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:54.879+0000 7f911a15c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f911410c820 con 0x7f9114101d10 2024-09-11T23:25:54.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:54.879+0000 7f9113fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91141026d0 0x7f911419f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:54.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:54.879+0000 7f9113fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91141026d0 0x7f911419f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59766/0 (socket says 172.21.15.5:59766) 2024-09-11T23:25:54.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:54.879+0000 7f9113fff640 1 -- 172.21.15.5:0/1624028547 learned_addr learned my addr 172.21.15.5:0/1624028547 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:25:54.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:54.879+0000 7f91137fe640 1 --2- 172.21.15.5:0/1624028547 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9114100b10 0x7f911406b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:54.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:54.879+0000 7f910affd640 1 --2- 172.21.15.5:0/1624028547 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9114101d10 0x7f911419cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:54.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:54.879+0000 7f9113fff640 1 -- 172.21.15.5:0/1624028547 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9114101d10 msgr2=0x7f911419cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:54.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:54.879+0000 7f9113fff640 1 --2- 172.21.15.5:0/1624028547 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9114101d10 0x7f911419cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:54.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:54.880+0000 7f9113fff640 1 -- 172.21.15.5:0/1624028547 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9114100b10 msgr2=0x7f911406b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:54.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:54.880+0000 7f9113fff640 1 --2- 172.21.15.5:0/1624028547 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9114100b10 0x7f911406b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:54.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:54.880+0000 7f9113fff640 1 -- 172.21.15.5:0/1624028547 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f911419fb20 con 0x7f91141026d0 2024-09-11T23:25:54.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:54.880+0000 7f91137fe640 1 --2- 172.21.15.5:0/1624028547 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9114100b10 0x7f911406b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:25:54.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:54.880+0000 7f9113fff640 1 --2- 172.21.15.5:0/1624028547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91141026d0 0x7f911419f210 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f910c00b970 tx=0x7f910c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:54.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:54.880+0000 7f91117fa640 1 -- 172.21.15.5:0/1624028547 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f910c019070 con 0x7f91141026d0 2024-09-11T23:25:54.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:54.880+0000 7f911a15c640 1 -- 172.21.15.5:0/1624028547 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f911419fdb0 con 0x7f91141026d0 2024-09-11T23:25:54.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:54.880+0000 7f91117fa640 1 -- 172.21.15.5:0/1624028547 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f910c014440 con 0x7f91141026d0 2024-09-11T23:25:54.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:54.880+0000 7f91117fa640 1 -- 172.21.15.5:0/1624028547 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f910c0075d0 con 0x7f91141026d0 2024-09-11T23:25:54.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:54.880+0000 7f911a15c640 1 -- 172.21.15.5:0/1624028547 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91141a02f0 con 0x7f91141026d0 2024-09-11T23:25:54.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:54.881+0000 7f911a15c640 1 -- 172.21.15.5:0/1624028547 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9114107f60 con 0x7f91141026d0 2024-09-11T23:25:54.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:54.882+0000 7f91117fa640 1 -- 172.21.15.5:0/1624028547 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f910c01c070 con 0x7f91141026d0 2024-09-11T23:25:54.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:54.883+0000 7f91117fa640 1 --2- 172.21.15.5:0/1624028547 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f91000a2b80 0x7f91000a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:54.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:54.883+0000 7f91137fe640 1 --2- 172.21.15.5:0/1624028547 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f91000a2b80 0x7f91000a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:54.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:54.883+0000 7f91117fa640 1 -- 172.21.15.5:0/1624028547 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f910c0ce200 con 0x7f91141026d0 2024-09-11T23:25:54.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:54.884+0000 7f91137fe640 1 --2- 172.21.15.5:0/1624028547 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f91000a2b80 0x7f91000a5040 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f91040058c0 tx=0x7f9104005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:54.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:54.887+0000 7f91117fa640 1 -- 172.21.15.5:0/1624028547 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f910c09b600 con 0x7f91141026d0 2024-09-11T23:25:55.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:55.062+0000 7f911a15c640 1 -- 172.21.15.5:0/1624028547 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f911402d9c0 con 0x7f91141026d0 2024-09-11T23:25:55.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:55.063+0000 7f91117fa640 1 -- 172.21.15.5:0/1624028547 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v75) ==== 74+0+133 (secure 0 0 0) 0x7f910c09af00 con 0x7f91141026d0 2024-09-11T23:25:55.064 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:25:55.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:55.065+0000 7f911a15c640 1 -- 172.21.15.5:0/1624028547 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f91000a2b80 msgr2=0x7f91000a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:55.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:55.065+0000 7f911a15c640 1 --2- 172.21.15.5:0/1624028547 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f91000a2b80 0x7f91000a5040 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f91040058c0 tx=0x7f9104005850 comp rx=0 tx=0).stop 2024-09-11T23:25:55.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:55.065+0000 7f911a15c640 1 -- 172.21.15.5:0/1624028547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91141026d0 msgr2=0x7f911419f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:55.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:55.065+0000 7f911a15c640 1 --2- 172.21.15.5:0/1624028547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91141026d0 0x7f911419f210 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f910c00b970 tx=0x7f910c00be30 comp rx=0 tx=0).stop 2024-09-11T23:25:55.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:55.065+0000 7f911a15c640 1 -- 172.21.15.5:0/1624028547 shutdown_connections 2024-09-11T23:25:55.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:55.065+0000 7f911a15c640 1 --2- 172.21.15.5:0/1624028547 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f91000a2b80 0x7f91000a5040 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:55.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:55.065+0000 7f911a15c640 1 --2- 172.21.15.5:0/1624028547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91141026d0 0x7f911419f210 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:55.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:55.065+0000 7f911a15c640 1 --2- 172.21.15.5:0/1624028547 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9114101d10 0x7f911419cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:55.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:55.065+0000 7f911a15c640 1 --2- 172.21.15.5:0/1624028547 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9114100b10 0x7f911406b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:55.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:55.065+0000 7f911a15c640 1 -- 172.21.15.5:0/1624028547 >> 172.21.15.5:0/1624028547 conn(0x7f91140fc2a0 msgr2=0x7f9114105130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:55.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:55.065+0000 7f911a15c640 1 -- 172.21.15.5:0/1624028547 shutdown_connections 2024-09-11T23:25:55.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:55.065+0000 7f911a15c640 1 -- 172.21.15.5:0/1624028547 wait complete. 2024-09-11T23:25:55.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:55 smithi005 ceph-mon[31201]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:25:55.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:55 smithi005 ceph-mon[31201]: osdmap e75: 12 total, 12 up, 12 in 2024-09-11T23:25:55.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:55 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/1624028547' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T23:25:55.809 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":75,"num_osds":12,"num_up_osds":12,"osd_up_since":1726097153,"num_in_osds":12,"osd_in_since":1726097129,"num_remapped_pgs":0} 2024-09-11T23:25:55.810 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T23:25:55.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:55 smithi159 ceph-mon[34394]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:25:55.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:55 smithi159 ceph-mon[34394]: osdmap e75: 12 total, 12 up, 12 in 2024-09-11T23:25:55.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:55 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/1624028547' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T23:25:55.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:55 smithi172 ceph-mon[34855]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:25:55.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:55 smithi172 ceph-mon[34855]: osdmap e75: 12 total, 12 up, 12 in 2024-09-11T23:25:55.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:55 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/1624028547' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T23:25:56.068 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:25:56.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.562+0000 7f5ff6c26640 1 -- 172.21.15.5:0/1611248216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ff0103660 msgr2=0x7f5ff010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:56.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.562+0000 7f5ff6c26640 1 --2- 172.21.15.5:0/1611248216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ff0103660 0x7f5ff010bb50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc009900 tx=0x7f5fdc02a480 comp rx=0 tx=0).stop 2024-09-11T23:25:56.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.562+0000 7f5ff6c26640 1 -- 172.21.15.5:0/1611248216 shutdown_connections 2024-09-11T23:25:56.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.562+0000 7f5ff6c26640 1 --2- 172.21.15.5:0/1611248216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ff010c170 0x7f5ff010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:56.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.562+0000 7f5ff6c26640 1 --2- 172.21.15.5:0/1611248216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ff0103660 0x7f5ff010bb50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:56.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.562+0000 7f5ff6c26640 1 --2- 172.21.15.5:0/1611248216 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ff0102d40 0x7f5ff0103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:56.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.562+0000 7f5ff6c26640 1 -- 172.21.15.5:0/1611248216 >> 172.21.15.5:0/1611248216 conn(0x7f5ff00fc7a0 msgr2=0x7f5ff00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:56.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.562+0000 7f5ff6c26640 1 -- 172.21.15.5:0/1611248216 shutdown_connections 2024-09-11T23:25:56.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.562+0000 7f5ff6c26640 1 -- 172.21.15.5:0/1611248216 wait complete. 2024-09-11T23:25:56.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.563+0000 7f5ff6c26640 1 Processor -- start 2024-09-11T23:25:56.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.563+0000 7f5ff6c26640 1 -- start start 2024-09-11T23:25:56.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.563+0000 7f5ff6c26640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ff0102d40 0x7f5ff01983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:56.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.563+0000 7f5ff6c26640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ff0103660 0x7f5ff0198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:56.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.563+0000 7f5ff6c26640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ff010c170 0x7f5ff019ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:56.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.563+0000 7f5ff6c26640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff0111e60 con 0x7f5ff0103660 2024-09-11T23:25:56.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.563+0000 7f5ff6c26640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff0111ce0 con 0x7f5ff010c170 2024-09-11T23:25:56.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.563+0000 7f5ff6c26640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff0111fe0 con 0x7f5ff0102d40 2024-09-11T23:25:56.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.563+0000 7f5feffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ff0103660 0x7f5ff0198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:56.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.563+0000 7f5feffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ff0103660 0x7f5ff0198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59784/0 (socket says 172.21.15.5:59784) 2024-09-11T23:25:56.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.563+0000 7f5feffff640 1 -- 172.21.15.5:0/1927650110 learned_addr learned my addr 172.21.15.5:0/1927650110 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:25:56.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.563+0000 7f5ff51c3640 1 --2- 172.21.15.5:0/1927650110 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ff010c170 0x7f5ff019ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:56.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.564+0000 7f5ff49c2640 1 --2- 172.21.15.5:0/1927650110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ff0102d40 0x7f5ff01983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:56.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.564+0000 7f5feffff640 1 -- 172.21.15.5:0/1927650110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ff0102d40 msgr2=0x7f5ff01983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:56.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.564+0000 7f5feffff640 1 --2- 172.21.15.5:0/1927650110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ff0102d40 0x7f5ff01983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:56.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.564+0000 7f5feffff640 1 -- 172.21.15.5:0/1927650110 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ff010c170 msgr2=0x7f5ff019ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:56.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.564+0000 7f5feffff640 1 --2- 172.21.15.5:0/1927650110 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ff010c170 0x7f5ff019ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:56.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.564+0000 7f5feffff640 1 -- 172.21.15.5:0/1927650110 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ff019d3a0 con 0x7f5ff0103660 2024-09-11T23:25:56.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.564+0000 7f5ff49c2640 1 --2- 172.21.15.5:0/1927650110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ff0102d40 0x7f5ff01983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:25:56.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.564+0000 7f5feffff640 1 --2- 172.21.15.5:0/1927650110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ff0103660 0x7f5ff0198930 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc005940 tx=0x7f5fdc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:56.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.564+0000 7f5fedffb640 1 -- 172.21.15.5:0/1927650110 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fdc03f030 con 0x7f5ff0103660 2024-09-11T23:25:56.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.564+0000 7f5fedffb640 1 -- 172.21.15.5:0/1927650110 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5fdc003cb0 con 0x7f5ff0103660 2024-09-11T23:25:56.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.564+0000 7f5ff6c26640 1 -- 172.21.15.5:0/1927650110 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ff019d630 con 0x7f5ff0103660 2024-09-11T23:25:56.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.564+0000 7f5fedffb640 1 -- 172.21.15.5:0/1927650110 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fdc035070 con 0x7f5ff0103660 2024-09-11T23:25:56.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.564+0000 7f5ff6c26640 1 -- 172.21.15.5:0/1927650110 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ff01a4f70 con 0x7f5ff0103660 2024-09-11T23:25:56.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.565+0000 7f5ff6c26640 1 -- 172.21.15.5:0/1927650110 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ff006b070 con 0x7f5ff0103660 2024-09-11T23:25:56.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.566+0000 7f5fedffb640 1 -- 172.21.15.5:0/1927650110 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f5fdc042030 con 0x7f5ff0103660 2024-09-11T23:25:56.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.567+0000 7f5fedffb640 1 --2- 172.21.15.5:0/1927650110 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f5fe00a2b80 0x7f5fe00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:56.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.567+0000 7f5fedffb640 1 -- 172.21.15.5:0/1927650110 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f5fdc0ef3c0 con 0x7f5ff0103660 2024-09-11T23:25:56.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.567+0000 7f5ff49c2640 1 --2- 172.21.15.5:0/1927650110 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f5fe00a2b80 0x7f5fe00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:56.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.568+0000 7f5ff49c2640 1 --2- 172.21.15.5:0/1927650110 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f5fe00a2b80 0x7f5fe00a5040 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4005fd0 tx=0x7f5fe400b5f0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:56.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.571+0000 7f5fedffb640 1 -- 172.21.15.5:0/1927650110 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5fdc0bc7c0 con 0x7f5ff0103660 2024-09-11T23:25:56.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.749+0000 7f5ff6c26640 1 -- 172.21.15.5:0/1927650110 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5ff01071e0 con 0x7f5ff0103660 2024-09-11T23:25:56.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.750+0000 7f5fedffb640 1 -- 172.21.15.5:0/1927650110 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+18412 (secure 0 0 0) 0x7f5fdc0bc0c0 con 0x7f5ff0103660 2024-09-11T23:25:56.751 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:25:56.752 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":75,"fsid":"1f5284d2-7094-11ef-bcea-c7b262605968","created":"2024-09-11T23:19:00.051813+0000","modified":"2024-09-11T23:25:54.435091+0000","last_up_change":"2024-09-11T23:25:53.433445+0000","last_in_change":"2024-09-11T23:25:29.443287+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:22:04.534014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bf95ced0-780b-482f-87da-0b5e61de62ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6803","nonce":624761084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6805","nonce":624761084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6809","nonce":624761084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6807","nonce":624761084}]},"public_addr":"172.21.15.5:6803/624761084","cluster_addr":"172.21.15.5:6805/624761084","heartbeat_back_addr":"172.21.15.5:6809/624761084","heartbeat_front_addr":"172.21.15.5:6807/624761084","state":["exists","up"]},{"osd":1,"uuid":"d926484f-78a6-497b-843d-f2db54ade4a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6801","nonce":2111290186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6803","nonce":2111290186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6807","nonce":2111290186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6805","nonce":2111290186}]},"public_addr":"172.21.15.159:6801/2111290186","cluster_addr":"172.21.15.159:6803/2111290186","heartbeat_back_addr":"172.21.15.159:6807/2111290186","heartbeat_front_addr":"172.21.15.159:6805/2111290186","state":["exists","up"]},{"osd":2,"uuid":"d92cd431-0ba7-4171-82b8-60fa3d63a64b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6801","nonce":299915717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6803","nonce":299915717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6807","nonce":299915717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6805","nonce":299915717}]},"public_addr":"172.21.15.172:6801/299915717","cluster_addr":"172.21.15.172:6803/299915717","heartbeat_back_addr":"172.21.15.172:6807/299915717","heartbeat_front_addr":"172.21.15.172:6805/299915717","state":["exists","up"]},{"osd":3,"uuid":"0521043b-559c-4671-b11e-9117871cff49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6811","nonce":2080498921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6813","nonce":2080498921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6817","nonce":2080498921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6815","nonce":2080498921}]},"public_addr":"172.21.15.5:6811/2080498921","cluster_addr":"172.21.15.5:6813/2080498921","heartbeat_back_addr":"172.21.15.5:6817/2080498921","heartbeat_front_addr":"172.21.15.5:6815/2080498921","state":["exists","up"]},{"osd":4,"uuid":"b968d762-a46e-4ae2-b19d-8225f82de613","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6809","nonce":4185908786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6811","nonce":4185908786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6815","nonce":4185908786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6813","nonce":4185908786}]},"public_addr":"172.21.15.159:6809/4185908786","cluster_addr":"172.21.15.159:6811/4185908786","heartbeat_back_addr":"172.21.15.159:6815/4185908786","heartbeat_front_addr":"172.21.15.159:6813/4185908786","state":["exists","up"]},{"osd":5,"uuid":"1b0a518a-3d17-4635-81da-52f9ef83a574","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6809","nonce":3742759000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6811","nonce":3742759000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6815","nonce":3742759000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6813","nonce":3742759000}]},"public_addr":"172.21.15.172:6809/3742759000","cluster_addr":"172.21.15.172:6811/3742759000","heartbeat_back_addr":"172.21.15.172:6815/3742759000","heartbeat_front_addr":"172.21.15.172:6813/3742759000","state":["exists","up"]},{"osd":6,"uuid":"c3a2db6c-9189-4e42-aa1e-52189a9c4291","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6819","nonce":4156823423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6821","nonce":4156823423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6825","nonce":4156823423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6823","nonce":4156823423}]},"public_addr":"172.21.15.5:6819/4156823423","cluster_addr":"172.21.15.5:6821/4156823423","heartbeat_back_addr":"172.21.15.5:6825/4156823423","heartbeat_front_addr":"172.21.15.5:6823/4156823423","state":["exists","up"]},{"osd":7,"uuid":"dfaadf28-74ab-4cda-8647-dcb58beb7cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6817","nonce":4222571927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6819","nonce":4222571927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6823","nonce":4222571927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6821","nonce":4222571927}]},"public_addr":"172.21.15.159:6817/4222571927","cluster_addr":"172.21.15.159:6819/4222571927","heartbeat_back_addr":"172.21.15.159:6823/4222571927","heartbeat_front_addr":"172.21.15.159:6821/4222571927","state":["exists","up"]},{"osd":8,"uuid":"47f66651-614c-4613-9793-69c140dbf705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6817","nonce":3661505951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6819","nonce":3661505951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6823","nonce":3661505951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6821","nonce":3661505951}]},"public_addr":"172.21.15.172:6817/3661505951","cluster_addr":"172.21.15.172:6819/3661505951","heartbeat_back_addr":"172.21.15.172:6823/3661505951","heartbeat_front_addr":"172.21.15.172:6821/3661505951","state":["exists","up"]},{"osd":9,"uuid":"c97b8221-8cf9-4fab-9e27-ff7f3bd98152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6827","nonce":72036667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6829","nonce":72036667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6833","nonce":72036667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6831","nonce":72036667}]},"public_addr":"172.21.15.5:6827/72036667","cluster_addr":"172.21.15.5:6829/72036667","heartbeat_back_addr":"172.21.15.5:6833/72036667","heartbeat_front_addr":"172.21.15.5:6831/72036667","state":["exists","up"]},{"osd":10,"uuid":"143376c1-f3f1-4df4-bcd3-a9b46fad8c1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6825","nonce":3334483164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6827","nonce":3334483164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6831","nonce":3334483164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6829","nonce":3334483164}]},"public_addr":"172.21.15.159:6825/3334483164","cluster_addr":"172.21.15.159:6827/3334483164","heartbeat_back_addr":"172.21.15.159:6831/3334483164","heartbeat_front_addr":"172.21.15.159:6829/3334483164","state":["exists","up"]},{"osd":11,"uuid":"5cc91ff9-fc0f-4e7a-8e4d-87df0e7efbeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6825","nonce":1965415663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6827","nonce":1965415663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6831","nonce":1965415663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6829","nonce":1965415663}]},"public_addr":"172.21.15.172:6825/1965415663","cluster_addr":"172.21.15.172:6827/1965415663","heartbeat_back_addr":"172.21.15.172:6831/1965415663","heartbeat_front_addr":"172.21.15.172:6829/1965415663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:21:13.024707+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:21:38.063741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:22:02.221583+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:22:27.919711+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:22:53.870543+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:23:18.539905+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:23:43.694229+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:24:08.984704+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:24:34.378582+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:25:00.102231+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:25:25.367178+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:25:51.439033+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/2713701762":"2024-09-12T23:19:50.031855+0000","172.21.15.5:0/3135835713":"2024-09-12T23:19:50.031855+0000","172.21.15.5:0/3935034940":"2024-09-12T23:19:50.031855+0000","172.21.15.5:6801/1790126649":"2024-09-12T23:19:50.031855+0000","172.21.15.5:6801/1358356358":"2024-09-12T23:19:26.149011+0000","172.21.15.5:6800/1790126649":"2024-09-12T23:19:50.031855+0000","172.21.15.5:6800/1358356358":"2024-09-12T23:19:26.149011+0000","172.21.15.5:0/2243688290":"2024-09-12T23:19:26.149011+0000","172.21.15.5:0/1493331899":"2024-09-12T23:19:26.149011+0000","172.21.15.5:0/2329812802":"2024-09-12T23:19:26.149011+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:25:56.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.753+0000 7f5ff6c26640 1 -- 172.21.15.5:0/1927650110 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f5fe00a2b80 msgr2=0x7f5fe00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:56.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.753+0000 7f5ff6c26640 1 --2- 172.21.15.5:0/1927650110 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f5fe00a2b80 0x7f5fe00a5040 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4005fd0 tx=0x7f5fe400b5f0 comp rx=0 tx=0).stop 2024-09-11T23:25:56.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.753+0000 7f5ff6c26640 1 -- 172.21.15.5:0/1927650110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ff0103660 msgr2=0x7f5ff0198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:56.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.753+0000 7f5ff6c26640 1 --2- 172.21.15.5:0/1927650110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ff0103660 0x7f5ff0198930 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc005940 tx=0x7f5fdc0042f0 comp rx=0 tx=0).stop 2024-09-11T23:25:56.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.753+0000 7f5ff6c26640 1 -- 172.21.15.5:0/1927650110 shutdown_connections 2024-09-11T23:25:56.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.753+0000 7f5ff6c26640 1 --2- 172.21.15.5:0/1927650110 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f5fe00a2b80 0x7f5fe00a5040 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:56.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.753+0000 7f5ff6c26640 1 --2- 172.21.15.5:0/1927650110 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ff010c170 0x7f5ff019ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:56.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.753+0000 7f5ff6c26640 1 --2- 172.21.15.5:0/1927650110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ff0103660 0x7f5ff0198930 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:56.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.753+0000 7f5ff6c26640 1 --2- 172.21.15.5:0/1927650110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ff0102d40 0x7f5ff01983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:56.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.753+0000 7f5ff6c26640 1 -- 172.21.15.5:0/1927650110 >> 172.21.15.5:0/1927650110 conn(0x7f5ff00fc7a0 msgr2=0x7f5ff00fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:56.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.753+0000 7f5ff6c26640 1 -- 172.21.15.5:0/1927650110 shutdown_connections 2024-09-11T23:25:56.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:56.753+0000 7f5ff6c26640 1 -- 172.21.15.5:0/1927650110 wait complete. 2024-09-11T23:25:57.483 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T23:22:04.534014+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T23:25:57.483 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-11T23:25:57.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:57 smithi005 ceph-mon[31201]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:25:57.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:57 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/1927650110' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:25:57.736 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:25:57.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:57 smithi159 ceph-mon[34394]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:25:57.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:57 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/1927650110' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:25:57.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:57 smithi172 ceph-mon[34855]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:25:57.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:57 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/1927650110' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:25:58.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.199+0000 7fe130519640 1 -- 172.21.15.5:0/1674383878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1281055b0 msgr2=0x7fe12810d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:58.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.199+0000 7fe130519640 1 --2- 172.21.15.5:0/1674383878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1281055b0 0x7fe12810d130 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe120009ca0 tx=0x7fe12002a8c0 comp rx=0 tx=0).stop 2024-09-11T23:25:58.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.199+0000 7fe130519640 1 -- 172.21.15.5:0/1674383878 shutdown_connections 2024-09-11T23:25:58.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.199+0000 7fe130519640 1 --2- 172.21.15.5:0/1674383878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1281055b0 0x7fe12810d130 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:58.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.199+0000 7fe130519640 1 --2- 172.21.15.5:0/1674383878 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe128100e30 0x7fe128104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:58.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.199+0000 7fe130519640 1 --2- 172.21.15.5:0/1674383878 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe128100480 0x7fe128100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:58.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.199+0000 7fe130519640 1 -- 172.21.15.5:0/1674383878 >> 172.21.15.5:0/1674383878 conn(0x7fe128077210 msgr2=0x7fe1280fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:58.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.199+0000 7fe130519640 1 -- 172.21.15.5:0/1674383878 shutdown_connections 2024-09-11T23:25:58.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.199+0000 7fe130519640 1 -- 172.21.15.5:0/1674383878 wait complete. 2024-09-11T23:25:58.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.199+0000 7fe130519640 1 Processor -- start 2024-09-11T23:25:58.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.199+0000 7fe130519640 1 -- start start 2024-09-11T23:25:58.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.200+0000 7fe130519640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe128100480 0x7fe1281982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:58.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.200+0000 7fe130519640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe128100e30 0x7fe1281987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:58.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.200+0000 7fe130519640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1281055b0 0x7fe12819cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:58.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.200+0000 7fe130519640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe128110470 con 0x7fe128100e30 2024-09-11T23:25:58.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.200+0000 7fe130519640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe1281102f0 con 0x7fe128100480 2024-09-11T23:25:58.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.200+0000 7fe130519640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe1281105f0 con 0x7fe1281055b0 2024-09-11T23:25:58.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.200+0000 7fe12dab4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe128100e30 0x7fe1281987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:58.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.200+0000 7fe12dab4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe128100e30 0x7fe1281987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59806/0 (socket says 172.21.15.5:59806) 2024-09-11T23:25:58.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.200+0000 7fe12dab4640 1 -- 172.21.15.5:0/2845677724 learned_addr learned my addr 172.21.15.5:0/2845677724 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:25:58.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.200+0000 7fe12eab6640 1 --2- 172.21.15.5:0/2845677724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1281055b0 0x7fe12819cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:58.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.200+0000 7fe12e2b5640 1 --2- 172.21.15.5:0/2845677724 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe128100480 0x7fe1281982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:58.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.200+0000 7fe12dab4640 1 -- 172.21.15.5:0/2845677724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1281055b0 msgr2=0x7fe12819cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:58.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.200+0000 7fe12dab4640 1 --2- 172.21.15.5:0/2845677724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1281055b0 0x7fe12819cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:58.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.200+0000 7fe12dab4640 1 -- 172.21.15.5:0/2845677724 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe128100480 msgr2=0x7fe1281982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:58.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.200+0000 7fe12dab4640 1 --2- 172.21.15.5:0/2845677724 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe128100480 0x7fe1281982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:58.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.200+0000 7fe12dab4640 1 -- 172.21.15.5:0/2845677724 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe12819d250 con 0x7fe128100e30 2024-09-11T23:25:58.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.200+0000 7fe12e2b5640 1 --2- 172.21.15.5:0/2845677724 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe128100480 0x7fe1281982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:25:58.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.200+0000 7fe12eab6640 1 --2- 172.21.15.5:0/2845677724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1281055b0 0x7fe12819cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:25:58.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.200+0000 7fe12dab4640 1 --2- 172.21.15.5:0/2845677724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe128100e30 0x7fe1281987e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe11800c890 tx=0x7fe11800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:58.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.200+0000 7fe11f7fe640 1 -- 172.21.15.5:0/2845677724 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe118004220 con 0x7fe128100e30 2024-09-11T23:25:58.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.200+0000 7fe11f7fe640 1 -- 172.21.15.5:0/2845677724 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe1180043c0 con 0x7fe128100e30 2024-09-11T23:25:58.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.200+0000 7fe130519640 1 -- 172.21.15.5:0/2845677724 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe12819d540 con 0x7fe128100e30 2024-09-11T23:25:58.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.200+0000 7fe11f7fe640 1 -- 172.21.15.5:0/2845677724 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe118004a00 con 0x7fe128100e30 2024-09-11T23:25:58.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.201+0000 7fe130519640 1 -- 172.21.15.5:0/2845677724 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1281a4e20 con 0x7fe128100e30 2024-09-11T23:25:58.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.201+0000 7fe130519640 1 -- 172.21.15.5:0/2845677724 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe128100860 con 0x7fe128100e30 2024-09-11T23:25:58.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.203+0000 7fe11f7fe640 1 -- 172.21.15.5:0/2845677724 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fe118004ba0 con 0x7fe128100e30 2024-09-11T23:25:58.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.203+0000 7fe11f7fe640 1 --2- 172.21.15.5:0/2845677724 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe1140a2c00 0x7fe1140a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:58.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.204+0000 7fe12e2b5640 1 --2- 172.21.15.5:0/2845677724 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe1140a2c00 0x7fe1140a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:58.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.204+0000 7fe11f7fe640 1 -- 172.21.15.5:0/2845677724 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fe1180ceca0 con 0x7fe128100e30 2024-09-11T23:25:58.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.204+0000 7fe12e2b5640 1 --2- 172.21.15.5:0/2845677724 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe1140a2c00 0x7fe1140a50c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe12400baa0 tx=0x7fe124005d90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:58.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.207+0000 7fe11f7fe640 1 -- 172.21.15.5:0/2845677724 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe118014030 con 0x7fe128100e30 2024-09-11T23:25:58.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.382+0000 7fe130519640 1 -- 172.21.15.5:0/2845677724 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe12802d7c0 con 0x7fe128100e30 2024-09-11T23:25:58.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.382+0000 7fe11f7fe640 1 -- 172.21.15.5:0/2845677724 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) ==== 93+0+10 (secure 0 0 0) 0x7fe11809c120 con 0x7fe128100e30 2024-09-11T23:25:58.383 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-11T23:25:58.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.385+0000 7fe130519640 1 -- 172.21.15.5:0/2845677724 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe1140a2c00 msgr2=0x7fe1140a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:58.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.385+0000 7fe130519640 1 --2- 172.21.15.5:0/2845677724 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe1140a2c00 0x7fe1140a50c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe12400baa0 tx=0x7fe124005d90 comp rx=0 tx=0).stop 2024-09-11T23:25:58.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.385+0000 7fe130519640 1 -- 172.21.15.5:0/2845677724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe128100e30 msgr2=0x7fe1281987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:58.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.385+0000 7fe130519640 1 --2- 172.21.15.5:0/2845677724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe128100e30 0x7fe1281987e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe11800c890 tx=0x7fe11800cd50 comp rx=0 tx=0).stop 2024-09-11T23:25:58.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.385+0000 7fe130519640 1 -- 172.21.15.5:0/2845677724 shutdown_connections 2024-09-11T23:25:58.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.385+0000 7fe130519640 1 --2- 172.21.15.5:0/2845677724 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe1140a2c00 0x7fe1140a50c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:58.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.385+0000 7fe130519640 1 --2- 172.21.15.5:0/2845677724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1281055b0 0x7fe12819cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:58.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.385+0000 7fe130519640 1 --2- 172.21.15.5:0/2845677724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe128100e30 0x7fe1281987e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:58.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.385+0000 7fe130519640 1 --2- 172.21.15.5:0/2845677724 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe128100480 0x7fe1281982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:58.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.385+0000 7fe130519640 1 -- 172.21.15.5:0/2845677724 >> 172.21.15.5:0/2845677724 conn(0x7fe128077210 msgr2=0x7fe128103500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:58.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.385+0000 7fe130519640 1 -- 172.21.15.5:0/2845677724 shutdown_connections 2024-09-11T23:25:58.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:25:58.385+0000 7fe130519640 1 -- 172.21.15.5:0/2845677724 wait complete. 2024-09-11T23:25:58.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:58 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/2845677724' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T23:25:58.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:58 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/2845677724' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T23:25:58.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:58 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/2845677724' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T23:25:59.163 INFO:tasks.cephadm:Adding mds.a on smithi005 2024-09-11T23:25:59.164 INFO:tasks.cephadm:Adding mds.d on smithi005 2024-09-11T23:25:59.164 INFO:tasks.cephadm:Adding mds.g on smithi005 2024-09-11T23:25:59.164 INFO:tasks.cephadm:Adding mds.j on smithi005 2024-09-11T23:25:59.164 INFO:tasks.cephadm:Adding mds.b on smithi159 2024-09-11T23:25:59.164 INFO:tasks.cephadm:Adding mds.e on smithi159 2024-09-11T23:25:59.164 INFO:tasks.cephadm:Adding mds.h on smithi159 2024-09-11T23:25:59.164 INFO:tasks.cephadm:Adding mds.k on smithi159 2024-09-11T23:25:59.164 INFO:tasks.cephadm:Adding mds.c on smithi172 2024-09-11T23:25:59.164 INFO:tasks.cephadm:Adding mds.f on smithi172 2024-09-11T23:25:59.164 INFO:tasks.cephadm:Adding mds.i on smithi172 2024-09-11T23:25:59.164 INFO:tasks.cephadm:Adding mds.l on smithi172 2024-09-11T23:25:59.165 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph orch apply mds all '12;smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi159=b;smithi159=e;smithi159=h;smithi159=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l' 2024-09-11T23:25:59.422 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:25:59.701 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:25:59 smithi172 ceph-mon[34855]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:25:59.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:25:59 smithi005 ceph-mon[31201]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:25:59.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:25:59 smithi159 ceph-mon[34394]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:25:59.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:59.938+0000 7f282d312640 1 -- 172.21.15.172:0/2976407633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2828102170 msgr2=0x7f2828102570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:59.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:59.938+0000 7f282d312640 1 --2- 172.21.15.172:0/2976407633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2828102170 0x7f2828102570 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2818009900 tx=0x7f281802a400 comp rx=0 tx=0).stop 2024-09-11T23:25:59.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:59.938+0000 7f282d312640 1 -- 172.21.15.172:0/2976407633 shutdown_connections 2024-09-11T23:25:59.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:59.938+0000 7f282d312640 1 --2- 172.21.15.172:0/2976407633 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2828101700 0x7f2828108fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:59.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:59.938+0000 7f282d312640 1 --2- 172.21.15.172:0/2976407633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2828100d40 0x7f28281011c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:59.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:59.938+0000 7f282d312640 1 --2- 172.21.15.172:0/2976407633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2828102170 0x7f2828102570 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:59.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:59.938+0000 7f282d312640 1 -- 172.21.15.172:0/2976407633 >> 172.21.15.172:0/2976407633 conn(0x7f28280fba40 msgr2=0x7f28280fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:59.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:59.938+0000 7f282d312640 1 -- 172.21.15.172:0/2976407633 shutdown_connections 2024-09-11T23:25:59.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:59.938+0000 7f282d312640 1 -- 172.21.15.172:0/2976407633 wait complete. 2024-09-11T23:25:59.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:59.938+0000 7f282d312640 1 Processor -- start 2024-09-11T23:25:59.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:59.939+0000 7f282d312640 1 -- start start 2024-09-11T23:25:59.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:59.939+0000 7f282d312640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2828100d40 0x7f2828197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:59.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:59.939+0000 7f282d312640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2828101700 0x7f28281983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:59.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:59.939+0000 7f282d312640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2828102170 0x7f282819f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:59.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:59.939+0000 7f282d312640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f282810d7a0 con 0x7f2828101700 2024-09-11T23:25:59.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:59.939+0000 7f282d312640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f282810d620 con 0x7f2828102170 2024-09-11T23:25:59.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:59.939+0000 7f282d312640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f282810d920 con 0x7f2828100d40 2024-09-11T23:25:59.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:59.939+0000 7f2826ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2828100d40 0x7f2828197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:59.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:59.939+0000 7f2826ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2828100d40 0x7f2828197e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:53046/0 (socket says 172.21.15.172:53046) 2024-09-11T23:25:59.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:59.939+0000 7f2826ffd640 1 -- 172.21.15.172:0/4210502453 learned_addr learned my addr 172.21.15.172:0/4210502453 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-11T23:25:59.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:59.939+0000 7f28277fe640 1 --2- 172.21.15.172:0/4210502453 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2828102170 0x7f282819f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:59.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:59.939+0000 7f28267fc640 1 --2- 172.21.15.172:0/4210502453 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2828101700 0x7f28281983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:59.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:59.939+0000 7f2826ffd640 1 -- 172.21.15.172:0/4210502453 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2828102170 msgr2=0x7f282819f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:59.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:59.939+0000 7f2826ffd640 1 --2- 172.21.15.172:0/4210502453 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2828102170 0x7f282819f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:59.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:59.939+0000 7f2826ffd640 1 -- 172.21.15.172:0/4210502453 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2828101700 msgr2=0x7f28281983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:59.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:59.939+0000 7f2826ffd640 1 --2- 172.21.15.172:0/4210502453 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2828101700 0x7f28281983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:59.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:59.939+0000 7f2826ffd640 1 -- 172.21.15.172:0/4210502453 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f282819fa90 con 0x7f2828100d40 2024-09-11T23:25:59.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:59.940+0000 7f2826ffd640 1 --2- 172.21.15.172:0/4210502453 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2828100d40 0x7f2828197e60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2818004770 tx=0x7f28180042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:59.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:59.940+0000 7f281ffff640 1 -- 172.21.15.172:0/4210502453 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f281803f030 con 0x7f2828100d40 2024-09-11T23:25:59.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:59.940+0000 7f282d312640 1 -- 172.21.15.172:0/4210502453 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f282819fd20 con 0x7f2828100d40 2024-09-11T23:25:59.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:59.940+0000 7f281ffff640 1 -- 172.21.15.172:0/4210502453 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2818003cb0 con 0x7f2828100d40 2024-09-11T23:25:59.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:59.940+0000 7f281ffff640 1 -- 172.21.15.172:0/4210502453 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2818035070 con 0x7f2828100d40 2024-09-11T23:25:59.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:59.940+0000 7f282d312640 1 -- 172.21.15.172:0/4210502453 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28281a01b0 con 0x7f2828100d40 2024-09-11T23:25:59.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:59.941+0000 7f282d312640 1 -- 172.21.15.172:0/4210502453 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2828107fa0 con 0x7f2828100d40 2024-09-11T23:25:59.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:59.942+0000 7f281ffff640 1 -- 172.21.15.172:0/4210502453 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f2818042030 con 0x7f2828100d40 2024-09-11T23:25:59.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:59.942+0000 7f281ffff640 1 --2- 172.21.15.172:0/4210502453 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f28140a2bb0 0x7f28140a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:59.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:59.943+0000 7f281ffff640 1 -- 172.21.15.172:0/4210502453 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f28180ef280 con 0x7f2828100d40 2024-09-11T23:25:59.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:59.943+0000 7f28267fc640 1 --2- 172.21.15.172:0/4210502453 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f28140a2bb0 0x7f28140a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:59.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:59.943+0000 7f28267fc640 1 --2- 172.21.15.172:0/4210502453 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f28140a2bb0 0x7f28140a5070 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2810005fd0 tx=0x7f2810005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:59.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:25:59.947+0000 7f281ffff640 1 -- 172.21.15.172:0/4210502453 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f28180bc680 con 0x7f2828100d40 2024-09-11T23:26:00.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:26:00.122+0000 7f282d312640 1 -- 172.21.15.172:0/4210502453 --> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi159=b;smithi159=e;smithi159=h;smithi159=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l", "target": ["mon-mgr", ""]}) -- 0x7f28280627f0 con 0x7f28140a2bb0 2024-09-11T23:26:00.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:26:00.130+0000 7f281ffff640 1 -- 172.21.15.172:0/4210502453 <== mgr.14148 v2:172.21.15.5:6800/2285128668 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f28280627f0 con 0x7f28140a2bb0 2024-09-11T23:26:00.130 INFO:teuthology.orchestra.run.smithi172.stdout:Scheduled mds.all update... 2024-09-11T23:26:00.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:26:00.132+0000 7f282d312640 1 -- 172.21.15.172:0/4210502453 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f28140a2bb0 msgr2=0x7f28140a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:00.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:26:00.132+0000 7f282d312640 1 --2- 172.21.15.172:0/4210502453 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f28140a2bb0 0x7f28140a5070 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2810005fd0 tx=0x7f2810005850 comp rx=0 tx=0).stop 2024-09-11T23:26:00.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:26:00.133+0000 7f282d312640 1 -- 172.21.15.172:0/4210502453 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2828100d40 msgr2=0x7f2828197e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:00.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:26:00.133+0000 7f282d312640 1 --2- 172.21.15.172:0/4210502453 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2828100d40 0x7f2828197e60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2818004770 tx=0x7f28180042f0 comp rx=0 tx=0).stop 2024-09-11T23:26:00.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:26:00.133+0000 7f282d312640 1 -- 172.21.15.172:0/4210502453 shutdown_connections 2024-09-11T23:26:00.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:26:00.133+0000 7f282d312640 1 --2- 172.21.15.172:0/4210502453 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f28140a2bb0 0x7f28140a5070 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:00.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:26:00.133+0000 7f282d312640 1 --2- 172.21.15.172:0/4210502453 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2828102170 0x7f282819f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:00.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:26:00.133+0000 7f282d312640 1 --2- 172.21.15.172:0/4210502453 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2828101700 0x7f28281983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:00.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:26:00.133+0000 7f282d312640 1 --2- 172.21.15.172:0/4210502453 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2828100d40 0x7f2828197e60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:00.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:26:00.133+0000 7f282d312640 1 -- 172.21.15.172:0/4210502453 >> 172.21.15.172:0/4210502453 conn(0x7f28280fba40 msgr2=0x7f2828105170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:00.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:26:00.133+0000 7f282d312640 1 -- 172.21.15.172:0/4210502453 shutdown_connections 2024-09-11T23:26:00.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-11T23:26:00.133+0000 7f282d312640 1 -- 172.21.15.172:0/4210502453 wait complete. 2024-09-11T23:26:00.903 DEBUG:teuthology.orchestra.run.smithi005:mds.a> sudo journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mds.a.service 2024-09-11T23:26:00.906 DEBUG:teuthology.orchestra.run.smithi005:mds.d> sudo journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mds.d.service 2024-09-11T23:26:00.949 DEBUG:teuthology.orchestra.run.smithi005:mds.g> sudo journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mds.g.service 2024-09-11T23:26:00.991 DEBUG:teuthology.orchestra.run.smithi005:mds.j> sudo journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mds.j.service 2024-09-11T23:26:01.034 DEBUG:teuthology.orchestra.run.smithi159:mds.b> sudo journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mds.b.service 2024-09-11T23:26:01.037 DEBUG:teuthology.orchestra.run.smithi159:mds.e> sudo journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mds.e.service 2024-09-11T23:26:01.082 DEBUG:teuthology.orchestra.run.smithi159:mds.h> sudo journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mds.h.service 2024-09-11T23:26:01.125 DEBUG:teuthology.orchestra.run.smithi159:mds.k> sudo journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mds.k.service 2024-09-11T23:26:01.168 DEBUG:teuthology.orchestra.run.smithi172:mds.c> sudo journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mds.c.service 2024-09-11T23:26:01.170 DEBUG:teuthology.orchestra.run.smithi172:mds.f> sudo journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mds.f.service 2024-09-11T23:26:01.214 DEBUG:teuthology.orchestra.run.smithi172:mds.i> sudo journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mds.i.service 2024-09-11T23:26:01.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:01 smithi005 ceph-mon[31201]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:01.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:01 smithi005 ceph-mon[31201]: from='client.24409 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi159=b;smithi159=e;smithi159=h;smithi159=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:26:01.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:01 smithi005 ceph-mon[31201]: Saving service mds.all spec with placement smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi159=b;smithi159=e;smithi159=h;smithi159=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l;count:12 2024-09-11T23:26:01.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:01 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:01.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:01 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:26:01.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:01 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:26:01.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:01 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:26:01.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:01 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:01.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:01 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:26:01.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:01 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:26:01.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:01 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:26:01.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:01 smithi005 ceph-mon[31201]: Deploying daemon mds.l on smithi172 2024-09-11T23:26:01.257 DEBUG:teuthology.orchestra.run.smithi172:mds.l> sudo journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mds.l.service 2024-09-11T23:26:01.301 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-11T23:26:01.301 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:26:01.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:01 smithi159 ceph-mon[34394]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:01.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:01 smithi159 ceph-mon[34394]: from='client.24409 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi159=b;smithi159=e;smithi159=h;smithi159=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:26:01.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:01 smithi159 ceph-mon[34394]: Saving service mds.all spec with placement smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi159=b;smithi159=e;smithi159=h;smithi159=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l;count:12 2024-09-11T23:26:01.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:01 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:01.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:01 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:26:01.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:01 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:26:01.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:01 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:26:01.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:01 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:01.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:01 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:26:01.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:01 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:26:01.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:01 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:26:01.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:01 smithi159 ceph-mon[34394]: Deploying daemon mds.l on smithi172 2024-09-11T23:26:01.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:01 smithi172 ceph-mon[34855]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:01.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:01 smithi172 ceph-mon[34855]: from='client.24409 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi159=b;smithi159=e;smithi159=h;smithi159=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:26:01.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:01 smithi172 ceph-mon[34855]: Saving service mds.all spec with placement smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi159=b;smithi159=e;smithi159=h;smithi159=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l;count:12 2024-09-11T23:26:01.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:01 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:01.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:01 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:26:01.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:01 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:26:01.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:01 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:26:01.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:01 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:01.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:01 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:26:01.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:01 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:26:01.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:01 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:26:01.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:01 smithi172 ceph-mon[34855]: Deploying daemon mds.l on smithi172 2024-09-11T23:26:01.558 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:26:02.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.022+0000 7f54cd188640 1 -- 172.21.15.5:0/1897487913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54c8100a80 msgr2=0x7f54c8100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:02.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.022+0000 7f54cd188640 1 --2- 172.21.15.5:0/1897487913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54c8100a80 0x7f54c8100ee0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f54bc009930 tx=0x7f54bc02a420 comp rx=0 tx=0).stop 2024-09-11T23:26:02.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.022+0000 7f54cd188640 1 -- 172.21.15.5:0/1897487913 shutdown_connections 2024-09-11T23:26:02.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.022+0000 7f54cd188640 1 --2- 172.21.15.5:0/1897487913 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54c8101420 0x7f54c810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:02.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.022+0000 7f54cd188640 1 --2- 172.21.15.5:0/1897487913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54c8100a80 0x7f54c8100ee0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:02.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.022+0000 7f54cd188640 1 --2- 172.21.15.5:0/1897487913 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54c8106a80 0x7f54c8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:02.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.022+0000 7f54cd188640 1 -- 172.21.15.5:0/1897487913 >> 172.21.15.5:0/1897487913 conn(0x7f54c80fc7a0 msgr2=0x7f54c80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:02.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.022+0000 7f54cd188640 1 -- 172.21.15.5:0/1897487913 shutdown_connections 2024-09-11T23:26:02.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.022+0000 7f54cd188640 1 -- 172.21.15.5:0/1897487913 wait complete. 2024-09-11T23:26:02.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.023+0000 7f54cd188640 1 Processor -- start 2024-09-11T23:26:02.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.023+0000 7f54cd188640 1 -- start start 2024-09-11T23:26:02.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.024+0000 7f54cd188640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54c8100a80 0x7f54c80fcd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:02.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.024+0000 7f54cd188640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54c8101420 0x7f54c80fd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:02.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.024+0000 7f54cd188640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54c8106a80 0x7f54c80fd810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:02.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.024+0000 7f54cd188640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f54c8110d30 con 0x7f54c8101420 2024-09-11T23:26:02.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.024+0000 7f54cd188640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f54c8110bb0 con 0x7f54c8106a80 2024-09-11T23:26:02.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.024+0000 7f54cd188640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f54c8110eb0 con 0x7f54c8100a80 2024-09-11T23:26:02.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.024+0000 7f54c659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54c8101420 0x7f54c80fd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:02.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.024+0000 7f54c6d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54c8100a80 0x7f54c80fcd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:02.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.024+0000 7f54c659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54c8101420 0x7f54c80fd2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59826/0 (socket says 172.21.15.5:59826) 2024-09-11T23:26:02.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.024+0000 7f54c659c640 1 -- 172.21.15.5:0/2904118448 learned_addr learned my addr 172.21.15.5:0/2904118448 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:26:02.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.024+0000 7f54c759e640 1 --2- 172.21.15.5:0/2904118448 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54c8106a80 0x7f54c80fd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:02.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.024+0000 7f54c6d9d640 1 -- 172.21.15.5:0/2904118448 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54c8106a80 msgr2=0x7f54c80fd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:02.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.024+0000 7f54c6d9d640 1 --2- 172.21.15.5:0/2904118448 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54c8106a80 0x7f54c80fd810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:02.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.024+0000 7f54c6d9d640 1 -- 172.21.15.5:0/2904118448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54c8101420 msgr2=0x7f54c80fd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:02.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.024+0000 7f54c6d9d640 1 --2- 172.21.15.5:0/2904118448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54c8101420 0x7f54c80fd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:02.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.024+0000 7f54c6d9d640 1 -- 172.21.15.5:0/2904118448 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54c81a6880 con 0x7f54c8100a80 2024-09-11T23:26:02.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.024+0000 7f54c659c640 1 --2- 172.21.15.5:0/2904118448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54c8101420 0x7f54c80fd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:26:02.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.024+0000 7f54c6d9d640 1 --2- 172.21.15.5:0/2904118448 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54c8100a80 0x7f54c80fcd90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f54b800e9f0 tx=0x7f54b800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:02.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.025+0000 7f54affff640 1 -- 172.21.15.5:0/2904118448 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b800ccc0 con 0x7f54c8100a80 2024-09-11T23:26:02.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.025+0000 7f54cd188640 1 -- 172.21.15.5:0/2904118448 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54c81a6b70 con 0x7f54c8100a80 2024-09-11T23:26:02.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.025+0000 7f54affff640 1 -- 172.21.15.5:0/2904118448 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f54b80108e0 con 0x7f54c8100a80 2024-09-11T23:26:02.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.025+0000 7f54affff640 1 -- 172.21.15.5:0/2904118448 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b8018880 con 0x7f54c8100a80 2024-09-11T23:26:02.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.025+0000 7f54cd188640 1 -- 172.21.15.5:0/2904118448 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54c81a70d0 con 0x7f54c8100a80 2024-09-11T23:26:02.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.026+0000 7f54cd188640 1 -- 172.21.15.5:0/2904118448 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54c8100ee0 con 0x7f54c8100a80 2024-09-11T23:26:02.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.027+0000 7f54affff640 1 -- 172.21.15.5:0/2904118448 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f54b8010a90 con 0x7f54c8100a80 2024-09-11T23:26:02.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.028+0000 7f54affff640 1 --2- 172.21.15.5:0/2904118448 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f54b00a2b80 0x7f54b00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:02.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.028+0000 7f54c659c640 1 --2- 172.21.15.5:0/2904118448 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f54b00a2b80 0x7f54b00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:02.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.028+0000 7f54affff640 1 -- 172.21.15.5:0/2904118448 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f54b80cf3a0 con 0x7f54c8100a80 2024-09-11T23:26:02.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.028+0000 7f54c659c640 1 --2- 172.21.15.5:0/2904118448 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f54b00a2b80 0x7f54b00a5040 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f54bc000c00 tx=0x7f54bc0058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:02.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.031+0000 7f54affff640 1 -- 172.21.15.5:0/2904118448 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f54b809c0b0 con 0x7f54c8100a80 2024-09-11T23:26:02.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.245+0000 7f54cd188640 1 -- 172.21.15.5:0/2904118448 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f54c80fe2c0 con 0x7f54c8100a80 2024-09-11T23:26:02.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.246+0000 7f54affff640 1 -- 172.21.15.5:0/2904118448 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f54b80a03b0 con 0x7f54c8100a80 2024-09-11T23:26:02.246 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:26:02.246 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":1,"btime":"2024-09-11T23:19:00:051658+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-11T23:26:02.247 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 1 2024-09-11T23:26:02.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.248+0000 7f54cd188640 1 -- 172.21.15.5:0/2904118448 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f54b00a2b80 msgr2=0x7f54b00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:02.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.248+0000 7f54cd188640 1 --2- 172.21.15.5:0/2904118448 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f54b00a2b80 0x7f54b00a5040 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f54bc000c00 tx=0x7f54bc0058d0 comp rx=0 tx=0).stop 2024-09-11T23:26:02.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.248+0000 7f54cd188640 1 -- 172.21.15.5:0/2904118448 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54c8100a80 msgr2=0x7f54c80fcd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:02.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.248+0000 7f54cd188640 1 --2- 172.21.15.5:0/2904118448 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54c8100a80 0x7f54c80fcd90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f54b800e9f0 tx=0x7f54b800eeb0 comp rx=0 tx=0).stop 2024-09-11T23:26:02.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.248+0000 7f54cd188640 1 -- 172.21.15.5:0/2904118448 shutdown_connections 2024-09-11T23:26:02.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.248+0000 7f54cd188640 1 --2- 172.21.15.5:0/2904118448 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f54b00a2b80 0x7f54b00a5040 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:02.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.248+0000 7f54cd188640 1 --2- 172.21.15.5:0/2904118448 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54c8106a80 0x7f54c80fd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:02.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.248+0000 7f54cd188640 1 --2- 172.21.15.5:0/2904118448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54c8101420 0x7f54c80fd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:02.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.248+0000 7f54cd188640 1 --2- 172.21.15.5:0/2904118448 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54c8100a80 0x7f54c80fcd90 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:02.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.248+0000 7f54cd188640 1 -- 172.21.15.5:0/2904118448 >> 172.21.15.5:0/2904118448 conn(0x7f54c80fc7a0 msgr2=0x7f54c806aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:02.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.248+0000 7f54cd188640 1 -- 172.21.15.5:0/2904118448 shutdown_connections 2024-09-11T23:26:02.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:02.248+0000 7f54cd188640 1 -- 172.21.15.5:0/2904118448 wait complete. 2024-09-11T23:26:02.821 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 11 23:26:02 smithi172 systemd[1]: Starting Ceph mds.l for 1f5284d2-7094-11ef-bcea-c7b262605968... 2024-09-11T23:26:03.089 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 11 23:26:02 smithi172 podman[63810]: 2024-09-11 23:26:02.821369472 +0000 UTC m=+0.113700048 container create 568f52ec07f3ed90f29a34e8e26e68be78743ec3cf6ab9eb81c3db46ea3ce5a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-l, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-11T23:26:03.090 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 11 23:26:02 smithi172 podman[63810]: 2024-09-11 23:26:02.724510581 +0000 UTC m=+0.016841166 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:26:03.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:03 smithi172 ceph-mon[34855]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:03.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:03 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/2904118448' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:26:03.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:03 smithi172 ceph-mon[34855]: mds.? [v2:172.21.15.172:6832/3113658116,v1:172.21.15.172:6833/3113658116] up:boot 2024-09-11T23:26:03.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:03 smithi172 ceph-mon[34855]: fsmap 1 up:standby 2024-09-11T23:26:03.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:03 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-11T23:26:03.384 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 11 23:26:03 smithi172 podman[63810]: 2024-09-11 23:26:03.090798668 +0000 UTC m=+0.383129243 container init 568f52ec07f3ed90f29a34e8e26e68be78743ec3cf6ab9eb81c3db46ea3ce5a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-l, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-11T23:26:03.385 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 11 23:26:03 smithi172 podman[63810]: 2024-09-11 23:26:03.093636915 +0000 UTC m=+0.385967491 container start 568f52ec07f3ed90f29a34e8e26e68be78743ec3cf6ab9eb81c3db46ea3ce5a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-l, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T23:26:03.385 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 11 23:26:03 smithi172 ceph-mds[63829]: -- 172.21.15.172:0/1410186650 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56033e3cd860 con 0x56033e3ab400 2024-09-11T23:26:03.385 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 11 23:26:03 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-l[63825]: starting mds.l at 2024-09-11T23:26:03.385 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 11 23:26:03 smithi172 bash[63810]: 568f52ec07f3ed90f29a34e8e26e68be78743ec3cf6ab9eb81c3db46ea3ce5a0 2024-09-11T23:26:03.385 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 11 23:26:03 smithi172 systemd[1]: Started Ceph mds.l for 1f5284d2-7094-11ef-bcea-c7b262605968. 2024-09-11T23:26:03.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:03 smithi005 ceph-mon[31201]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:03.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:03 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/2904118448' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:26:03.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:03 smithi005 ceph-mon[31201]: mds.? [v2:172.21.15.172:6832/3113658116,v1:172.21.15.172:6833/3113658116] up:boot 2024-09-11T23:26:03.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:03 smithi005 ceph-mon[31201]: fsmap 1 up:standby 2024-09-11T23:26:03.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:03 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-11T23:26:03.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:03 smithi159 ceph-mon[34394]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:03.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:03 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/2904118448' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:26:03.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:03 smithi159 ceph-mon[34394]: mds.? [v2:172.21.15.172:6832/3113658116,v1:172.21.15.172:6833/3113658116] up:boot 2024-09-11T23:26:03.627 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:03 smithi159 ceph-mon[34394]: fsmap 1 up:standby 2024-09-11T23:26:03.627 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:03 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-11T23:26:04.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:04 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:04.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:04 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:04.627 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:04 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:04.627 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:04 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:26:04.627 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:04 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:26:04.627 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:04 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:26:04.627 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:04 smithi159 ceph-mon[34394]: Deploying daemon mds.k on smithi159 2024-09-11T23:26:04.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:04 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:04.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:04 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:04.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:04 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:04.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:04 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:26:04.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:04 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:26:04.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:04 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:26:04.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:04 smithi172 ceph-mon[34855]: Deploying daemon mds.k on smithi159 2024-09-11T23:26:04.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:04 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:04.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:04 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:04.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:04 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:04.725 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:04 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:26:04.725 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:04 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:26:04.725 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:04 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:26:04.725 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:04 smithi005 ceph-mon[31201]: Deploying daemon mds.k on smithi159 2024-09-11T23:26:05.076 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:26:05.344 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:26:05.464 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:05 smithi005 ceph-mon[31201]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:05.535 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:05 smithi159 ceph-mon[34394]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:05.536 INFO:journalctl@ceph.mds.k.smithi159.stdout:Sep 11 23:26:05 smithi159 systemd[1]: Starting Ceph mds.k for 1f5284d2-7094-11ef-bcea-c7b262605968... 2024-09-11T23:26:05.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:05 smithi172 ceph-mon[34855]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:05.822 INFO:journalctl@ceph.mds.k.smithi159.stdout:Sep 11 23:26:05 smithi159 podman[63566]: 2024-09-11 23:26:05.438833701 +0000 UTC m=+0.015507253 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:26:05.822 INFO:journalctl@ceph.mds.k.smithi159.stdout:Sep 11 23:26:05 smithi159 podman[63566]: 2024-09-11 23:26:05.594893369 +0000 UTC m=+0.171566913 container create 75a8503077496deea605ced73188b934c00d2c0dbfaa107b89d08a9bc5f9550f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-k, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3) 2024-09-11T23:26:05.822 INFO:journalctl@ceph.mds.k.smithi159.stdout:Sep 11 23:26:05 smithi159 podman[63566]: 2024-09-11 23:26:05.82278423 +0000 UTC m=+0.399457788 container init 75a8503077496deea605ced73188b934c00d2c0dbfaa107b89d08a9bc5f9550f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-k, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-11T23:26:05.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:05.824+0000 7f1b10730640 1 -- 172.21.15.5:0/305227963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b08106f50 msgr2=0x7f1b0810eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:05.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:05.824+0000 7f1b10730640 1 --2- 172.21.15.5:0/305227963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b08106f50 0x7f1b0810eaf0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1b00009cd0 tx=0x7f1b0002a8e0 comp rx=0 tx=0).stop 2024-09-11T23:26:05.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:05.824+0000 7f1b10730640 1 -- 172.21.15.5:0/305227963 shutdown_connections 2024-09-11T23:26:05.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:05.824+0000 7f1b10730640 1 --2- 172.21.15.5:0/305227963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b08106f50 0x7f1b0810eaf0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:05.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:05.824+0000 7f1b10730640 1 --2- 172.21.15.5:0/305227963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b08100ca0 0x7f1b08106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:05.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:05.824+0000 7f1b10730640 1 --2- 172.21.15.5:0/305227963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b081002f0 0x7f1b081006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:05.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:05.824+0000 7f1b10730640 1 -- 172.21.15.5:0/305227963 >> 172.21.15.5:0/305227963 conn(0x7f1b08077210 msgr2=0x7f1b080fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:05.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:05.824+0000 7f1b10730640 1 -- 172.21.15.5:0/305227963 shutdown_connections 2024-09-11T23:26:05.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:05.824+0000 7f1b10730640 1 -- 172.21.15.5:0/305227963 wait complete. 2024-09-11T23:26:05.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:05.825+0000 7f1b10730640 1 Processor -- start 2024-09-11T23:26:05.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:05.825+0000 7f1b10730640 1 -- start start 2024-09-11T23:26:05.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:05.825+0000 7f1b10730640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b081002f0 0x7f1b08198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:05.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:05.825+0000 7f1b10730640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b08100ca0 0x7f1b08198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:05.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:05.825+0000 7f1b10730640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b08106f50 0x7f1b0819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:05.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:05.825+0000 7f1b10730640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1b08111eb0 con 0x7f1b081002f0 2024-09-11T23:26:05.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:05.825+0000 7f1b10730640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1b08111d30 con 0x7f1b08106f50 2024-09-11T23:26:05.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:05.825+0000 7f1b10730640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1b08112030 con 0x7f1b08100ca0 2024-09-11T23:26:05.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:05.825+0000 7f1b0e4cc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b081002f0 0x7f1b08198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:05.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:05.825+0000 7f1b0e4cc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b081002f0 0x7f1b08198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33322/0 (socket says 172.21.15.5:33322) 2024-09-11T23:26:05.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:05.825+0000 7f1b0e4cc640 1 -- 172.21.15.5:0/1604329568 learned_addr learned my addr 172.21.15.5:0/1604329568 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:26:05.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:05.825+0000 7f1b0eccd640 1 --2- 172.21.15.5:0/1604329568 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b08106f50 0x7f1b0819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:05.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:05.826+0000 7f1b0dccb640 1 --2- 172.21.15.5:0/1604329568 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b08100ca0 0x7f1b08198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:05.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:05.826+0000 7f1b0e4cc640 1 -- 172.21.15.5:0/1604329568 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b08100ca0 msgr2=0x7f1b08198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:05.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:05.826+0000 7f1b0e4cc640 1 --2- 172.21.15.5:0/1604329568 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b08100ca0 0x7f1b08198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:05.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:05.826+0000 7f1b0e4cc640 1 -- 172.21.15.5:0/1604329568 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b08106f50 msgr2=0x7f1b0819cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:05.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:05.826+0000 7f1b0e4cc640 1 --2- 172.21.15.5:0/1604329568 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b08106f50 0x7f1b0819cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:05.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:05.826+0000 7f1b0e4cc640 1 -- 172.21.15.5:0/1604329568 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b0819d3c0 con 0x7f1b081002f0 2024-09-11T23:26:05.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:05.826+0000 7f1b0dccb640 1 --2- 172.21.15.5:0/1604329568 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b08100ca0 0x7f1b08198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:26:05.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:05.826+0000 7f1b0e4cc640 1 --2- 172.21.15.5:0/1604329568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b081002f0 0x7f1b08198410 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1b0400d950 tx=0x7f1b0400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:05.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:05.826+0000 7f1aff7fe640 1 -- 172.21.15.5:0/1604329568 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b04017030 con 0x7f1b081002f0 2024-09-11T23:26:05.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:05.826+0000 7f1aff7fe640 1 -- 172.21.15.5:0/1604329568 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1b04004020 con 0x7f1b081002f0 2024-09-11T23:26:05.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:05.826+0000 7f1b10730640 1 -- 172.21.15.5:0/1604329568 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b0819d6b0 con 0x7f1b081002f0 2024-09-11T23:26:05.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:05.826+0000 7f1aff7fe640 1 -- 172.21.15.5:0/1604329568 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b040047a0 con 0x7f1b081002f0 2024-09-11T23:26:05.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:05.826+0000 7f1b10730640 1 -- 172.21.15.5:0/1604329568 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b081a4f90 con 0x7f1b081002f0 2024-09-11T23:26:05.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:05.827+0000 7f1b10730640 1 -- 172.21.15.5:0/1604329568 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b081006d0 con 0x7f1b081002f0 2024-09-11T23:26:05.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:05.828+0000 7f1aff7fe640 1 -- 172.21.15.5:0/1604329568 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f1b040041d0 con 0x7f1b081002f0 2024-09-11T23:26:05.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:05.829+0000 7f1aff7fe640 1 --2- 172.21.15.5:0/1604329568 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f1af40a2b80 0x7f1af40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:05.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:05.829+0000 7f1aff7fe640 1 -- 172.21.15.5:0/1604329568 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f1b040ce690 con 0x7f1b081002f0 2024-09-11T23:26:05.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:05.829+0000 7f1b0dccb640 1 --2- 172.21.15.5:0/1604329568 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f1af40a2b80 0x7f1af40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:05.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:05.830+0000 7f1b0dccb640 1 --2- 172.21.15.5:0/1604329568 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f1af40a2b80 0x7f1af40a5040 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1af8006fd0 tx=0x7f1af8008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:05.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:05.834+0000 7f1aff7fe640 1 -- 172.21.15.5:0/1604329568 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1b0409b9f0 con 0x7f1b081002f0 2024-09-11T23:26:06.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:06.047+0000 7f1b10730640 1 -- 172.21.15.5:0/1604329568 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1b0802d7c0 con 0x7f1b081002f0 2024-09-11T23:26:06.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:06.047+0000 7f1aff7fe640 1 -- 172.21.15.5:0/1604329568 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7f1b0409b2f0 con 0x7f1b081002f0 2024-09-11T23:26:06.048 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:26:06.048 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":2,"btime":"2024-09-11T23:26:03:122149+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3113658116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3113658116},{"type":"v1","addr":"172.21.15.172:6833","nonce":3113658116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-11T23:26:06.049 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 2 2024-09-11T23:26:06.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:06.050+0000 7f1b10730640 1 -- 172.21.15.5:0/1604329568 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f1af40a2b80 msgr2=0x7f1af40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:06.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:06.050+0000 7f1b10730640 1 --2- 172.21.15.5:0/1604329568 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f1af40a2b80 0x7f1af40a5040 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1af8006fd0 tx=0x7f1af8008040 comp rx=0 tx=0).stop 2024-09-11T23:26:06.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:06.050+0000 7f1b10730640 1 -- 172.21.15.5:0/1604329568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b081002f0 msgr2=0x7f1b08198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:06.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:06.050+0000 7f1b10730640 1 --2- 172.21.15.5:0/1604329568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b081002f0 0x7f1b08198410 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1b0400d950 tx=0x7f1b0400de10 comp rx=0 tx=0).stop 2024-09-11T23:26:06.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:06.050+0000 7f1b10730640 1 -- 172.21.15.5:0/1604329568 shutdown_connections 2024-09-11T23:26:06.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:06.050+0000 7f1b10730640 1 --2- 172.21.15.5:0/1604329568 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f1af40a2b80 0x7f1af40a5040 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:06.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:06.050+0000 7f1b10730640 1 --2- 172.21.15.5:0/1604329568 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b08106f50 0x7f1b0819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:06.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:06.050+0000 7f1b10730640 1 --2- 172.21.15.5:0/1604329568 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b08100ca0 0x7f1b08198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:06.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:06.050+0000 7f1b10730640 1 --2- 172.21.15.5:0/1604329568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b081002f0 0x7f1b08198410 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:06.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:06.050+0000 7f1b10730640 1 -- 172.21.15.5:0/1604329568 >> 172.21.15.5:0/1604329568 conn(0x7f1b08077210 msgr2=0x7f1b081051d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:06.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:06.051+0000 7f1b10730640 1 -- 172.21.15.5:0/1604329568 shutdown_connections 2024-09-11T23:26:06.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:06.051+0000 7f1b10730640 1 -- 172.21.15.5:0/1604329568 wait complete. 2024-09-11T23:26:06.126 INFO:journalctl@ceph.mds.k.smithi159.stdout:Sep 11 23:26:05 smithi159 podman[63566]: 2024-09-11 23:26:05.825932455 +0000 UTC m=+0.402606011 container start 75a8503077496deea605ced73188b934c00d2c0dbfaa107b89d08a9bc5f9550f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-k, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0) 2024-09-11T23:26:06.127 INFO:journalctl@ceph.mds.k.smithi159.stdout:Sep 11 23:26:05 smithi159 ceph-mds[63585]: -- 172.21.15.159:0/2666195911 <== mon.2 v2:172.21.15.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c17bd39860 con 0x55c17bd16800 2024-09-11T23:26:06.127 INFO:journalctl@ceph.mds.k.smithi159.stdout:Sep 11 23:26:05 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-k[63581]: starting mds.k at 2024-09-11T23:26:06.127 INFO:journalctl@ceph.mds.k.smithi159.stdout:Sep 11 23:26:05 smithi159 bash[63566]: 75a8503077496deea605ced73188b934c00d2c0dbfaa107b89d08a9bc5f9550f 2024-09-11T23:26:06.127 INFO:journalctl@ceph.mds.k.smithi159.stdout:Sep 11 23:26:05 smithi159 systemd[1]: Started Ceph mds.k for 1f5284d2-7094-11ef-bcea-c7b262605968. 2024-09-11T23:26:07.118 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:06 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:07.118 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:06 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:07.118 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:06 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:07.118 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:06 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:26:07.118 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:06 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:26:07.118 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:06 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:26:07.118 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:06 smithi005 ceph-mon[31201]: Deploying daemon mds.j on smithi005 2024-09-11T23:26:07.118 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:06 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/1604329568' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:26:07.118 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:06 smithi005 ceph-mon[31201]: mds.? [v2:172.21.15.159:6832/3887336060,v1:172.21.15.159:6833/3887336060] up:boot 2024-09-11T23:26:07.119 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:06 smithi005 ceph-mon[31201]: fsmap 2 up:standby 2024-09-11T23:26:07.119 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:06 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-11T23:26:07.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:06 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:07.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:06 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:07.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:06 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:07.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:06 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:26:07.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:06 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:26:07.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:06 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:26:07.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:06 smithi159 ceph-mon[34394]: Deploying daemon mds.j on smithi005 2024-09-11T23:26:07.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:06 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/1604329568' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:26:07.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:06 smithi159 ceph-mon[34394]: mds.? [v2:172.21.15.159:6832/3887336060,v1:172.21.15.159:6833/3887336060] up:boot 2024-09-11T23:26:07.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:06 smithi159 ceph-mon[34394]: fsmap 2 up:standby 2024-09-11T23:26:07.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:06 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-11T23:26:07.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:06 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:07.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:06 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:07.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:06 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:07.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:06 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:26:07.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:06 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:26:07.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:06 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:26:07.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:06 smithi172 ceph-mon[34855]: Deploying daemon mds.j on smithi005 2024-09-11T23:26:07.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:06 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/1604329568' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:26:07.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:06 smithi172 ceph-mon[34855]: mds.? [v2:172.21.15.159:6832/3887336060,v1:172.21.15.159:6833/3887336060] up:boot 2024-09-11T23:26:07.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:06 smithi172 ceph-mon[34855]: fsmap 2 up:standby 2024-09-11T23:26:07.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:06 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-11T23:26:08.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:07 smithi159 ceph-mon[34394]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:08.386 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:07 smithi172 ceph-mon[34855]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:08.392 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:07 smithi005 ceph-mon[31201]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:08.724 INFO:journalctl@ceph.mds.j.smithi005.stdout:Sep 11 23:26:08 smithi005 systemd[1]: Starting Ceph mds.j for 1f5284d2-7094-11ef-bcea-c7b262605968... 2024-09-11T23:26:08.849 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:26:09.064 INFO:journalctl@ceph.mds.j.smithi005.stdout:Sep 11 23:26:08 smithi005 podman[70793]: 2024-09-11 23:26:08.689029723 +0000 UTC m=+0.016456195 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:26:09.064 INFO:journalctl@ceph.mds.j.smithi005.stdout:Sep 11 23:26:08 smithi005 podman[70793]: 2024-09-11 23:26:08.803419766 +0000 UTC m=+0.130846226 container create 6fd8b844226b0398d417afe7d8597df55bdda6101df46afe77c22c569d8f987b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-j, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T23:26:09.064 INFO:journalctl@ceph.mds.j.smithi005.stdout:Sep 11 23:26:09 smithi005 podman[70793]: 2024-09-11 23:26:09.064825173 +0000 UTC m=+0.392251636 container init 6fd8b844226b0398d417afe7d8597df55bdda6101df46afe77c22c569d8f987b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-j, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-11T23:26:09.217 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:26:09.340 INFO:journalctl@ceph.mds.j.smithi005.stdout:Sep 11 23:26:09 smithi005 podman[70793]: 2024-09-11 23:26:09.068567139 +0000 UTC m=+0.395993607 container start 6fd8b844226b0398d417afe7d8597df55bdda6101df46afe77c22c569d8f987b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3) 2024-09-11T23:26:09.340 INFO:journalctl@ceph.mds.j.smithi005.stdout:Sep 11 23:26:09 smithi005 ceph-mds[70841]: -- 172.21.15.5:0/3189884758 <== mon.0 v2:172.21.15.5:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5611acbf3860 con 0x5611acbd1000 2024-09-11T23:26:09.340 INFO:journalctl@ceph.mds.j.smithi005.stdout:Sep 11 23:26:09 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-j[70826]: starting mds.j at 2024-09-11T23:26:09.340 INFO:journalctl@ceph.mds.j.smithi005.stdout:Sep 11 23:26:09 smithi005 bash[70793]: 6fd8b844226b0398d417afe7d8597df55bdda6101df46afe77c22c569d8f987b 2024-09-11T23:26:09.341 INFO:journalctl@ceph.mds.j.smithi005.stdout:Sep 11 23:26:09 smithi005 systemd[1]: Started Ceph mds.j for 1f5284d2-7094-11ef-bcea-c7b262605968. 2024-09-11T23:26:09.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.769+0000 7f924a4a6640 1 -- 172.21.15.5:0/1485957937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9244102790 msgr2=0x7f92441067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:09.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.769+0000 7f924a4a6640 1 --2- 172.21.15.5:0/1485957937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9244102790 0x7f92441067e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9238009900 tx=0x7f923802a410 comp rx=0 tx=0).stop 2024-09-11T23:26:09.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.769+0000 7f924a4a6640 1 -- 172.21.15.5:0/1485957937 shutdown_connections 2024-09-11T23:26:09.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.769+0000 7f924a4a6640 1 --2- 172.21.15.5:0/1485957937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9244106f10 0x7f924410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:09.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.769+0000 7f924a4a6640 1 --2- 172.21.15.5:0/1485957937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9244102790 0x7f92441067e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:09.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.769+0000 7f924a4a6640 1 --2- 172.21.15.5:0/1485957937 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9244101de0 0x7f92441021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:09.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.769+0000 7f924a4a6640 1 -- 172.21.15.5:0/1485957937 >> 172.21.15.5:0/1485957937 conn(0x7f92440fd8c0 msgr2=0x7f92440ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:09.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.769+0000 7f924a4a6640 1 -- 172.21.15.5:0/1485957937 shutdown_connections 2024-09-11T23:26:09.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.769+0000 7f924a4a6640 1 -- 172.21.15.5:0/1485957937 wait complete. 2024-09-11T23:26:09.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.770+0000 7f924a4a6640 1 Processor -- start 2024-09-11T23:26:09.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.770+0000 7f924a4a6640 1 -- start start 2024-09-11T23:26:09.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.770+0000 7f924a4a6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9244101de0 0x7f9244198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:09.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.770+0000 7f924a4a6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9244102790 0x7f92441988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:09.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.770+0000 7f924a4a6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9244106f10 0x7f924419cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:09.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.770+0000 7f924a4a6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9244111e20 con 0x7f9244102790 2024-09-11T23:26:09.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.770+0000 7f924a4a6640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9244111ca0 con 0x7f9244106f10 2024-09-11T23:26:09.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.770+0000 7f924a4a6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9244111fa0 con 0x7f9244101de0 2024-09-11T23:26:09.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.771+0000 7f92437fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9244102790 0x7f92441988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:09.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.771+0000 7f92437fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9244102790 0x7f92441988a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33362/0 (socket says 172.21.15.5:33362) 2024-09-11T23:26:09.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.771+0000 7f92437fe640 1 -- 172.21.15.5:0/31498502 learned_addr learned my addr 172.21.15.5:0/31498502 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:26:09.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.771+0000 7f9248a43640 1 --2- 172.21.15.5:0/31498502 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9244106f10 0x7f924419cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:09.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.771+0000 7f9243fff640 1 --2- 172.21.15.5:0/31498502 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9244101de0 0x7f9244198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:09.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.771+0000 7f92437fe640 1 -- 172.21.15.5:0/31498502 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9244101de0 msgr2=0x7f9244198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:09.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.771+0000 7f92437fe640 1 --2- 172.21.15.5:0/31498502 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9244101de0 0x7f9244198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:09.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.771+0000 7f92437fe640 1 -- 172.21.15.5:0/31498502 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9244106f10 msgr2=0x7f924419cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:09.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.771+0000 7f92437fe640 1 --2- 172.21.15.5:0/31498502 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9244106f10 0x7f924419cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:09.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.771+0000 7f92437fe640 1 -- 172.21.15.5:0/31498502 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f924419d310 con 0x7f9244102790 2024-09-11T23:26:09.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.771+0000 7f92437fe640 1 --2- 172.21.15.5:0/31498502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9244102790 0x7f92441988a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9238005940 tx=0x7f9238004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:09.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.771+0000 7f92417fa640 1 -- 172.21.15.5:0/31498502 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f923803f030 con 0x7f9244102790 2024-09-11T23:26:09.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.771+0000 7f92417fa640 1 -- 172.21.15.5:0/31498502 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9238003aa0 con 0x7f9244102790 2024-09-11T23:26:09.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.771+0000 7f924a4a6640 1 -- 172.21.15.5:0/31498502 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f924419d5a0 con 0x7f9244102790 2024-09-11T23:26:09.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.771+0000 7f92417fa640 1 -- 172.21.15.5:0/31498502 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9238035070 con 0x7f9244102790 2024-09-11T23:26:09.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.771+0000 7f924a4a6640 1 -- 172.21.15.5:0/31498502 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92441a4ee0 con 0x7f9244102790 2024-09-11T23:26:09.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.772+0000 7f924a4a6640 1 -- 172.21.15.5:0/31498502 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92441021c0 con 0x7f9244102790 2024-09-11T23:26:09.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.774+0000 7f92417fa640 1 -- 172.21.15.5:0/31498502 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f9238042030 con 0x7f9244102790 2024-09-11T23:26:09.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.774+0000 7f92417fa640 1 --2- 172.21.15.5:0/31498502 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f922c0a2b80 0x7f922c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:09.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.774+0000 7f9243fff640 1 --2- 172.21.15.5:0/31498502 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f922c0a2b80 0x7f922c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:09.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.774+0000 7f92417fa640 1 -- 172.21.15.5:0/31498502 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f92380ef350 con 0x7f9244102790 2024-09-11T23:26:09.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.775+0000 7f9243fff640 1 --2- 172.21.15.5:0/31498502 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f922c0a2b80 0x7f922c0a5040 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9234005fd0 tx=0x7f9234005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:09.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.779+0000 7f92417fa640 1 -- 172.21.15.5:0/31498502 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f92380bc750 con 0x7f9244102790 2024-09-11T23:26:09.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.995+0000 7f924a4a6640 1 -- 172.21.15.5:0/31498502 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f924410a0f0 con 0x7f9244102790 2024-09-11T23:26:09.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.996+0000 7f92417fa640 1 -- 172.21.15.5:0/31498502 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2266 (secure 0 0 0) 0x7f92380bc050 con 0x7f9244102790 2024-09-11T23:26:09.996 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:26:09.996 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":3,"btime":"2024-09-11T23:26:06:262876+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3113658116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3113658116},{"type":"v1","addr":"172.21.15.172:6833","nonce":3113658116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3887336060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3887336060},{"type":"v1","addr":"172.21.15.159:6833","nonce":3887336060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-11T23:26:09.996 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 3 2024-09-11T23:26:09.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.998+0000 7f924a4a6640 1 -- 172.21.15.5:0/31498502 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f922c0a2b80 msgr2=0x7f922c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:09.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.998+0000 7f924a4a6640 1 --2- 172.21.15.5:0/31498502 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f922c0a2b80 0x7f922c0a5040 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9234005fd0 tx=0x7f9234005850 comp rx=0 tx=0).stop 2024-09-11T23:26:09.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.998+0000 7f924a4a6640 1 -- 172.21.15.5:0/31498502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9244102790 msgr2=0x7f92441988a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:09.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.998+0000 7f924a4a6640 1 --2- 172.21.15.5:0/31498502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9244102790 0x7f92441988a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9238005940 tx=0x7f9238004270 comp rx=0 tx=0).stop 2024-09-11T23:26:09.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.998+0000 7f924a4a6640 1 -- 172.21.15.5:0/31498502 shutdown_connections 2024-09-11T23:26:09.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.998+0000 7f924a4a6640 1 --2- 172.21.15.5:0/31498502 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f922c0a2b80 0x7f922c0a5040 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:09.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.998+0000 7f924a4a6640 1 --2- 172.21.15.5:0/31498502 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9244106f10 0x7f924419cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:09.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.998+0000 7f924a4a6640 1 --2- 172.21.15.5:0/31498502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9244102790 0x7f92441988a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:09.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.998+0000 7f924a4a6640 1 --2- 172.21.15.5:0/31498502 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9244101de0 0x7f9244198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:09.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.998+0000 7f924a4a6640 1 -- 172.21.15.5:0/31498502 >> 172.21.15.5:0/31498502 conn(0x7f92440fd8c0 msgr2=0x7f92440fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:09.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.998+0000 7f924a4a6640 1 -- 172.21.15.5:0/31498502 shutdown_connections 2024-09-11T23:26:09.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:09.998+0000 7f924a4a6640 1 -- 172.21.15.5:0/31498502 wait complete. 2024-09-11T23:26:10.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:10 smithi005 ceph-mon[31201]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:10.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:10 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:10.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:10 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:10.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:10 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:10.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:10 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:26:10.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:10 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:26:10.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:10 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:26:10.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:10 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/31498502' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:26:10.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:10 smithi159 ceph-mon[34394]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:10.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:10 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:10.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:10 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:10.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:10 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:10.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:10 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:26:10.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:10 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:26:10.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:10 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:26:10.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:10 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/31498502' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:26:10.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:10 smithi172 ceph-mon[34855]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:10.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:10 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:10.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:10 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:10.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:10 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:10.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:10 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:26:10.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:10 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:26:10.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:10 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:26:10.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:10 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/31498502' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:26:11.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:11 smithi005 ceph-mon[31201]: Deploying daemon mds.d on smithi005 2024-09-11T23:26:11.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:11 smithi005 ceph-mon[31201]: mds.? [v2:172.21.15.5:6834/3865435482,v1:172.21.15.5:6835/3865435482] up:boot 2024-09-11T23:26:11.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:11 smithi005 ceph-mon[31201]: fsmap 3 up:standby 2024-09-11T23:26:11.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:11 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-11T23:26:11.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:11 smithi159 ceph-mon[34394]: Deploying daemon mds.d on smithi005 2024-09-11T23:26:11.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:11 smithi159 ceph-mon[34394]: mds.? [v2:172.21.15.5:6834/3865435482,v1:172.21.15.5:6835/3865435482] up:boot 2024-09-11T23:26:11.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:11 smithi159 ceph-mon[34394]: fsmap 3 up:standby 2024-09-11T23:26:11.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:11 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-11T23:26:11.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:11 smithi172 ceph-mon[34855]: Deploying daemon mds.d on smithi005 2024-09-11T23:26:11.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:11 smithi172 ceph-mon[34855]: mds.? [v2:172.21.15.5:6834/3865435482,v1:172.21.15.5:6835/3865435482] up:boot 2024-09-11T23:26:11.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:11 smithi172 ceph-mon[34855]: fsmap 3 up:standby 2024-09-11T23:26:11.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:11 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-11T23:26:12.073 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:12 smithi005 ceph-mon[31201]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:12.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:12 smithi159 ceph-mon[34394]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:12.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:12 smithi172 ceph-mon[34855]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:12.473 INFO:journalctl@ceph.mds.d.smithi005.stdout:Sep 11 23:26:12 smithi005 systemd[1]: Starting Ceph mds.d for 1f5284d2-7094-11ef-bcea-c7b262605968... 2024-09-11T23:26:12.724 INFO:journalctl@ceph.mds.d.smithi005.stdout:Sep 11 23:26:12 smithi005 podman[71205]: 2024-09-11 23:26:12.376126894 +0000 UTC m=+0.016382897 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:26:12.724 INFO:journalctl@ceph.mds.d.smithi005.stdout:Sep 11 23:26:12 smithi005 podman[71205]: 2024-09-11 23:26:12.503461069 +0000 UTC m=+0.143717064 container create 3a21c7a513f6abba004d5beffd9731fdb437a9f4643e5ca10ed55aea598dedd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-d, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-11T23:26:12.850 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:26:13.115 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:26:13.224 INFO:journalctl@ceph.mds.d.smithi005.stdout:Sep 11 23:26:12 smithi005 podman[71205]: 2024-09-11 23:26:12.739864014 +0000 UTC m=+0.380120005 container init 3a21c7a513f6abba004d5beffd9731fdb437a9f4643e5ca10ed55aea598dedd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-d, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-11T23:26:13.225 INFO:journalctl@ceph.mds.d.smithi005.stdout:Sep 11 23:26:12 smithi005 podman[71205]: 2024-09-11 23:26:12.74289517 +0000 UTC m=+0.383151167 container start 3a21c7a513f6abba004d5beffd9731fdb437a9f4643e5ca10ed55aea598dedd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-d, GIT_CLEAN=True, RELEASE=squid-b53b6d3, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-11T23:26:13.225 INFO:journalctl@ceph.mds.d.smithi005.stdout:Sep 11 23:26:12 smithi005 ceph-mds[71224]: -- 172.21.15.5:0/2540665869 <== mon.0 v2:172.21.15.5:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c72decd860 con 0x55c72deaa800 2024-09-11T23:26:13.225 INFO:journalctl@ceph.mds.d.smithi005.stdout:Sep 11 23:26:12 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-d[71220]: starting mds.d at 2024-09-11T23:26:13.225 INFO:journalctl@ceph.mds.d.smithi005.stdout:Sep 11 23:26:12 smithi005 bash[71205]: 3a21c7a513f6abba004d5beffd9731fdb437a9f4643e5ca10ed55aea598dedd8 2024-09-11T23:26:13.225 INFO:journalctl@ceph.mds.d.smithi005.stdout:Sep 11 23:26:12 smithi005 systemd[1]: Started Ceph mds.d for 1f5284d2-7094-11ef-bcea-c7b262605968. 2024-09-11T23:26:13.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.584+0000 7fcb5e788640 1 -- 172.21.15.5:0/3537068563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb58101de0 msgr2=0x7fcb581021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:13.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.584+0000 7fcb5e788640 1 --2- 172.21.15.5:0/3537068563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb58101de0 0x7fcb581021c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcb48009900 tx=0x7fcb4802a410 comp rx=0 tx=0).stop 2024-09-11T23:26:13.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.584+0000 7fcb5e788640 1 -- 172.21.15.5:0/3537068563 shutdown_connections 2024-09-11T23:26:13.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.584+0000 7fcb5e788640 1 --2- 172.21.15.5:0/3537068563 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb58106f10 0x7fcb5810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:13.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.584+0000 7fcb5e788640 1 --2- 172.21.15.5:0/3537068563 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb58102790 0x7fcb581067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:13.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.584+0000 7fcb5e788640 1 --2- 172.21.15.5:0/3537068563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb58101de0 0x7fcb581021c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:13.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.584+0000 7fcb5e788640 1 -- 172.21.15.5:0/3537068563 >> 172.21.15.5:0/3537068563 conn(0x7fcb580fd8c0 msgr2=0x7fcb580ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:13.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.584+0000 7fcb5e788640 1 -- 172.21.15.5:0/3537068563 shutdown_connections 2024-09-11T23:26:13.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.584+0000 7fcb5e788640 1 -- 172.21.15.5:0/3537068563 wait complete. 2024-09-11T23:26:13.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.585+0000 7fcb5e788640 1 Processor -- start 2024-09-11T23:26:13.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.585+0000 7fcb5e788640 1 -- start start 2024-09-11T23:26:13.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.585+0000 7fcb5e788640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb58101de0 0x7fcb581983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:13.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.585+0000 7fcb5e788640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb58102790 0x7fcb58198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:13.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.585+0000 7fcb5e788640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb58106f10 0x7fcb5819ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:13.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.585+0000 7fcb5e788640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcb58111e90 con 0x7fcb58102790 2024-09-11T23:26:13.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.585+0000 7fcb5e788640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fcb58111d10 con 0x7fcb58106f10 2024-09-11T23:26:13.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.585+0000 7fcb5e788640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcb58112010 con 0x7fcb58101de0 2024-09-11T23:26:13.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.586+0000 7fcb5cd25640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb58106f10 0x7fcb5819ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:13.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.586+0000 7fcb577fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb58102790 0x7fcb58198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:13.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.586+0000 7fcb5cd25640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb58106f10 0x7fcb5819ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.5:55862/0 (socket says 172.21.15.5:55862) 2024-09-11T23:26:13.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.586+0000 7fcb577fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb58102790 0x7fcb58198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59076/0 (socket says 172.21.15.5:59076) 2024-09-11T23:26:13.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.586+0000 7fcb5cd25640 1 -- 172.21.15.5:0/1942876178 learned_addr learned my addr 172.21.15.5:0/1942876178 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:26:13.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.586+0000 7fcb57fff640 1 --2- 172.21.15.5:0/1942876178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb58101de0 0x7fcb581983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:13.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.586+0000 7fcb577fe640 1 -- 172.21.15.5:0/1942876178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb58101de0 msgr2=0x7fcb581983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:13.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.586+0000 7fcb577fe640 1 --2- 172.21.15.5:0/1942876178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb58101de0 0x7fcb581983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:13.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.586+0000 7fcb577fe640 1 -- 172.21.15.5:0/1942876178 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb58106f10 msgr2=0x7fcb5819ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:13.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.586+0000 7fcb577fe640 1 --2- 172.21.15.5:0/1942876178 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb58106f10 0x7fcb5819ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:13.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.586+0000 7fcb577fe640 1 -- 172.21.15.5:0/1942876178 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb5819d3a0 con 0x7fcb58102790 2024-09-11T23:26:13.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.586+0000 7fcb577fe640 1 --2- 172.21.15.5:0/1942876178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb58102790 0x7fcb58198930 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c00b3f0 tx=0x7fcb4c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:13.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.586+0000 7fcb557fa640 1 -- 172.21.15.5:0/1942876178 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c015020 con 0x7fcb58102790 2024-09-11T23:26:13.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.586+0000 7fcb557fa640 1 -- 172.21.15.5:0/1942876178 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcb4c011ce0 con 0x7fcb58102790 2024-09-11T23:26:13.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.586+0000 7fcb5e788640 1 -- 172.21.15.5:0/1942876178 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb5819d690 con 0x7fcb58102790 2024-09-11T23:26:13.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.586+0000 7fcb557fa640 1 -- 172.21.15.5:0/1942876178 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c010d80 con 0x7fcb58102790 2024-09-11T23:26:13.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.586+0000 7fcb5e788640 1 -- 172.21.15.5:0/1942876178 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb581a4f70 con 0x7fcb58102790 2024-09-11T23:26:13.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.587+0000 7fcb5e788640 1 -- 172.21.15.5:0/1942876178 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb581021c0 con 0x7fcb58102790 2024-09-11T23:26:13.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.589+0000 7fcb557fa640 1 -- 172.21.15.5:0/1942876178 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fcb4c018020 con 0x7fcb58102790 2024-09-11T23:26:13.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.589+0000 7fcb557fa640 1 --2- 172.21.15.5:0/1942876178 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fcb400a2c00 0x7fcb400a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:13.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.589+0000 7fcb57fff640 1 --2- 172.21.15.5:0/1942876178 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fcb400a2c00 0x7fcb400a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:13.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.589+0000 7fcb557fa640 1 -- 172.21.15.5:0/1942876178 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fcb4c0ce2b0 con 0x7fcb58102790 2024-09-11T23:26:13.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.590+0000 7fcb57fff640 1 --2- 172.21.15.5:0/1942876178 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fcb400a2c00 0x7fcb400a50c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcb48005ab0 tx=0x7fcb48005a20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:13.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.594+0000 7fcb557fa640 1 -- 172.21.15.5:0/1942876178 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcb4c01f020 con 0x7fcb58102790 2024-09-11T23:26:13.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.803+0000 7fcb5e788640 1 -- 172.21.15.5:0/1942876178 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcb5802d7c0 con 0x7fcb58102790 2024-09-11T23:26:13.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.803+0000 7fcb557fa640 1 -- 172.21.15.5:0/1942876178 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3910 (secure 0 0 0) 0x7fcb4c09b6b0 con 0x7fcb58102790 2024-09-11T23:26:13.804 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:26:13.804 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":5,"btime":"2024-09-11T23:26:13:018915+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3865435482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3865435482},{"type":"v1","addr":"172.21.15.5:6835","nonce":3865435482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1323314897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":1323314897},{"type":"v1","addr":"172.21.15.5:6837","nonce":1323314897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3113658116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3113658116},{"type":"v1","addr":"172.21.15.172:6833","nonce":3113658116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3887336060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3887336060},{"type":"v1","addr":"172.21.15.159:6833","nonce":3887336060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-11T23:26:13.804 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 5 2024-09-11T23:26:13.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.805+0000 7fcb5e788640 1 -- 172.21.15.5:0/1942876178 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fcb400a2c00 msgr2=0x7fcb400a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:13.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.805+0000 7fcb5e788640 1 --2- 172.21.15.5:0/1942876178 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fcb400a2c00 0x7fcb400a50c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcb48005ab0 tx=0x7fcb48005a20 comp rx=0 tx=0).stop 2024-09-11T23:26:13.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.805+0000 7fcb5e788640 1 -- 172.21.15.5:0/1942876178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb58102790 msgr2=0x7fcb58198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:13.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.805+0000 7fcb5e788640 1 --2- 172.21.15.5:0/1942876178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb58102790 0x7fcb58198930 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c00b3f0 tx=0x7fcb4c00b8b0 comp rx=0 tx=0).stop 2024-09-11T23:26:13.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.806+0000 7fcb5e788640 1 -- 172.21.15.5:0/1942876178 shutdown_connections 2024-09-11T23:26:13.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.806+0000 7fcb5e788640 1 --2- 172.21.15.5:0/1942876178 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fcb400a2c00 0x7fcb400a50c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:13.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.806+0000 7fcb5e788640 1 --2- 172.21.15.5:0/1942876178 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb58106f10 0x7fcb5819ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:13.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.806+0000 7fcb5e788640 1 --2- 172.21.15.5:0/1942876178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb58102790 0x7fcb58198930 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:13.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.806+0000 7fcb5e788640 1 --2- 172.21.15.5:0/1942876178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb58101de0 0x7fcb581983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:13.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.806+0000 7fcb5e788640 1 -- 172.21.15.5:0/1942876178 >> 172.21.15.5:0/1942876178 conn(0x7fcb580fd8c0 msgr2=0x7fcb580fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:13.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.806+0000 7fcb5e788640 1 -- 172.21.15.5:0/1942876178 shutdown_connections 2024-09-11T23:26:13.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:13.806+0000 7fcb5e788640 1 -- 172.21.15.5:0/1942876178 wait complete. 2024-09-11T23:26:14.164 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:13 smithi005 ceph-mon[31201]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:14.164 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:13 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:14.164 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:13 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:14.164 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:13 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:14.164 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:13 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:26:14.165 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:13 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:26:14.165 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:13 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:26:14.165 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:13 smithi005 ceph-mon[31201]: Deploying daemon mds.e on smithi159 2024-09-11T23:26:14.165 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:13 smithi005 ceph-mon[31201]: mds.? [v2:172.21.15.5:6836/1323314897,v1:172.21.15.5:6837/1323314897] up:boot 2024-09-11T23:26:14.165 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:13 smithi005 ceph-mon[31201]: fsmap 4 up:standby 2024-09-11T23:26:14.165 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:13 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-11T23:26:14.165 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:13 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/1942876178' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:26:14.297 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:13 smithi172 ceph-mon[34855]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:14.297 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:13 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:14.297 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:13 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:14.297 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:13 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:14.297 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:13 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:26:14.297 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:13 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:26:14.297 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:13 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:26:14.297 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:13 smithi172 ceph-mon[34855]: Deploying daemon mds.e on smithi159 2024-09-11T23:26:14.297 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:13 smithi172 ceph-mon[34855]: mds.? [v2:172.21.15.5:6836/1323314897,v1:172.21.15.5:6837/1323314897] up:boot 2024-09-11T23:26:14.298 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:13 smithi172 ceph-mon[34855]: fsmap 4 up:standby 2024-09-11T23:26:14.298 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:13 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-11T23:26:14.298 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:13 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/1942876178' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:26:14.343 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:13 smithi159 ceph-mon[34394]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:14.343 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:13 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:14.343 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:13 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:14.343 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:13 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:14.343 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:13 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:26:14.344 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:13 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:26:14.344 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:13 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:26:14.344 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:13 smithi159 ceph-mon[34394]: Deploying daemon mds.e on smithi159 2024-09-11T23:26:14.344 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:13 smithi159 ceph-mon[34394]: mds.? [v2:172.21.15.5:6836/1323314897,v1:172.21.15.5:6837/1323314897] up:boot 2024-09-11T23:26:14.344 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:13 smithi159 ceph-mon[34394]: fsmap 4 up:standby 2024-09-11T23:26:14.344 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:13 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-11T23:26:14.344 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:13 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/1942876178' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:26:15.127 INFO:journalctl@ceph.mds.e.smithi159.stdout:Sep 11 23:26:14 smithi159 systemd[1]: Starting Ceph mds.e for 1f5284d2-7094-11ef-bcea-c7b262605968... 2024-09-11T23:26:15.405 INFO:journalctl@ceph.mds.e.smithi159.stdout:Sep 11 23:26:15 smithi159 podman[63867]: 2024-09-11 23:26:15.035095001 +0000 UTC m=+0.015967782 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:26:15.405 INFO:journalctl@ceph.mds.e.smithi159.stdout:Sep 11 23:26:15 smithi159 podman[63867]: 2024-09-11 23:26:15.143350409 +0000 UTC m=+0.124223230 container create 3fa760af338f5565ad6381cb7241801c2d09e637a7f1a4f1711d5f71ba1d0112 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-e, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3) 2024-09-11T23:26:15.405 INFO:journalctl@ceph.mds.e.smithi159.stdout:Sep 11 23:26:15 smithi159 podman[63867]: 2024-09-11 23:26:15.379353958 +0000 UTC m=+0.360226737 container init 3fa760af338f5565ad6381cb7241801c2d09e637a7f1a4f1711d5f71ba1d0112 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-e, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-11T23:26:15.405 INFO:journalctl@ceph.mds.e.smithi159.stdout:Sep 11 23:26:15 smithi159 podman[63867]: 2024-09-11 23:26:15.382071376 +0000 UTC m=+0.362944158 container start 3fa760af338f5565ad6381cb7241801c2d09e637a7f1a4f1711d5f71ba1d0112 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-11T23:26:15.876 INFO:journalctl@ceph.mds.e.smithi159.stdout:Sep 11 23:26:15 smithi159 ceph-mds[63886]: -- 172.21.15.159:0/3641591777 <== mon.2 v2:172.21.15.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56455e62b860 con 0x56455e608800 2024-09-11T23:26:15.876 INFO:journalctl@ceph.mds.e.smithi159.stdout:Sep 11 23:26:15 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-e[63882]: starting mds.e at 2024-09-11T23:26:15.876 INFO:journalctl@ceph.mds.e.smithi159.stdout:Sep 11 23:26:15 smithi159 bash[63867]: 3fa760af338f5565ad6381cb7241801c2d09e637a7f1a4f1711d5f71ba1d0112 2024-09-11T23:26:15.876 INFO:journalctl@ceph.mds.e.smithi159.stdout:Sep 11 23:26:15 smithi159 systemd[1]: Started Ceph mds.e for 1f5284d2-7094-11ef-bcea-c7b262605968. 2024-09-11T23:26:16.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:15 smithi005 ceph-mon[31201]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:16.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:15 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:16.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:15 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:16.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:15 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:16.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:15 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:26:16.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:15 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:26:16.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:15 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:26:16.226 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:15 smithi172 ceph-mon[34855]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:16.226 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:15 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:16.226 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:15 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:16.226 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:15 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:16.226 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:15 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:26:16.227 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:15 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:26:16.227 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:15 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:26:16.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:15 smithi159 ceph-mon[34394]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:16.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:15 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:16.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:15 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:16.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:15 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:16.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:15 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:26:16.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:15 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:26:16.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:15 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:26:16.607 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:26:16.876 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:26:17.154 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:16 smithi005 ceph-mon[31201]: Deploying daemon mds.f on smithi172 2024-09-11T23:26:17.154 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:16 smithi005 ceph-mon[31201]: mds.? [v2:172.21.15.159:6834/2539263301,v1:172.21.15.159:6835/2539263301] up:boot 2024-09-11T23:26:17.154 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:16 smithi005 ceph-mon[31201]: fsmap 5 up:standby 2024-09-11T23:26:17.154 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:16 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-11T23:26:17.287 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:16 smithi172 ceph-mon[34855]: Deploying daemon mds.f on smithi172 2024-09-11T23:26:17.287 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:16 smithi172 ceph-mon[34855]: mds.? [v2:172.21.15.159:6834/2539263301,v1:172.21.15.159:6835/2539263301] up:boot 2024-09-11T23:26:17.287 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:16 smithi172 ceph-mon[34855]: fsmap 5 up:standby 2024-09-11T23:26:17.287 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:16 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-11T23:26:17.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:16 smithi159 ceph-mon[34394]: Deploying daemon mds.f on smithi172 2024-09-11T23:26:17.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:16 smithi159 ceph-mon[34394]: mds.? [v2:172.21.15.159:6834/2539263301,v1:172.21.15.159:6835/2539263301] up:boot 2024-09-11T23:26:17.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:16 smithi159 ceph-mon[34394]: fsmap 5 up:standby 2024-09-11T23:26:17.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:16 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-11T23:26:17.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.363+0000 7fea24c90640 1 -- 172.21.15.5:0/3257381075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea20101420 msgr2=0x7fea2010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:17.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.363+0000 7fea24c90640 1 --2- 172.21.15.5:0/3257381075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea20101420 0x7fea2010d950 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fea18009cd0 tx=0x7fea1802a8e0 comp rx=0 tx=0).stop 2024-09-11T23:26:17.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.363+0000 7fea24c90640 1 -- 172.21.15.5:0/3257381075 shutdown_connections 2024-09-11T23:26:17.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.363+0000 7fea24c90640 1 --2- 172.21.15.5:0/3257381075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea20101420 0x7fea2010d950 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:17.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.363+0000 7fea24c90640 1 --2- 172.21.15.5:0/3257381075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea20100a80 0x7fea20100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:17.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.363+0000 7fea24c90640 1 --2- 172.21.15.5:0/3257381075 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea20106a80 0x7fea20106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:17.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.364+0000 7fea24c90640 1 -- 172.21.15.5:0/3257381075 >> 172.21.15.5:0/3257381075 conn(0x7fea200fc7a0 msgr2=0x7fea200febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:17.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.364+0000 7fea24c90640 1 -- 172.21.15.5:0/3257381075 shutdown_connections 2024-09-11T23:26:17.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.364+0000 7fea24c90640 1 -- 172.21.15.5:0/3257381075 wait complete. 2024-09-11T23:26:17.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.364+0000 7fea24c90640 1 Processor -- start 2024-09-11T23:26:17.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.365+0000 7fea24c90640 1 -- start start 2024-09-11T23:26:17.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.365+0000 7fea24c90640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea20100a80 0x7fea20197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:17.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.365+0000 7fea24c90640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea20101420 0x7fea201977b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:17.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.365+0000 7fea24c90640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea20106a80 0x7fea2019bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:17.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.365+0000 7fea24c90640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fea20110d30 con 0x7fea20106a80 2024-09-11T23:26:17.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.365+0000 7fea24c90640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fea20110bb0 con 0x7fea20100a80 2024-09-11T23:26:17.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.365+0000 7fea24c90640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fea20110eb0 con 0x7fea20101420 2024-09-11T23:26:17.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.365+0000 7fea1ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea20106a80 0x7fea2019bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:17.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.365+0000 7fea1ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea20106a80 0x7fea2019bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59084/0 (socket says 172.21.15.5:59084) 2024-09-11T23:26:17.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.365+0000 7fea1ed9d640 1 -- 172.21.15.5:0/3479170107 learned_addr learned my addr 172.21.15.5:0/3479170107 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:26:17.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.365+0000 7fea1dd9b640 1 --2- 172.21.15.5:0/3479170107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea20101420 0x7fea201977b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:17.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.365+0000 7fea1e59c640 1 --2- 172.21.15.5:0/3479170107 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea20100a80 0x7fea20197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:17.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.365+0000 7fea1ed9d640 1 -- 172.21.15.5:0/3479170107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea20101420 msgr2=0x7fea201977b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:17.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.365+0000 7fea1ed9d640 1 --2- 172.21.15.5:0/3479170107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea20101420 0x7fea201977b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:17.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.365+0000 7fea1ed9d640 1 -- 172.21.15.5:0/3479170107 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea20100a80 msgr2=0x7fea20197270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:17.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.365+0000 7fea1ed9d640 1 --2- 172.21.15.5:0/3479170107 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea20100a80 0x7fea20197270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:17.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.365+0000 7fea1ed9d640 1 -- 172.21.15.5:0/3479170107 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea2019c220 con 0x7fea20106a80 2024-09-11T23:26:17.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.365+0000 7fea1e59c640 1 --2- 172.21.15.5:0/3479170107 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea20100a80 0x7fea20197270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:26:17.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.365+0000 7fea1ed9d640 1 --2- 172.21.15.5:0/3479170107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea20106a80 0x7fea2019bb40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fea18033040 tx=0x7fea18003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:17.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.366+0000 7fea0f7fe640 1 -- 172.21.15.5:0/3479170107 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea18004040 con 0x7fea20106a80 2024-09-11T23:26:17.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.366+0000 7fea0f7fe640 1 -- 172.21.15.5:0/3479170107 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fea18004690 con 0x7fea20106a80 2024-09-11T23:26:17.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.366+0000 7fea24c90640 1 -- 172.21.15.5:0/3479170107 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea2019c4b0 con 0x7fea20106a80 2024-09-11T23:26:17.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.366+0000 7fea0f7fe640 1 -- 172.21.15.5:0/3479170107 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea18030e10 con 0x7fea20106a80 2024-09-11T23:26:17.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.366+0000 7fea24c90640 1 -- 172.21.15.5:0/3479170107 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea201a3df0 con 0x7fea20106a80 2024-09-11T23:26:17.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.367+0000 7fea24c90640 1 -- 172.21.15.5:0/3479170107 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea20100ee0 con 0x7fea20106a80 2024-09-11T23:26:17.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.368+0000 7fea0f7fe640 1 -- 172.21.15.5:0/3479170107 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fea180305a0 con 0x7fea20106a80 2024-09-11T23:26:17.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.369+0000 7fea0f7fe640 1 --2- 172.21.15.5:0/3479170107 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fea080a2b80 0x7fea080a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:17.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.369+0000 7fea1e59c640 1 --2- 172.21.15.5:0/3479170107 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fea080a2b80 0x7fea080a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:17.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.369+0000 7fea0f7fe640 1 -- 172.21.15.5:0/3479170107 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fea1802e030 con 0x7fea20106a80 2024-09-11T23:26:17.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.369+0000 7fea1e59c640 1 --2- 172.21.15.5:0/3479170107 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fea080a2b80 0x7fea080a5040 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fea10009ba0 tx=0x7fea10005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:17.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.372+0000 7fea0f7fe640 1 -- 172.21.15.5:0/3479170107 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fea1804b060 con 0x7fea20106a80 2024-09-11T23:26:17.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.583+0000 7fea24c90640 1 -- 172.21.15.5:0/3479170107 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fea201985d0 con 0x7fea20106a80 2024-09-11T23:26:17.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.583+0000 7fea0f7fe640 1 -- 172.21.15.5:0/3479170107 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4738 (secure 0 0 0) 0x7fea201985d0 con 0x7fea20106a80 2024-09-11T23:26:17.583 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:26:17.583 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":6,"btime":"2024-09-11T23:26:15:886540+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3865435482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3865435482},{"type":"v1","addr":"172.21.15.5:6835","nonce":3865435482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1323314897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":1323314897},{"type":"v1","addr":"172.21.15.5:6837","nonce":1323314897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3113658116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3113658116},{"type":"v1","addr":"172.21.15.172:6833","nonce":3113658116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3887336060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3887336060},{"type":"v1","addr":"172.21.15.159:6833","nonce":3887336060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2539263301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2539263301},{"type":"v1","addr":"172.21.15.159:6835","nonce":2539263301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-11T23:26:17.583 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 6 2024-09-11T23:26:17.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.585+0000 7fea24c90640 1 -- 172.21.15.5:0/3479170107 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fea080a2b80 msgr2=0x7fea080a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:17.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.585+0000 7fea24c90640 1 --2- 172.21.15.5:0/3479170107 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fea080a2b80 0x7fea080a5040 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fea10009ba0 tx=0x7fea10005f90 comp rx=0 tx=0).stop 2024-09-11T23:26:17.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.585+0000 7fea24c90640 1 -- 172.21.15.5:0/3479170107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea20106a80 msgr2=0x7fea2019bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:17.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.585+0000 7fea24c90640 1 --2- 172.21.15.5:0/3479170107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea20106a80 0x7fea2019bb40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fea18033040 tx=0x7fea18003970 comp rx=0 tx=0).stop 2024-09-11T23:26:17.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.585+0000 7fea24c90640 1 -- 172.21.15.5:0/3479170107 shutdown_connections 2024-09-11T23:26:17.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.585+0000 7fea24c90640 1 --2- 172.21.15.5:0/3479170107 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fea080a2b80 0x7fea080a5040 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:17.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.585+0000 7fea24c90640 1 --2- 172.21.15.5:0/3479170107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea20106a80 0x7fea2019bb40 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:17.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.585+0000 7fea24c90640 1 --2- 172.21.15.5:0/3479170107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea20101420 0x7fea201977b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:17.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.585+0000 7fea24c90640 1 --2- 172.21.15.5:0/3479170107 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea20100a80 0x7fea20197270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:17.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.585+0000 7fea24c90640 1 -- 172.21.15.5:0/3479170107 >> 172.21.15.5:0/3479170107 conn(0x7fea200fc7a0 msgr2=0x7fea200fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:17.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.585+0000 7fea24c90640 1 -- 172.21.15.5:0/3479170107 shutdown_connections 2024-09-11T23:26:17.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:17.585+0000 7fea24c90640 1 -- 172.21.15.5:0/3479170107 wait complete. 2024-09-11T23:26:17.634 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 11 23:26:17 smithi172 systemd[1]: Starting Ceph mds.f for 1f5284d2-7094-11ef-bcea-c7b262605968... 2024-09-11T23:26:17.954 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:17 smithi172 ceph-mon[34855]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:17.954 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:17 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/3479170107' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:26:17.955 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 11 23:26:17 smithi172 podman[64109]: 2024-09-11 23:26:17.684578429 +0000 UTC m=+0.111562710 container create efbbb98c4e73734e204901142de4c9a68d7bcb5b286b04a9ba4960ce418637d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-f, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-11T23:26:17.955 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 11 23:26:17 smithi172 podman[64109]: 2024-09-11 23:26:17.588906287 +0000 UTC m=+0.015890566 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:26:17.955 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 11 23:26:17 smithi172 podman[64109]: 2024-09-11 23:26:17.928871869 +0000 UTC m=+0.355856149 container init efbbb98c4e73734e204901142de4c9a68d7bcb5b286b04a9ba4960ce418637d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-f, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T23:26:17.955 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 11 23:26:17 smithi172 podman[64109]: 2024-09-11 23:26:17.931850424 +0000 UTC m=+0.358834705 container start efbbb98c4e73734e204901142de4c9a68d7bcb5b286b04a9ba4960ce418637d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-f, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-11T23:26:17.955 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 11 23:26:17 smithi172 ceph-mds[64128]: -- 172.21.15.172:0/100613088 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55eb1b411860 con 0x55eb1b3ef400 2024-09-11T23:26:18.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:17 smithi005 ceph-mon[31201]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:18.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:17 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/3479170107' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:26:18.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:17 smithi159 ceph-mon[34394]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:18.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:17 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/3479170107' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:26:18.383 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 11 23:26:17 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-f[64124]: starting mds.f at 2024-09-11T23:26:18.384 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 11 23:26:18 smithi172 bash[64109]: efbbb98c4e73734e204901142de4c9a68d7bcb5b286b04a9ba4960ce418637d0 2024-09-11T23:26:18.384 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 11 23:26:18 smithi172 systemd[1]: Started Ceph mds.f for 1f5284d2-7094-11ef-bcea-c7b262605968. 2024-09-11T23:26:19.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:19 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:19.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:19 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:19.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:19 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:19.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:19 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:26:19.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:19 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:26:19.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:19 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:26:19.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:19 smithi172 ceph-mon[34855]: Deploying daemon mds.c on smithi172 2024-09-11T23:26:19.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:19 smithi172 ceph-mon[34855]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:19.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:19 smithi172 ceph-mon[34855]: mds.? [v2:172.21.15.172:6834/4240913699,v1:172.21.15.172:6835/4240913699] up:boot 2024-09-11T23:26:19.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:19 smithi172 ceph-mon[34855]: fsmap 6 up:standby 2024-09-11T23:26:19.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:19 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-11T23:26:19.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:19 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:19.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:19 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:19.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:19 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:19.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:19 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:26:19.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:19 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:26:19.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:19 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:26:19.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:19 smithi159 ceph-mon[34394]: Deploying daemon mds.c on smithi172 2024-09-11T23:26:19.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:19 smithi159 ceph-mon[34394]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:19.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:19 smithi159 ceph-mon[34394]: mds.? [v2:172.21.15.172:6834/4240913699,v1:172.21.15.172:6835/4240913699] up:boot 2024-09-11T23:26:19.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:19 smithi159 ceph-mon[34394]: fsmap 6 up:standby 2024-09-11T23:26:19.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:19 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-11T23:26:19.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:19 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:19.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:19 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:19.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:19 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:19.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:19 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:26:19.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:19 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:26:19.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:19 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:26:19.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:19 smithi005 ceph-mon[31201]: Deploying daemon mds.c on smithi172 2024-09-11T23:26:19.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:19 smithi005 ceph-mon[31201]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:19.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:19 smithi005 ceph-mon[31201]: mds.? [v2:172.21.15.172:6834/4240913699,v1:172.21.15.172:6835/4240913699] up:boot 2024-09-11T23:26:19.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:19 smithi005 ceph-mon[31201]: fsmap 6 up:standby 2024-09-11T23:26:19.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:19 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-11T23:26:20.134 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 11 23:26:19 smithi172 systemd[1]: Starting Ceph mds.c for 1f5284d2-7094-11ef-bcea-c7b262605968... 2024-09-11T23:26:20.339 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:26:20.509 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 11 23:26:20 smithi172 podman[64412]: 2024-09-11 23:26:20.107331084 +0000 UTC m=+0.016390322 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:26:20.509 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 11 23:26:20 smithi172 podman[64412]: 2024-09-11 23:26:20.26561815 +0000 UTC m=+0.174677387 container create a3587b6467da5fcd358e568f26cb27f8cee9d0321ceb7ad6fa3a43d0c18aadb6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-c, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-11T23:26:20.609 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:26:20.884 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 11 23:26:20 smithi172 podman[64412]: 2024-09-11 23:26:20.510050372 +0000 UTC m=+0.419109610 container init a3587b6467da5fcd358e568f26cb27f8cee9d0321ceb7ad6fa3a43d0c18aadb6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-c, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T23:26:20.884 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 11 23:26:20 smithi172 podman[64412]: 2024-09-11 23:26:20.512917683 +0000 UTC m=+0.421976922 container start a3587b6467da5fcd358e568f26cb27f8cee9d0321ceb7ad6fa3a43d0c18aadb6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-c, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-11T23:26:20.884 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 11 23:26:20 smithi172 ceph-mds[64431]: -- 172.21.15.172:0/414148492 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563e58a2d860 con 0x563e58a0a800 2024-09-11T23:26:20.884 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 11 23:26:20 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-c[64427]: starting mds.c at 2024-09-11T23:26:20.884 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 11 23:26:20 smithi172 bash[64412]: a3587b6467da5fcd358e568f26cb27f8cee9d0321ceb7ad6fa3a43d0c18aadb6 2024-09-11T23:26:20.884 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 11 23:26:20 smithi172 systemd[1]: Started Ceph mds.c for 1f5284d2-7094-11ef-bcea-c7b262605968. 2024-09-11T23:26:21.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.073+0000 7f7424b81640 1 -- 172.21.15.5:0/617175923 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7420102ef0 msgr2=0x7f742010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:21.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.073+0000 7f7424b81640 1 --2- 172.21.15.5:0/617175923 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7420102ef0 0x7f742010da40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7418009ca0 tx=0x7f741802a950 comp rx=0 tx=0).stop 2024-09-11T23:26:21.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.074+0000 7f7424b81640 1 -- 172.21.15.5:0/617175923 shutdown_connections 2024-09-11T23:26:21.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.074+0000 7f7424b81640 1 --2- 172.21.15.5:0/617175923 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7420102ef0 0x7f742010da40 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:21.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.074+0000 7f7424b81640 1 --2- 172.21.15.5:0/617175923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7420102570 0x7f74201029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:21.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.074+0000 7f7424b81640 1 --2- 172.21.15.5:0/617175923 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7420100e20 0x7f7420101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:21.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.074+0000 7f7424b81640 1 -- 172.21.15.5:0/617175923 >> 172.21.15.5:0/617175923 conn(0x7f74200fc7d0 msgr2=0x7f74200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:21.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.074+0000 7f7424b81640 1 -- 172.21.15.5:0/617175923 shutdown_connections 2024-09-11T23:26:21.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.074+0000 7f7424b81640 1 -- 172.21.15.5:0/617175923 wait complete. 2024-09-11T23:26:21.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.074+0000 7f7424b81640 1 Processor -- start 2024-09-11T23:26:21.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.074+0000 7f7424b81640 1 -- start start 2024-09-11T23:26:21.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.075+0000 7f7424b81640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7420100e20 0x7f74200fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:21.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.075+0000 7f7424b81640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7420102570 0x7f74200fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:21.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.075+0000 7f7424b81640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7420102ef0 0x7f74200fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:21.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.075+0000 7f7424b81640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7420110e30 con 0x7f7420102ef0 2024-09-11T23:26:21.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.075+0000 7f7424b81640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7420110cb0 con 0x7f7420102570 2024-09-11T23:26:21.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.075+0000 7f7424b81640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7420110fb0 con 0x7f7420100e20 2024-09-11T23:26:21.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.075+0000 7f741ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7420102ef0 0x7f74200fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:21.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.075+0000 7f741ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7420102ef0 0x7f74200fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59102/0 (socket says 172.21.15.5:59102) 2024-09-11T23:26:21.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.075+0000 7f741ed9d640 1 -- 172.21.15.5:0/1322420618 learned_addr learned my addr 172.21.15.5:0/1322420618 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:26:21.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.075+0000 7f741dd9b640 1 --2- 172.21.15.5:0/1322420618 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7420102570 0x7f74200fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:21.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.075+0000 7f741e59c640 1 --2- 172.21.15.5:0/1322420618 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7420100e20 0x7f74200fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:21.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.075+0000 7f741ed9d640 1 -- 172.21.15.5:0/1322420618 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7420100e20 msgr2=0x7f74200fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:21.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.075+0000 7f741ed9d640 1 --2- 172.21.15.5:0/1322420618 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7420100e20 0x7f74200fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:21.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.075+0000 7f741ed9d640 1 -- 172.21.15.5:0/1322420618 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7420102570 msgr2=0x7f74200fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:21.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.075+0000 7f741ed9d640 1 --2- 172.21.15.5:0/1322420618 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7420102570 0x7f74200fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:21.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.075+0000 7f741ed9d640 1 -- 172.21.15.5:0/1322420618 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74201a6840 con 0x7f7420102ef0 2024-09-11T23:26:21.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.075+0000 7f741e59c640 1 --2- 172.21.15.5:0/1322420618 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7420100e20 0x7f74200fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:26:21.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.075+0000 7f741ed9d640 1 --2- 172.21.15.5:0/1322420618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7420102ef0 0x7f74200fd700 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7418004af0 tx=0x7f741802f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:21.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.075+0000 7f740f7fe640 1 -- 172.21.15.5:0/1322420618 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7418034040 con 0x7f7420102ef0 2024-09-11T23:26:21.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.076+0000 7f7424b81640 1 -- 172.21.15.5:0/1322420618 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74201a6ad0 con 0x7f7420102ef0 2024-09-11T23:26:21.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.076+0000 7f740f7fe640 1 -- 172.21.15.5:0/1322420618 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f74180308f0 con 0x7f7420102ef0 2024-09-11T23:26:21.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.076+0000 7f740f7fe640 1 -- 172.21.15.5:0/1322420618 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7418004670 con 0x7f7420102ef0 2024-09-11T23:26:21.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.076+0000 7f7424b81640 1 -- 172.21.15.5:0/1322420618 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74201a7000 con 0x7f7420102ef0 2024-09-11T23:26:21.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.077+0000 7f7424b81640 1 -- 172.21.15.5:0/1322420618 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7420101200 con 0x7f7420102ef0 2024-09-11T23:26:21.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.078+0000 7f740f7fe640 1 -- 172.21.15.5:0/1322420618 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f7418037020 con 0x7f7420102ef0 2024-09-11T23:26:21.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.079+0000 7f740f7fe640 1 --2- 172.21.15.5:0/1322420618 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f74080a2b80 0x7f74080a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:21.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.079+0000 7f740f7fe640 1 -- 172.21.15.5:0/1322420618 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f74180efd80 con 0x7f7420102ef0 2024-09-11T23:26:21.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.079+0000 7f741e59c640 1 --2- 172.21.15.5:0/1322420618 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f74080a2b80 0x7f74080a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:21.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.079+0000 7f741e59c640 1 --2- 172.21.15.5:0/1322420618 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f74080a2b80 0x7f74080a5040 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7410009b40 tx=0x7f7410005e50 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:21.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.082+0000 7f740f7fe640 1 -- 172.21.15.5:0/1322420618 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f74180811b0 con 0x7f7420102ef0 2024-09-11T23:26:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.295+0000 7f7424b81640 1 -- 172.21.15.5:0/1322420618 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f74200fe1b0 con 0x7f7420102ef0 2024-09-11T23:26:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.295+0000 7f740f7fe640 1 -- 172.21.15.5:0/1322420618 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6394 (secure 0 0 0) 0x7f74200fe1b0 con 0x7f7420102ef0 2024-09-11T23:26:21.295 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:26:21.296 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":8,"btime":"2024-09-11T23:26:21:160958+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3865435482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3865435482},{"type":"v1","addr":"172.21.15.5:6835","nonce":3865435482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1323314897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":1323314897},{"type":"v1","addr":"172.21.15.5:6837","nonce":1323314897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3113658116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3113658116},{"type":"v1","addr":"172.21.15.172:6833","nonce":3113658116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3887336060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3887336060},{"type":"v1","addr":"172.21.15.159:6833","nonce":3887336060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2539263301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2539263301},{"type":"v1","addr":"172.21.15.159:6835","nonce":2539263301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/4240913699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":4240913699},{"type":"v1","addr":"172.21.15.172:6835","nonce":4240913699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24460,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4200951601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":4200951601},{"type":"v1","addr":"172.21.15.172:6837","nonce":4200951601}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-11T23:26:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 8 2024-09-11T23:26:21.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.298+0000 7f7424b81640 1 -- 172.21.15.5:0/1322420618 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f74080a2b80 msgr2=0x7f74080a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:21.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.298+0000 7f7424b81640 1 --2- 172.21.15.5:0/1322420618 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f74080a2b80 0x7f74080a5040 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7410009b40 tx=0x7f7410005e50 comp rx=0 tx=0).stop 2024-09-11T23:26:21.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.298+0000 7f7424b81640 1 -- 172.21.15.5:0/1322420618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7420102ef0 msgr2=0x7f74200fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:21.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.298+0000 7f7424b81640 1 --2- 172.21.15.5:0/1322420618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7420102ef0 0x7f74200fd700 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7418004af0 tx=0x7f741802f5d0 comp rx=0 tx=0).stop 2024-09-11T23:26:21.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.298+0000 7f7424b81640 1 -- 172.21.15.5:0/1322420618 shutdown_connections 2024-09-11T23:26:21.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.298+0000 7f7424b81640 1 --2- 172.21.15.5:0/1322420618 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f74080a2b80 0x7f74080a5040 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:21.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.298+0000 7f7424b81640 1 --2- 172.21.15.5:0/1322420618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7420102ef0 0x7f74200fd700 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:21.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.298+0000 7f7424b81640 1 --2- 172.21.15.5:0/1322420618 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7420102570 0x7f74200fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:21.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.298+0000 7f7424b81640 1 --2- 172.21.15.5:0/1322420618 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7420100e20 0x7f74200fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:21.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.298+0000 7f7424b81640 1 -- 172.21.15.5:0/1322420618 >> 172.21.15.5:0/1322420618 conn(0x7f74200fc7d0 msgr2=0x7f742006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:21.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.298+0000 7f7424b81640 1 -- 172.21.15.5:0/1322420618 shutdown_connections 2024-09-11T23:26:21.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:21.298+0000 7f7424b81640 1 -- 172.21.15.5:0/1322420618 wait complete. 2024-09-11T23:26:21.945 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:21 smithi005 ceph-mon[31201]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:21.945 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:21 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:21.945 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:21 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:21.945 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:21 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:21.945 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:21 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:26:21.945 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:21 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:26:21.945 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:21 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:26:21.945 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:21 smithi005 ceph-mon[31201]: Deploying daemon mds.h on smithi159 2024-09-11T23:26:21.946 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:21 smithi005 ceph-mon[31201]: mds.? [v2:172.21.15.172:6836/4200951601,v1:172.21.15.172:6837/4200951601] up:boot 2024-09-11T23:26:21.946 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:21 smithi005 ceph-mon[31201]: fsmap 7 up:standby 2024-09-11T23:26:21.946 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:21 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-11T23:26:21.946 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:21 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/1322420618' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:26:22.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:21 smithi159 ceph-mon[34394]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:22.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:21 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:22.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:21 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:22.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:21 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:22.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:21 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:26:22.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:21 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:26:22.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:21 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:26:22.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:21 smithi159 ceph-mon[34394]: Deploying daemon mds.h on smithi159 2024-09-11T23:26:22.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:21 smithi159 ceph-mon[34394]: mds.? [v2:172.21.15.172:6836/4200951601,v1:172.21.15.172:6837/4200951601] up:boot 2024-09-11T23:26:22.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:21 smithi159 ceph-mon[34394]: fsmap 7 up:standby 2024-09-11T23:26:22.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:21 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-11T23:26:22.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:21 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/1322420618' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:26:22.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:21 smithi172 ceph-mon[34855]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:22.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:21 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:22.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:21 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:22.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:21 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:22.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:21 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:26:22.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:21 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:26:22.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:21 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:26:22.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:21 smithi172 ceph-mon[34855]: Deploying daemon mds.h on smithi159 2024-09-11T23:26:22.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:21 smithi172 ceph-mon[34855]: mds.? [v2:172.21.15.172:6836/4200951601,v1:172.21.15.172:6837/4200951601] up:boot 2024-09-11T23:26:22.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:21 smithi172 ceph-mon[34855]: fsmap 7 up:standby 2024-09-11T23:26:22.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:21 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-11T23:26:22.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:21 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/1322420618' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:26:22.877 INFO:journalctl@ceph.mds.h.smithi159.stdout:Sep 11 23:26:22 smithi159 systemd[1]: Starting Ceph mds.h for 1f5284d2-7094-11ef-bcea-c7b262605968... 2024-09-11T23:26:23.187 INFO:journalctl@ceph.mds.h.smithi159.stdout:Sep 11 23:26:22 smithi159 podman[64168]: 2024-09-11 23:26:22.91678864 +0000 UTC m=+0.106174908 container create 3aa3463c53753b75bc8edea0bff8cb966e2889540a71fb11bc3334ded9f4abc1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-h, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-11T23:26:23.188 INFO:journalctl@ceph.mds.h.smithi159.stdout:Sep 11 23:26:22 smithi159 podman[64168]: 2024-09-11 23:26:22.826766192 +0000 UTC m=+0.016152414 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:26:23.188 INFO:journalctl@ceph.mds.h.smithi159.stdout:Sep 11 23:26:23 smithi159 podman[64168]: 2024-09-11 23:26:23.161365128 +0000 UTC m=+0.350751350 container init 3aa3463c53753b75bc8edea0bff8cb966e2889540a71fb11bc3334ded9f4abc1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-h, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-11T23:26:23.188 INFO:journalctl@ceph.mds.h.smithi159.stdout:Sep 11 23:26:23 smithi159 podman[64168]: 2024-09-11 23:26:23.164527381 +0000 UTC m=+0.353913613 container start 3aa3463c53753b75bc8edea0bff8cb966e2889540a71fb11bc3334ded9f4abc1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-h, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-11T23:26:23.188 INFO:journalctl@ceph.mds.h.smithi159.stdout:Sep 11 23:26:23 smithi159 ceph-mds[64187]: -- 172.21.15.159:0/3653514870 <== mon.2 v2:172.21.15.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555dd1197860 con 0x555dd1174800 2024-09-11T23:26:23.626 INFO:journalctl@ceph.mds.h.smithi159.stdout:Sep 11 23:26:23 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-h[64183]: starting mds.h at 2024-09-11T23:26:23.626 INFO:journalctl@ceph.mds.h.smithi159.stdout:Sep 11 23:26:23 smithi159 bash[64168]: 3aa3463c53753b75bc8edea0bff8cb966e2889540a71fb11bc3334ded9f4abc1 2024-09-11T23:26:23.626 INFO:journalctl@ceph.mds.h.smithi159.stdout:Sep 11 23:26:23 smithi159 systemd[1]: Started Ceph mds.h for 1f5284d2-7094-11ef-bcea-c7b262605968. 2024-09-11T23:26:23.974 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:26:23.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:23 smithi005 ceph-mon[31201]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:23.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:23 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:23.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:23 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:23.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:23 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:23.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:23 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:26:23.976 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:23 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:26:23.976 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:23 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:26:24.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:23 smithi172 ceph-mon[34855]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:24.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:23 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:24.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:23 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:24.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:23 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:24.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:23 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:26:24.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:23 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:26:24.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:23 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:26:24.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:23 smithi159 ceph-mon[34394]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:24.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:23 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:24.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:23 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:24.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:23 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:24.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:23 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:26:24.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:23 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:26:24.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:23 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:26:24.248 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:26:24.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.732+0000 7eff094e1640 1 -- 172.21.15.5:0/3897013487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff04102da0 msgr2=0x7eff04103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:24.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.732+0000 7eff094e1640 1 --2- 172.21.15.5:0/3897013487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff04102da0 0x7eff04103180 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efef4009900 tx=0x7efef402a480 comp rx=0 tx=0).stop 2024-09-11T23:26:24.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.732+0000 7eff094e1640 1 -- 172.21.15.5:0/3897013487 shutdown_connections 2024-09-11T23:26:24.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.732+0000 7eff094e1640 1 --2- 172.21.15.5:0/3897013487 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff0410c180 0x7eff0410e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:24.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.732+0000 7eff094e1640 1 --2- 172.21.15.5:0/3897013487 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff041036c0 0x7eff0410bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:24.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.732+0000 7eff094e1640 1 --2- 172.21.15.5:0/3897013487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff04102da0 0x7eff04103180 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:24.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.732+0000 7eff094e1640 1 -- 172.21.15.5:0/3897013487 >> 172.21.15.5:0/3897013487 conn(0x7eff040fc7a0 msgr2=0x7eff040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:24.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.732+0000 7eff094e1640 1 -- 172.21.15.5:0/3897013487 shutdown_connections 2024-09-11T23:26:24.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.732+0000 7eff094e1640 1 -- 172.21.15.5:0/3897013487 wait complete. 2024-09-11T23:26:24.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.733+0000 7eff094e1640 1 Processor -- start 2024-09-11T23:26:24.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.733+0000 7eff094e1640 1 -- start start 2024-09-11T23:26:24.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.733+0000 7eff094e1640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff04102da0 0x7eff041982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:24.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.733+0000 7eff094e1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff041036c0 0x7eff04198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:24.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.733+0000 7eff094e1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff0410c180 0x7eff0419cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:24.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.733+0000 7eff094e1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7eff04111e10 con 0x7eff041036c0 2024-09-11T23:26:24.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.733+0000 7eff094e1640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7eff04111c90 con 0x7eff04102da0 2024-09-11T23:26:24.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.733+0000 7eff094e1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7eff04111f90 con 0x7eff0410c180 2024-09-11T23:26:24.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.733+0000 7eff027fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff041036c0 0x7eff04198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:24.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.733+0000 7eff027fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff041036c0 0x7eff04198830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37988/0 (socket says 172.21.15.5:37988) 2024-09-11T23:26:24.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.733+0000 7eff027fc640 1 -- 172.21.15.5:0/3002573750 learned_addr learned my addr 172.21.15.5:0/3002573750 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:26:24.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.734+0000 7eff037fe640 1 --2- 172.21.15.5:0/3002573750 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff0410c180 0x7eff0419cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:24.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.734+0000 7eff02ffd640 1 --2- 172.21.15.5:0/3002573750 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff04102da0 0x7eff041982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:24.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.734+0000 7eff027fc640 1 -- 172.21.15.5:0/3002573750 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff0410c180 msgr2=0x7eff0419cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:24.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.734+0000 7eff027fc640 1 --2- 172.21.15.5:0/3002573750 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff0410c180 0x7eff0419cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:24.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.734+0000 7eff027fc640 1 -- 172.21.15.5:0/3002573750 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff04102da0 msgr2=0x7eff041982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:24.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.734+0000 7eff027fc640 1 --2- 172.21.15.5:0/3002573750 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff04102da0 0x7eff041982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:24.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.734+0000 7eff027fc640 1 -- 172.21.15.5:0/3002573750 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff0419d2a0 con 0x7eff041036c0 2024-09-11T23:26:24.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.734+0000 7eff027fc640 1 --2- 172.21.15.5:0/3002573750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff041036c0 0x7eff04198830 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7efef800cce0 tx=0x7efef800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:24.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.734+0000 7efeebfff640 1 -- 172.21.15.5:0/3002573750 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef800f650 con 0x7eff041036c0 2024-09-11T23:26:24.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.734+0000 7efeebfff640 1 -- 172.21.15.5:0/3002573750 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efef800fca0 con 0x7eff041036c0 2024-09-11T23:26:24.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.734+0000 7eff094e1640 1 -- 172.21.15.5:0/3002573750 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff0419d590 con 0x7eff041036c0 2024-09-11T23:26:24.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.734+0000 7efeebfff640 1 -- 172.21.15.5:0/3002573750 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef8018b90 con 0x7eff041036c0 2024-09-11T23:26:24.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.734+0000 7eff094e1640 1 -- 172.21.15.5:0/3002573750 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff041a4e70 con 0x7eff041036c0 2024-09-11T23:26:24.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.735+0000 7eff094e1640 1 -- 172.21.15.5:0/3002573750 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff04103180 con 0x7eff041036c0 2024-09-11T23:26:24.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.736+0000 7efeebfff640 1 -- 172.21.15.5:0/3002573750 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7efef800f7f0 con 0x7eff041036c0 2024-09-11T23:26:24.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.737+0000 7efeebfff640 1 --2- 172.21.15.5:0/3002573750 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7efeec0a2b80 0x7efeec0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:24.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.737+0000 7eff02ffd640 1 --2- 172.21.15.5:0/3002573750 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7efeec0a2b80 0x7efeec0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:24.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.737+0000 7efeebfff640 1 -- 172.21.15.5:0/3002573750 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7efef80cf110 con 0x7eff041036c0 2024-09-11T23:26:24.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.737+0000 7eff02ffd640 1 --2- 172.21.15.5:0/3002573750 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7efeec0a2b80 0x7efeec0a5040 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efef4031440 tx=0x7efef40095f0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:24.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.741+0000 7efeebfff640 1 -- 172.21.15.5:0/3002573750 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efef8014030 con 0x7eff041036c0 2024-09-11T23:26:24.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.951+0000 7eff094e1640 1 -- 172.21.15.5:0/3002573750 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7eff0402d7c0 con 0x7eff041036c0 2024-09-11T23:26:24.952 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:24 smithi005 ceph-mon[31201]: Deploying daemon mds.i on smithi172 2024-09-11T23:26:24.952 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:24 smithi005 ceph-mon[31201]: mds.? [v2:172.21.15.159:6836/4020181017,v1:172.21.15.159:6837/4020181017] up:boot 2024-09-11T23:26:24.952 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:24 smithi005 ceph-mon[31201]: fsmap 8 up:standby 2024-09-11T23:26:24.952 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:24 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-11T23:26:24.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.952+0000 7efeebfff640 1 -- 172.21.15.5:0/3002573750 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7222 (secure 0 0 0) 0x7efef809c510 con 0x7eff041036c0 2024-09-11T23:26:24.953 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:26:24.953 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":9,"btime":"2024-09-11T23:26:23:652789+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3865435482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3865435482},{"type":"v1","addr":"172.21.15.5:6835","nonce":3865435482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1323314897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":1323314897},{"type":"v1","addr":"172.21.15.5:6837","nonce":1323314897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3113658116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3113658116},{"type":"v1","addr":"172.21.15.172:6833","nonce":3113658116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3887336060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3887336060},{"type":"v1","addr":"172.21.15.159:6833","nonce":3887336060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2539263301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2539263301},{"type":"v1","addr":"172.21.15.159:6835","nonce":2539263301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/4240913699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":4240913699},{"type":"v1","addr":"172.21.15.172:6835","nonce":4240913699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24460,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4200951601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":4200951601},{"type":"v1","addr":"172.21.15.172:6837","nonce":4200951601}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/4020181017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":4020181017},{"type":"v1","addr":"172.21.15.159:6837","nonce":4020181017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-11T23:26:24.953 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 9 2024-09-11T23:26:24.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.955+0000 7eff094e1640 1 -- 172.21.15.5:0/3002573750 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7efeec0a2b80 msgr2=0x7efeec0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:24.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.955+0000 7eff094e1640 1 --2- 172.21.15.5:0/3002573750 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7efeec0a2b80 0x7efeec0a5040 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efef4031440 tx=0x7efef40095f0 comp rx=0 tx=0).stop 2024-09-11T23:26:24.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.955+0000 7eff094e1640 1 -- 172.21.15.5:0/3002573750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff041036c0 msgr2=0x7eff04198830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:24.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.955+0000 7eff094e1640 1 --2- 172.21.15.5:0/3002573750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff041036c0 0x7eff04198830 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7efef800cce0 tx=0x7efef800a620 comp rx=0 tx=0).stop 2024-09-11T23:26:24.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.955+0000 7eff094e1640 1 -- 172.21.15.5:0/3002573750 shutdown_connections 2024-09-11T23:26:24.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.955+0000 7eff094e1640 1 --2- 172.21.15.5:0/3002573750 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7efeec0a2b80 0x7efeec0a5040 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:24.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.955+0000 7eff094e1640 1 --2- 172.21.15.5:0/3002573750 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff0410c180 0x7eff0419cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:24.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.955+0000 7eff094e1640 1 --2- 172.21.15.5:0/3002573750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff041036c0 0x7eff04198830 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:24.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.955+0000 7eff094e1640 1 --2- 172.21.15.5:0/3002573750 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff04102da0 0x7eff041982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:24.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.955+0000 7eff094e1640 1 -- 172.21.15.5:0/3002573750 >> 172.21.15.5:0/3002573750 conn(0x7eff040fc7a0 msgr2=0x7eff040fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:24.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.955+0000 7eff094e1640 1 -- 172.21.15.5:0/3002573750 shutdown_connections 2024-09-11T23:26:24.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:24.955+0000 7eff094e1640 1 -- 172.21.15.5:0/3002573750 wait complete. 2024-09-11T23:26:25.074 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:24 smithi172 ceph-mon[34855]: Deploying daemon mds.i on smithi172 2024-09-11T23:26:25.074 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:24 smithi172 ceph-mon[34855]: mds.? [v2:172.21.15.159:6836/4020181017,v1:172.21.15.159:6837/4020181017] up:boot 2024-09-11T23:26:25.074 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:24 smithi172 ceph-mon[34855]: fsmap 8 up:standby 2024-09-11T23:26:25.074 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:24 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-11T23:26:25.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:24 smithi159 ceph-mon[34394]: Deploying daemon mds.i on smithi172 2024-09-11T23:26:25.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:24 smithi159 ceph-mon[34394]: mds.? [v2:172.21.15.159:6836/4020181017,v1:172.21.15.159:6837/4020181017] up:boot 2024-09-11T23:26:25.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:24 smithi159 ceph-mon[34394]: fsmap 8 up:standby 2024-09-11T23:26:25.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:24 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-11T23:26:25.384 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 11 23:26:25 smithi172 systemd[1]: Starting Ceph mds.i for 1f5284d2-7094-11ef-bcea-c7b262605968... 2024-09-11T23:26:25.735 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:25 smithi172 ceph-mon[34855]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:25.735 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:25 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/3002573750' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:26:25.735 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 11 23:26:25 smithi172 podman[64718]: 2024-09-11 23:26:25.372562687 +0000 UTC m=+0.015939701 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:26:25.735 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 11 23:26:25 smithi172 podman[64718]: 2024-09-11 23:26:25.481289349 +0000 UTC m=+0.124666362 container create 2f4e129ca679c932b263ee4fcbf7e4e866c493fad9e4529f25765a234289412a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-i, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-11T23:26:25.735 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 11 23:26:25 smithi172 podman[64718]: 2024-09-11 23:26:25.709423988 +0000 UTC m=+0.352801001 container init 2f4e129ca679c932b263ee4fcbf7e4e866c493fad9e4529f25765a234289412a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-i, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-11T23:26:25.735 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 11 23:26:25 smithi172 podman[64718]: 2024-09-11 23:26:25.712563367 +0000 UTC m=+0.355940384 container start 2f4e129ca679c932b263ee4fcbf7e4e866c493fad9e4529f25765a234289412a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-i, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T23:26:25.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:25 smithi005 ceph-mon[31201]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:25.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:25 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/3002573750' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:26:26.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:25 smithi159 ceph-mon[34394]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:26.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:25 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/3002573750' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:26:26.134 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 11 23:26:25 smithi172 ceph-mds[64737]: -- 172.21.15.172:0/2113156021 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55da57a27860 con 0x55da57a04800 2024-09-11T23:26:26.134 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 11 23:26:25 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-i[64733]: starting mds.i at 2024-09-11T23:26:26.134 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 11 23:26:25 smithi172 bash[64718]: 2f4e129ca679c932b263ee4fcbf7e4e866c493fad9e4529f25765a234289412a 2024-09-11T23:26:26.134 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 11 23:26:25 smithi172 systemd[1]: Started Ceph mds.i for 1f5284d2-7094-11ef-bcea-c7b262605968. 2024-09-11T23:26:27.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:26 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:27.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:26 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:27.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:26 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:27.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:26 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:26:27.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:26 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:26:27.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:26 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:26:27.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:26 smithi159 ceph-mon[34394]: Deploying daemon mds.g on smithi005 2024-09-11T23:26:27.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:26 smithi159 ceph-mon[34394]: mds.? [v2:172.21.15.172:6838/3928313314,v1:172.21.15.172:6839/3928313314] up:boot 2024-09-11T23:26:27.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:26 smithi159 ceph-mon[34394]: fsmap 9 up:standby 2024-09-11T23:26:27.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:26 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-11T23:26:27.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:26 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:27.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:26 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:27.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:26 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:27.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:26 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:26:27.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:26 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:26:27.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:26 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:26:27.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:26 smithi172 ceph-mon[34855]: Deploying daemon mds.g on smithi005 2024-09-11T23:26:27.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:26 smithi172 ceph-mon[34855]: mds.? [v2:172.21.15.172:6838/3928313314,v1:172.21.15.172:6839/3928313314] up:boot 2024-09-11T23:26:27.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:26 smithi172 ceph-mon[34855]: fsmap 9 up:standby 2024-09-11T23:26:27.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:26 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-11T23:26:27.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:26 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:27.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:26 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:27.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:26 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:27.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:26 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:26:27.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:26 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:26:27.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:26 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:26:27.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:26 smithi005 ceph-mon[31201]: Deploying daemon mds.g on smithi005 2024-09-11T23:26:27.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:26 smithi005 ceph-mon[31201]: mds.? [v2:172.21.15.172:6838/3928313314,v1:172.21.15.172:6839/3928313314] up:boot 2024-09-11T23:26:27.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:26 smithi005 ceph-mon[31201]: fsmap 9 up:standby 2024-09-11T23:26:27.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:26 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-11T23:26:27.629 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:26:27.882 INFO:journalctl@ceph.mds.g.smithi005.stdout:Sep 11 23:26:27 smithi005 systemd[1]: Starting Ceph mds.g for 1f5284d2-7094-11ef-bcea-c7b262605968... 2024-09-11T23:26:28.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:27 smithi172 ceph-mon[34855]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:28.178 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:27 smithi005 ceph-mon[31201]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:28.179 INFO:journalctl@ceph.mds.g.smithi005.stdout:Sep 11 23:26:28 smithi005 podman[71994]: 2024-09-11 23:26:27.94460641 +0000 UTC m=+0.016929362 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:26:28.179 INFO:journalctl@ceph.mds.g.smithi005.stdout:Sep 11 23:26:28 smithi005 podman[71994]: 2024-09-11 23:26:28.058082755 +0000 UTC m=+0.130405694 container create 48c20a1f938338a65db9939d94a3f3219c997bc10d87eaea745f86dae0a736a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-g, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-11T23:26:28.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:27 smithi159 ceph-mon[34394]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:28.429 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:26:28.552 INFO:journalctl@ceph.mds.g.smithi005.stdout:Sep 11 23:26:28 smithi005 podman[71994]: 2024-09-11 23:26:28.294729813 +0000 UTC m=+0.367052754 container init 48c20a1f938338a65db9939d94a3f3219c997bc10d87eaea745f86dae0a736a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-g, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T23:26:28.553 INFO:journalctl@ceph.mds.g.smithi005.stdout:Sep 11 23:26:28 smithi005 podman[71994]: 2024-09-11 23:26:28.297600795 +0000 UTC m=+0.369923740 container start 48c20a1f938338a65db9939d94a3f3219c997bc10d87eaea745f86dae0a736a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-g, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-11T23:26:28.553 INFO:journalctl@ceph.mds.g.smithi005.stdout:Sep 11 23:26:28 smithi005 ceph-mds[72039]: -- 172.21.15.5:0/827945445 <== mon.0 v2:172.21.15.5:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55582fab3860 con 0x55582fa91000 2024-09-11T23:26:28.553 INFO:journalctl@ceph.mds.g.smithi005.stdout:Sep 11 23:26:28 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-g[72023]: starting mds.g at 2024-09-11T23:26:28.553 INFO:journalctl@ceph.mds.g.smithi005.stdout:Sep 11 23:26:28 smithi005 bash[71994]: 48c20a1f938338a65db9939d94a3f3219c997bc10d87eaea745f86dae0a736a1 2024-09-11T23:26:28.553 INFO:journalctl@ceph.mds.g.smithi005.stdout:Sep 11 23:26:28 smithi005 systemd[1]: Started Ceph mds.g for 1f5284d2-7094-11ef-bcea-c7b262605968. 2024-09-11T23:26:28.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:28.917+0000 7f441ff8f640 1 -- 172.21.15.5:0/1106508626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44181082a0 msgr2=0x7f441810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:28.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:28.917+0000 7f441ff8f640 1 --2- 172.21.15.5:0/1106508626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44181082a0 0x7f441810ec40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4410009cd0 tx=0x7f441002a8e0 comp rx=0 tx=0).stop 2024-09-11T23:26:28.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:28.917+0000 7f441ff8f640 1 -- 172.21.15.5:0/1106508626 shutdown_connections 2024-09-11T23:26:28.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:28.917+0000 7f441ff8f640 1 --2- 172.21.15.5:0/1106508626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44181082a0 0x7f441810ec40 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:28.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:28.917+0000 7f441ff8f640 1 --2- 172.21.15.5:0/1106508626 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44181036e0 0x7f4418107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:28.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:28.917+0000 7f441ff8f640 1 --2- 172.21.15.5:0/1106508626 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4418102d30 0x7f4418103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:28.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:28.917+0000 7f441ff8f640 1 -- 172.21.15.5:0/1106508626 >> 172.21.15.5:0/1106508626 conn(0x7f44180fc7d0 msgr2=0x7f44180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:28.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:28.917+0000 7f441ff8f640 1 -- 172.21.15.5:0/1106508626 shutdown_connections 2024-09-11T23:26:28.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:28.917+0000 7f441ff8f640 1 -- 172.21.15.5:0/1106508626 wait complete. 2024-09-11T23:26:28.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:28.918+0000 7f441ff8f640 1 Processor -- start 2024-09-11T23:26:28.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:28.918+0000 7f441ff8f640 1 -- start start 2024-09-11T23:26:28.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:28.918+0000 7f441ff8f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4418102d30 0x7f4418198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:28.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:28.918+0000 7f441ff8f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44181036e0 0x7f44181989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:28.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:28.918+0000 7f441ff8f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44181082a0 0x7f441819cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:28.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:28.918+0000 7f441ff8f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4418111f50 con 0x7f44181082a0 2024-09-11T23:26:28.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:28.918+0000 7f441ff8f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f4418111dd0 con 0x7f44181036e0 2024-09-11T23:26:28.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:28.918+0000 7f441ff8f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f44181120d0 con 0x7f4418102d30 2024-09-11T23:26:28.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:28.918+0000 7f441e52c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44181082a0 0x7f441819cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:28.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:28.918+0000 7f441e52c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44181082a0 0x7f441819cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38042/0 (socket says 172.21.15.5:38042) 2024-09-11T23:26:28.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:28.918+0000 7f441e52c640 1 -- 172.21.15.5:0/3422009950 learned_addr learned my addr 172.21.15.5:0/3422009950 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:26:28.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:28.918+0000 7f441d52a640 1 --2- 172.21.15.5:0/3422009950 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44181036e0 0x7f44181989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:28.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:28.918+0000 7f441dd2b640 1 --2- 172.21.15.5:0/3422009950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4418102d30 0x7f4418198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:28.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:28.918+0000 7f441e52c640 1 -- 172.21.15.5:0/3422009950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4418102d30 msgr2=0x7f4418198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:28.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:28.918+0000 7f441e52c640 1 --2- 172.21.15.5:0/3422009950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4418102d30 0x7f4418198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:28.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:28.918+0000 7f441e52c640 1 -- 172.21.15.5:0/3422009950 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44181036e0 msgr2=0x7f44181989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:28.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:28.918+0000 7f441e52c640 1 --2- 172.21.15.5:0/3422009950 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44181036e0 0x7f44181989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:28.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:28.918+0000 7f441e52c640 1 -- 172.21.15.5:0/3422009950 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f441819d440 con 0x7f44181082a0 2024-09-11T23:26:28.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:28.918+0000 7f441d52a640 1 --2- 172.21.15.5:0/3422009950 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44181036e0 0x7f44181989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:26:28.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:28.918+0000 7f441dd2b640 1 --2- 172.21.15.5:0/3422009950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4418102d30 0x7f4418198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:26:28.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:28.919+0000 7f441e52c640 1 --2- 172.21.15.5:0/3422009950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44181082a0 0x7f441819cd60 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4410033040 tx=0x7f4410003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:28.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:28.919+0000 7f440effd640 1 -- 172.21.15.5:0/3422009950 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4410004040 con 0x7f44181082a0 2024-09-11T23:26:28.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:28.919+0000 7f441ff8f640 1 -- 172.21.15.5:0/3422009950 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f441819d6d0 con 0x7f44181082a0 2024-09-11T23:26:28.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:28.919+0000 7f440effd640 1 -- 172.21.15.5:0/3422009950 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4410004690 con 0x7f44181082a0 2024-09-11T23:26:28.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:28.919+0000 7f440effd640 1 -- 172.21.15.5:0/3422009950 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4410030e10 con 0x7f44181082a0 2024-09-11T23:26:28.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:28.919+0000 7f441ff8f640 1 -- 172.21.15.5:0/3422009950 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44181a5010 con 0x7f44181082a0 2024-09-11T23:26:28.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:28.920+0000 7f441ff8f640 1 -- 172.21.15.5:0/3422009950 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4418103110 con 0x7f44181082a0 2024-09-11T23:26:28.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:28.921+0000 7f440effd640 1 -- 172.21.15.5:0/3422009950 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f44100305a0 con 0x7f44181082a0 2024-09-11T23:26:28.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:28.922+0000 7f440effd640 1 --2- 172.21.15.5:0/3422009950 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f44040a2b80 0x7f44040a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:28.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:28.922+0000 7f441dd2b640 1 --2- 172.21.15.5:0/3422009950 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f44040a2b80 0x7f44040a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:28.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:28.922+0000 7f440effd640 1 -- 172.21.15.5:0/3422009950 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f441002e030 con 0x7f44181082a0 2024-09-11T23:26:28.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:28.923+0000 7f441dd2b640 1 --2- 172.21.15.5:0/3422009950 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f44040a2b80 0x7f44040a5040 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4414009b50 tx=0x7f4414005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:28.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:28.926+0000 7f440effd640 1 -- 172.21.15.5:0/3422009950 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f441004b060 con 0x7f44181082a0 2024-09-11T23:26:29.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:29.156+0000 7f441ff8f640 1 -- 172.21.15.5:0/3422009950 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f441810a2b0 con 0x7f44181082a0 2024-09-11T23:26:29.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:29.157+0000 7f440effd640 1 -- 172.21.15.5:0/3422009950 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8875 (secure 0 0 0) 0x7f44100bd9a0 con 0x7f44181082a0 2024-09-11T23:26:29.157 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:26:29.157 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":11,"btime":"2024-09-11T23:26:28:882708+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3865435482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3865435482},{"type":"v1","addr":"172.21.15.5:6835","nonce":3865435482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1323314897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":1323314897},{"type":"v1","addr":"172.21.15.5:6837","nonce":1323314897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14610,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6839/4140073288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":4140073288},{"type":"v1","addr":"172.21.15.5:6839","nonce":4140073288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3113658116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3113658116},{"type":"v1","addr":"172.21.15.172:6833","nonce":3113658116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3887336060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3887336060},{"type":"v1","addr":"172.21.15.159:6833","nonce":3887336060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2539263301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2539263301},{"type":"v1","addr":"172.21.15.159:6835","nonce":2539263301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/4240913699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":4240913699},{"type":"v1","addr":"172.21.15.172:6835","nonce":4240913699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24460,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4200951601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":4200951601},{"type":"v1","addr":"172.21.15.172:6837","nonce":4200951601}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/4020181017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":4020181017},{"type":"v1","addr":"172.21.15.159:6837","nonce":4020181017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24475,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6839/3928313314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3928313314},{"type":"v1","addr":"172.21.15.172:6839","nonce":3928313314}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-11T23:26:29.157 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 11 2024-09-11T23:26:29.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:29.159+0000 7f441ff8f640 1 -- 172.21.15.5:0/3422009950 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f44040a2b80 msgr2=0x7f44040a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:29.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:29.159+0000 7f441ff8f640 1 --2- 172.21.15.5:0/3422009950 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f44040a2b80 0x7f44040a5040 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4414009b50 tx=0x7f4414005f90 comp rx=0 tx=0).stop 2024-09-11T23:26:29.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:29.159+0000 7f441ff8f640 1 -- 172.21.15.5:0/3422009950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44181082a0 msgr2=0x7f441819cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:29.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:29.159+0000 7f441ff8f640 1 --2- 172.21.15.5:0/3422009950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44181082a0 0x7f441819cd60 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4410033040 tx=0x7f4410003970 comp rx=0 tx=0).stop 2024-09-11T23:26:29.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:29.160+0000 7f441ff8f640 1 -- 172.21.15.5:0/3422009950 shutdown_connections 2024-09-11T23:26:29.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:29.160+0000 7f441ff8f640 1 --2- 172.21.15.5:0/3422009950 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f44040a2b80 0x7f44040a5040 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:29.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:29.160+0000 7f441ff8f640 1 --2- 172.21.15.5:0/3422009950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44181082a0 0x7f441819cd60 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:29.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:29.160+0000 7f441ff8f640 1 --2- 172.21.15.5:0/3422009950 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44181036e0 0x7f44181989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:29.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:29.160+0000 7f441ff8f640 1 --2- 172.21.15.5:0/3422009950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4418102d30 0x7f4418198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:29.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:29.160+0000 7f441ff8f640 1 -- 172.21.15.5:0/3422009950 >> 172.21.15.5:0/3422009950 conn(0x7f44180fc7d0 msgr2=0x7f4418105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:29.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:29.160+0000 7f441ff8f640 1 -- 172.21.15.5:0/3422009950 shutdown_connections 2024-09-11T23:26:29.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:29.160+0000 7f441ff8f640 1 -- 172.21.15.5:0/3422009950 wait complete. 2024-09-11T23:26:29.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:29 smithi005 ceph-mon[31201]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:29.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:29 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:29.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:29 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:29.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:29 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:29.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:29 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:26:29.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:29 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:26:29.725 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:29 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:26:29.725 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:29 smithi005 ceph-mon[31201]: Deploying daemon mds.a on smithi005 2024-09-11T23:26:29.725 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:29 smithi005 ceph-mon[31201]: mds.? [v2:172.21.15.5:6838/4140073288,v1:172.21.15.5:6839/4140073288] up:boot 2024-09-11T23:26:29.725 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:29 smithi005 ceph-mon[31201]: fsmap 10 up:standby 2024-09-11T23:26:29.725 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:29 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-11T23:26:29.725 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:29 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/3422009950' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:26:29.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:29 smithi159 ceph-mon[34394]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:29.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:29 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:29.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:29 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:29.877 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:29 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:29.877 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:29 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:26:29.877 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:29 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:26:29.877 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:29 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:26:29.877 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:29 smithi159 ceph-mon[34394]: Deploying daemon mds.a on smithi005 2024-09-11T23:26:29.877 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:29 smithi159 ceph-mon[34394]: mds.? [v2:172.21.15.5:6838/4140073288,v1:172.21.15.5:6839/4140073288] up:boot 2024-09-11T23:26:29.877 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:29 smithi159 ceph-mon[34394]: fsmap 10 up:standby 2024-09-11T23:26:29.877 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:29 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-11T23:26:29.877 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:29 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/3422009950' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:26:29.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:29 smithi172 ceph-mon[34855]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:29.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:29 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:29.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:29 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:29.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:29 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:29.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:29 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:26:29.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:29 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:26:29.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:29 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:26:29.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:29 smithi172 ceph-mon[34855]: Deploying daemon mds.a on smithi005 2024-09-11T23:26:29.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:29 smithi172 ceph-mon[34855]: mds.? [v2:172.21.15.5:6838/4140073288,v1:172.21.15.5:6839/4140073288] up:boot 2024-09-11T23:26:29.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:29 smithi172 ceph-mon[34855]: fsmap 10 up:standby 2024-09-11T23:26:29.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:29 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-11T23:26:29.885 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:29 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/3422009950' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:26:31.451 INFO:journalctl@ceph.mds.a.smithi005.stdout:Sep 11 23:26:31 smithi005 systemd[1]: Starting Ceph mds.a for 1f5284d2-7094-11ef-bcea-c7b262605968... 2024-09-11T23:26:31.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:31 smithi005 ceph-mon[31201]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:31.724 INFO:journalctl@ceph.mds.a.smithi005.stdout:Sep 11 23:26:31 smithi005 podman[72396]: 2024-09-11 23:26:31.505450323 +0000 UTC m=+0.016015287 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:26:31.724 INFO:journalctl@ceph.mds.a.smithi005.stdout:Sep 11 23:26:31 smithi005 podman[72396]: 2024-09-11 23:26:31.624999658 +0000 UTC m=+0.135564625 container create 24640fa9d37a549ce2e2874a7e9c513b9384cc72fe916ee24fdbc83fb65248b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-a, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-11T23:26:31.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:31 smithi159 ceph-mon[34394]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:31.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:31 smithi172 ceph-mon[34855]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:31.997 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:26:32.023 INFO:journalctl@ceph.mds.a.smithi005.stdout:Sep 11 23:26:31 smithi005 podman[72396]: 2024-09-11 23:26:31.869487879 +0000 UTC m=+0.380052843 container init 24640fa9d37a549ce2e2874a7e9c513b9384cc72fe916ee24fdbc83fb65248b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-a, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-11T23:26:32.023 INFO:journalctl@ceph.mds.a.smithi005.stdout:Sep 11 23:26:31 smithi005 podman[72396]: 2024-09-11 23:26:31.872500999 +0000 UTC m=+0.383065967 container start 24640fa9d37a549ce2e2874a7e9c513b9384cc72fe916ee24fdbc83fb65248b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-a, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T23:26:32.023 INFO:journalctl@ceph.mds.a.smithi005.stdout:Sep 11 23:26:31 smithi005 ceph-mds[72415]: -- 172.21.15.5:0/3855636850 <== mon.0 v2:172.21.15.5:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b8723d3860 con 0x55b8723b1000 2024-09-11T23:26:32.023 INFO:journalctl@ceph.mds.a.smithi005.stdout:Sep 11 23:26:31 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-a[72411]: starting mds.a at 2024-09-11T23:26:32.023 INFO:journalctl@ceph.mds.a.smithi005.stdout:Sep 11 23:26:31 smithi005 bash[72396]: 24640fa9d37a549ce2e2874a7e9c513b9384cc72fe916ee24fdbc83fb65248b2 2024-09-11T23:26:32.023 INFO:journalctl@ceph.mds.a.smithi005.stdout:Sep 11 23:26:31 smithi005 systemd[1]: Started Ceph mds.a for 1f5284d2-7094-11ef-bcea-c7b262605968. 2024-09-11T23:26:32.259 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:26:32.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.741+0000 7fcc8abc5640 1 -- 172.21.15.5:0/1274932429 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc8410c170 msgr2=0x7fcc8410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:32.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.741+0000 7fcc8abc5640 1 --2- 172.21.15.5:0/1274932429 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc8410c170 0x7fcc8410e610 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c009ca0 tx=0x7fcc7c02a950 comp rx=0 tx=0).stop 2024-09-11T23:26:32.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.741+0000 7fcc8abc5640 1 -- 172.21.15.5:0/1274932429 shutdown_connections 2024-09-11T23:26:32.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.741+0000 7fcc8abc5640 1 --2- 172.21.15.5:0/1274932429 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc8410c170 0x7fcc8410e610 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:32.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.741+0000 7fcc8abc5640 1 --2- 172.21.15.5:0/1274932429 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc84103660 0x7fcc8410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:32.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.741+0000 7fcc8abc5640 1 --2- 172.21.15.5:0/1274932429 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc84102d40 0x7fcc84103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:32.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.741+0000 7fcc8abc5640 1 -- 172.21.15.5:0/1274932429 >> 172.21.15.5:0/1274932429 conn(0x7fcc840fc7a0 msgr2=0x7fcc840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:32.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.741+0000 7fcc8abc5640 1 -- 172.21.15.5:0/1274932429 shutdown_connections 2024-09-11T23:26:32.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.741+0000 7fcc8abc5640 1 -- 172.21.15.5:0/1274932429 wait complete. 2024-09-11T23:26:32.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.741+0000 7fcc8abc5640 1 Processor -- start 2024-09-11T23:26:32.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.741+0000 7fcc8abc5640 1 -- start start 2024-09-11T23:26:32.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.742+0000 7fcc8abc5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc84102d40 0x7fcc84198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:32.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.742+0000 7fcc8abc5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc84103660 0x7fcc84198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:32.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.742+0000 7fcc8abc5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc8410c170 0x7fcc8419cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:32.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.742+0000 7fcc8abc5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcc84111e20 con 0x7fcc84102d40 2024-09-11T23:26:32.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.742+0000 7fcc8abc5640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fcc84111ca0 con 0x7fcc84103660 2024-09-11T23:26:32.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.742+0000 7fcc8abc5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcc84111fa0 con 0x7fcc8410c170 2024-09-11T23:26:32.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.742+0000 7fcc88961640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc84102d40 0x7fcc84198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:32.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.742+0000 7fcc88961640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc84102d40 0x7fcc84198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38090/0 (socket says 172.21.15.5:38090) 2024-09-11T23:26:32.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.742+0000 7fcc88961640 1 -- 172.21.15.5:0/601790804 learned_addr learned my addr 172.21.15.5:0/601790804 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:26:32.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.742+0000 7fcc83fff640 1 --2- 172.21.15.5:0/601790804 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc84103660 0x7fcc84198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:32.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.742+0000 7fcc89162640 1 --2- 172.21.15.5:0/601790804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc8410c170 0x7fcc8419cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:32.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.742+0000 7fcc88961640 1 -- 172.21.15.5:0/601790804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc8410c170 msgr2=0x7fcc8419cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:32.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.742+0000 7fcc88961640 1 --2- 172.21.15.5:0/601790804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc8410c170 0x7fcc8419cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:32.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.742+0000 7fcc88961640 1 -- 172.21.15.5:0/601790804 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc84103660 msgr2=0x7fcc84198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:32.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.742+0000 7fcc88961640 1 --2- 172.21.15.5:0/601790804 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc84103660 0x7fcc84198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:32.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.742+0000 7fcc88961640 1 -- 172.21.15.5:0/601790804 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc8419d2b0 con 0x7fcc84102d40 2024-09-11T23:26:32.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.742+0000 7fcc83fff640 1 --2- 172.21.15.5:0/601790804 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc84103660 0x7fcc84198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:26:32.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.742+0000 7fcc88961640 1 --2- 172.21.15.5:0/601790804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc84102d40 0x7fcc84198300 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcc7400e9f0 tx=0x7fcc7400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:32.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.742+0000 7fcc81ffb640 1 -- 172.21.15.5:0/601790804 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc7400cd80 con 0x7fcc84102d40 2024-09-11T23:26:32.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.742+0000 7fcc81ffb640 1 -- 172.21.15.5:0/601790804 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcc740108e0 con 0x7fcc84102d40 2024-09-11T23:26:32.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.742+0000 7fcc8abc5640 1 -- 172.21.15.5:0/601790804 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc8419d5a0 con 0x7fcc84102d40 2024-09-11T23:26:32.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.742+0000 7fcc81ffb640 1 -- 172.21.15.5:0/601790804 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc74018920 con 0x7fcc84102d40 2024-09-11T23:26:32.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.743+0000 7fcc8abc5640 1 -- 172.21.15.5:0/601790804 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc841a4e80 con 0x7fcc84102d40 2024-09-11T23:26:32.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.744+0000 7fcc8abc5640 1 -- 172.21.15.5:0/601790804 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc84103120 con 0x7fcc84102d40 2024-09-11T23:26:32.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.745+0000 7fcc81ffb640 1 -- 172.21.15.5:0/601790804 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fcc74010a90 con 0x7fcc84102d40 2024-09-11T23:26:32.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.746+0000 7fcc81ffb640 1 --2- 172.21.15.5:0/601790804 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fcc6c0a2b80 0x7fcc6c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:32.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.746+0000 7fcc83fff640 1 --2- 172.21.15.5:0/601790804 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fcc6c0a2b80 0x7fcc6c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:32.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.746+0000 7fcc81ffb640 1 -- 172.21.15.5:0/601790804 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fcc740cf440 con 0x7fcc84102d40 2024-09-11T23:26:32.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.746+0000 7fcc83fff640 1 --2- 172.21.15.5:0/601790804 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fcc6c0a2b80 0x7fcc6c0a5040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcc840fed50 tx=0x7fcc7800a250 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:32.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.750+0000 7fcc81ffb640 1 -- 172.21.15.5:0/601790804 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcc7409c150 con 0x7fcc84102d40 2024-09-11T23:26:32.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.959+0000 7fcc8abc5640 1 -- 172.21.15.5:0/601790804 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcc84199660 con 0x7fcc84102d40 2024-09-11T23:26:32.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.960+0000 7fcc81ffb640 1 -- 172.21.15.5:0/601790804 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9698 (secure 0 0 0) 0x7fcc740a0450 con 0x7fcc84102d40 2024-09-11T23:26:32.959 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:26:32.959 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":12,"btime":"2024-09-11T23:26:32:451628+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3865435482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3865435482},{"type":"v1","addr":"172.21.15.5:6835","nonce":3865435482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1323314897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":1323314897},{"type":"v1","addr":"172.21.15.5:6837","nonce":1323314897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14610,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6839/4140073288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":4140073288},{"type":"v1","addr":"172.21.15.5:6839","nonce":4140073288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6841/1162578713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":1162578713},{"type":"v1","addr":"172.21.15.5:6841","nonce":1162578713}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3113658116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3113658116},{"type":"v1","addr":"172.21.15.172:6833","nonce":3113658116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3887336060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3887336060},{"type":"v1","addr":"172.21.15.159:6833","nonce":3887336060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2539263301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2539263301},{"type":"v1","addr":"172.21.15.159:6835","nonce":2539263301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/4240913699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":4240913699},{"type":"v1","addr":"172.21.15.172:6835","nonce":4240913699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24460,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4200951601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":4200951601},{"type":"v1","addr":"172.21.15.172:6837","nonce":4200951601}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/4020181017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":4020181017},{"type":"v1","addr":"172.21.15.159:6837","nonce":4020181017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24475,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6839/3928313314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3928313314},{"type":"v1","addr":"172.21.15.172:6839","nonce":3928313314}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-11T23:26:32.960 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 12 2024-09-11T23:26:32.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.962+0000 7fcc8abc5640 1 -- 172.21.15.5:0/601790804 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fcc6c0a2b80 msgr2=0x7fcc6c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:32.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.962+0000 7fcc8abc5640 1 --2- 172.21.15.5:0/601790804 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fcc6c0a2b80 0x7fcc6c0a5040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcc840fed50 tx=0x7fcc7800a250 comp rx=0 tx=0).stop 2024-09-11T23:26:32.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.962+0000 7fcc8abc5640 1 -- 172.21.15.5:0/601790804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc84102d40 msgr2=0x7fcc84198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:32.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.962+0000 7fcc8abc5640 1 --2- 172.21.15.5:0/601790804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc84102d40 0x7fcc84198300 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcc7400e9f0 tx=0x7fcc7400eeb0 comp rx=0 tx=0).stop 2024-09-11T23:26:32.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.962+0000 7fcc8abc5640 1 -- 172.21.15.5:0/601790804 shutdown_connections 2024-09-11T23:26:32.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.962+0000 7fcc8abc5640 1 --2- 172.21.15.5:0/601790804 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fcc6c0a2b80 0x7fcc6c0a5040 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:32.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.962+0000 7fcc8abc5640 1 --2- 172.21.15.5:0/601790804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc8410c170 0x7fcc8419cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:32.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.962+0000 7fcc8abc5640 1 --2- 172.21.15.5:0/601790804 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc84103660 0x7fcc84198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:32.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.962+0000 7fcc8abc5640 1 --2- 172.21.15.5:0/601790804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc84102d40 0x7fcc84198300 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:32.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.962+0000 7fcc8abc5640 1 -- 172.21.15.5:0/601790804 >> 172.21.15.5:0/601790804 conn(0x7fcc840fc7a0 msgr2=0x7fcc840fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:32.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.962+0000 7fcc8abc5640 1 -- 172.21.15.5:0/601790804 shutdown_connections 2024-09-11T23:26:32.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:32.963+0000 7fcc8abc5640 1 -- 172.21.15.5:0/601790804 wait complete. 2024-09-11T23:26:33.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:33 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:33.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:33 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:33.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:33 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:33.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:33 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:26:33.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:33 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:26:33.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:33 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:26:33.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:33 smithi005 ceph-mon[31201]: Deploying daemon mds.b on smithi159 2024-09-11T23:26:33.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:33 smithi005 ceph-mon[31201]: mds.? [v2:172.21.15.5:6840/1162578713,v1:172.21.15.5:6841/1162578713] up:boot 2024-09-11T23:26:33.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:33 smithi005 ceph-mon[31201]: fsmap 11 up:standby 2024-09-11T23:26:33.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:33 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-11T23:26:33.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:33 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/601790804' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:26:33.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:33 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:33.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:33 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:33.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:33 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:33.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:33 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:26:33.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:33 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:26:33.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:33 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:26:33.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:33 smithi159 ceph-mon[34394]: Deploying daemon mds.b on smithi159 2024-09-11T23:26:33.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:33 smithi159 ceph-mon[34394]: mds.? [v2:172.21.15.5:6840/1162578713,v1:172.21.15.5:6841/1162578713] up:boot 2024-09-11T23:26:33.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:33 smithi159 ceph-mon[34394]: fsmap 11 up:standby 2024-09-11T23:26:33.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:33 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-11T23:26:33.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:33 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/601790804' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:26:33.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:33 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:33.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:33 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:33.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:33 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:33.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:33 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:26:33.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:33 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:26:33.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:33 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:26:33.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:33 smithi172 ceph-mon[34855]: Deploying daemon mds.b on smithi159 2024-09-11T23:26:33.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:33 smithi172 ceph-mon[34855]: mds.? [v2:172.21.15.5:6840/1162578713,v1:172.21.15.5:6841/1162578713] up:boot 2024-09-11T23:26:33.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:33 smithi172 ceph-mon[34855]: fsmap 11 up:standby 2024-09-11T23:26:33.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:33 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-11T23:26:33.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:33 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/601790804' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:26:34.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:34 smithi159 ceph-mon[34394]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:34.377 INFO:journalctl@ceph.mds.b.smithi159.stdout:Sep 11 23:26:34 smithi159 systemd[1]: Starting Ceph mds.b for 1f5284d2-7094-11ef-bcea-c7b262605968... 2024-09-11T23:26:34.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:34 smithi172 ceph-mon[34855]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:34.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:34 smithi005 ceph-mon[31201]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:34.653 INFO:journalctl@ceph.mds.b.smithi159.stdout:Sep 11 23:26:34 smithi159 podman[64482]: 2024-09-11 23:26:34.283094792 +0000 UTC m=+0.016185677 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:26:34.653 INFO:journalctl@ceph.mds.b.smithi159.stdout:Sep 11 23:26:34 smithi159 podman[64482]: 2024-09-11 23:26:34.399463201 +0000 UTC m=+0.132554074 container create f6b2c4ebdb71b52ad077707d2aa85987bcdc92e39c7bddf48e1cfe455a2ba76b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T23:26:34.653 INFO:journalctl@ceph.mds.b.smithi159.stdout:Sep 11 23:26:34 smithi159 podman[64482]: 2024-09-11 23:26:34.627179032 +0000 UTC m=+0.360269906 container init f6b2c4ebdb71b52ad077707d2aa85987bcdc92e39c7bddf48e1cfe455a2ba76b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-b, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T23:26:34.653 INFO:journalctl@ceph.mds.b.smithi159.stdout:Sep 11 23:26:34 smithi159 podman[64482]: 2024-09-11 23:26:34.629941305 +0000 UTC m=+0.363032194 container start f6b2c4ebdb71b52ad077707d2aa85987bcdc92e39c7bddf48e1cfe455a2ba76b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-b, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-11T23:26:35.126 INFO:journalctl@ceph.mds.b.smithi159.stdout:Sep 11 23:26:34 smithi159 ceph-mds[64502]: -- 172.21.15.159:0/1635480483 <== mon.2 v2:172.21.15.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5622ec343860 con 0x5622ec321400 2024-09-11T23:26:35.126 INFO:journalctl@ceph.mds.b.smithi159.stdout:Sep 11 23:26:34 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-b[64498]: starting mds.b at 2024-09-11T23:26:35.126 INFO:journalctl@ceph.mds.b.smithi159.stdout:Sep 11 23:26:34 smithi159 bash[64482]: f6b2c4ebdb71b52ad077707d2aa85987bcdc92e39c7bddf48e1cfe455a2ba76b 2024-09-11T23:26:35.126 INFO:journalctl@ceph.mds.b.smithi159.stdout:Sep 11 23:26:34 smithi159 systemd[1]: Started Ceph mds.b for 1f5284d2-7094-11ef-bcea-c7b262605968. 2024-09-11T23:26:35.670 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:26:35.788 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:35 smithi159 ceph-mon[34394]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:35.789 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:35 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:35.789 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:35 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:35.789 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:35 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:35.789 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:35 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:35.789 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:35 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:35.789 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:35 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:26:35.789 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:35 smithi159 ceph-mon[34394]: mds.? [v2:172.21.15.159:6838/3843336290,v1:172.21.15.159:6839/3843336290] up:boot 2024-09-11T23:26:35.789 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:35 smithi159 ceph-mon[34394]: fsmap 12 up:standby 2024-09-11T23:26:35.789 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:35 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-11T23:26:35.789 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:35 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:35.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:35 smithi172 ceph-mon[34855]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:35.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:35 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:35.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:35 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:35.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:35 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:35.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:35 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:35.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:35 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:35.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:35 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:26:35.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:35 smithi172 ceph-mon[34855]: mds.? [v2:172.21.15.159:6838/3843336290,v1:172.21.15.159:6839/3843336290] up:boot 2024-09-11T23:26:35.885 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:35 smithi172 ceph-mon[34855]: fsmap 12 up:standby 2024-09-11T23:26:35.885 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:35 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-11T23:26:35.885 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:35 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:36.041 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:26:36.164 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:35 smithi005 ceph-mon[31201]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:36.164 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:35 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:36.165 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:35 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:36.165 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:35 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:36.165 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:35 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:36.165 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:35 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:36.165 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:35 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:26:36.165 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:35 smithi005 ceph-mon[31201]: mds.? [v2:172.21.15.159:6838/3843336290,v1:172.21.15.159:6839/3843336290] up:boot 2024-09-11T23:26:36.165 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:35 smithi005 ceph-mon[31201]: fsmap 12 up:standby 2024-09-11T23:26:36.165 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:35 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-11T23:26:36.165 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:35 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:36.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.563+0000 7efde69f9640 1 -- 172.21.15.5:0/1300675048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efde0102790 msgr2=0x7efde01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:36.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.563+0000 7efde69f9640 1 --2- 172.21.15.5:0/1300675048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efde0102790 0x7efde01067e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efdc8009900 tx=0x7efdc802a410 comp rx=0 tx=0).stop 2024-09-11T23:26:36.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.563+0000 7efde69f9640 1 -- 172.21.15.5:0/1300675048 shutdown_connections 2024-09-11T23:26:36.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.563+0000 7efde69f9640 1 --2- 172.21.15.5:0/1300675048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efde0106f10 0x7efde010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:36.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.563+0000 7efde69f9640 1 --2- 172.21.15.5:0/1300675048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efde0102790 0x7efde01067e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:36.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.563+0000 7efde69f9640 1 --2- 172.21.15.5:0/1300675048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efde0101de0 0x7efde01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:36.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.563+0000 7efde69f9640 1 -- 172.21.15.5:0/1300675048 >> 172.21.15.5:0/1300675048 conn(0x7efde00fd8c0 msgr2=0x7efde00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:36.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.563+0000 7efde69f9640 1 -- 172.21.15.5:0/1300675048 shutdown_connections 2024-09-11T23:26:36.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.563+0000 7efde69f9640 1 -- 172.21.15.5:0/1300675048 wait complete. 2024-09-11T23:26:36.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.564+0000 7efde69f9640 1 Processor -- start 2024-09-11T23:26:36.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.564+0000 7efde69f9640 1 -- start start 2024-09-11T23:26:36.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.564+0000 7efde69f9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efde0101de0 0x7efde00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:36.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.564+0000 7efde69f9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efde0102790 0x7efde0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:36.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.564+0000 7efde69f9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efde0106f10 0x7efde0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:36.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.564+0000 7efde69f9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7efde0111de0 con 0x7efde0101de0 2024-09-11T23:26:36.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.564+0000 7efde69f9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7efde0111c60 con 0x7efde0102790 2024-09-11T23:26:36.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.564+0000 7efde69f9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efde0111f60 con 0x7efde0106f10 2024-09-11T23:26:36.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.564+0000 7efddffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efde0101de0 0x7efde00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:36.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.564+0000 7efdd7fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efde0102790 0x7efde0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:36.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.564+0000 7efddffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efde0101de0 0x7efde00744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35522/0 (socket says 172.21.15.5:35522) 2024-09-11T23:26:36.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.564+0000 7efddffff640 1 -- 172.21.15.5:0/2440842377 learned_addr learned my addr 172.21.15.5:0/2440842377 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:26:36.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.564+0000 7efde4f96640 1 --2- 172.21.15.5:0/2440842377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efde0106f10 0x7efde0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:36.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.564+0000 7efdd7fff640 1 -- 172.21.15.5:0/2440842377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efde0106f10 msgr2=0x7efde0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:36.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.564+0000 7efdd7fff640 1 --2- 172.21.15.5:0/2440842377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efde0106f10 0x7efde0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:36.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.564+0000 7efdd7fff640 1 -- 172.21.15.5:0/2440842377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efde0101de0 msgr2=0x7efde00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:36.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.564+0000 7efdd7fff640 1 --2- 172.21.15.5:0/2440842377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efde0101de0 0x7efde00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:36.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.564+0000 7efdd7fff640 1 -- 172.21.15.5:0/2440842377 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efde01a68a0 con 0x7efde0102790 2024-09-11T23:26:36.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.564+0000 7efddffff640 1 --2- 172.21.15.5:0/2440842377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efde0101de0 0x7efde00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:26:36.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.565+0000 7efdd7fff640 1 --2- 172.21.15.5:0/2440842377 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efde0102790 0x7efde0074a30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efdc802a930 tx=0x7efdc8004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:36.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.565+0000 7efdddffb640 1 -- 172.21.15.5:0/2440842377 <== mon.2 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc803f030 con 0x7efde0102790 2024-09-11T23:26:36.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.565+0000 7efdddffb640 1 -- 172.21.15.5:0/2440842377 <== mon.2 v2:172.21.15.159:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efdc8003aa0 con 0x7efde0102790 2024-09-11T23:26:36.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.565+0000 7efde69f9640 1 -- 172.21.15.5:0/2440842377 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efde01a6b30 con 0x7efde0102790 2024-09-11T23:26:36.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.565+0000 7efdddffb640 1 -- 172.21.15.5:0/2440842377 <== mon.2 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc8035070 con 0x7efde0102790 2024-09-11T23:26:36.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.565+0000 7efde69f9640 1 -- 172.21.15.5:0/2440842377 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efde01a7010 con 0x7efde0102790 2024-09-11T23:26:36.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.566+0000 7efde69f9640 1 -- 172.21.15.5:0/2440842377 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efde01021c0 con 0x7efde0102790 2024-09-11T23:26:36.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.567+0000 7efdddffb640 1 -- 172.21.15.5:0/2440842377 <== mon.2 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7efdc8042030 con 0x7efde0102790 2024-09-11T23:26:36.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.567+0000 7efdddffb640 1 --2- 172.21.15.5:0/2440842377 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7efdcc0a2b80 0x7efdcc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:36.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.568+0000 7efddffff640 1 --2- 172.21.15.5:0/2440842377 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7efdcc0a2b80 0x7efdcc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:36.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.568+0000 7efdddffb640 1 -- 172.21.15.5:0/2440842377 <== mon.2 v2:172.21.15.159:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7efdc80ef3a0 con 0x7efde0102790 2024-09-11T23:26:36.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.568+0000 7efddffff640 1 --2- 172.21.15.5:0/2440842377 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7efdcc0a2b80 0x7efdcc0a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7efdd0005fd0 tx=0x7efdd000b4a0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:36.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.571+0000 7efdddffb640 1 -- 172.21.15.5:0/2440842377 <== mon.2 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efdc80bc150 con 0x7efde0102790 2024-09-11T23:26:36.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.802+0000 7efde69f9640 1 -- 172.21.15.5:0/2440842377 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efde0075a20 con 0x7efde0102790 2024-09-11T23:26:36.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.803+0000 7efdddffb640 1 -- 172.21.15.5:0/2440842377 <== mon.2 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10527 (secure 0 0 0) 0x7efdc80c0450 con 0x7efde0102790 2024-09-11T23:26:36.804 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:26:36.804 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":13,"btime":"2024-09-11T23:26:35:019878+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3865435482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3865435482},{"type":"v1","addr":"172.21.15.5:6835","nonce":3865435482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1323314897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":1323314897},{"type":"v1","addr":"172.21.15.5:6837","nonce":1323314897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14610,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6839/4140073288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":4140073288},{"type":"v1","addr":"172.21.15.5:6839","nonce":4140073288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6841/1162578713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":1162578713},{"type":"v1","addr":"172.21.15.5:6841","nonce":1162578713}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3113658116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3113658116},{"type":"v1","addr":"172.21.15.172:6833","nonce":3113658116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3887336060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3887336060},{"type":"v1","addr":"172.21.15.159:6833","nonce":3887336060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2539263301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2539263301},{"type":"v1","addr":"172.21.15.159:6835","nonce":2539263301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/4240913699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":4240913699},{"type":"v1","addr":"172.21.15.172:6835","nonce":4240913699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24460,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4200951601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":4200951601},{"type":"v1","addr":"172.21.15.172:6837","nonce":4200951601}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/4020181017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":4020181017},{"type":"v1","addr":"172.21.15.159:6837","nonce":4020181017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24475,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6839/3928313314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3928313314},{"type":"v1","addr":"172.21.15.172:6839","nonce":3928313314}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24494,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/3843336290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3843336290},{"type":"v1","addr":"172.21.15.159:6839","nonce":3843336290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-11T23:26:36.804 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 13 2024-09-11T23:26:36.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.806+0000 7efde69f9640 1 -- 172.21.15.5:0/2440842377 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7efdcc0a2b80 msgr2=0x7efdcc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:36.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.806+0000 7efde69f9640 1 --2- 172.21.15.5:0/2440842377 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7efdcc0a2b80 0x7efdcc0a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7efdd0005fd0 tx=0x7efdd000b4a0 comp rx=0 tx=0).stop 2024-09-11T23:26:36.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.806+0000 7efde69f9640 1 -- 172.21.15.5:0/2440842377 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efde0102790 msgr2=0x7efde0074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:36.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.806+0000 7efde69f9640 1 --2- 172.21.15.5:0/2440842377 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efde0102790 0x7efde0074a30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efdc802a930 tx=0x7efdc8004270 comp rx=0 tx=0).stop 2024-09-11T23:26:36.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.806+0000 7efde69f9640 1 -- 172.21.15.5:0/2440842377 shutdown_connections 2024-09-11T23:26:36.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.806+0000 7efde69f9640 1 --2- 172.21.15.5:0/2440842377 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7efdcc0a2b80 0x7efdcc0a5040 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:36.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.806+0000 7efde69f9640 1 --2- 172.21.15.5:0/2440842377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efde0106f10 0x7efde0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:36.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.806+0000 7efde69f9640 1 --2- 172.21.15.5:0/2440842377 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efde0102790 0x7efde0074a30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:36.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.806+0000 7efde69f9640 1 --2- 172.21.15.5:0/2440842377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efde0101de0 0x7efde00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:36.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.806+0000 7efde69f9640 1 -- 172.21.15.5:0/2440842377 >> 172.21.15.5:0/2440842377 conn(0x7efde00fd8c0 msgr2=0x7efde00fed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:36.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.806+0000 7efde69f9640 1 -- 172.21.15.5:0/2440842377 shutdown_connections 2024-09-11T23:26:36.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:36.806+0000 7efde69f9640 1 -- 172.21.15.5:0/2440842377 wait complete. 2024-09-11T23:26:37.461 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:37 smithi005 ceph-mon[31201]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:37.461 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:37 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:37.461 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:37 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:37.461 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:37 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:37.461 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:37 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:37.461 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:37 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/2440842377' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:26:37.495 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-11T23:26:37.769 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:26:37.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:37 smithi159 ceph-mon[34394]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:37.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:37 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:37.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:37 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:37.877 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:37 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:37.877 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:37 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:37.877 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:37 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/2440842377' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:26:37.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:37 smithi172 ceph-mon[34855]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:37.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:37 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:37.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:37 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:37.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:37 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:37.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:37 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:37.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:37 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/2440842377' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:26:38.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.281+0000 7ff467c8e640 1 -- 172.21.15.5:0/2144274503 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff460101280 msgr2=0x7ff46010df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:38.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.281+0000 7ff467c8e640 1 --2- 172.21.15.5:0/2144274503 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff460101280 0x7ff46010df40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff450009900 tx=0x7ff45002a410 comp rx=0 tx=0).stop 2024-09-11T23:26:38.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.281+0000 7ff467c8e640 1 -- 172.21.15.5:0/2144274503 shutdown_connections 2024-09-11T23:26:38.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.281+0000 7ff467c8e640 1 --2- 172.21.15.5:0/2144274503 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff46010e480 0x7ff460110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:38.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.281+0000 7ff467c8e640 1 --2- 172.21.15.5:0/2144274503 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff460101280 0x7ff46010df40 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:38.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.281+0000 7ff467c8e640 1 --2- 172.21.15.5:0/2144274503 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4601008d0 0x7ff460100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:38.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.282+0000 7ff467c8e640 1 -- 172.21.15.5:0/2144274503 >> 172.21.15.5:0/2144274503 conn(0x7ff4600fc7a0 msgr2=0x7ff4600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:38.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.282+0000 7ff467c8e640 1 -- 172.21.15.5:0/2144274503 shutdown_connections 2024-09-11T23:26:38.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.282+0000 7ff467c8e640 1 -- 172.21.15.5:0/2144274503 wait complete. 2024-09-11T23:26:38.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.282+0000 7ff467c8e640 1 Processor -- start 2024-09-11T23:26:38.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.282+0000 7ff467c8e640 1 -- start start 2024-09-11T23:26:38.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.282+0000 7ff467c8e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4601008d0 0x7ff46019a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:38.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.282+0000 7ff467c8e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff460101280 0x7ff46019abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:38.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.282+0000 7ff467c8e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff46010e480 0x7ff46019ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:38.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.282+0000 7ff467c8e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff460114090 con 0x7ff460101280 2024-09-11T23:26:38.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.282+0000 7ff467c8e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff460113f10 con 0x7ff4601008d0 2024-09-11T23:26:38.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.282+0000 7ff467c8e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff460114210 con 0x7ff46010e480 2024-09-11T23:26:38.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.283+0000 7ff465229640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff460101280 0x7ff46019abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:38.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.283+0000 7ff465229640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff460101280 0x7ff46019abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35544/0 (socket says 172.21.15.5:35544) 2024-09-11T23:26:38.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.283+0000 7ff465229640 1 -- 172.21.15.5:0/2534627304 learned_addr learned my addr 172.21.15.5:0/2534627304 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:26:38.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.283+0000 7ff465a2a640 1 --2- 172.21.15.5:0/2534627304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4601008d0 0x7ff46019a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:38.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.283+0000 7ff46622b640 1 --2- 172.21.15.5:0/2534627304 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff46010e480 0x7ff46019ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:38.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.283+0000 7ff465229640 1 -- 172.21.15.5:0/2534627304 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff46010e480 msgr2=0x7ff46019ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:38.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.283+0000 7ff465229640 1 --2- 172.21.15.5:0/2534627304 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff46010e480 0x7ff46019ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:38.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.283+0000 7ff465229640 1 -- 172.21.15.5:0/2534627304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4601008d0 msgr2=0x7ff46019a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:38.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.283+0000 7ff465229640 1 --2- 172.21.15.5:0/2534627304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4601008d0 0x7ff46019a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:38.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.283+0000 7ff465229640 1 -- 172.21.15.5:0/2534627304 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff46019f640 con 0x7ff460101280 2024-09-11T23:26:38.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.283+0000 7ff465229640 1 --2- 172.21.15.5:0/2534627304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff460101280 0x7ff46019abd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff450005940 tx=0x7ff4500042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:38.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.283+0000 7ff456ffd640 1 -- 172.21.15.5:0/2534627304 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff45003f030 con 0x7ff460101280 2024-09-11T23:26:38.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.283+0000 7ff467c8e640 1 -- 172.21.15.5:0/2534627304 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff46019f8d0 con 0x7ff460101280 2024-09-11T23:26:38.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.283+0000 7ff456ffd640 1 -- 172.21.15.5:0/2534627304 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff450003cb0 con 0x7ff460101280 2024-09-11T23:26:38.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.283+0000 7ff456ffd640 1 -- 172.21.15.5:0/2534627304 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff450035070 con 0x7ff460101280 2024-09-11T23:26:38.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.283+0000 7ff467c8e640 1 -- 172.21.15.5:0/2534627304 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4601a7210 con 0x7ff460101280 2024-09-11T23:26:38.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.284+0000 7ff467c8e640 1 -- 172.21.15.5:0/2534627304 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff460100cb0 con 0x7ff460101280 2024-09-11T23:26:38.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.286+0000 7ff456ffd640 1 -- 172.21.15.5:0/2534627304 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7ff450042030 con 0x7ff460101280 2024-09-11T23:26:38.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.286+0000 7ff456ffd640 1 --2- 172.21.15.5:0/2534627304 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7ff44c0a2b80 0x7ff44c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:38.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.286+0000 7ff465a2a640 1 --2- 172.21.15.5:0/2534627304 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7ff44c0a2b80 0x7ff44c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:38.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.286+0000 7ff456ffd640 1 -- 172.21.15.5:0/2534627304 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7ff4500ef600 con 0x7ff460101280 2024-09-11T23:26:38.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.287+0000 7ff465a2a640 1 --2- 172.21.15.5:0/2534627304 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7ff44c0a2b80 0x7ff44c0a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff45c00bbe0 tx=0x7ff45c00b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:38.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.290+0000 7ff456ffd640 1 -- 172.21.15.5:0/2534627304 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff4500bc3b0 con 0x7ff460101280 2024-09-11T23:26:38.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.479+0000 7ff467c8e640 1 -- 172.21.15.5:0/2534627304 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ff460109610 con 0x7ff460101280 2024-09-11T23:26:38.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.479+0000 7ff456ffd640 1 -- 172.21.15.5:0/2534627304 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v75) ==== 84+0+65 (secure 0 0 0) 0x7ff4500c06b0 con 0x7ff460101280 2024-09-11T23:26:38.480 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:26:38.480 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-09-11T23:26:38.480 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:26:38.480 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2024-09-11T23:26:38.481 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2024-09-11T23:26:38.481 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:26:38.481 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-09-11T23:26:38.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.481+0000 7ff467c8e640 1 -- 172.21.15.5:0/2534627304 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7ff44c0a2b80 msgr2=0x7ff44c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:38.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.481+0000 7ff467c8e640 1 --2- 172.21.15.5:0/2534627304 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7ff44c0a2b80 0x7ff44c0a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff45c00bbe0 tx=0x7ff45c00b390 comp rx=0 tx=0).stop 2024-09-11T23:26:38.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.481+0000 7ff467c8e640 1 -- 172.21.15.5:0/2534627304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff460101280 msgr2=0x7ff46019abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:38.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.481+0000 7ff467c8e640 1 --2- 172.21.15.5:0/2534627304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff460101280 0x7ff46019abd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff450005940 tx=0x7ff4500042f0 comp rx=0 tx=0).stop 2024-09-11T23:26:38.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.481+0000 7ff467c8e640 1 -- 172.21.15.5:0/2534627304 shutdown_connections 2024-09-11T23:26:38.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.481+0000 7ff467c8e640 1 --2- 172.21.15.5:0/2534627304 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7ff44c0a2b80 0x7ff44c0a5040 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:38.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.481+0000 7ff467c8e640 1 --2- 172.21.15.5:0/2534627304 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff46010e480 0x7ff46019ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:38.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.481+0000 7ff467c8e640 1 --2- 172.21.15.5:0/2534627304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff460101280 0x7ff46019abd0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:38.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.481+0000 7ff467c8e640 1 --2- 172.21.15.5:0/2534627304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff4601008d0 0x7ff46019a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:38.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.481+0000 7ff467c8e640 1 -- 172.21.15.5:0/2534627304 >> 172.21.15.5:0/2534627304 conn(0x7ff4600fc7a0 msgr2=0x7ff4600feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:38.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.482+0000 7ff467c8e640 1 -- 172.21.15.5:0/2534627304 shutdown_connections 2024-09-11T23:26:38.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:38.482+0000 7ff467c8e640 1 -- 172.21.15.5:0/2534627304 wait complete. 2024-09-11T23:26:38.601 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:38 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:38.601 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:38 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:38.601 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:38 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:26:38.601 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:38 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:26:38.601 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:38 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:38.602 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:38 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:26:38.602 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:38 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/2534627304' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-11T23:26:38.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:38 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:38.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:38 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:38.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:38 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:26:38.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:38 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:26:38.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:38 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:38.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:38 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:26:38.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:38 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/2534627304' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-11T23:26:38.820 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:38 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:38.820 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:38 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:38.820 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:38 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:26:38.820 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:38 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:26:38.820 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:38 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:38.820 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:38 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:26:38.820 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:38 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/2534627304' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-11T23:26:39.818 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:39 smithi005 ceph-mon[31201]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:39.818 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:39 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:39.818 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:39 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:39.818 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:39 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:39.818 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:39 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:39.850 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T23:26:39.850 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T23:26:39.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:39 smithi159 ceph-mon[34394]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:39.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:39 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:39.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:39 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:39.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:39 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:39.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:39 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:39.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:39 smithi172 ceph-mon[34855]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:39.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:39 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:39.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:39 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:39.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:39 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:39.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:39 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:40.136 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:26:40.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:40.602+0000 7f2bbd841640 1 -- 172.21.15.5:0/880581708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bb8102570 msgr2=0x7f2bb81029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:40.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:40.602+0000 7f2bbd841640 1 --2- 172.21.15.5:0/880581708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bb8102570 0x7f2bb81029b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2bac009900 tx=0x7f2bac02a480 comp rx=0 tx=0).stop 2024-09-11T23:26:40.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:40.602+0000 7f2bbd841640 1 -- 172.21.15.5:0/880581708 shutdown_connections 2024-09-11T23:26:40.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:40.602+0000 7f2bbd841640 1 --2- 172.21.15.5:0/880581708 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2bb8102ef0 0x7f2bb810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:40.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:40.602+0000 7f2bbd841640 1 --2- 172.21.15.5:0/880581708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bb8102570 0x7f2bb81029b0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:40.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:40.602+0000 7f2bbd841640 1 --2- 172.21.15.5:0/880581708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bb8100e20 0x7f2bb8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:40.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:40.602+0000 7f2bbd841640 1 -- 172.21.15.5:0/880581708 >> 172.21.15.5:0/880581708 conn(0x7f2bb80fc7d0 msgr2=0x7f2bb80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:40.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:40.602+0000 7f2bbd841640 1 -- 172.21.15.5:0/880581708 shutdown_connections 2024-09-11T23:26:40.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:40.602+0000 7f2bbd841640 1 -- 172.21.15.5:0/880581708 wait complete. 2024-09-11T23:26:40.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:40.603+0000 7f2bbd841640 1 Processor -- start 2024-09-11T23:26:40.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:40.603+0000 7f2bbd841640 1 -- start start 2024-09-11T23:26:40.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:40.603+0000 7f2bbd841640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bb8100e20 0x7f2bb8198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:40.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:40.603+0000 7f2bbd841640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bb8102570 0x7f2bb81989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:40.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:40.603+0000 7f2bbd841640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2bb8102ef0 0x7f2bb819cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:40.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:40.603+0000 7f2bbd841640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb8110e50 con 0x7f2bb8100e20 2024-09-11T23:26:40.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:40.603+0000 7f2bbd841640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb8110cd0 con 0x7f2bb8102ef0 2024-09-11T23:26:40.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:40.603+0000 7f2bbd841640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb8110fd0 con 0x7f2bb8102570 2024-09-11T23:26:40.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:40.603+0000 7f2bb6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bb8100e20 0x7f2bb8198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:40.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:40.603+0000 7f2bb6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bb8100e20 0x7f2bb8198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35574/0 (socket says 172.21.15.5:35574) 2024-09-11T23:26:40.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:40.603+0000 7f2bb6ffd640 1 -- 172.21.15.5:0/3348307323 learned_addr learned my addr 172.21.15.5:0/3348307323 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:26:40.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:40.603+0000 7f2bb77fe640 1 --2- 172.21.15.5:0/3348307323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2bb8102ef0 0x7f2bb819cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:40.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:40.603+0000 7f2bb67fc640 1 --2- 172.21.15.5:0/3348307323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bb8102570 0x7f2bb81989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:40.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:40.603+0000 7f2bb6ffd640 1 -- 172.21.15.5:0/3348307323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bb8102570 msgr2=0x7f2bb81989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:40.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:40.603+0000 7f2bb6ffd640 1 --2- 172.21.15.5:0/3348307323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bb8102570 0x7f2bb81989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:40.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:40.603+0000 7f2bb6ffd640 1 -- 172.21.15.5:0/3348307323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2bb8102ef0 msgr2=0x7f2bb819cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:40.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:40.604+0000 7f2bb6ffd640 1 --2- 172.21.15.5:0/3348307323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2bb8102ef0 0x7f2bb819cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:40.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:40.604+0000 7f2bb6ffd640 1 -- 172.21.15.5:0/3348307323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bb819d410 con 0x7f2bb8100e20 2024-09-11T23:26:40.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:40.604+0000 7f2bb6ffd640 1 --2- 172.21.15.5:0/3348307323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bb8100e20 0x7f2bb8198460 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2ba800d950 tx=0x7f2ba800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:40.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:40.604+0000 7f2bbc83f640 1 -- 172.21.15.5:0/3348307323 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba8017070 con 0x7f2bb8100e20 2024-09-11T23:26:40.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:40.604+0000 7f2bbc83f640 1 -- 172.21.15.5:0/3348307323 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2ba8009c30 con 0x7f2bb8100e20 2024-09-11T23:26:40.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:40.604+0000 7f2bbd841640 1 -- 172.21.15.5:0/3348307323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bb819d700 con 0x7f2bb8100e20 2024-09-11T23:26:40.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:40.604+0000 7f2bbc83f640 1 -- 172.21.15.5:0/3348307323 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba800f620 con 0x7f2bb8100e20 2024-09-11T23:26:40.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:40.604+0000 7f2bbd841640 1 -- 172.21.15.5:0/3348307323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bb81a4fe0 con 0x7f2bb8100e20 2024-09-11T23:26:40.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:40.605+0000 7f2bbd841640 1 -- 172.21.15.5:0/3348307323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bb8101200 con 0x7f2bb8100e20 2024-09-11T23:26:40.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:40.606+0000 7f2bbc83f640 1 -- 172.21.15.5:0/3348307323 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f2ba80109a0 con 0x7f2bb8100e20 2024-09-11T23:26:40.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:40.607+0000 7f2bbc83f640 1 --2- 172.21.15.5:0/3348307323 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f2ba00a2c00 0x7f2ba00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:40.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:40.607+0000 7f2bb67fc640 1 --2- 172.21.15.5:0/3348307323 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f2ba00a2c00 0x7f2ba00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:40.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:40.607+0000 7f2bbc83f640 1 -- 172.21.15.5:0/3348307323 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f2ba80ce700 con 0x7f2bb8100e20 2024-09-11T23:26:40.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:40.607+0000 7f2bb67fc640 1 --2- 172.21.15.5:0/3348307323 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f2ba00a2c00 0x7f2ba00a50c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2bac000c00 tx=0x7f2bac005e80 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:40.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:40.610+0000 7f2bbc83f640 1 -- 172.21.15.5:0/3348307323 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2ba8009de0 con 0x7f2bb8100e20 2024-09-11T23:26:40.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:40.787+0000 7f2bbd841640 1 -- 172.21.15.5:0/3348307323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f2bb810a0a0 con 0x7f2bb8100e20 2024-09-11T23:26:41.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:41.593+0000 7f2bbc83f640 1 -- 172.21.15.5:0/3348307323 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v76) ==== 138+0+0 (secure 0 0 0) 0x7f2ba809b490 con 0x7f2bb8100e20 2024-09-11T23:26:41.594 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2024-09-11T23:26:41.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:41.596+0000 7f2bbd841640 1 -- 172.21.15.5:0/3348307323 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f2ba00a2c00 msgr2=0x7f2ba00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:41.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:41.596+0000 7f2bbd841640 1 --2- 172.21.15.5:0/3348307323 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f2ba00a2c00 0x7f2ba00a50c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2bac000c00 tx=0x7f2bac005e80 comp rx=0 tx=0).stop 2024-09-11T23:26:41.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:41.596+0000 7f2bbd841640 1 -- 172.21.15.5:0/3348307323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bb8100e20 msgr2=0x7f2bb8198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:41.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:41.596+0000 7f2bbd841640 1 --2- 172.21.15.5:0/3348307323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bb8100e20 0x7f2bb8198460 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2ba800d950 tx=0x7f2ba800de10 comp rx=0 tx=0).stop 2024-09-11T23:26:41.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:41.596+0000 7f2bbd841640 1 -- 172.21.15.5:0/3348307323 shutdown_connections 2024-09-11T23:26:41.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:41.596+0000 7f2bbd841640 1 --2- 172.21.15.5:0/3348307323 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f2ba00a2c00 0x7f2ba00a50c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:41.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:41.596+0000 7f2bbd841640 1 --2- 172.21.15.5:0/3348307323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2bb8102ef0 0x7f2bb819cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:41.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:41.596+0000 7f2bbd841640 1 --2- 172.21.15.5:0/3348307323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bb8102570 0x7f2bb81989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:41.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:41.596+0000 7f2bbd841640 1 --2- 172.21.15.5:0/3348307323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bb8100e20 0x7f2bb8198460 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:41.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:41.596+0000 7f2bbd841640 1 -- 172.21.15.5:0/3348307323 >> 172.21.15.5:0/3348307323 conn(0x7f2bb80fc7d0 msgr2=0x7f2bb806a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:41.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:41.597+0000 7f2bbd841640 1 -- 172.21.15.5:0/3348307323 shutdown_connections 2024-09-11T23:26:41.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:41.597+0000 7f2bbd841640 1 -- 172.21.15.5:0/3348307323 wait complete. 2024-09-11T23:26:41.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:41 smithi005 ceph-mon[31201]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:41.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:41 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:41.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:41 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:41.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:41 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:26:41.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:41 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:26:41.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:41 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:41.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:41 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/3348307323' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-11T23:26:41.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:41 smithi159 ceph-mon[34394]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:41.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:41 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:41.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:41 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:41.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:41 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:26:41.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:41 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:26:41.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:41 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:41.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:41 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/3348307323' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-11T23:26:41.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:41 smithi172 ceph-mon[34855]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:41.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:41 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:41.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:41 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:41.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:41 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:26:41.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:41 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:26:41.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:41 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:26:41.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:41 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/3348307323' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-11T23:26:42.301 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-11T23:26:42.560 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:26:42.852 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:42 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/3348307323' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-11T23:26:42.852 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:42 smithi005 ceph-mon[31201]: osdmap e76: 12 total, 12 up, 12 in 2024-09-11T23:26:42.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:42 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/3348307323' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-11T23:26:42.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:42 smithi159 ceph-mon[34394]: osdmap e76: 12 total, 12 up, 12 in 2024-09-11T23:26:42.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:42 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/3348307323' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-11T23:26:42.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:42 smithi172 ceph-mon[34855]: osdmap e76: 12 total, 12 up, 12 in 2024-09-11T23:26:43.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.047+0000 7f77e01d1640 1 -- 172.21.15.5:0/553593662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d8100e20 msgr2=0x7f77d8101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:43.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.047+0000 7f77e01d1640 1 --2- 172.21.15.5:0/553593662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d8100e20 0x7f77d8101200 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f77d4009900 tx=0x7f77d402a480 comp rx=0 tx=0).stop 2024-09-11T23:26:43.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.047+0000 7f77e01d1640 1 -- 172.21.15.5:0/553593662 shutdown_connections 2024-09-11T23:26:43.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.047+0000 7f77e01d1640 1 --2- 172.21.15.5:0/553593662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77d8102ef0 0x7f77d810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:43.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.047+0000 7f77e01d1640 1 --2- 172.21.15.5:0/553593662 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77d8102570 0x7f77d81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:43.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.047+0000 7f77e01d1640 1 --2- 172.21.15.5:0/553593662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d8100e20 0x7f77d8101200 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:43.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.047+0000 7f77e01d1640 1 -- 172.21.15.5:0/553593662 >> 172.21.15.5:0/553593662 conn(0x7f77d80fc7d0 msgr2=0x7f77d80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:43.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.047+0000 7f77e01d1640 1 -- 172.21.15.5:0/553593662 shutdown_connections 2024-09-11T23:26:43.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.047+0000 7f77e01d1640 1 -- 172.21.15.5:0/553593662 wait complete. 2024-09-11T23:26:43.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.047+0000 7f77e01d1640 1 Processor -- start 2024-09-11T23:26:43.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.047+0000 7f77e01d1640 1 -- start start 2024-09-11T23:26:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.048+0000 7f77e01d1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77d8100e20 0x7f77d80fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.048+0000 7f77e01d1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d8102570 0x7f77d80fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.048+0000 7f77e01d1640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77d8102ef0 0x7f77d80fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.048+0000 7f77e01d1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f77d8110e00 con 0x7f77d8102570 2024-09-11T23:26:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.048+0000 7f77e01d1640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f77d8110c80 con 0x7f77d8102ef0 2024-09-11T23:26:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.048+0000 7f77e01d1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f77d8110f80 con 0x7f77d8100e20 2024-09-11T23:26:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.048+0000 7f77dd76c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d8102570 0x7f77d80fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.048+0000 7f77dd76c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d8102570 0x7f77d80fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35586/0 (socket says 172.21.15.5:35586) 2024-09-11T23:26:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.048+0000 7f77dd76c640 1 -- 172.21.15.5:0/1111900755 learned_addr learned my addr 172.21.15.5:0/1111900755 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:26:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.048+0000 7f77ddf6d640 1 --2- 172.21.15.5:0/1111900755 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77d8100e20 0x7f77d80fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.048+0000 7f77de76e640 1 --2- 172.21.15.5:0/1111900755 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77d8102ef0 0x7f77d80fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.048+0000 7f77dd76c640 1 -- 172.21.15.5:0/1111900755 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77d8100e20 msgr2=0x7f77d80fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.048+0000 7f77dd76c640 1 --2- 172.21.15.5:0/1111900755 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77d8100e20 0x7f77d80fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:43.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.048+0000 7f77dd76c640 1 -- 172.21.15.5:0/1111900755 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77d8102ef0 msgr2=0x7f77d80fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:43.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.048+0000 7f77dd76c640 1 --2- 172.21.15.5:0/1111900755 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77d8102ef0 0x7f77d80fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:43.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.048+0000 7f77dd76c640 1 -- 172.21.15.5:0/1111900755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77d81a6790 con 0x7f77d8102570 2024-09-11T23:26:43.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.048+0000 7f77dd76c640 1 --2- 172.21.15.5:0/1111900755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d8102570 0x7f77d80fd1c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f77c800c920 tx=0x7f77c800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:43.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.049+0000 7f77ceffd640 1 -- 172.21.15.5:0/1111900755 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c8007c70 con 0x7f77d8102570 2024-09-11T23:26:43.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.049+0000 7f77e01d1640 1 -- 172.21.15.5:0/1111900755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77d81a6a80 con 0x7f77d8102570 2024-09-11T23:26:43.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.049+0000 7f77ceffd640 1 -- 172.21.15.5:0/1111900755 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f77c8007e10 con 0x7f77d8102570 2024-09-11T23:26:43.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.049+0000 7f77ceffd640 1 -- 172.21.15.5:0/1111900755 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c8018820 con 0x7f77d8102570 2024-09-11T23:26:43.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.049+0000 7f77e01d1640 1 -- 172.21.15.5:0/1111900755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77d81a6fc0 con 0x7f77d8102570 2024-09-11T23:26:43.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.050+0000 7f77e01d1640 1 -- 172.21.15.5:0/1111900755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77d8101200 con 0x7f77d8102570 2024-09-11T23:26:43.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.051+0000 7f77ceffd640 1 -- 172.21.15.5:0/1111900755 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f77c80189c0 con 0x7f77d8102570 2024-09-11T23:26:43.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.052+0000 7f77ceffd640 1 --2- 172.21.15.5:0/1111900755 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f77c40a2b80 0x7f77c40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:43.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.052+0000 7f77ddf6d640 1 --2- 172.21.15.5:0/1111900755 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f77c40a2b80 0x7f77c40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:43.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.052+0000 7f77ceffd640 1 -- 172.21.15.5:0/1111900755 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7497+0+0 (secure 0 0 0) 0x7f77c80cf080 con 0x7f77d8102570 2024-09-11T23:26:43.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.052+0000 7f77ddf6d640 1 --2- 172.21.15.5:0/1111900755 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f77c40a2b80 0x7f77c40a5040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f77d4009230 tx=0x7f77d40058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:43.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.056+0000 7f77ceffd640 1 -- 172.21.15.5:0/1111900755 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f77c8014030 con 0x7f77d8102570 2024-09-11T23:26:43.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.231+0000 7f77e01d1640 1 -- 172.21.15.5:0/1111900755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f77d810a0a0 con 0x7f77d8102570 2024-09-11T23:26:43.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.668+0000 7f77ceffd640 1 -- 172.21.15.5:0/1111900755 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v78) ==== 171+0+0 (secure 0 0 0) 0x7f77c809c3a0 con 0x7f77d8102570 2024-09-11T23:26:43.669 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2024-09-11T23:26:43.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.671+0000 7f77e01d1640 1 -- 172.21.15.5:0/1111900755 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f77c40a2b80 msgr2=0x7f77c40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:43.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.671+0000 7f77e01d1640 1 --2- 172.21.15.5:0/1111900755 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f77c40a2b80 0x7f77c40a5040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f77d4009230 tx=0x7f77d40058d0 comp rx=0 tx=0).stop 2024-09-11T23:26:43.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.671+0000 7f77e01d1640 1 -- 172.21.15.5:0/1111900755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d8102570 msgr2=0x7f77d80fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:43.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.671+0000 7f77e01d1640 1 --2- 172.21.15.5:0/1111900755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d8102570 0x7f77d80fd1c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f77c800c920 tx=0x7f77c800cde0 comp rx=0 tx=0).stop 2024-09-11T23:26:43.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.671+0000 7f77e01d1640 1 -- 172.21.15.5:0/1111900755 shutdown_connections 2024-09-11T23:26:43.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.671+0000 7f77e01d1640 1 --2- 172.21.15.5:0/1111900755 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f77c40a2b80 0x7f77c40a5040 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:43.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.671+0000 7f77e01d1640 1 --2- 172.21.15.5:0/1111900755 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77d8102ef0 0x7f77d80fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:43.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.671+0000 7f77e01d1640 1 --2- 172.21.15.5:0/1111900755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77d8102570 0x7f77d80fd1c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:43.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.671+0000 7f77e01d1640 1 --2- 172.21.15.5:0/1111900755 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77d8100e20 0x7f77d80fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:43.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.671+0000 7f77e01d1640 1 -- 172.21.15.5:0/1111900755 >> 172.21.15.5:0/1111900755 conn(0x7f77d80fc7d0 msgr2=0x7f77d806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:43.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.671+0000 7f77e01d1640 1 -- 172.21.15.5:0/1111900755 shutdown_connections 2024-09-11T23:26:43.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:43.671+0000 7f77e01d1640 1 -- 172.21.15.5:0/1111900755 wait complete. 2024-09-11T23:26:43.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:43 smithi005 ceph-mon[31201]: pgmap v272: 33 pgs: 3 creating+peering, 1 active+clean, 29 unknown; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:43.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:43 smithi005 ceph-mon[31201]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T23:26:43.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:43 smithi005 ceph-mon[31201]: osdmap e77: 12 total, 12 up, 12 in 2024-09-11T23:26:44.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:43 smithi159 ceph-mon[34394]: pgmap v272: 33 pgs: 3 creating+peering, 1 active+clean, 29 unknown; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:44.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:43 smithi159 ceph-mon[34394]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T23:26:44.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:43 smithi159 ceph-mon[34394]: osdmap e77: 12 total, 12 up, 12 in 2024-09-11T23:26:44.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:43 smithi172 ceph-mon[34855]: pgmap v272: 33 pgs: 3 creating+peering, 1 active+clean, 29 unknown; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:44.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:43 smithi172 ceph-mon[34855]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T23:26:44.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:43 smithi172 ceph-mon[34855]: osdmap e77: 12 total, 12 up, 12 in 2024-09-11T23:26:44.333 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T23:26:44.588 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:26:44.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:44 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/1111900755' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-11T23:26:44.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:44 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/1111900755' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-11T23:26:44.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:44 smithi005 ceph-mon[31201]: osdmap e78: 12 total, 12 up, 12 in 2024-09-11T23:26:45.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:45.082+0000 7f7105c88640 1 -- 172.21.15.5:0/2865457200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7100102790 msgr2=0x7f71001067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:45.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:45.082+0000 7f7105c88640 1 --2- 172.21.15.5:0/2865457200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7100102790 0x7f71001067e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f70e8009900 tx=0x7f70e802a410 comp rx=0 tx=0).stop 2024-09-11T23:26:45.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:45.082+0000 7f7105c88640 1 -- 172.21.15.5:0/2865457200 shutdown_connections 2024-09-11T23:26:45.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:45.082+0000 7f7105c88640 1 --2- 172.21.15.5:0/2865457200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7100106f10 0x7f710010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:45.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:45.082+0000 7f7105c88640 1 --2- 172.21.15.5:0/2865457200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7100102790 0x7f71001067e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:45.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:45.082+0000 7f7105c88640 1 --2- 172.21.15.5:0/2865457200 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7100101de0 0x7f71001021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:45.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:45.082+0000 7f7105c88640 1 -- 172.21.15.5:0/2865457200 >> 172.21.15.5:0/2865457200 conn(0x7f71000fd8c0 msgr2=0x7f71000ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:45.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:45.082+0000 7f7105c88640 1 -- 172.21.15.5:0/2865457200 shutdown_connections 2024-09-11T23:26:45.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:45.082+0000 7f7105c88640 1 -- 172.21.15.5:0/2865457200 wait complete. 2024-09-11T23:26:45.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:45.083+0000 7f7105c88640 1 Processor -- start 2024-09-11T23:26:45.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:45.083+0000 7f7105c88640 1 -- start start 2024-09-11T23:26:45.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:45.083+0000 7f7105c88640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7100101de0 0x7f7100198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:45.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:45.083+0000 7f7105c88640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7100102790 0x7f71001988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:45.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:45.083+0000 7f7105c88640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7100106f10 0x7f710019cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:45.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:45.083+0000 7f7105c88640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7100111e20 con 0x7f7100106f10 2024-09-11T23:26:45.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:45.083+0000 7f7105c88640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7100111ca0 con 0x7f7100101de0 2024-09-11T23:26:45.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:45.083+0000 7f7105c88640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7100111fa0 con 0x7f7100102790 2024-09-11T23:26:45.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:45.083+0000 7f70fffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7100106f10 0x7f710019cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:45.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:45.084+0000 7f70fffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7100106f10 0x7f710019cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44120/0 (socket says 172.21.15.5:44120) 2024-09-11T23:26:45.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:45.084+0000 7f70fffff640 1 -- 172.21.15.5:0/1187215963 learned_addr learned my addr 172.21.15.5:0/1187215963 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:26:45.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:45.084+0000 7f70f6ffd640 1 --2- 172.21.15.5:0/1187215963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7100102790 0x7f71001988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:45.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:45.084+0000 7f70ff7fe640 1 --2- 172.21.15.5:0/1187215963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7100101de0 0x7f7100198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:45.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:45.084+0000 7f70fffff640 1 -- 172.21.15.5:0/1187215963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7100102790 msgr2=0x7f71001988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:45.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:45.084+0000 7f70fffff640 1 --2- 172.21.15.5:0/1187215963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7100102790 0x7f71001988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:45.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:45.084+0000 7f70fffff640 1 -- 172.21.15.5:0/1187215963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7100101de0 msgr2=0x7f7100198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:45.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:45.084+0000 7f70fffff640 1 --2- 172.21.15.5:0/1187215963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7100101de0 0x7f7100198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:45.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:45.084+0000 7f70fffff640 1 -- 172.21.15.5:0/1187215963 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f710019d310 con 0x7f7100106f10 2024-09-11T23:26:45.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:45.084+0000 7f70fffff640 1 --2- 172.21.15.5:0/1187215963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7100106f10 0x7f710019cc30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f70f800eaa0 tx=0x7f70f800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:45.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:45.084+0000 7f70fd7fa640 1 -- 172.21.15.5:0/1187215963 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f800cdb0 con 0x7f7100106f10 2024-09-11T23:26:45.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:45.084+0000 7f70fd7fa640 1 -- 172.21.15.5:0/1187215963 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f70f8005020 con 0x7f7100106f10 2024-09-11T23:26:45.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:45.084+0000 7f7105c88640 1 -- 172.21.15.5:0/1187215963 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f710019d600 con 0x7f7100106f10 2024-09-11T23:26:45.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:45.084+0000 7f70fd7fa640 1 -- 172.21.15.5:0/1187215963 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f80116d0 con 0x7f7100106f10 2024-09-11T23:26:45.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:45.084+0000 7f7105c88640 1 -- 172.21.15.5:0/1187215963 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71001a4ee0 con 0x7f7100106f10 2024-09-11T23:26:45.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:45.085+0000 7f7105c88640 1 -- 172.21.15.5:0/1187215963 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71001021c0 con 0x7f7100106f10 2024-09-11T23:26:45.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:45.087+0000 7f70fd7fa640 1 -- 172.21.15.5:0/1187215963 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f70f80051d0 con 0x7f7100106f10 2024-09-11T23:26:45.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:45.088+0000 7f70fd7fa640 1 --2- 172.21.15.5:0/1187215963 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f70ec0a2c00 0x7f70ec0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:45.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:45.088+0000 7f70ff7fe640 1 --2- 172.21.15.5:0/1187215963 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f70ec0a2c00 0x7f70ec0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:45.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:45.088+0000 7f70fd7fa640 1 -- 172.21.15.5:0/1187215963 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7879+0+0 (secure 0 0 0) 0x7f70f80cf290 con 0x7f7100106f10 2024-09-11T23:26:45.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:45.088+0000 7f70ff7fe640 1 --2- 172.21.15.5:0/1187215963 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f70ec0a2c00 0x7f70ec0a50c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f70f000bbe0 tx=0x7f70f000b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:45.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:45.091+0000 7f70fd7fa640 1 -- 172.21.15.5:0/1187215963 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f70f8016030 con 0x7f7100106f10 2024-09-11T23:26:45.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:44 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/1111900755' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-11T23:26:45.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:44 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/1111900755' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-11T23:26:45.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:44 smithi159 ceph-mon[34394]: osdmap e78: 12 total, 12 up, 12 in 2024-09-11T23:26:45.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:44 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/1111900755' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-11T23:26:45.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:44 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/1111900755' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-11T23:26:45.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:44 smithi172 ceph-mon[34855]: osdmap e78: 12 total, 12 up, 12 in 2024-09-11T23:26:45.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:45.303+0000 7f7105c88640 1 -- 172.21.15.5:0/1187215963 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f71001996c0 con 0x7f7100106f10 2024-09-11T23:26:45.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:45 smithi005 ceph-mon[31201]: pgmap v275: 97 pgs: 13 creating+peering, 4 active+clean, 80 unknown; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:45.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:45 smithi005 ceph-mon[31201]: osdmap e79: 12 total, 12 up, 12 in 2024-09-11T23:26:45.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:45 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/1187215963' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-11T23:26:45.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:45 smithi005 ceph-mon[31201]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-11T23:26:46.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:46.014+0000 7f70fd7fa640 1 -- 172.21.15.5:0/1187215963 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f71001996c0 con 0x7f7100106f10 2024-09-11T23:26:46.015 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 2 and data pool 3 2024-09-11T23:26:46.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:46.017+0000 7f7105c88640 1 -- 172.21.15.5:0/1187215963 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f70ec0a2c00 msgr2=0x7f70ec0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:46.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:46.017+0000 7f7105c88640 1 --2- 172.21.15.5:0/1187215963 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f70ec0a2c00 0x7f70ec0a50c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f70f000bbe0 tx=0x7f70f000b390 comp rx=0 tx=0).stop 2024-09-11T23:26:46.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:46.017+0000 7f7105c88640 1 -- 172.21.15.5:0/1187215963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7100106f10 msgr2=0x7f710019cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:46.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:46.017+0000 7f7105c88640 1 --2- 172.21.15.5:0/1187215963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7100106f10 0x7f710019cc30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f70f800eaa0 tx=0x7f70f800ef60 comp rx=0 tx=0).stop 2024-09-11T23:26:46.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:46.018+0000 7f7105c88640 1 -- 172.21.15.5:0/1187215963 shutdown_connections 2024-09-11T23:26:46.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:46.018+0000 7f7105c88640 1 --2- 172.21.15.5:0/1187215963 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f70ec0a2c00 0x7f70ec0a50c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:46.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:46.018+0000 7f7105c88640 1 --2- 172.21.15.5:0/1187215963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7100106f10 0x7f710019cc30 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:46.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:46.018+0000 7f7105c88640 1 --2- 172.21.15.5:0/1187215963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7100102790 0x7f71001988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:46.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:46.018+0000 7f7105c88640 1 --2- 172.21.15.5:0/1187215963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7100101de0 0x7f7100198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:46.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:46.018+0000 7f7105c88640 1 -- 172.21.15.5:0/1187215963 >> 172.21.15.5:0/1187215963 conn(0x7f71000fd8c0 msgr2=0x7f71000fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:46.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:46.018+0000 7f7105c88640 1 -- 172.21.15.5:0/1187215963 shutdown_connections 2024-09-11T23:26:46.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:46.018+0000 7f7105c88640 1 -- 172.21.15.5:0/1187215963 wait complete. 2024-09-11T23:26:46.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:45 smithi159 ceph-mon[34394]: pgmap v275: 97 pgs: 13 creating+peering, 4 active+clean, 80 unknown; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:46.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:45 smithi159 ceph-mon[34394]: osdmap e79: 12 total, 12 up, 12 in 2024-09-11T23:26:46.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:45 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/1187215963' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-11T23:26:46.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:45 smithi159 ceph-mon[34394]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-11T23:26:46.133 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:45 smithi172 ceph-mon[34855]: pgmap v275: 97 pgs: 13 creating+peering, 4 active+clean, 80 unknown; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:26:46.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:45 smithi172 ceph-mon[34855]: osdmap e79: 12 total, 12 up, 12 in 2024-09-11T23:26:46.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:45 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/1187215963' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-11T23:26:46.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:45 smithi172 ceph-mon[34855]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-11T23:26:46.707 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-11T23:26:46.708 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-11T23:26:46.968 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:26:46.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:46 smithi005 ceph-mon[31201]: osdmap e80: 12 total, 12 up, 12 in 2024-09-11T23:26:46.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:46 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/1187215963' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-11T23:26:46.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:46 smithi005 ceph-mon[31201]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-11T23:26:46.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:46 smithi005 ceph-mon[31201]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-11T23:26:47.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:46 smithi159 ceph-mon[34394]: osdmap e80: 12 total, 12 up, 12 in 2024-09-11T23:26:47.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:46 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/1187215963' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-11T23:26:47.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:46 smithi159 ceph-mon[34394]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-11T23:26:47.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:46 smithi159 ceph-mon[34394]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-11T23:26:47.133 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:46 smithi172 ceph-mon[34855]: osdmap e80: 12 total, 12 up, 12 in 2024-09-11T23:26:47.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:46 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/1187215963' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-11T23:26:47.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:46 smithi172 ceph-mon[34855]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-11T23:26:47.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:46 smithi172 ceph-mon[34855]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-11T23:26:47.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:47.446+0000 7fba4d4a7640 1 -- 172.21.15.5:0/1276087961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba48106f10 msgr2=0x7fba4810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:47.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:47.446+0000 7fba4d4a7640 1 --2- 172.21.15.5:0/1276087961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba48106f10 0x7fba4810ea90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fba40009ca0 tx=0x7fba4002a8c0 comp rx=0 tx=0).stop 2024-09-11T23:26:47.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:47.446+0000 7fba4d4a7640 1 -- 172.21.15.5:0/1276087961 shutdown_connections 2024-09-11T23:26:47.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:47.446+0000 7fba4d4a7640 1 --2- 172.21.15.5:0/1276087961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba48106f10 0x7fba4810ea90 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:47.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:47.446+0000 7fba4d4a7640 1 --2- 172.21.15.5:0/1276087961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba48102790 0x7fba481067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:47.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:47.446+0000 7fba4d4a7640 1 --2- 172.21.15.5:0/1276087961 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba48101de0 0x7fba481021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:47.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:47.446+0000 7fba4d4a7640 1 -- 172.21.15.5:0/1276087961 >> 172.21.15.5:0/1276087961 conn(0x7fba480fd8c0 msgr2=0x7fba480ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:47.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:47.446+0000 7fba4d4a7640 1 -- 172.21.15.5:0/1276087961 shutdown_connections 2024-09-11T23:26:47.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:47.446+0000 7fba4d4a7640 1 -- 172.21.15.5:0/1276087961 wait complete. 2024-09-11T23:26:47.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:47.447+0000 7fba4d4a7640 1 Processor -- start 2024-09-11T23:26:47.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:47.447+0000 7fba4d4a7640 1 -- start start 2024-09-11T23:26:47.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:47.447+0000 7fba4d4a7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba48101de0 0x7fba48198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:47.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:47.447+0000 7fba4d4a7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba48102790 0x7fba48198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:47.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:47.447+0000 7fba4d4a7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba48106f10 0x7fba4819cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:47.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:47.447+0000 7fba4d4a7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fba48111e20 con 0x7fba48106f10 2024-09-11T23:26:47.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:47.447+0000 7fba4d4a7640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fba48111ca0 con 0x7fba48102790 2024-09-11T23:26:47.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:47.447+0000 7fba4d4a7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fba48111fa0 con 0x7fba48101de0 2024-09-11T23:26:47.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:47.447+0000 7fba477fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba48106f10 0x7fba4819cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:47.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:47.447+0000 7fba477fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba48106f10 0x7fba4819cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44144/0 (socket says 172.21.15.5:44144) 2024-09-11T23:26:47.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:47.447+0000 7fba477fe640 1 -- 172.21.15.5:0/3026657774 learned_addr learned my addr 172.21.15.5:0/3026657774 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:26:47.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:47.447+0000 7fba46ffd640 1 --2- 172.21.15.5:0/3026657774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba48101de0 0x7fba48198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:47.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:47.448+0000 7fba3ffff640 1 --2- 172.21.15.5:0/3026657774 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba48102790 0x7fba48198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:47.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:47.448+0000 7fba477fe640 1 -- 172.21.15.5:0/3026657774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba48101de0 msgr2=0x7fba48198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:47.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:47.448+0000 7fba477fe640 1 --2- 172.21.15.5:0/3026657774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba48101de0 0x7fba48198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:47.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:47.448+0000 7fba477fe640 1 -- 172.21.15.5:0/3026657774 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba48102790 msgr2=0x7fba48198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:47.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:47.448+0000 7fba477fe640 1 --2- 172.21.15.5:0/3026657774 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba48102790 0x7fba48198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:47.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:47.448+0000 7fba477fe640 1 -- 172.21.15.5:0/3026657774 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba4819d2f0 con 0x7fba48106f10 2024-09-11T23:26:47.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:47.448+0000 7fba477fe640 1 --2- 172.21.15.5:0/3026657774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba48106f10 0x7fba4819cc10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fba40009dc0 tx=0x7fba40032ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:47.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:47.448+0000 7fba44ff9640 1 -- 172.21.15.5:0/3026657774 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba40003cf0 con 0x7fba48106f10 2024-09-11T23:26:47.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:47.448+0000 7fba4d4a7640 1 -- 172.21.15.5:0/3026657774 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba4819d580 con 0x7fba48106f10 2024-09-11T23:26:47.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:47.448+0000 7fba44ff9640 1 -- 172.21.15.5:0/3026657774 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fba400044f0 con 0x7fba48106f10 2024-09-11T23:26:47.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:47.448+0000 7fba44ff9640 1 -- 172.21.15.5:0/3026657774 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba40030bf0 con 0x7fba48106f10 2024-09-11T23:26:47.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:47.448+0000 7fba4d4a7640 1 -- 172.21.15.5:0/3026657774 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba481a4ec0 con 0x7fba48106f10 2024-09-11T23:26:47.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:47.449+0000 7fba4d4a7640 1 -- 172.21.15.5:0/3026657774 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba481021c0 con 0x7fba48106f10 2024-09-11T23:26:47.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:47.450+0000 7fba44ff9640 1 -- 172.21.15.5:0/3026657774 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fba40004040 con 0x7fba48106f10 2024-09-11T23:26:47.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:47.451+0000 7fba44ff9640 1 --2- 172.21.15.5:0/3026657774 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fba340a2b80 0x7fba340a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:47.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:47.451+0000 7fba46ffd640 1 --2- 172.21.15.5:0/3026657774 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fba340a2b80 0x7fba340a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:47.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:47.451+0000 7fba44ff9640 1 -- 172.21.15.5:0/3026657774 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fba400f0550 con 0x7fba48106f10 2024-09-11T23:26:47.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:47.451+0000 7fba46ffd640 1 --2- 172.21.15.5:0/3026657774 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fba340a2b80 0x7fba340a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fba3800bbe0 tx=0x7fba3800b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:47.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:47.455+0000 7fba44ff9640 1 -- 172.21.15.5:0/3026657774 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fba400bd600 con 0x7fba48106f10 2024-09-11T23:26:47.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:47.639+0000 7fba4d4a7640 1 -- 172.21.15.5:0/3026657774 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fba4810a0f0 con 0x7fba48106f10 2024-09-11T23:26:47.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:47 smithi005 ceph-mon[31201]: pgmap v278: 97 pgs: 13 creating+peering, 70 active+clean, 14 unknown; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1 op/s 2024-09-11T23:26:47.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:47 smithi005 ceph-mon[31201]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-11T23:26:47.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:47 smithi005 ceph-mon[31201]: Cluster is now healthy 2024-09-11T23:26:47.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:47 smithi005 ceph-mon[31201]: mds.? [v2:172.21.15.159:6838/3843336290,v1:172.21.15.159:6839/3843336290] up:active 2024-09-11T23:26:47.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:47 smithi005 ceph-mon[31201]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T23:26:47.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:47 smithi005 ceph-mon[31201]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T23:26:47.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:47 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/3026657774' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T23:26:48.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:48.024+0000 7fba44ff9640 1 -- 172.21.15.5:0/3026657774 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v81) ==== 157+0+0 (secure 0 0 0) 0x7fba400bcf00 con 0x7fba48106f10 2024-09-11T23:26:48.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:48.027+0000 7fba4d4a7640 1 -- 172.21.15.5:0/3026657774 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fba340a2b80 msgr2=0x7fba340a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:48.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:48.027+0000 7fba4d4a7640 1 --2- 172.21.15.5:0/3026657774 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fba340a2b80 0x7fba340a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fba3800bbe0 tx=0x7fba3800b390 comp rx=0 tx=0).stop 2024-09-11T23:26:48.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:48.027+0000 7fba4d4a7640 1 -- 172.21.15.5:0/3026657774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba48106f10 msgr2=0x7fba4819cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:48.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:48.027+0000 7fba4d4a7640 1 --2- 172.21.15.5:0/3026657774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba48106f10 0x7fba4819cc10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fba40009dc0 tx=0x7fba40032ff0 comp rx=0 tx=0).stop 2024-09-11T23:26:48.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:48.027+0000 7fba4d4a7640 1 -- 172.21.15.5:0/3026657774 shutdown_connections 2024-09-11T23:26:48.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:48.027+0000 7fba4d4a7640 1 --2- 172.21.15.5:0/3026657774 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fba340a2b80 0x7fba340a5040 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:48.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:48.027+0000 7fba4d4a7640 1 --2- 172.21.15.5:0/3026657774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba48106f10 0x7fba4819cc10 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:48.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:48.027+0000 7fba4d4a7640 1 --2- 172.21.15.5:0/3026657774 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba48102790 0x7fba48198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:48.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:48.027+0000 7fba4d4a7640 1 --2- 172.21.15.5:0/3026657774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba48101de0 0x7fba48198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:48.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:48.027+0000 7fba4d4a7640 1 -- 172.21.15.5:0/3026657774 >> 172.21.15.5:0/3026657774 conn(0x7fba480fd8c0 msgr2=0x7fba480fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:48.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:48.027+0000 7fba4d4a7640 1 -- 172.21.15.5:0/3026657774 shutdown_connections 2024-09-11T23:26:48.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:48.027+0000 7fba4d4a7640 1 -- 172.21.15.5:0/3026657774 wait complete. 2024-09-11T23:26:48.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:47 smithi159 ceph-mon[34394]: pgmap v278: 97 pgs: 13 creating+peering, 70 active+clean, 14 unknown; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1 op/s 2024-09-11T23:26:48.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:47 smithi159 ceph-mon[34394]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-11T23:26:48.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:47 smithi159 ceph-mon[34394]: Cluster is now healthy 2024-09-11T23:26:48.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:47 smithi159 ceph-mon[34394]: mds.? [v2:172.21.15.159:6838/3843336290,v1:172.21.15.159:6839/3843336290] up:active 2024-09-11T23:26:48.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:47 smithi159 ceph-mon[34394]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T23:26:48.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:47 smithi159 ceph-mon[34394]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T23:26:48.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:47 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/3026657774' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T23:26:48.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:47 smithi172 ceph-mon[34855]: pgmap v278: 97 pgs: 13 creating+peering, 70 active+clean, 14 unknown; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1 op/s 2024-09-11T23:26:48.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:47 smithi172 ceph-mon[34855]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-11T23:26:48.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:47 smithi172 ceph-mon[34855]: Cluster is now healthy 2024-09-11T23:26:48.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:47 smithi172 ceph-mon[34855]: mds.? [v2:172.21.15.159:6838/3843336290,v1:172.21.15.159:6839/3843336290] up:active 2024-09-11T23:26:48.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:47 smithi172 ceph-mon[34855]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T23:26:48.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:47 smithi172 ceph-mon[34855]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T23:26:48.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:47 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/3026657774' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T23:26:48.776 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T23:26:49.040 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:26:49.322 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:49 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/3026657774' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-11T23:26:49.322 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:49 smithi005 ceph-mon[31201]: osdmap e81: 12 total, 12 up, 12 in 2024-09-11T23:26:49.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:49 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/3026657774' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-11T23:26:49.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:49 smithi159 ceph-mon[34394]: osdmap e81: 12 total, 12 up, 12 in 2024-09-11T23:26:49.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:49 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/3026657774' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-11T23:26:49.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:49 smithi172 ceph-mon[34855]: osdmap e81: 12 total, 12 up, 12 in 2024-09-11T23:26:49.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:49.550+0000 7fed53ba2640 1 -- 172.21.15.5:0/2227484927 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed4c106a80 msgr2=0x7fed4c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:49.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:49.550+0000 7fed53ba2640 1 --2- 172.21.15.5:0/2227484927 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed4c106a80 0x7fed4c106e60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fed48009930 tx=0x7fed4802a420 comp rx=0 tx=0).stop 2024-09-11T23:26:49.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:49.550+0000 7fed53ba2640 1 -- 172.21.15.5:0/2227484927 shutdown_connections 2024-09-11T23:26:49.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:49.550+0000 7fed53ba2640 1 --2- 172.21.15.5:0/2227484927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed4c101420 0x7fed4c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:49.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:49.550+0000 7fed53ba2640 1 --2- 172.21.15.5:0/2227484927 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed4c100a80 0x7fed4c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:49.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:49.550+0000 7fed53ba2640 1 --2- 172.21.15.5:0/2227484927 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed4c106a80 0x7fed4c106e60 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:49.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:49.550+0000 7fed53ba2640 1 -- 172.21.15.5:0/2227484927 >> 172.21.15.5:0/2227484927 conn(0x7fed4c0fc7a0 msgr2=0x7fed4c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:49.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:49.550+0000 7fed53ba2640 1 -- 172.21.15.5:0/2227484927 shutdown_connections 2024-09-11T23:26:49.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:49.550+0000 7fed53ba2640 1 -- 172.21.15.5:0/2227484927 wait complete. 2024-09-11T23:26:49.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:49.551+0000 7fed53ba2640 1 Processor -- start 2024-09-11T23:26:49.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:49.551+0000 7fed53ba2640 1 -- start start 2024-09-11T23:26:49.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:49.551+0000 7fed53ba2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed4c100a80 0x7fed4c198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:49.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:49.551+0000 7fed53ba2640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed4c101420 0x7fed4c1987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:49.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:49.551+0000 7fed53ba2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed4c106a80 0x7fed4c19cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:49.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:49.551+0000 7fed53ba2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fed4c110d30 con 0x7fed4c100a80 2024-09-11T23:26:49.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:49.551+0000 7fed53ba2640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fed4c110bb0 con 0x7fed4c101420 2024-09-11T23:26:49.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:49.551+0000 7fed53ba2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fed4c110eb0 con 0x7fed4c106a80 2024-09-11T23:26:49.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:49.551+0000 7fed5193e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed4c100a80 0x7fed4c198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:49.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:49.551+0000 7fed5193e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed4c100a80 0x7fed4c198260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44172/0 (socket says 172.21.15.5:44172) 2024-09-11T23:26:49.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:49.551+0000 7fed5193e640 1 -- 172.21.15.5:0/798736274 learned_addr learned my addr 172.21.15.5:0/798736274 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:26:49.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:49.551+0000 7fed5113d640 1 --2- 172.21.15.5:0/798736274 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed4c101420 0x7fed4c1987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:49.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:49.551+0000 7fed5213f640 1 --2- 172.21.15.5:0/798736274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed4c106a80 0x7fed4c19cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:49.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:49.552+0000 7fed5193e640 1 -- 172.21.15.5:0/798736274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed4c106a80 msgr2=0x7fed4c19cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:49.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:49.552+0000 7fed5193e640 1 --2- 172.21.15.5:0/798736274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed4c106a80 0x7fed4c19cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:49.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:49.552+0000 7fed5193e640 1 -- 172.21.15.5:0/798736274 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed4c101420 msgr2=0x7fed4c1987a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:49.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:49.552+0000 7fed5193e640 1 --2- 172.21.15.5:0/798736274 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed4c101420 0x7fed4c1987a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:49.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:49.552+0000 7fed5193e640 1 -- 172.21.15.5:0/798736274 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed4c19d210 con 0x7fed4c100a80 2024-09-11T23:26:49.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:49.552+0000 7fed5213f640 1 --2- 172.21.15.5:0/798736274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed4c106a80 0x7fed4c19cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:26:49.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:49.552+0000 7fed5193e640 1 --2- 172.21.15.5:0/798736274 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed4c100a80 0x7fed4c198260 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fed48005940 tx=0x7fed480042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:49.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:49.552+0000 7fed42ffd640 1 -- 172.21.15.5:0/798736274 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed4803f030 con 0x7fed4c100a80 2024-09-11T23:26:49.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:49.552+0000 7fed42ffd640 1 -- 172.21.15.5:0/798736274 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fed48003cb0 con 0x7fed4c100a80 2024-09-11T23:26:49.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:49.552+0000 7fed53ba2640 1 -- 172.21.15.5:0/798736274 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed4c19d4a0 con 0x7fed4c100a80 2024-09-11T23:26:49.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:49.552+0000 7fed42ffd640 1 -- 172.21.15.5:0/798736274 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed48035070 con 0x7fed4c100a80 2024-09-11T23:26:49.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:49.552+0000 7fed53ba2640 1 -- 172.21.15.5:0/798736274 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed4c1a4de0 con 0x7fed4c100a80 2024-09-11T23:26:49.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:49.553+0000 7fed53ba2640 1 -- 172.21.15.5:0/798736274 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed4c100ee0 con 0x7fed4c100a80 2024-09-11T23:26:49.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:49.554+0000 7fed42ffd640 1 -- 172.21.15.5:0/798736274 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fed48042030 con 0x7fed4c100a80 2024-09-11T23:26:49.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:49.555+0000 7fed42ffd640 1 --2- 172.21.15.5:0/798736274 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fed380a2c00 0x7fed380a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:49.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:49.555+0000 7fed5113d640 1 --2- 172.21.15.5:0/798736274 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fed380a2c00 0x7fed380a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:49.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:49.555+0000 7fed42ffd640 1 -- 172.21.15.5:0/798736274 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8277+0+0 (secure 0 0 0) 0x7fed480ef7f0 con 0x7fed4c100a80 2024-09-11T23:26:49.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:49.555+0000 7fed5113d640 1 --2- 172.21.15.5:0/798736274 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fed380a2c00 0x7fed380a50c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fed4c0fec60 tx=0x7fed3c00a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:49.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:49.558+0000 7fed42ffd640 1 -- 172.21.15.5:0/798736274 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fed480bc6c0 con 0x7fed4c100a80 2024-09-11T23:26:49.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:49.735+0000 7fed53ba2640 1 -- 172.21.15.5:0/798736274 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fed4c1a5010 con 0x7fed4c100a80 2024-09-11T23:26:50.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:50 smithi159 ceph-mon[34394]: pgmap v280: 97 pgs: 7 creating+peering, 90 active+clean; 579 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s wr, 3 op/s 2024-09-11T23:26:50.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:50 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/798736274' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-11T23:26:50.377 INFO:journalctl@ceph.mds.b.smithi159.stdout:Sep 11 23:26:50 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-b[64498]: 2024-09-11T23:26:50.029+0000 7f6823cf6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T23:26:50.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:50 smithi172 ceph-mon[34855]: pgmap v280: 97 pgs: 7 creating+peering, 90 active+clean; 579 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s wr, 3 op/s 2024-09-11T23:26:50.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:50 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/798736274' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-11T23:26:50.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:50 smithi005 ceph-mon[31201]: pgmap v280: 97 pgs: 7 creating+peering, 90 active+clean; 579 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s wr, 3 op/s 2024-09-11T23:26:50.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:50 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/798736274' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-11T23:26:51.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:51.042+0000 7fed42ffd640 1 -- 172.21.15.5:0/798736274 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v83) ==== 228+0+0 (secure 0 0 0) 0x7fed480bbfc0 con 0x7fed4c100a80 2024-09-11T23:26:51.043 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data_ec' created 2024-09-11T23:26:51.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:51.045+0000 7fed53ba2640 1 -- 172.21.15.5:0/798736274 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fed380a2c00 msgr2=0x7fed380a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:51.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:51.045+0000 7fed53ba2640 1 --2- 172.21.15.5:0/798736274 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fed380a2c00 0x7fed380a50c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fed4c0fec60 tx=0x7fed3c00a2d0 comp rx=0 tx=0).stop 2024-09-11T23:26:51.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:51.045+0000 7fed53ba2640 1 -- 172.21.15.5:0/798736274 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed4c100a80 msgr2=0x7fed4c198260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:51.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:51.045+0000 7fed53ba2640 1 --2- 172.21.15.5:0/798736274 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed4c100a80 0x7fed4c198260 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fed48005940 tx=0x7fed480042f0 comp rx=0 tx=0).stop 2024-09-11T23:26:51.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:51.045+0000 7fed53ba2640 1 -- 172.21.15.5:0/798736274 shutdown_connections 2024-09-11T23:26:51.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:51.045+0000 7fed53ba2640 1 --2- 172.21.15.5:0/798736274 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fed380a2c00 0x7fed380a50c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:51.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:51.045+0000 7fed53ba2640 1 --2- 172.21.15.5:0/798736274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed4c106a80 0x7fed4c19cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:51.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:51.045+0000 7fed53ba2640 1 --2- 172.21.15.5:0/798736274 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed4c101420 0x7fed4c1987a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:51.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:51.045+0000 7fed53ba2640 1 --2- 172.21.15.5:0/798736274 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed4c100a80 0x7fed4c198260 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:51.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:51.045+0000 7fed53ba2640 1 -- 172.21.15.5:0/798736274 >> 172.21.15.5:0/798736274 conn(0x7fed4c0fc7a0 msgr2=0x7fed4c06a860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:51.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:51.045+0000 7fed53ba2640 1 -- 172.21.15.5:0/798736274 shutdown_connections 2024-09-11T23:26:51.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:51.046+0000 7fed53ba2640 1 -- 172.21.15.5:0/798736274 wait complete. 2024-09-11T23:26:51.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:51 smithi159 ceph-mon[34394]: osdmap e82: 12 total, 12 up, 12 in 2024-09-11T23:26:51.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:51 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-09-11T23:26:51.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:51 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]: dispatch 2024-09-11T23:26:51.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:51 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2024-09-11T23:26:51.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:51 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [5, 11]}]: dispatch 2024-09-11T23:26:51.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:51 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-09-11T23:26:51.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:51 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8, 5, 9]}]: dispatch 2024-09-11T23:26:51.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:51 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]}]: dispatch 2024-09-11T23:26:51.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:51 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2d", "id": [3, 9]}]: dispatch 2024-09-11T23:26:51.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:51 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-09-11T23:26:51.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:51 smithi172 ceph-mon[34855]: osdmap e82: 12 total, 12 up, 12 in 2024-09-11T23:26:51.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:51 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-09-11T23:26:51.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:51 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]: dispatch 2024-09-11T23:26:51.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:51 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2024-09-11T23:26:51.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:51 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [5, 11]}]: dispatch 2024-09-11T23:26:51.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:51 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-09-11T23:26:51.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:51 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8, 5, 9]}]: dispatch 2024-09-11T23:26:51.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:51 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]}]: dispatch 2024-09-11T23:26:51.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:51 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2d", "id": [3, 9]}]: dispatch 2024-09-11T23:26:51.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:51 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-09-11T23:26:51.448 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:51 smithi005 ceph-mon[31201]: osdmap e82: 12 total, 12 up, 12 in 2024-09-11T23:26:51.449 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:51 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-09-11T23:26:51.449 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:51 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]: dispatch 2024-09-11T23:26:51.449 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:51 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2024-09-11T23:26:51.449 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:51 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [5, 11]}]: dispatch 2024-09-11T23:26:51.449 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:51 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-09-11T23:26:51.449 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:51 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8, 5, 9]}]: dispatch 2024-09-11T23:26:51.449 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:51 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]}]: dispatch 2024-09-11T23:26:51.449 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:51 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2d", "id": [3, 9]}]: dispatch 2024-09-11T23:26:51.449 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:51 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-09-11T23:26:51.758 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-11T23:26:52.022 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:26:52.053 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:52 smithi005 ceph-mon[31201]: pgmap v282: 97 pgs: 97 active+clean; 579 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 3 op/s 2024-09-11T23:26:52.053 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:52 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/798736274' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-11T23:26:52.053 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:52 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-09-11T23:26:52.053 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:52 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]': finished 2024-09-11T23:26:52.053 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:52 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-09-11T23:26:52.053 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:52 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [5, 11]}]': finished 2024-09-11T23:26:52.054 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:52 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-11T23:26:52.054 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:52 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8, 5, 9]}]': finished 2024-09-11T23:26:52.054 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:52 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]}]': finished 2024-09-11T23:26:52.054 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:52 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2d", "id": [3, 9]}]': finished 2024-09-11T23:26:52.054 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:52 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-09-11T23:26:52.054 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:52 smithi005 ceph-mon[31201]: osdmap e83: 12 total, 12 up, 12 in 2024-09-11T23:26:52.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:52 smithi159 ceph-mon[34394]: pgmap v282: 97 pgs: 97 active+clean; 579 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 3 op/s 2024-09-11T23:26:52.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:52 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/798736274' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-11T23:26:52.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:52 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-09-11T23:26:52.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:52 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]': finished 2024-09-11T23:26:52.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:52 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-09-11T23:26:52.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:52 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [5, 11]}]': finished 2024-09-11T23:26:52.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:52 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-11T23:26:52.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:52 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8, 5, 9]}]': finished 2024-09-11T23:26:52.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:52 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]}]': finished 2024-09-11T23:26:52.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:52 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2d", "id": [3, 9]}]': finished 2024-09-11T23:26:52.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:52 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-09-11T23:26:52.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:52 smithi159 ceph-mon[34394]: osdmap e83: 12 total, 12 up, 12 in 2024-09-11T23:26:52.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:52 smithi172 ceph-mon[34855]: pgmap v282: 97 pgs: 97 active+clean; 579 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 3 op/s 2024-09-11T23:26:52.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:52 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/798736274' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-11T23:26:52.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:52 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-09-11T23:26:52.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:52 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]': finished 2024-09-11T23:26:52.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:52 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-09-11T23:26:52.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:52 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [5, 11]}]': finished 2024-09-11T23:26:52.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:52 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-11T23:26:52.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:52 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8, 5, 9]}]': finished 2024-09-11T23:26:52.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:52 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]}]': finished 2024-09-11T23:26:52.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:52 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2d", "id": [3, 9]}]': finished 2024-09-11T23:26:52.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:52 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-09-11T23:26:52.385 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:52 smithi172 ceph-mon[34855]: osdmap e83: 12 total, 12 up, 12 in 2024-09-11T23:26:52.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:52.532+0000 7fcd141de640 1 -- 172.21.15.5:0/1168097944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd0c102da0 msgr2=0x7fcd0c103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:52.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:52.532+0000 7fcd141de640 1 --2- 172.21.15.5:0/1168097944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd0c102da0 0x7fcd0c103180 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcd08009900 tx=0x7fcd0802a480 comp rx=0 tx=0).stop 2024-09-11T23:26:52.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:52.532+0000 7fcd141de640 1 -- 172.21.15.5:0/1168097944 shutdown_connections 2024-09-11T23:26:52.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:52.532+0000 7fcd141de640 1 --2- 172.21.15.5:0/1168097944 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd0c10c180 0x7fcd0c10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:52.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:52.532+0000 7fcd141de640 1 --2- 172.21.15.5:0/1168097944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd0c1036c0 0x7fcd0c10bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:52.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:52.532+0000 7fcd141de640 1 --2- 172.21.15.5:0/1168097944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd0c102da0 0x7fcd0c103180 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:52.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:52.532+0000 7fcd141de640 1 -- 172.21.15.5:0/1168097944 >> 172.21.15.5:0/1168097944 conn(0x7fcd0c0fc7a0 msgr2=0x7fcd0c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:52.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:52.532+0000 7fcd141de640 1 -- 172.21.15.5:0/1168097944 shutdown_connections 2024-09-11T23:26:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:52.532+0000 7fcd141de640 1 -- 172.21.15.5:0/1168097944 wait complete. 2024-09-11T23:26:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:52.533+0000 7fcd141de640 1 Processor -- start 2024-09-11T23:26:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:52.533+0000 7fcd141de640 1 -- start start 2024-09-11T23:26:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:52.533+0000 7fcd141de640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd0c102da0 0x7fcd0c198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:52.533+0000 7fcd141de640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd0c1036c0 0x7fcd0c1987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:52.533+0000 7fcd141de640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd0c10c180 0x7fcd0c19cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:52.533+0000 7fcd141de640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0c111e10 con 0x7fcd0c1036c0 2024-09-11T23:26:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:52.533+0000 7fcd141de640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0c111c90 con 0x7fcd0c102da0 2024-09-11T23:26:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:52.533+0000 7fcd141de640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0c111f90 con 0x7fcd0c10c180 2024-09-11T23:26:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:52.533+0000 7fcd11779640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd0c1036c0 0x7fcd0c1987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:52.533+0000 7fcd11779640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd0c1036c0 0x7fcd0c1987b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44186/0 (socket says 172.21.15.5:44186) 2024-09-11T23:26:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:52.533+0000 7fcd11779640 1 -- 172.21.15.5:0/1713356835 learned_addr learned my addr 172.21.15.5:0/1713356835 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:26:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:52.533+0000 7fcd11f7a640 1 --2- 172.21.15.5:0/1713356835 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd0c102da0 0x7fcd0c198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:52.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:52.534+0000 7fcd1277b640 1 --2- 172.21.15.5:0/1713356835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd0c10c180 0x7fcd0c19cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:52.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:52.534+0000 7fcd11779640 1 -- 172.21.15.5:0/1713356835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd0c10c180 msgr2=0x7fcd0c19cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:52.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:52.534+0000 7fcd11779640 1 --2- 172.21.15.5:0/1713356835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd0c10c180 0x7fcd0c19cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:52.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:52.534+0000 7fcd11779640 1 -- 172.21.15.5:0/1713356835 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd0c102da0 msgr2=0x7fcd0c198270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:52.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:52.534+0000 7fcd11779640 1 --2- 172.21.15.5:0/1713356835 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd0c102da0 0x7fcd0c198270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:52.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:52.534+0000 7fcd11779640 1 -- 172.21.15.5:0/1713356835 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd0c19d220 con 0x7fcd0c1036c0 2024-09-11T23:26:52.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:52.534+0000 7fcd11f7a640 1 --2- 172.21.15.5:0/1713356835 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd0c102da0 0x7fcd0c198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:26:52.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:52.534+0000 7fcd11779640 1 --2- 172.21.15.5:0/1713356835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd0c1036c0 0x7fcd0c1987b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fccfc00c920 tx=0x7fccfc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:52.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:52.534+0000 7fcd02ffd640 1 -- 172.21.15.5:0/1713356835 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccfc007c70 con 0x7fcd0c1036c0 2024-09-11T23:26:52.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:52.534+0000 7fcd02ffd640 1 -- 172.21.15.5:0/1713356835 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fccfc007e10 con 0x7fcd0c1036c0 2024-09-11T23:26:52.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:52.534+0000 7fcd141de640 1 -- 172.21.15.5:0/1713356835 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd0c19d510 con 0x7fcd0c1036c0 2024-09-11T23:26:52.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:52.534+0000 7fcd02ffd640 1 -- 172.21.15.5:0/1713356835 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccfc018820 con 0x7fcd0c1036c0 2024-09-11T23:26:52.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:52.534+0000 7fcd141de640 1 -- 172.21.15.5:0/1713356835 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd0c1a4df0 con 0x7fcd0c1036c0 2024-09-11T23:26:52.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:52.535+0000 7fcd141de640 1 -- 172.21.15.5:0/1713356835 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd0c103180 con 0x7fcd0c1036c0 2024-09-11T23:26:52.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:52.536+0000 7fcd02ffd640 1 -- 172.21.15.5:0/1713356835 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fccfc0189c0 con 0x7fcd0c1036c0 2024-09-11T23:26:52.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:52.537+0000 7fcd02ffd640 1 --2- 172.21.15.5:0/1713356835 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fccf80a2b80 0x7fccf80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:52.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:52.537+0000 7fcd11f7a640 1 --2- 172.21.15.5:0/1713356835 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fccf80a2b80 0x7fccf80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:52.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:52.538+0000 7fcd02ffd640 1 -- 172.21.15.5:0/1713356835 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9039+0+0 (secure 0 0 0) 0x7fccfc0cf870 con 0x7fcd0c1036c0 2024-09-11T23:26:52.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:52.538+0000 7fcd11f7a640 1 --2- 172.21.15.5:0/1713356835 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fccf80a2b80 0x7fccf80a5040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcd08031440 tx=0x7fcd080095f0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:52.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:52.541+0000 7fcd02ffd640 1 -- 172.21.15.5:0/1713356835 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fccfc014030 con 0x7fcd0c1036c0 2024-09-11T23:26:52.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:52.720+0000 7fcd141de640 1 -- 172.21.15.5:0/1713356835 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7fcd0c1995d0 con 0x7fcd0c1036c0 2024-09-11T23:26:53.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:53.055+0000 7fcd02ffd640 1 -- 172.21.15.5:0/1713356835 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v85) ==== 169+0+0 (secure 0 0 0) 0x7fcd0c1995d0 con 0x7fcd0c1036c0 2024-09-11T23:26:53.056 INFO:teuthology.orchestra.run.smithi005.stderr:set pool 4 allow_ec_overwrites to true 2024-09-11T23:26:53.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:53.059+0000 7fcd141de640 1 -- 172.21.15.5:0/1713356835 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fccf80a2b80 msgr2=0x7fccf80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:53.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:53.059+0000 7fcd141de640 1 --2- 172.21.15.5:0/1713356835 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fccf80a2b80 0x7fccf80a5040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcd08031440 tx=0x7fcd080095f0 comp rx=0 tx=0).stop 2024-09-11T23:26:53.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:53.059+0000 7fcd141de640 1 -- 172.21.15.5:0/1713356835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd0c1036c0 msgr2=0x7fcd0c1987b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:53.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:53.059+0000 7fcd141de640 1 --2- 172.21.15.5:0/1713356835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd0c1036c0 0x7fcd0c1987b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fccfc00c920 tx=0x7fccfc00cde0 comp rx=0 tx=0).stop 2024-09-11T23:26:53.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:53.059+0000 7fcd141de640 1 -- 172.21.15.5:0/1713356835 shutdown_connections 2024-09-11T23:26:53.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:53.059+0000 7fcd141de640 1 --2- 172.21.15.5:0/1713356835 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fccf80a2b80 0x7fccf80a5040 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:53.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:53.059+0000 7fcd141de640 1 --2- 172.21.15.5:0/1713356835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd0c10c180 0x7fcd0c19cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:53.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:53.059+0000 7fcd141de640 1 --2- 172.21.15.5:0/1713356835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd0c1036c0 0x7fcd0c1987b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:53.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:53.059+0000 7fcd141de640 1 --2- 172.21.15.5:0/1713356835 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd0c102da0 0x7fcd0c198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:53.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:53.059+0000 7fcd141de640 1 -- 172.21.15.5:0/1713356835 >> 172.21.15.5:0/1713356835 conn(0x7fcd0c0fc7a0 msgr2=0x7fcd0c0fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:53.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:53.059+0000 7fcd141de640 1 -- 172.21.15.5:0/1713356835 shutdown_connections 2024-09-11T23:26:53.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:53.059+0000 7fcd141de640 1 -- 172.21.15.5:0/1713356835 wait complete. 2024-09-11T23:26:53.349 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:53 smithi005 ceph-mon[31201]: osdmap e84: 12 total, 12 up, 12 in 2024-09-11T23:26:53.349 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:53 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/1713356835' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-11T23:26:53.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:53 smithi159 ceph-mon[34394]: osdmap e84: 12 total, 12 up, 12 in 2024-09-11T23:26:53.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:53 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/1713356835' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-11T23:26:53.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:53 smithi172 ceph-mon[34855]: osdmap e84: 12 total, 12 up, 12 in 2024-09-11T23:26:53.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:53 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/1713356835' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-11T23:26:53.798 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-11T23:26:54.058 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:54 smithi005 ceph-mon[31201]: pgmap v285: 129 pgs: 4 creating+peering, 1 peering, 28 unknown, 96 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 6 op/s 2024-09-11T23:26:54.058 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:54 smithi005 ceph-mon[31201]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T23:26:54.058 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:54 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/1713356835' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-11T23:26:54.058 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:54 smithi005 ceph-mon[31201]: osdmap e85: 12 total, 12 up, 12 in 2024-09-11T23:26:54.066 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:26:54.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:54 smithi159 ceph-mon[34394]: pgmap v285: 129 pgs: 4 creating+peering, 1 peering, 28 unknown, 96 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 6 op/s 2024-09-11T23:26:54.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:54 smithi159 ceph-mon[34394]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T23:26:54.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:54 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/1713356835' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-11T23:26:54.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:54 smithi159 ceph-mon[34394]: osdmap e85: 12 total, 12 up, 12 in 2024-09-11T23:26:54.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:54 smithi172 ceph-mon[34855]: pgmap v285: 129 pgs: 4 creating+peering, 1 peering, 28 unknown, 96 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 6 op/s 2024-09-11T23:26:54.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:54 smithi172 ceph-mon[34855]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T23:26:54.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:54 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/1713356835' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-11T23:26:54.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:54 smithi172 ceph-mon[34855]: osdmap e85: 12 total, 12 up, 12 in 2024-09-11T23:26:54.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:54.581+0000 7f788a9c2640 1 -- 172.21.15.5:0/3962779490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7884102d40 msgr2=0x7f7884103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:54.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:54.581+0000 7f788a9c2640 1 --2- 172.21.15.5:0/3962779490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7884102d40 0x7f7884103120 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7874009900 tx=0x7f787402a480 comp rx=0 tx=0).stop 2024-09-11T23:26:54.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:54.581+0000 7f788a9c2640 1 -- 172.21.15.5:0/3962779490 shutdown_connections 2024-09-11T23:26:54.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:54.581+0000 7f788a9c2640 1 --2- 172.21.15.5:0/3962779490 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f788410c170 0x7f788410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:54.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:54.581+0000 7f788a9c2640 1 --2- 172.21.15.5:0/3962779490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7884103660 0x7f788410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:54.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:54.581+0000 7f788a9c2640 1 --2- 172.21.15.5:0/3962779490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7884102d40 0x7f7884103120 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:54.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:54.581+0000 7f788a9c2640 1 -- 172.21.15.5:0/3962779490 >> 172.21.15.5:0/3962779490 conn(0x7f78840fc7a0 msgr2=0x7f78840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:54.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:54.581+0000 7f788a9c2640 1 -- 172.21.15.5:0/3962779490 shutdown_connections 2024-09-11T23:26:54.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:54.581+0000 7f788a9c2640 1 -- 172.21.15.5:0/3962779490 wait complete. 2024-09-11T23:26:54.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:54.582+0000 7f788a9c2640 1 Processor -- start 2024-09-11T23:26:54.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:54.582+0000 7f788a9c2640 1 -- start start 2024-09-11T23:26:54.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:54.582+0000 7f788a9c2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7884102d40 0x7f7884198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:54.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:54.582+0000 7f788a9c2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7884103660 0x7f78841989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:54.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:54.582+0000 7f788a9c2640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f788410c170 0x7f788419cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:54.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:54.582+0000 7f788a9c2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7884111e60 con 0x7f7884103660 2024-09-11T23:26:54.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:54.582+0000 7f788a9c2640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7884111ce0 con 0x7f788410c170 2024-09-11T23:26:54.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:54.582+0000 7f788a9c2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7884111fe0 con 0x7f7884102d40 2024-09-11T23:26:54.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:54.582+0000 7f78837fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7884103660 0x7f78841989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:54.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:54.582+0000 7f78837fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7884103660 0x7f78841989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36746/0 (socket says 172.21.15.5:36746) 2024-09-11T23:26:54.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:54.582+0000 7f78837fe640 1 -- 172.21.15.5:0/2233559524 learned_addr learned my addr 172.21.15.5:0/2233559524 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:26:54.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:54.583+0000 7f7883fff640 1 --2- 172.21.15.5:0/2233559524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7884102d40 0x7f7884198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:54.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:54.583+0000 7f78837fe640 1 -- 172.21.15.5:0/2233559524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7884102d40 msgr2=0x7f7884198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:54.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:54.583+0000 7f78837fe640 1 --2- 172.21.15.5:0/2233559524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7884102d40 0x7f7884198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:54.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:54.583+0000 7f78837fe640 1 -- 172.21.15.5:0/2233559524 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f788410c170 msgr2=0x7f788419cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:54.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:54.583+0000 7f78837fe640 1 --2- 172.21.15.5:0/2233559524 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f788410c170 0x7f788419cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:54.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:54.583+0000 7f78837fe640 1 -- 172.21.15.5:0/2233559524 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f788419d410 con 0x7f7884103660 2024-09-11T23:26:54.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:54.583+0000 7f78837fe640 1 --2- 172.21.15.5:0/2233559524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7884103660 0x7f78841989a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f787800d740 tx=0x7f787800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:54.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:54.583+0000 7f78817fa640 1 -- 172.21.15.5:0/2233559524 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7878017070 con 0x7f7884103660 2024-09-11T23:26:54.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:54.583+0000 7f78817fa640 1 -- 172.21.15.5:0/2233559524 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f787800de50 con 0x7f7884103660 2024-09-11T23:26:54.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:54.583+0000 7f788a9c2640 1 -- 172.21.15.5:0/2233559524 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f788419d700 con 0x7f7884103660 2024-09-11T23:26:54.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:54.583+0000 7f78817fa640 1 -- 172.21.15.5:0/2233559524 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f787800f620 con 0x7f7884103660 2024-09-11T23:26:54.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:54.583+0000 7f788a9c2640 1 -- 172.21.15.5:0/2233559524 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78841a4fe0 con 0x7f7884103660 2024-09-11T23:26:54.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:54.584+0000 7f788a9c2640 1 -- 172.21.15.5:0/2233559524 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7884103120 con 0x7f7884103660 2024-09-11T23:26:54.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:54.585+0000 7f78817fa640 1 -- 172.21.15.5:0/2233559524 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f7878009c30 con 0x7f7884103660 2024-09-11T23:26:54.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:54.586+0000 7f78817fa640 1 --2- 172.21.15.5:0/2233559524 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f786c0a2c00 0x7f786c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:54.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:54.586+0000 7f78817fa640 1 -- 172.21.15.5:0/2233559524 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9039+0+0 (secure 0 0 0) 0x7f78780cef40 con 0x7f7884103660 2024-09-11T23:26:54.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:54.586+0000 7f7883fff640 1 --2- 172.21.15.5:0/2233559524 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f786c0a2c00 0x7f786c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:54.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:54.587+0000 7f7883fff640 1 --2- 172.21.15.5:0/2233559524 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f786c0a2c00 0x7f786c0a50c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7874031440 tx=0x7f78740095f0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:54.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:54.591+0000 7f78817fa640 1 -- 172.21.15.5:0/2233559524 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f787809bb80 con 0x7f7884103660 2024-09-11T23:26:54.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:54.805+0000 7f788a9c2640 1 -- 172.21.15.5:0/2233559524 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f7884106c80 con 0x7f7884103660 2024-09-11T23:26:55.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:55.065+0000 7f78817fa640 1 -- 172.21.15.5:0/2233559524 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) ==== 137+0+0 (secure 0 0 0) 0x7f787809b480 con 0x7f7884103660 2024-09-11T23:26:55.066 INFO:teuthology.orchestra.run.smithi005.stderr:added data pool 4 to fsmap 2024-09-11T23:26:55.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:55.067+0000 7f788a9c2640 1 -- 172.21.15.5:0/2233559524 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f786c0a2c00 msgr2=0x7f786c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:55.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:55.068+0000 7f788a9c2640 1 --2- 172.21.15.5:0/2233559524 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f786c0a2c00 0x7f786c0a50c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7874031440 tx=0x7f78740095f0 comp rx=0 tx=0).stop 2024-09-11T23:26:55.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:55.068+0000 7f788a9c2640 1 -- 172.21.15.5:0/2233559524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7884103660 msgr2=0x7f78841989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:55.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:55.068+0000 7f788a9c2640 1 --2- 172.21.15.5:0/2233559524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7884103660 0x7f78841989a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f787800d740 tx=0x7f787800dc00 comp rx=0 tx=0).stop 2024-09-11T23:26:55.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:55.068+0000 7f788a9c2640 1 -- 172.21.15.5:0/2233559524 shutdown_connections 2024-09-11T23:26:55.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:55.068+0000 7f788a9c2640 1 --2- 172.21.15.5:0/2233559524 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f786c0a2c00 0x7f786c0a50c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:55.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:55.068+0000 7f788a9c2640 1 --2- 172.21.15.5:0/2233559524 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f788410c170 0x7f788419cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:55.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:55.068+0000 7f788a9c2640 1 --2- 172.21.15.5:0/2233559524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7884103660 0x7f78841989a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:55.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:55.068+0000 7f788a9c2640 1 --2- 172.21.15.5:0/2233559524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7884102d40 0x7f7884198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:55.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:55.068+0000 7f788a9c2640 1 -- 172.21.15.5:0/2233559524 >> 172.21.15.5:0/2233559524 conn(0x7f78840fc7a0 msgr2=0x7f78840fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:55.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:55.068+0000 7f788a9c2640 1 -- 172.21.15.5:0/2233559524 shutdown_connections 2024-09-11T23:26:55.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:55.068+0000 7f788a9c2640 1 -- 172.21.15.5:0/2233559524 wait complete. 2024-09-11T23:26:55.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:55 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/2233559524' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-11T23:26:55.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:55 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/2233559524' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-11T23:26:55.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:55 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/2233559524' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-11T23:26:55.710 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:26:55.973 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:26:56.372 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:56 smithi005 ceph-mon[31201]: pgmap v287: 129 pgs: 4 creating+peering, 1 peering, 21 unknown, 103 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 753 B/s wr, 6 op/s; 0 B/s, 0 objects/s recovering 2024-09-11T23:26:56.372 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:56 smithi005 ceph-mon[31201]: osdmap e86: 12 total, 12 up, 12 in 2024-09-11T23:26:56.373 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:56 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/2233559524' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-11T23:26:56.373 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:56 smithi005 ceph-mon[31201]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T23:26:56.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:56 smithi159 ceph-mon[34394]: pgmap v287: 129 pgs: 4 creating+peering, 1 peering, 21 unknown, 103 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 753 B/s wr, 6 op/s; 0 B/s, 0 objects/s recovering 2024-09-11T23:26:56.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:56 smithi159 ceph-mon[34394]: osdmap e86: 12 total, 12 up, 12 in 2024-09-11T23:26:56.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:56 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/2233559524' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-11T23:26:56.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:56 smithi159 ceph-mon[34394]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T23:26:56.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:56 smithi172 ceph-mon[34855]: pgmap v287: 129 pgs: 4 creating+peering, 1 peering, 21 unknown, 103 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 753 B/s wr, 6 op/s; 0 B/s, 0 objects/s recovering 2024-09-11T23:26:56.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:56 smithi172 ceph-mon[34855]: osdmap e86: 12 total, 12 up, 12 in 2024-09-11T23:26:56.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:56 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/2233559524' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-11T23:26:56.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:56 smithi172 ceph-mon[34855]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T23:26:56.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.454+0000 7fa1606cb640 1 -- 172.21.15.5:0/1164838787 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa158102d30 msgr2=0x7fa158103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:56.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.454+0000 7fa1606cb640 1 --2- 172.21.15.5:0/1164838787 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa158102d30 0x7fa158103110 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa154009930 tx=0x7fa15402a440 comp rx=0 tx=0).stop 2024-09-11T23:26:56.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.454+0000 7fa1606cb640 1 -- 172.21.15.5:0/1164838787 shutdown_connections 2024-09-11T23:26:56.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.454+0000 7fa1606cb640 1 --2- 172.21.15.5:0/1164838787 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1581082a0 0x7fa15810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:56.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.454+0000 7fa1606cb640 1 --2- 172.21.15.5:0/1164838787 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1581036e0 0x7fa158107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:56.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.454+0000 7fa1606cb640 1 --2- 172.21.15.5:0/1164838787 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa158102d30 0x7fa158103110 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:56.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.454+0000 7fa1606cb640 1 -- 172.21.15.5:0/1164838787 >> 172.21.15.5:0/1164838787 conn(0x7fa1580fc7d0 msgr2=0x7fa1580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:56.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.454+0000 7fa1606cb640 1 -- 172.21.15.5:0/1164838787 shutdown_connections 2024-09-11T23:26:56.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.454+0000 7fa1606cb640 1 -- 172.21.15.5:0/1164838787 wait complete. 2024-09-11T23:26:56.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.454+0000 7fa1606cb640 1 Processor -- start 2024-09-11T23:26:56.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.454+0000 7fa1606cb640 1 -- start start 2024-09-11T23:26:56.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.455+0000 7fa1606cb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa158102d30 0x7fa158100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:56.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.455+0000 7fa1606cb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1581036e0 0x7fa158100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:56.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.455+0000 7fa1606cb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1581082a0 0x7fa158101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:56.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.455+0000 7fa1606cb640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa158111f90 con 0x7fa1581036e0 2024-09-11T23:26:56.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.455+0000 7fa1606cb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa158111e10 con 0x7fa1581082a0 2024-09-11T23:26:56.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.455+0000 7fa1606cb640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa158112110 con 0x7fa158102d30 2024-09-11T23:26:56.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.455+0000 7fa15dc66640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1581036e0 0x7fa158100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:56.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.455+0000 7fa15dc66640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1581036e0 0x7fa158100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36766/0 (socket says 172.21.15.5:36766) 2024-09-11T23:26:56.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.455+0000 7fa15dc66640 1 -- 172.21.15.5:0/2530551936 learned_addr learned my addr 172.21.15.5:0/2530551936 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:26:56.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.455+0000 7fa15e467640 1 --2- 172.21.15.5:0/2530551936 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa158102d30 0x7fa158100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:56.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.455+0000 7fa15ec68640 1 --2- 172.21.15.5:0/2530551936 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1581082a0 0x7fa158101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:56.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.455+0000 7fa15dc66640 1 -- 172.21.15.5:0/2530551936 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa158102d30 msgr2=0x7fa158100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:56.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.455+0000 7fa15dc66640 1 --2- 172.21.15.5:0/2530551936 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa158102d30 0x7fa158100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:56.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.455+0000 7fa15dc66640 1 -- 172.21.15.5:0/2530551936 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1581082a0 msgr2=0x7fa158101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:56.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.455+0000 7fa15dc66640 1 --2- 172.21.15.5:0/2530551936 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1581082a0 0x7fa158101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:56.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.455+0000 7fa15dc66640 1 -- 172.21.15.5:0/2530551936 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1581a6a30 con 0x7fa1581036e0 2024-09-11T23:26:56.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.455+0000 7fa15dc66640 1 --2- 172.21.15.5:0/2530551936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1581036e0 0x7fa158100ed0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa148006fd0 tx=0x7fa14800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:56.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.455+0000 7fa14f7fe640 1 -- 172.21.15.5:0/2530551936 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa148011830 con 0x7fa1581036e0 2024-09-11T23:26:56.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.455+0000 7fa14f7fe640 1 -- 172.21.15.5:0/2530551936 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa148016070 con 0x7fa1581036e0 2024-09-11T23:26:56.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.456+0000 7fa1606cb640 1 -- 172.21.15.5:0/2530551936 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1581a6d20 con 0x7fa1581036e0 2024-09-11T23:26:56.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.456+0000 7fa14f7fe640 1 -- 172.21.15.5:0/2530551936 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa148010df0 con 0x7fa1581036e0 2024-09-11T23:26:56.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.456+0000 7fa1606cb640 1 -- 172.21.15.5:0/2530551936 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1581a7200 con 0x7fa1581036e0 2024-09-11T23:26:56.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.456+0000 7fa1606cb640 1 -- 172.21.15.5:0/2530551936 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa15806a850 con 0x7fa1581036e0 2024-09-11T23:26:56.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.458+0000 7fa14f7fe640 1 -- 172.21.15.5:0/2530551936 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fa1480119d0 con 0x7fa1581036e0 2024-09-11T23:26:56.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.459+0000 7fa14f7fe640 1 --2- 172.21.15.5:0/2530551936 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fa1440a2b80 0x7fa1440a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:56.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.459+0000 7fa15e467640 1 --2- 172.21.15.5:0/2530551936 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fa1440a2b80 0x7fa1440a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:56.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.459+0000 7fa14f7fe640 1 -- 172.21.15.5:0/2530551936 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9071+0+0 (secure 0 0 0) 0x7fa1480cf0c0 con 0x7fa1581036e0 2024-09-11T23:26:56.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.460+0000 7fa15e467640 1 --2- 172.21.15.5:0/2530551936 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fa1440a2b80 0x7fa1440a5040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa154006010 tx=0x7fa154000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:56.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.462+0000 7fa14f7fe640 1 -- 172.21.15.5:0/2530551936 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa14809bc80 con 0x7fa1581036e0 2024-09-11T23:26:56.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.671+0000 7fa1606cb640 1 -- 172.21.15.5:0/2530551936 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa158103110 con 0x7fa1581036e0 2024-09-11T23:26:56.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.672+0000 7fa14f7fe640 1 -- 172.21.15.5:0/2530551936 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11845 (secure 0 0 0) 0x7fa158103110 con 0x7fa1581036e0 2024-09-11T23:26:56.673 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:26:56.673 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":17,"btime":"2024-09-11T23:26:55:058773+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3865435482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3865435482},{"type":"v1","addr":"172.21.15.5:6835","nonce":3865435482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1323314897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":1323314897},{"type":"v1","addr":"172.21.15.5:6837","nonce":1323314897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14610,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6839/4140073288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":4140073288},{"type":"v1","addr":"172.21.15.5:6839","nonce":4140073288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6841/1162578713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":1162578713},{"type":"v1","addr":"172.21.15.5:6841","nonce":1162578713}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3113658116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3113658116},{"type":"v1","addr":"172.21.15.172:6833","nonce":3113658116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3887336060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3887336060},{"type":"v1","addr":"172.21.15.159:6833","nonce":3887336060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2539263301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2539263301},{"type":"v1","addr":"172.21.15.159:6835","nonce":2539263301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/4240913699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":4240913699},{"type":"v1","addr":"172.21.15.172:6835","nonce":4240913699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24460,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4200951601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":4200951601},{"type":"v1","addr":"172.21.15.172:6837","nonce":4200951601}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/4020181017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":4020181017},{"type":"v1","addr":"172.21.15.159:6837","nonce":4020181017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24475,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6839/3928313314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3928313314},{"type":"v1","addr":"172.21.15.172:6839","nonce":3928313314}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:26:45.305894+0000","modified":"2024-09-11T23:26:54.807420+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24494},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.159:6839/3843336290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3843336290},{"type":"v1","addr":"172.21.15.159:6839","nonce":3843336290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24494,"qdb_cluster":[24494]},"id":1}]} 2024-09-11T23:26:56.674 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 17 2024-09-11T23:26:56.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.675+0000 7fa1606cb640 1 -- 172.21.15.5:0/2530551936 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fa1440a2b80 msgr2=0x7fa1440a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:56.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.675+0000 7fa1606cb640 1 --2- 172.21.15.5:0/2530551936 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fa1440a2b80 0x7fa1440a5040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa154006010 tx=0x7fa154000bc0 comp rx=0 tx=0).stop 2024-09-11T23:26:56.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.675+0000 7fa1606cb640 1 -- 172.21.15.5:0/2530551936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1581036e0 msgr2=0x7fa158100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:56.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.675+0000 7fa1606cb640 1 --2- 172.21.15.5:0/2530551936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1581036e0 0x7fa158100ed0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa148006fd0 tx=0x7fa14800b8e0 comp rx=0 tx=0).stop 2024-09-11T23:26:56.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.675+0000 7fa1606cb640 1 -- 172.21.15.5:0/2530551936 shutdown_connections 2024-09-11T23:26:56.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.675+0000 7fa1606cb640 1 --2- 172.21.15.5:0/2530551936 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fa1440a2b80 0x7fa1440a5040 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:56.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.675+0000 7fa1606cb640 1 --2- 172.21.15.5:0/2530551936 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1581082a0 0x7fa158101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:56.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.675+0000 7fa1606cb640 1 --2- 172.21.15.5:0/2530551936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1581036e0 0x7fa158100ed0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:56.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.675+0000 7fa1606cb640 1 --2- 172.21.15.5:0/2530551936 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa158102d30 0x7fa158100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:56.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.675+0000 7fa1606cb640 1 -- 172.21.15.5:0/2530551936 >> 172.21.15.5:0/2530551936 conn(0x7fa1580fc7d0 msgr2=0x7fa158105ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:56.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.675+0000 7fa1606cb640 1 -- 172.21.15.5:0/2530551936 shutdown_connections 2024-09-11T23:26:56.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:56.675+0000 7fa1606cb640 1 -- 172.21.15.5:0/2530551936 wait complete. 2024-09-11T23:26:57.314 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:57 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/2530551936' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:26:57.347 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T23:26:57.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:57 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/2530551936' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:26:57.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:57 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/2530551936' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:26:57.609 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:26:58.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.049+0000 7f8fa89d3640 1 -- 172.21.15.5:0/3344498748 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fa41002f0 msgr2=0x7f8fa41006d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:58.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.049+0000 7f8fa89d3640 1 --2- 172.21.15.5:0/3344498748 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fa41002f0 0x7f8fa41006d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8f94009930 tx=0x7f8f9402a420 comp rx=0 tx=0).stop 2024-09-11T23:26:58.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.049+0000 7f8fa89d3640 1 -- 172.21.15.5:0/3344498748 shutdown_connections 2024-09-11T23:26:58.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.049+0000 7f8fa89d3640 1 --2- 172.21.15.5:0/3344498748 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fa4106f50 0x7f8fa410eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:58.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.049+0000 7f8fa89d3640 1 --2- 172.21.15.5:0/3344498748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fa4100ca0 0x7f8fa4106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:58.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.049+0000 7f8fa89d3640 1 --2- 172.21.15.5:0/3344498748 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fa41002f0 0x7f8fa41006d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:58.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.049+0000 7f8fa89d3640 1 -- 172.21.15.5:0/3344498748 >> 172.21.15.5:0/3344498748 conn(0x7f8fa4077210 msgr2=0x7f8fa40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:58.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.049+0000 7f8fa89d3640 1 -- 172.21.15.5:0/3344498748 shutdown_connections 2024-09-11T23:26:58.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.049+0000 7f8fa89d3640 1 -- 172.21.15.5:0/3344498748 wait complete. 2024-09-11T23:26:58.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.050+0000 7f8fa89d3640 1 Processor -- start 2024-09-11T23:26:58.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.050+0000 7f8fa89d3640 1 -- start start 2024-09-11T23:26:58.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.050+0000 7f8fa89d3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fa41002f0 0x7f8fa4198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:58.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.050+0000 7f8fa89d3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fa4100ca0 0x7f8fa4198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:58.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.050+0000 7f8fa89d3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fa4106f50 0x7f8fa419ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:58.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.050+0000 7f8fa89d3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa4111f80 con 0x7f8fa4106f50 2024-09-11T23:26:58.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.050+0000 7f8fa89d3640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa4111e00 con 0x7f8fa41002f0 2024-09-11T23:26:58.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.050+0000 7f8fa89d3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa4112100 con 0x7f8fa4100ca0 2024-09-11T23:26:58.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.050+0000 7f8fa2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fa4106f50 0x7f8fa419ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:58.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.050+0000 7f8fa2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fa4106f50 0x7f8fa419ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36790/0 (socket says 172.21.15.5:36790) 2024-09-11T23:26:58.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.050+0000 7f8fa2d9d640 1 -- 172.21.15.5:0/1089573127 learned_addr learned my addr 172.21.15.5:0/1089573127 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:26:58.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.050+0000 7f8fa1d9b640 1 --2- 172.21.15.5:0/1089573127 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fa4100ca0 0x7f8fa4198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:58.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.051+0000 7f8fa259c640 1 --2- 172.21.15.5:0/1089573127 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fa41002f0 0x7f8fa4198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:58.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.051+0000 7f8fa2d9d640 1 -- 172.21.15.5:0/1089573127 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fa4100ca0 msgr2=0x7f8fa4198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:58.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.051+0000 7f8fa2d9d640 1 --2- 172.21.15.5:0/1089573127 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fa4100ca0 0x7f8fa4198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:58.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.051+0000 7f8fa2d9d640 1 -- 172.21.15.5:0/1089573127 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fa41002f0 msgr2=0x7f8fa4198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:58.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.051+0000 7f8fa2d9d640 1 --2- 172.21.15.5:0/1089573127 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fa41002f0 0x7f8fa4198560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:58.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.051+0000 7f8fa2d9d640 1 -- 172.21.15.5:0/1089573127 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fa419d510 con 0x7f8fa4106f50 2024-09-11T23:26:58.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.051+0000 7f8fa2d9d640 1 --2- 172.21.15.5:0/1089573127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fa4106f50 0x7f8fa419ce30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c00b970 tx=0x7f8f9c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:58.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.051+0000 7f8f937fe640 1 -- 172.21.15.5:0/1089573127 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c019070 con 0x7f8fa4106f50 2024-09-11T23:26:58.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.051+0000 7f8f937fe640 1 -- 172.21.15.5:0/1089573127 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8f9c014440 con 0x7f8fa4106f50 2024-09-11T23:26:58.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.051+0000 7f8fa89d3640 1 -- 172.21.15.5:0/1089573127 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fa419d800 con 0x7f8fa4106f50 2024-09-11T23:26:58.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.051+0000 7f8f937fe640 1 -- 172.21.15.5:0/1089573127 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c0075d0 con 0x7f8fa4106f50 2024-09-11T23:26:58.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.051+0000 7f8fa89d3640 1 -- 172.21.15.5:0/1089573127 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fa41a50e0 con 0x7f8fa4106f50 2024-09-11T23:26:58.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.052+0000 7f8fa89d3640 1 -- 172.21.15.5:0/1089573127 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fa4100750 con 0x7f8fa4106f50 2024-09-11T23:26:58.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.053+0000 7f8f937fe640 1 -- 172.21.15.5:0/1089573127 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f8f9c01c070 con 0x7f8fa4106f50 2024-09-11T23:26:58.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.054+0000 7f8f937fe640 1 --2- 172.21.15.5:0/1089573127 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f8f8c0a2b80 0x7f8f8c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:58.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.054+0000 7f8fa259c640 1 --2- 172.21.15.5:0/1089573127 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f8f8c0a2b80 0x7f8f8c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:58.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.054+0000 7f8f937fe640 1 -- 172.21.15.5:0/1089573127 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9071+0+0 (secure 0 0 0) 0x7f8f9c0ceeb0 con 0x7f8fa4106f50 2024-09-11T23:26:58.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.055+0000 7f8fa259c640 1 --2- 172.21.15.5:0/1089573127 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f8f8c0a2b80 0x7f8f8c0a5040 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8f94009930 tx=0x7f8f94005fd0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:58.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.057+0000 7f8f937fe640 1 -- 172.21.15.5:0/1089573127 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8f9c0fe1b0 con 0x7f8fa4106f50 2024-09-11T23:26:58.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.235+0000 7f8fa89d3640 1 -- 172.21.15.5:0/1089573127 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8fa402d7c0 con 0x7f8fa4106f50 2024-09-11T23:26:58.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.236+0000 7f8f937fe640 1 -- 172.21.15.5:0/1089573127 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24655 (secure 0 0 0) 0x7f8f9c09bad0 con 0x7f8fa4106f50 2024-09-11T23:26:58.238 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:26:58.238 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":86,"fsid":"1f5284d2-7094-11ef-bcea-c7b262605968","created":"2024-09-11T23:19:00.051813+0000","modified":"2024-09-11T23:26:54.807250+0000","last_up_change":"2024-09-11T23:25:53.433445+0000","last_in_change":"2024-09-11T23:25:29.443287+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:22:04.534014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:26:41.220887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:26:43.664094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T23:26:50.471521+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bf95ced0-780b-482f-87da-0b5e61de62ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6803","nonce":624761084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6805","nonce":624761084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6809","nonce":624761084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6807","nonce":624761084}]},"public_addr":"172.21.15.5:6803/624761084","cluster_addr":"172.21.15.5:6805/624761084","heartbeat_back_addr":"172.21.15.5:6809/624761084","heartbeat_front_addr":"172.21.15.5:6807/624761084","state":["exists","up"]},{"osd":1,"uuid":"d926484f-78a6-497b-843d-f2db54ade4a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6801","nonce":2111290186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6803","nonce":2111290186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6807","nonce":2111290186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6805","nonce":2111290186}]},"public_addr":"172.21.15.159:6801/2111290186","cluster_addr":"172.21.15.159:6803/2111290186","heartbeat_back_addr":"172.21.15.159:6807/2111290186","heartbeat_front_addr":"172.21.15.159:6805/2111290186","state":["exists","up"]},{"osd":2,"uuid":"d92cd431-0ba7-4171-82b8-60fa3d63a64b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6801","nonce":299915717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6803","nonce":299915717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6807","nonce":299915717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6805","nonce":299915717}]},"public_addr":"172.21.15.172:6801/299915717","cluster_addr":"172.21.15.172:6803/299915717","heartbeat_back_addr":"172.21.15.172:6807/299915717","heartbeat_front_addr":"172.21.15.172:6805/299915717","state":["exists","up"]},{"osd":3,"uuid":"0521043b-559c-4671-b11e-9117871cff49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6811","nonce":2080498921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6813","nonce":2080498921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6817","nonce":2080498921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6815","nonce":2080498921}]},"public_addr":"172.21.15.5:6811/2080498921","cluster_addr":"172.21.15.5:6813/2080498921","heartbeat_back_addr":"172.21.15.5:6817/2080498921","heartbeat_front_addr":"172.21.15.5:6815/2080498921","state":["exists","up"]},{"osd":4,"uuid":"b968d762-a46e-4ae2-b19d-8225f82de613","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6809","nonce":4185908786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6811","nonce":4185908786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6815","nonce":4185908786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6813","nonce":4185908786}]},"public_addr":"172.21.15.159:6809/4185908786","cluster_addr":"172.21.15.159:6811/4185908786","heartbeat_back_addr":"172.21.15.159:6815/4185908786","heartbeat_front_addr":"172.21.15.159:6813/4185908786","state":["exists","up"]},{"osd":5,"uuid":"1b0a518a-3d17-4635-81da-52f9ef83a574","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6809","nonce":3742759000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6811","nonce":3742759000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6815","nonce":3742759000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6813","nonce":3742759000}]},"public_addr":"172.21.15.172:6809/3742759000","cluster_addr":"172.21.15.172:6811/3742759000","heartbeat_back_addr":"172.21.15.172:6815/3742759000","heartbeat_front_addr":"172.21.15.172:6813/3742759000","state":["exists","up"]},{"osd":6,"uuid":"c3a2db6c-9189-4e42-aa1e-52189a9c4291","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6819","nonce":4156823423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6821","nonce":4156823423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6825","nonce":4156823423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6823","nonce":4156823423}]},"public_addr":"172.21.15.5:6819/4156823423","cluster_addr":"172.21.15.5:6821/4156823423","heartbeat_back_addr":"172.21.15.5:6825/4156823423","heartbeat_front_addr":"172.21.15.5:6823/4156823423","state":["exists","up"]},{"osd":7,"uuid":"dfaadf28-74ab-4cda-8647-dcb58beb7cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6817","nonce":4222571927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6819","nonce":4222571927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6823","nonce":4222571927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6821","nonce":4222571927}]},"public_addr":"172.21.15.159:6817/4222571927","cluster_addr":"172.21.15.159:6819/4222571927","heartbeat_back_addr":"172.21.15.159:6823/4222571927","heartbeat_front_addr":"172.21.15.159:6821/4222571927","state":["exists","up"]},{"osd":8,"uuid":"47f66651-614c-4613-9793-69c140dbf705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6817","nonce":3661505951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6819","nonce":3661505951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6823","nonce":3661505951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6821","nonce":3661505951}]},"public_addr":"172.21.15.172:6817/3661505951","cluster_addr":"172.21.15.172:6819/3661505951","heartbeat_back_addr":"172.21.15.172:6823/3661505951","heartbeat_front_addr":"172.21.15.172:6821/3661505951","state":["exists","up"]},{"osd":9,"uuid":"c97b8221-8cf9-4fab-9e27-ff7f3bd98152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6827","nonce":72036667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6829","nonce":72036667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6833","nonce":72036667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6831","nonce":72036667}]},"public_addr":"172.21.15.5:6827/72036667","cluster_addr":"172.21.15.5:6829/72036667","heartbeat_back_addr":"172.21.15.5:6833/72036667","heartbeat_front_addr":"172.21.15.5:6831/72036667","state":["exists","up"]},{"osd":10,"uuid":"143376c1-f3f1-4df4-bcd3-a9b46fad8c1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6825","nonce":3334483164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6827","nonce":3334483164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6831","nonce":3334483164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6829","nonce":3334483164}]},"public_addr":"172.21.15.159:6825/3334483164","cluster_addr":"172.21.15.159:6827/3334483164","heartbeat_back_addr":"172.21.15.159:6831/3334483164","heartbeat_front_addr":"172.21.15.159:6829/3334483164","state":["exists","up"]},{"osd":11,"uuid":"5cc91ff9-fc0f-4e7a-8e4d-87df0e7efbeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6825","nonce":1965415663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6827","nonce":1965415663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6831","nonce":1965415663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6829","nonce":1965415663}]},"public_addr":"172.21.15.172:6825/1965415663","cluster_addr":"172.21.15.172:6827/1965415663","heartbeat_back_addr":"172.21.15.172:6831/1965415663","heartbeat_front_addr":"172.21.15.172:6829/1965415663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:21:13.024707+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:21:38.063741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:22:02.221583+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:22:27.919711+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:22:53.870543+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:23:18.539905+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:23:43.694229+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:24:08.984704+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:24:34.378582+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:25:00.102231+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:25:25.367178+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:25:51.439033+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/2713701762":"2024-09-12T23:19:50.031855+0000","172.21.15.5:0/3135835713":"2024-09-12T23:19:50.031855+0000","172.21.15.5:0/3935034940":"2024-09-12T23:19:50.031855+0000","172.21.15.5:6801/1790126649":"2024-09-12T23:19:50.031855+0000","172.21.15.5:6801/1358356358":"2024-09-12T23:19:26.149011+0000","172.21.15.5:6800/1790126649":"2024-09-12T23:19:50.031855+0000","172.21.15.5:6800/1358356358":"2024-09-12T23:19:26.149011+0000","172.21.15.5:0/2243688290":"2024-09-12T23:19:26.149011+0000","172.21.15.5:0/1493331899":"2024-09-12T23:19:26.149011+0000","172.21.15.5:0/2329812802":"2024-09-12T23:19:26.149011+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:26:58.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.238+0000 7f8fa89d3640 1 -- 172.21.15.5:0/1089573127 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f8f8c0a2b80 msgr2=0x7f8f8c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:58.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.238+0000 7f8fa89d3640 1 --2- 172.21.15.5:0/1089573127 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f8f8c0a2b80 0x7f8f8c0a5040 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8f94009930 tx=0x7f8f94005fd0 comp rx=0 tx=0).stop 2024-09-11T23:26:58.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.238+0000 7f8fa89d3640 1 -- 172.21.15.5:0/1089573127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fa4106f50 msgr2=0x7f8fa419ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:58.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.238+0000 7f8fa89d3640 1 --2- 172.21.15.5:0/1089573127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fa4106f50 0x7f8fa419ce30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c00b970 tx=0x7f8f9c00be30 comp rx=0 tx=0).stop 2024-09-11T23:26:58.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.238+0000 7f8fa89d3640 1 -- 172.21.15.5:0/1089573127 shutdown_connections 2024-09-11T23:26:58.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.238+0000 7f8fa89d3640 1 --2- 172.21.15.5:0/1089573127 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f8f8c0a2b80 0x7f8f8c0a5040 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:58.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.238+0000 7f8fa89d3640 1 --2- 172.21.15.5:0/1089573127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fa4106f50 0x7f8fa419ce30 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:58.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.238+0000 7f8fa89d3640 1 --2- 172.21.15.5:0/1089573127 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fa4100ca0 0x7f8fa4198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:58.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.238+0000 7f8fa89d3640 1 --2- 172.21.15.5:0/1089573127 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8fa41002f0 0x7f8fa4198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:58.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.238+0000 7f8fa89d3640 1 -- 172.21.15.5:0/1089573127 >> 172.21.15.5:0/1089573127 conn(0x7f8fa4077210 msgr2=0x7f8fa4105320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:58.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.239+0000 7f8fa89d3640 1 -- 172.21.15.5:0/1089573127 shutdown_connections 2024-09-11T23:26:58.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:58.239+0000 7f8fa89d3640 1 -- 172.21.15.5:0/1089573127 wait complete. 2024-09-11T23:26:58.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:58 smithi159 ceph-mon[34394]: pgmap v289: 129 pgs: 1 creating+peering, 128 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s; 0 B/s, 1 objects/s recovering 2024-09-11T23:26:58.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:58 smithi159 ceph-mon[34394]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-11T23:26:58.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:58 smithi159 ceph-mon[34394]: Cluster is now healthy 2024-09-11T23:26:58.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:58 smithi172 ceph-mon[34855]: pgmap v289: 129 pgs: 1 creating+peering, 128 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s; 0 B/s, 1 objects/s recovering 2024-09-11T23:26:58.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:58 smithi172 ceph-mon[34855]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-11T23:26:58.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:58 smithi172 ceph-mon[34855]: Cluster is now healthy 2024-09-11T23:26:58.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:58 smithi005 ceph-mon[31201]: pgmap v289: 129 pgs: 1 creating+peering, 128 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s; 0 B/s, 1 objects/s recovering 2024-09-11T23:26:58.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:58 smithi005 ceph-mon[31201]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-11T23:26:58.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:58 smithi005 ceph-mon[31201]: Cluster is now healthy 2024-09-11T23:26:58.948 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T23:26:59.210 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:26:59.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:26:59 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/1089573127' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:26:59.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:26:59 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/1089573127' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:26:59.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:26:59 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/1089573127' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:26:59.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.684+0000 7f49c5e60640 1 -- 172.21.15.5:0/1851305124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49c0106f20 msgr2=0x7f49c010eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:59.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.684+0000 7f49c5e60640 1 --2- 172.21.15.5:0/1851305124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49c0106f20 0x7f49c010eaa0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f49b8009ca0 tx=0x7f49b802a8c0 comp rx=0 tx=0).stop 2024-09-11T23:26:59.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.684+0000 7f49c5e60640 1 -- 172.21.15.5:0/1851305124 shutdown_connections 2024-09-11T23:26:59.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.684+0000 7f49c5e60640 1 --2- 172.21.15.5:0/1851305124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49c0106f20 0x7f49c010eaa0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:59.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.684+0000 7f49c5e60640 1 --2- 172.21.15.5:0/1851305124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49c01027a0 0x7f49c01067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:59.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.684+0000 7f49c5e60640 1 --2- 172.21.15.5:0/1851305124 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49c0101df0 0x7f49c01021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:59.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.684+0000 7f49c5e60640 1 -- 172.21.15.5:0/1851305124 >> 172.21.15.5:0/1851305124 conn(0x7f49c00fd8b0 msgr2=0x7f49c00ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:59.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.684+0000 7f49c5e60640 1 -- 172.21.15.5:0/1851305124 shutdown_connections 2024-09-11T23:26:59.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.684+0000 7f49c5e60640 1 -- 172.21.15.5:0/1851305124 wait complete. 2024-09-11T23:26:59.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.685+0000 7f49c5e60640 1 Processor -- start 2024-09-11T23:26:59.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.685+0000 7f49c5e60640 1 -- start start 2024-09-11T23:26:59.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.685+0000 7f49c5e60640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49c0101df0 0x7f49c00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:59.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.685+0000 7f49c5e60640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49c01027a0 0x7f49c0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:59.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.685+0000 7f49c5e60640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49c0106f20 0x7f49c0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:59.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.685+0000 7f49c5e60640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f49c0111e80 con 0x7f49c0106f20 2024-09-11T23:26:59.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.685+0000 7f49c5e60640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f49c0111d00 con 0x7f49c0101df0 2024-09-11T23:26:59.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.685+0000 7f49c5e60640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f49c0112000 con 0x7f49c01027a0 2024-09-11T23:26:59.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.686+0000 7f49bffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49c0106f20 0x7f49c0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:59.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.686+0000 7f49bffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49c0106f20 0x7f49c0074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36804/0 (socket says 172.21.15.5:36804) 2024-09-11T23:26:59.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.686+0000 7f49bffff640 1 -- 172.21.15.5:0/2555774626 learned_addr learned my addr 172.21.15.5:0/2555774626 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:26:59.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.686+0000 7f49bf7fe640 1 --2- 172.21.15.5:0/2555774626 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49c0101df0 0x7f49c00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:59.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.686+0000 7f49beffd640 1 --2- 172.21.15.5:0/2555774626 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49c01027a0 0x7f49c0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:59.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.686+0000 7f49bffff640 1 -- 172.21.15.5:0/2555774626 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49c01027a0 msgr2=0x7f49c0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:59.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.686+0000 7f49bffff640 1 --2- 172.21.15.5:0/2555774626 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49c01027a0 0x7f49c0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:59.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.686+0000 7f49bffff640 1 -- 172.21.15.5:0/2555774626 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49c0101df0 msgr2=0x7f49c00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:59.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.686+0000 7f49bffff640 1 --2- 172.21.15.5:0/2555774626 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49c0101df0 0x7f49c00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:59.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.686+0000 7f49bffff640 1 -- 172.21.15.5:0/2555774626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49c01a6880 con 0x7f49c0106f20 2024-09-11T23:26:59.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.686+0000 7f49beffd640 1 --2- 172.21.15.5:0/2555774626 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49c01027a0 0x7f49c0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:26:59.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.686+0000 7f49bffff640 1 --2- 172.21.15.5:0/2555774626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49c0106f20 0x7f49c0074f70 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f49b8031040 tx=0x7f49b8003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:59.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.686+0000 7f49bcff9640 1 -- 172.21.15.5:0/2555774626 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b8003ce0 con 0x7f49c0106f20 2024-09-11T23:26:59.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.686+0000 7f49c5e60640 1 -- 172.21.15.5:0/2555774626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49c01a6b10 con 0x7f49c0106f20 2024-09-11T23:26:59.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.686+0000 7f49bcff9640 1 -- 172.21.15.5:0/2555774626 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f49b80044f0 con 0x7f49c0106f20 2024-09-11T23:26:59.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.686+0000 7f49bcff9640 1 -- 172.21.15.5:0/2555774626 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b8030c90 con 0x7f49c0106f20 2024-09-11T23:26:59.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.686+0000 7f49c5e60640 1 -- 172.21.15.5:0/2555774626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49c01a7050 con 0x7f49c0106f20 2024-09-11T23:26:59.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.687+0000 7f49c5e60640 1 -- 172.21.15.5:0/2555774626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49c01021d0 con 0x7f49c0106f20 2024-09-11T23:26:59.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.688+0000 7f49bcff9640 1 -- 172.21.15.5:0/2555774626 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f49b80046a0 con 0x7f49c0106f20 2024-09-11T23:26:59.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.689+0000 7f49bcff9640 1 --2- 172.21.15.5:0/2555774626 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f49a80a2b80 0x7f49a80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:59.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.689+0000 7f49bcff9640 1 -- 172.21.15.5:0/2555774626 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9071+0+0 (secure 0 0 0) 0x7f49b80f09c0 con 0x7f49c0106f20 2024-09-11T23:26:59.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.689+0000 7f49bf7fe640 1 --2- 172.21.15.5:0/2555774626 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f49a80a2b80 0x7f49a80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:59.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.690+0000 7f49bf7fe640 1 --2- 172.21.15.5:0/2555774626 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f49a80a2b80 0x7f49a80a5040 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f49b000bbe0 tx=0x7f49b000b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:59.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.694+0000 7f49bcff9640 1 -- 172.21.15.5:0/2555774626 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f49b80f2e20 con 0x7f49c0106f20 2024-09-11T23:26:59.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.871+0000 7f49c5e60640 1 -- 172.21.15.5:0/2555774626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f49c010a160 con 0x7f49c0106f20 2024-09-11T23:26:59.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.873+0000 7f49bcff9640 1 -- 172.21.15.5:0/2555774626 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24655 (secure 0 0 0) 0x7f49b80bd5e0 con 0x7f49c0106f20 2024-09-11T23:26:59.873 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:26:59.873 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":86,"fsid":"1f5284d2-7094-11ef-bcea-c7b262605968","created":"2024-09-11T23:19:00.051813+0000","modified":"2024-09-11T23:26:54.807250+0000","last_up_change":"2024-09-11T23:25:53.433445+0000","last_in_change":"2024-09-11T23:25:29.443287+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:22:04.534014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:26:41.220887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:26:43.664094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T23:26:50.471521+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bf95ced0-780b-482f-87da-0b5e61de62ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6803","nonce":624761084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6805","nonce":624761084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6809","nonce":624761084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6807","nonce":624761084}]},"public_addr":"172.21.15.5:6803/624761084","cluster_addr":"172.21.15.5:6805/624761084","heartbeat_back_addr":"172.21.15.5:6809/624761084","heartbeat_front_addr":"172.21.15.5:6807/624761084","state":["exists","up"]},{"osd":1,"uuid":"d926484f-78a6-497b-843d-f2db54ade4a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6801","nonce":2111290186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6803","nonce":2111290186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6807","nonce":2111290186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6805","nonce":2111290186}]},"public_addr":"172.21.15.159:6801/2111290186","cluster_addr":"172.21.15.159:6803/2111290186","heartbeat_back_addr":"172.21.15.159:6807/2111290186","heartbeat_front_addr":"172.21.15.159:6805/2111290186","state":["exists","up"]},{"osd":2,"uuid":"d92cd431-0ba7-4171-82b8-60fa3d63a64b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6801","nonce":299915717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6803","nonce":299915717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6807","nonce":299915717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6805","nonce":299915717}]},"public_addr":"172.21.15.172:6801/299915717","cluster_addr":"172.21.15.172:6803/299915717","heartbeat_back_addr":"172.21.15.172:6807/299915717","heartbeat_front_addr":"172.21.15.172:6805/299915717","state":["exists","up"]},{"osd":3,"uuid":"0521043b-559c-4671-b11e-9117871cff49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6811","nonce":2080498921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6813","nonce":2080498921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6817","nonce":2080498921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6815","nonce":2080498921}]},"public_addr":"172.21.15.5:6811/2080498921","cluster_addr":"172.21.15.5:6813/2080498921","heartbeat_back_addr":"172.21.15.5:6817/2080498921","heartbeat_front_addr":"172.21.15.5:6815/2080498921","state":["exists","up"]},{"osd":4,"uuid":"b968d762-a46e-4ae2-b19d-8225f82de613","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6809","nonce":4185908786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6811","nonce":4185908786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6815","nonce":4185908786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6813","nonce":4185908786}]},"public_addr":"172.21.15.159:6809/4185908786","cluster_addr":"172.21.15.159:6811/4185908786","heartbeat_back_addr":"172.21.15.159:6815/4185908786","heartbeat_front_addr":"172.21.15.159:6813/4185908786","state":["exists","up"]},{"osd":5,"uuid":"1b0a518a-3d17-4635-81da-52f9ef83a574","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6809","nonce":3742759000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6811","nonce":3742759000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6815","nonce":3742759000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6813","nonce":3742759000}]},"public_addr":"172.21.15.172:6809/3742759000","cluster_addr":"172.21.15.172:6811/3742759000","heartbeat_back_addr":"172.21.15.172:6815/3742759000","heartbeat_front_addr":"172.21.15.172:6813/3742759000","state":["exists","up"]},{"osd":6,"uuid":"c3a2db6c-9189-4e42-aa1e-52189a9c4291","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6819","nonce":4156823423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6821","nonce":4156823423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6825","nonce":4156823423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6823","nonce":4156823423}]},"public_addr":"172.21.15.5:6819/4156823423","cluster_addr":"172.21.15.5:6821/4156823423","heartbeat_back_addr":"172.21.15.5:6825/4156823423","heartbeat_front_addr":"172.21.15.5:6823/4156823423","state":["exists","up"]},{"osd":7,"uuid":"dfaadf28-74ab-4cda-8647-dcb58beb7cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6817","nonce":4222571927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6819","nonce":4222571927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6823","nonce":4222571927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6821","nonce":4222571927}]},"public_addr":"172.21.15.159:6817/4222571927","cluster_addr":"172.21.15.159:6819/4222571927","heartbeat_back_addr":"172.21.15.159:6823/4222571927","heartbeat_front_addr":"172.21.15.159:6821/4222571927","state":["exists","up"]},{"osd":8,"uuid":"47f66651-614c-4613-9793-69c140dbf705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6817","nonce":3661505951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6819","nonce":3661505951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6823","nonce":3661505951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6821","nonce":3661505951}]},"public_addr":"172.21.15.172:6817/3661505951","cluster_addr":"172.21.15.172:6819/3661505951","heartbeat_back_addr":"172.21.15.172:6823/3661505951","heartbeat_front_addr":"172.21.15.172:6821/3661505951","state":["exists","up"]},{"osd":9,"uuid":"c97b8221-8cf9-4fab-9e27-ff7f3bd98152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6827","nonce":72036667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6829","nonce":72036667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6833","nonce":72036667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6831","nonce":72036667}]},"public_addr":"172.21.15.5:6827/72036667","cluster_addr":"172.21.15.5:6829/72036667","heartbeat_back_addr":"172.21.15.5:6833/72036667","heartbeat_front_addr":"172.21.15.5:6831/72036667","state":["exists","up"]},{"osd":10,"uuid":"143376c1-f3f1-4df4-bcd3-a9b46fad8c1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6825","nonce":3334483164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6827","nonce":3334483164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6831","nonce":3334483164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6829","nonce":3334483164}]},"public_addr":"172.21.15.159:6825/3334483164","cluster_addr":"172.21.15.159:6827/3334483164","heartbeat_back_addr":"172.21.15.159:6831/3334483164","heartbeat_front_addr":"172.21.15.159:6829/3334483164","state":["exists","up"]},{"osd":11,"uuid":"5cc91ff9-fc0f-4e7a-8e4d-87df0e7efbeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6825","nonce":1965415663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6827","nonce":1965415663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6831","nonce":1965415663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6829","nonce":1965415663}]},"public_addr":"172.21.15.172:6825/1965415663","cluster_addr":"172.21.15.172:6827/1965415663","heartbeat_back_addr":"172.21.15.172:6831/1965415663","heartbeat_front_addr":"172.21.15.172:6829/1965415663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:21:13.024707+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:21:38.063741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:22:02.221583+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:22:27.919711+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:22:53.870543+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:23:18.539905+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:23:43.694229+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:24:08.984704+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:24:34.378582+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:25:00.102231+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:25:25.367178+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:25:51.439033+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/2713701762":"2024-09-12T23:19:50.031855+0000","172.21.15.5:0/3135835713":"2024-09-12T23:19:50.031855+0000","172.21.15.5:0/3935034940":"2024-09-12T23:19:50.031855+0000","172.21.15.5:6801/1790126649":"2024-09-12T23:19:50.031855+0000","172.21.15.5:6801/1358356358":"2024-09-12T23:19:26.149011+0000","172.21.15.5:6800/1790126649":"2024-09-12T23:19:50.031855+0000","172.21.15.5:6800/1358356358":"2024-09-12T23:19:26.149011+0000","172.21.15.5:0/2243688290":"2024-09-12T23:19:26.149011+0000","172.21.15.5:0/1493331899":"2024-09-12T23:19:26.149011+0000","172.21.15.5:0/2329812802":"2024-09-12T23:19:26.149011+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:26:59.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.875+0000 7f49c5e60640 1 -- 172.21.15.5:0/2555774626 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f49a80a2b80 msgr2=0x7f49a80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:59.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.875+0000 7f49c5e60640 1 --2- 172.21.15.5:0/2555774626 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f49a80a2b80 0x7f49a80a5040 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f49b000bbe0 tx=0x7f49b000b390 comp rx=0 tx=0).stop 2024-09-11T23:26:59.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.875+0000 7f49c5e60640 1 -- 172.21.15.5:0/2555774626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49c0106f20 msgr2=0x7f49c0074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:59.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.875+0000 7f49c5e60640 1 --2- 172.21.15.5:0/2555774626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49c0106f20 0x7f49c0074f70 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f49b8031040 tx=0x7f49b8003970 comp rx=0 tx=0).stop 2024-09-11T23:26:59.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.875+0000 7f49c5e60640 1 -- 172.21.15.5:0/2555774626 shutdown_connections 2024-09-11T23:26:59.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.875+0000 7f49c5e60640 1 --2- 172.21.15.5:0/2555774626 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f49a80a2b80 0x7f49a80a5040 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:59.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.875+0000 7f49c5e60640 1 --2- 172.21.15.5:0/2555774626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49c0106f20 0x7f49c0074f70 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:59.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.875+0000 7f49c5e60640 1 --2- 172.21.15.5:0/2555774626 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49c01027a0 0x7f49c0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:59.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.875+0000 7f49c5e60640 1 --2- 172.21.15.5:0/2555774626 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49c0101df0 0x7f49c00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:59.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.875+0000 7f49c5e60640 1 -- 172.21.15.5:0/2555774626 >> 172.21.15.5:0/2555774626 conn(0x7f49c00fd8b0 msgr2=0x7f49c00feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:59.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.875+0000 7f49c5e60640 1 -- 172.21.15.5:0/2555774626 shutdown_connections 2024-09-11T23:26:59.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:26:59.875+0000 7f49c5e60640 1 -- 172.21.15.5:0/2555774626 wait complete. 2024-09-11T23:27:00.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:00 smithi005 ceph-mon[31201]: pgmap v290: 129 pgs: 129 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-11T23:27:00.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:00 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/2555774626' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:27:00.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:00 smithi159 ceph-mon[34394]: pgmap v290: 129 pgs: 129 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-11T23:27:00.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:00 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/2555774626' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:27:00.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:00 smithi172 ceph-mon[34855]: pgmap v290: 129 pgs: 129 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-11T23:27:00.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:00 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/2555774626' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:27:00.651 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:27:00.912 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:27:01.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.411+0000 7f7ca49cc640 1 -- 172.21.15.5:0/2360632752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ca0102790 msgr2=0x7f7ca01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:01.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.411+0000 7f7ca49cc640 1 --2- 172.21.15.5:0/2360632752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ca0102790 0x7f7ca01067e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7c88009900 tx=0x7f7c8802a410 comp rx=0 tx=0).stop 2024-09-11T23:27:01.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.411+0000 7f7ca49cc640 1 -- 172.21.15.5:0/2360632752 shutdown_connections 2024-09-11T23:27:01.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.411+0000 7f7ca49cc640 1 --2- 172.21.15.5:0/2360632752 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ca0106f10 0x7f7ca010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:01.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.411+0000 7f7ca49cc640 1 --2- 172.21.15.5:0/2360632752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ca0102790 0x7f7ca01067e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:01.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.411+0000 7f7ca49cc640 1 --2- 172.21.15.5:0/2360632752 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ca0101de0 0x7f7ca01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:01.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.411+0000 7f7ca49cc640 1 -- 172.21.15.5:0/2360632752 >> 172.21.15.5:0/2360632752 conn(0x7f7ca00fd8c0 msgr2=0x7f7ca00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:01.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.411+0000 7f7ca49cc640 1 -- 172.21.15.5:0/2360632752 shutdown_connections 2024-09-11T23:27:01.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.411+0000 7f7ca49cc640 1 -- 172.21.15.5:0/2360632752 wait complete. 2024-09-11T23:27:01.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.412+0000 7f7ca49cc640 1 Processor -- start 2024-09-11T23:27:01.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.412+0000 7f7ca49cc640 1 -- start start 2024-09-11T23:27:01.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.412+0000 7f7ca49cc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ca0101de0 0x7f7ca01983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:01.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.412+0000 7f7ca49cc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ca0102790 0x7f7ca0198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:01.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.412+0000 7f7ca49cc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ca0106f10 0x7f7ca019cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:01.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.412+0000 7f7ca49cc640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7ca0111e20 con 0x7f7ca0101de0 2024-09-11T23:27:01.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.412+0000 7f7ca49cc640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7ca0111ca0 con 0x7f7ca0106f10 2024-09-11T23:27:01.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.412+0000 7f7ca49cc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7ca0111fa0 con 0x7f7ca0102790 2024-09-11T23:27:01.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.412+0000 7f7c9e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ca0101de0 0x7f7ca01983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:01.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.412+0000 7f7c9e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ca0101de0 0x7f7ca01983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36816/0 (socket says 172.21.15.5:36816) 2024-09-11T23:27:01.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.412+0000 7f7c9e59c640 1 -- 172.21.15.5:0/2438504111 learned_addr learned my addr 172.21.15.5:0/2438504111 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:27:01.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.413+0000 7f7c97fff640 1 --2- 172.21.15.5:0/2438504111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ca0102790 0x7f7ca0198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:01.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.413+0000 7f7c9e59c640 1 -- 172.21.15.5:0/2438504111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ca0102790 msgr2=0x7f7ca0198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:01.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.413+0000 7f7c9e59c640 1 --2- 172.21.15.5:0/2438504111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ca0102790 0x7f7ca0198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:01.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.413+0000 7f7c9e59c640 1 -- 172.21.15.5:0/2438504111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ca0106f10 msgr2=0x7f7ca019cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:01.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.413+0000 7f7c9ed9d640 1 --2- 172.21.15.5:0/2438504111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ca0106f10 0x7f7ca019cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:01.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.413+0000 7f7c9e59c640 1 --2- 172.21.15.5:0/2438504111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ca0106f10 0x7f7ca019cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:01.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.413+0000 7f7c9e59c640 1 -- 172.21.15.5:0/2438504111 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ca019d370 con 0x7f7ca0101de0 2024-09-11T23:27:01.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.413+0000 7f7c9e59c640 1 --2- 172.21.15.5:0/2438504111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ca0101de0 0x7f7ca01983c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000c890 tx=0x7f7c9000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:01.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.413+0000 7f7c977fe640 1 -- 172.21.15.5:0/2438504111 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c90004220 con 0x7f7ca0101de0 2024-09-11T23:27:01.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.413+0000 7f7ca49cc640 1 -- 172.21.15.5:0/2438504111 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ca019d660 con 0x7f7ca0101de0 2024-09-11T23:27:01.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.413+0000 7f7c977fe640 1 -- 172.21.15.5:0/2438504111 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7c900043c0 con 0x7f7ca0101de0 2024-09-11T23:27:01.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.413+0000 7f7c977fe640 1 -- 172.21.15.5:0/2438504111 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c90004a00 con 0x7f7ca0101de0 2024-09-11T23:27:01.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.413+0000 7f7ca49cc640 1 -- 172.21.15.5:0/2438504111 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ca01a4f40 con 0x7f7ca0101de0 2024-09-11T23:27:01.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.414+0000 7f7ca49cc640 1 -- 172.21.15.5:0/2438504111 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ca01021c0 con 0x7f7ca0101de0 2024-09-11T23:27:01.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.415+0000 7f7c977fe640 1 -- 172.21.15.5:0/2438504111 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f7c90004ba0 con 0x7f7ca0101de0 2024-09-11T23:27:01.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.416+0000 7f7c977fe640 1 --2- 172.21.15.5:0/2438504111 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f7c8c0a2c00 0x7f7c8c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:01.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.416+0000 7f7c97fff640 1 --2- 172.21.15.5:0/2438504111 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f7c8c0a2c00 0x7f7c8c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:01.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.416+0000 7f7c977fe640 1 -- 172.21.15.5:0/2438504111 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9071+0+0 (secure 0 0 0) 0x7f7c900cf070 con 0x7f7ca0101de0 2024-09-11T23:27:01.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.416+0000 7f7c97fff640 1 --2- 172.21.15.5:0/2438504111 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f7c8c0a2c00 0x7f7c8c0a50c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7c88031440 tx=0x7f7c880095f0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:01.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.420+0000 7f7c977fe640 1 -- 172.21.15.5:0/2438504111 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7c90014030 con 0x7f7ca0101de0 2024-09-11T23:27:01.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.631+0000 7f7ca49cc640 1 -- 172.21.15.5:0/2438504111 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7ca002d7c0 con 0x7f7ca0101de0 2024-09-11T23:27:01.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.632+0000 7f7c977fe640 1 -- 172.21.15.5:0/2438504111 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11845 (secure 0 0 0) 0x7f7c9009bc90 con 0x7f7ca0101de0 2024-09-11T23:27:01.632 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:27:01.632 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":17,"btime":"2024-09-11T23:26:55:058773+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3865435482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3865435482},{"type":"v1","addr":"172.21.15.5:6835","nonce":3865435482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1323314897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":1323314897},{"type":"v1","addr":"172.21.15.5:6837","nonce":1323314897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14610,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6839/4140073288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":4140073288},{"type":"v1","addr":"172.21.15.5:6839","nonce":4140073288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6841/1162578713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":1162578713},{"type":"v1","addr":"172.21.15.5:6841","nonce":1162578713}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3113658116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3113658116},{"type":"v1","addr":"172.21.15.172:6833","nonce":3113658116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3887336060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3887336060},{"type":"v1","addr":"172.21.15.159:6833","nonce":3887336060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2539263301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2539263301},{"type":"v1","addr":"172.21.15.159:6835","nonce":2539263301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/4240913699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":4240913699},{"type":"v1","addr":"172.21.15.172:6835","nonce":4240913699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24460,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4200951601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":4200951601},{"type":"v1","addr":"172.21.15.172:6837","nonce":4200951601}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/4020181017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":4020181017},{"type":"v1","addr":"172.21.15.159:6837","nonce":4020181017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24475,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6839/3928313314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3928313314},{"type":"v1","addr":"172.21.15.172:6839","nonce":3928313314}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:26:45.305894+0000","modified":"2024-09-11T23:26:54.807420+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24494},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.159:6839/3843336290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3843336290},{"type":"v1","addr":"172.21.15.159:6839","nonce":3843336290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24494,"qdb_cluster":[24494]},"id":1}]} 2024-09-11T23:27:01.632 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 17 2024-09-11T23:27:01.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.634+0000 7f7ca49cc640 1 -- 172.21.15.5:0/2438504111 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f7c8c0a2c00 msgr2=0x7f7c8c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:01.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.634+0000 7f7ca49cc640 1 --2- 172.21.15.5:0/2438504111 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f7c8c0a2c00 0x7f7c8c0a50c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7c88031440 tx=0x7f7c880095f0 comp rx=0 tx=0).stop 2024-09-11T23:27:01.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.634+0000 7f7ca49cc640 1 -- 172.21.15.5:0/2438504111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ca0101de0 msgr2=0x7f7ca01983c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:01.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.634+0000 7f7ca49cc640 1 --2- 172.21.15.5:0/2438504111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ca0101de0 0x7f7ca01983c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000c890 tx=0x7f7c9000cd50 comp rx=0 tx=0).stop 2024-09-11T23:27:01.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.634+0000 7f7ca49cc640 1 -- 172.21.15.5:0/2438504111 shutdown_connections 2024-09-11T23:27:01.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.634+0000 7f7ca49cc640 1 --2- 172.21.15.5:0/2438504111 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f7c8c0a2c00 0x7f7c8c0a50c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:01.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.634+0000 7f7ca49cc640 1 --2- 172.21.15.5:0/2438504111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ca0106f10 0x7f7ca019cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:01.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.634+0000 7f7ca49cc640 1 --2- 172.21.15.5:0/2438504111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ca0102790 0x7f7ca0198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:01.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.634+0000 7f7ca49cc640 1 --2- 172.21.15.5:0/2438504111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ca0101de0 0x7f7ca01983c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:01.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.634+0000 7f7ca49cc640 1 -- 172.21.15.5:0/2438504111 >> 172.21.15.5:0/2438504111 conn(0x7f7ca00fd8c0 msgr2=0x7f7ca00fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:01.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.634+0000 7f7ca49cc640 1 -- 172.21.15.5:0/2438504111 shutdown_connections 2024-09-11T23:27:01.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:01.634+0000 7f7ca49cc640 1 -- 172.21.15.5:0/2438504111 wait complete. 2024-09-11T23:27:02.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:02 smithi005 ceph-mon[31201]: pgmap v291: 129 pgs: 129 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-11T23:27:02.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:02 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/2438504111' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:27:02.347 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T23:27:02.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:02 smithi159 ceph-mon[34394]: pgmap v291: 129 pgs: 129 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-11T23:27:02.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:02 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/2438504111' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:27:02.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:02 smithi172 ceph-mon[34855]: pgmap v291: 129 pgs: 129 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-11T23:27:02.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:02 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/2438504111' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:27:02.604 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:27:03.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.097+0000 7f3fbb8ba640 1 -- 172.21.15.5:0/101949352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fb41008c0 msgr2=0x7f3fb4100ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:03.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.097+0000 7f3fbb8ba640 1 --2- 172.21.15.5:0/101949352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fb41008c0 0x7f3fb4100ca0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3fac009900 tx=0x7f3fac02a410 comp rx=0 tx=0).stop 2024-09-11T23:27:03.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.097+0000 7f3fbb8ba640 1 -- 172.21.15.5:0/101949352 shutdown_connections 2024-09-11T23:27:03.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.097+0000 7f3fbb8ba640 1 --2- 172.21.15.5:0/101949352 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fb4105ec0 0x7f3fb4106340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:03.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.097+0000 7f3fbb8ba640 1 --2- 172.21.15.5:0/101949352 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fb41011e0 0x7f3fb4105980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:03.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.097+0000 7f3fbb8ba640 1 --2- 172.21.15.5:0/101949352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fb41008c0 0x7f3fb4100ca0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:03.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.097+0000 7f3fbb8ba640 1 -- 172.21.15.5:0/101949352 >> 172.21.15.5:0/101949352 conn(0x7f3fb40fc7d0 msgr2=0x7f3fb40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:03.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.097+0000 7f3fbb8ba640 1 -- 172.21.15.5:0/101949352 shutdown_connections 2024-09-11T23:27:03.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.097+0000 7f3fbb8ba640 1 -- 172.21.15.5:0/101949352 wait complete. 2024-09-11T23:27:03.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.098+0000 7f3fbb8ba640 1 Processor -- start 2024-09-11T23:27:03.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.098+0000 7f3fbb8ba640 1 -- start start 2024-09-11T23:27:03.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.098+0000 7f3fbb8ba640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fb41008c0 0x7f3fb41a4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:03.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.098+0000 7f3fbb8ba640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fb41011e0 0x7f3fb41a4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:03.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.098+0000 7f3fbb8ba640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fb4105ec0 0x7f3fb419e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:03.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.098+0000 7f3fbb8ba640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb41184c0 con 0x7f3fb4105ec0 2024-09-11T23:27:03.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.098+0000 7f3fbb8ba640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb4118340 con 0x7f3fb41011e0 2024-09-11T23:27:03.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.098+0000 7f3fbb8ba640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb4118640 con 0x7f3fb41008c0 2024-09-11T23:27:03.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.098+0000 7f3fb9e57640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fb4105ec0 0x7f3fb419e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:03.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.098+0000 7f3fb9e57640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fb4105ec0 0x7f3fb419e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36828/0 (socket says 172.21.15.5:36828) 2024-09-11T23:27:03.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.098+0000 7f3fb9e57640 1 -- 172.21.15.5:0/2550154546 learned_addr learned my addr 172.21.15.5:0/2550154546 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:27:03.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.098+0000 7f3fb8e55640 1 --2- 172.21.15.5:0/2550154546 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fb41011e0 0x7f3fb41a4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:03.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.098+0000 7f3fb9656640 1 --2- 172.21.15.5:0/2550154546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fb41008c0 0x7f3fb41a4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:03.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.098+0000 7f3fb9e57640 1 -- 172.21.15.5:0/2550154546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fb41008c0 msgr2=0x7f3fb41a4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:03.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.098+0000 7f3fb9e57640 1 --2- 172.21.15.5:0/2550154546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fb41008c0 0x7f3fb41a4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:03.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.098+0000 7f3fb9e57640 1 -- 172.21.15.5:0/2550154546 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fb41011e0 msgr2=0x7f3fb41a4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:03.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.098+0000 7f3fb9e57640 1 --2- 172.21.15.5:0/2550154546 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fb41011e0 0x7f3fb41a4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:03.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.098+0000 7f3fb9e57640 1 -- 172.21.15.5:0/2550154546 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fb419f080 con 0x7f3fb4105ec0 2024-09-11T23:27:03.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.099+0000 7f3fb9e57640 1 --2- 172.21.15.5:0/2550154546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fb4105ec0 0x7f3fb419e950 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3fa400cad0 tx=0x7f3fa400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:03.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.099+0000 7f3fb27fc640 1 -- 172.21.15.5:0/2550154546 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa400ae20 con 0x7f3fb4105ec0 2024-09-11T23:27:03.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.099+0000 7f3fbb8ba640 1 -- 172.21.15.5:0/2550154546 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fb419f370 con 0x7f3fb4105ec0 2024-09-11T23:27:03.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.099+0000 7f3fb27fc640 1 -- 172.21.15.5:0/2550154546 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3fa4005020 con 0x7f3fb4105ec0 2024-09-11T23:27:03.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.099+0000 7f3fb27fc640 1 -- 172.21.15.5:0/2550154546 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa400f6b0 con 0x7f3fb4105ec0 2024-09-11T23:27:03.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.099+0000 7f3fbb8ba640 1 -- 172.21.15.5:0/2550154546 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fb41ab660 con 0x7f3fb4105ec0 2024-09-11T23:27:03.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.100+0000 7f3fbb8ba640 1 -- 172.21.15.5:0/2550154546 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fb406a850 con 0x7f3fb4105ec0 2024-09-11T23:27:03.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.101+0000 7f3fb27fc640 1 -- 172.21.15.5:0/2550154546 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f3fa40051d0 con 0x7f3fb4105ec0 2024-09-11T23:27:03.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.102+0000 7f3fb27fc640 1 --2- 172.21.15.5:0/2550154546 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f3f9c0a2b80 0x7f3f9c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:03.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.102+0000 7f3fb9656640 1 --2- 172.21.15.5:0/2550154546 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f3f9c0a2b80 0x7f3f9c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:03.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.102+0000 7f3fb27fc640 1 -- 172.21.15.5:0/2550154546 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9071+0+0 (secure 0 0 0) 0x7f3fa40cf7b0 con 0x7f3fb4105ec0 2024-09-11T23:27:03.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.102+0000 7f3fb9656640 1 --2- 172.21.15.5:0/2550154546 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f3f9c0a2b80 0x7f3f9c0a5040 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3fac000c00 tx=0x7f3fac005a20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:03.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.105+0000 7f3fb27fc640 1 -- 172.21.15.5:0/2550154546 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3fa4014030 con 0x7f3fb4105ec0 2024-09-11T23:27:03.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.284+0000 7f3fbb8ba640 1 -- 172.21.15.5:0/2550154546 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3fb4105980 con 0x7f3fb4105ec0 2024-09-11T23:27:03.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.286+0000 7f3fb27fc640 1 -- 172.21.15.5:0/2550154546 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24655 (secure 0 0 0) 0x7f3fb4105980 con 0x7f3fb4105ec0 2024-09-11T23:27:03.286 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:27:03.286 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":86,"fsid":"1f5284d2-7094-11ef-bcea-c7b262605968","created":"2024-09-11T23:19:00.051813+0000","modified":"2024-09-11T23:26:54.807250+0000","last_up_change":"2024-09-11T23:25:53.433445+0000","last_in_change":"2024-09-11T23:25:29.443287+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:22:04.534014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:26:41.220887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:26:43.664094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T23:26:50.471521+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bf95ced0-780b-482f-87da-0b5e61de62ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6803","nonce":624761084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6805","nonce":624761084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6809","nonce":624761084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6807","nonce":624761084}]},"public_addr":"172.21.15.5:6803/624761084","cluster_addr":"172.21.15.5:6805/624761084","heartbeat_back_addr":"172.21.15.5:6809/624761084","heartbeat_front_addr":"172.21.15.5:6807/624761084","state":["exists","up"]},{"osd":1,"uuid":"d926484f-78a6-497b-843d-f2db54ade4a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6801","nonce":2111290186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6803","nonce":2111290186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6807","nonce":2111290186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6805","nonce":2111290186}]},"public_addr":"172.21.15.159:6801/2111290186","cluster_addr":"172.21.15.159:6803/2111290186","heartbeat_back_addr":"172.21.15.159:6807/2111290186","heartbeat_front_addr":"172.21.15.159:6805/2111290186","state":["exists","up"]},{"osd":2,"uuid":"d92cd431-0ba7-4171-82b8-60fa3d63a64b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6801","nonce":299915717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6803","nonce":299915717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6807","nonce":299915717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6805","nonce":299915717}]},"public_addr":"172.21.15.172:6801/299915717","cluster_addr":"172.21.15.172:6803/299915717","heartbeat_back_addr":"172.21.15.172:6807/299915717","heartbeat_front_addr":"172.21.15.172:6805/299915717","state":["exists","up"]},{"osd":3,"uuid":"0521043b-559c-4671-b11e-9117871cff49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6811","nonce":2080498921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6813","nonce":2080498921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6817","nonce":2080498921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6815","nonce":2080498921}]},"public_addr":"172.21.15.5:6811/2080498921","cluster_addr":"172.21.15.5:6813/2080498921","heartbeat_back_addr":"172.21.15.5:6817/2080498921","heartbeat_front_addr":"172.21.15.5:6815/2080498921","state":["exists","up"]},{"osd":4,"uuid":"b968d762-a46e-4ae2-b19d-8225f82de613","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6809","nonce":4185908786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6811","nonce":4185908786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6815","nonce":4185908786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6813","nonce":4185908786}]},"public_addr":"172.21.15.159:6809/4185908786","cluster_addr":"172.21.15.159:6811/4185908786","heartbeat_back_addr":"172.21.15.159:6815/4185908786","heartbeat_front_addr":"172.21.15.159:6813/4185908786","state":["exists","up"]},{"osd":5,"uuid":"1b0a518a-3d17-4635-81da-52f9ef83a574","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6809","nonce":3742759000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6811","nonce":3742759000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6815","nonce":3742759000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6813","nonce":3742759000}]},"public_addr":"172.21.15.172:6809/3742759000","cluster_addr":"172.21.15.172:6811/3742759000","heartbeat_back_addr":"172.21.15.172:6815/3742759000","heartbeat_front_addr":"172.21.15.172:6813/3742759000","state":["exists","up"]},{"osd":6,"uuid":"c3a2db6c-9189-4e42-aa1e-52189a9c4291","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6819","nonce":4156823423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6821","nonce":4156823423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6825","nonce":4156823423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6823","nonce":4156823423}]},"public_addr":"172.21.15.5:6819/4156823423","cluster_addr":"172.21.15.5:6821/4156823423","heartbeat_back_addr":"172.21.15.5:6825/4156823423","heartbeat_front_addr":"172.21.15.5:6823/4156823423","state":["exists","up"]},{"osd":7,"uuid":"dfaadf28-74ab-4cda-8647-dcb58beb7cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6817","nonce":4222571927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6819","nonce":4222571927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6823","nonce":4222571927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6821","nonce":4222571927}]},"public_addr":"172.21.15.159:6817/4222571927","cluster_addr":"172.21.15.159:6819/4222571927","heartbeat_back_addr":"172.21.15.159:6823/4222571927","heartbeat_front_addr":"172.21.15.159:6821/4222571927","state":["exists","up"]},{"osd":8,"uuid":"47f66651-614c-4613-9793-69c140dbf705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6817","nonce":3661505951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6819","nonce":3661505951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6823","nonce":3661505951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6821","nonce":3661505951}]},"public_addr":"172.21.15.172:6817/3661505951","cluster_addr":"172.21.15.172:6819/3661505951","heartbeat_back_addr":"172.21.15.172:6823/3661505951","heartbeat_front_addr":"172.21.15.172:6821/3661505951","state":["exists","up"]},{"osd":9,"uuid":"c97b8221-8cf9-4fab-9e27-ff7f3bd98152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6827","nonce":72036667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6829","nonce":72036667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6833","nonce":72036667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6831","nonce":72036667}]},"public_addr":"172.21.15.5:6827/72036667","cluster_addr":"172.21.15.5:6829/72036667","heartbeat_back_addr":"172.21.15.5:6833/72036667","heartbeat_front_addr":"172.21.15.5:6831/72036667","state":["exists","up"]},{"osd":10,"uuid":"143376c1-f3f1-4df4-bcd3-a9b46fad8c1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6825","nonce":3334483164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6827","nonce":3334483164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6831","nonce":3334483164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6829","nonce":3334483164}]},"public_addr":"172.21.15.159:6825/3334483164","cluster_addr":"172.21.15.159:6827/3334483164","heartbeat_back_addr":"172.21.15.159:6831/3334483164","heartbeat_front_addr":"172.21.15.159:6829/3334483164","state":["exists","up"]},{"osd":11,"uuid":"5cc91ff9-fc0f-4e7a-8e4d-87df0e7efbeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6825","nonce":1965415663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6827","nonce":1965415663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6831","nonce":1965415663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6829","nonce":1965415663}]},"public_addr":"172.21.15.172:6825/1965415663","cluster_addr":"172.21.15.172:6827/1965415663","heartbeat_back_addr":"172.21.15.172:6831/1965415663","heartbeat_front_addr":"172.21.15.172:6829/1965415663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:21:13.024707+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:21:38.063741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:22:02.221583+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:22:27.919711+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:22:53.870543+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:23:18.539905+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:23:43.694229+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:24:08.984704+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:24:34.378582+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:25:00.102231+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:25:25.367178+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:25:51.439033+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/2713701762":"2024-09-12T23:19:50.031855+0000","172.21.15.5:0/3135835713":"2024-09-12T23:19:50.031855+0000","172.21.15.5:0/3935034940":"2024-09-12T23:19:50.031855+0000","172.21.15.5:6801/1790126649":"2024-09-12T23:19:50.031855+0000","172.21.15.5:6801/1358356358":"2024-09-12T23:19:26.149011+0000","172.21.15.5:6800/1790126649":"2024-09-12T23:19:50.031855+0000","172.21.15.5:6800/1358356358":"2024-09-12T23:19:26.149011+0000","172.21.15.5:0/2243688290":"2024-09-12T23:19:26.149011+0000","172.21.15.5:0/1493331899":"2024-09-12T23:19:26.149011+0000","172.21.15.5:0/2329812802":"2024-09-12T23:19:26.149011+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:27:03.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.288+0000 7f3fbb8ba640 1 -- 172.21.15.5:0/2550154546 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f3f9c0a2b80 msgr2=0x7f3f9c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:03.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.288+0000 7f3fbb8ba640 1 --2- 172.21.15.5:0/2550154546 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f3f9c0a2b80 0x7f3f9c0a5040 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3fac000c00 tx=0x7f3fac005a20 comp rx=0 tx=0).stop 2024-09-11T23:27:03.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.288+0000 7f3fbb8ba640 1 -- 172.21.15.5:0/2550154546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fb4105ec0 msgr2=0x7f3fb419e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:03.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.288+0000 7f3fbb8ba640 1 --2- 172.21.15.5:0/2550154546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fb4105ec0 0x7f3fb419e950 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3fa400cad0 tx=0x7f3fa400cf90 comp rx=0 tx=0).stop 2024-09-11T23:27:03.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.288+0000 7f3fbb8ba640 1 -- 172.21.15.5:0/2550154546 shutdown_connections 2024-09-11T23:27:03.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.288+0000 7f3fbb8ba640 1 --2- 172.21.15.5:0/2550154546 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f3f9c0a2b80 0x7f3f9c0a5040 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:03.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.288+0000 7f3fbb8ba640 1 --2- 172.21.15.5:0/2550154546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fb4105ec0 0x7f3fb419e950 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:03.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.288+0000 7f3fbb8ba640 1 --2- 172.21.15.5:0/2550154546 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fb41011e0 0x7f3fb41a4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:03.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.288+0000 7f3fbb8ba640 1 --2- 172.21.15.5:0/2550154546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fb41008c0 0x7f3fb41a4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:03.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.288+0000 7f3fbb8ba640 1 -- 172.21.15.5:0/2550154546 >> 172.21.15.5:0/2550154546 conn(0x7f3fb40fc7d0 msgr2=0x7f3fb40fda40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:03.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.288+0000 7f3fbb8ba640 1 -- 172.21.15.5:0/2550154546 shutdown_connections 2024-09-11T23:27:03.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:03.288+0000 7f3fbb8ba640 1 -- 172.21.15.5:0/2550154546 wait complete. 2024-09-11T23:27:03.949 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T23:26:45.305894+0000', 'modified': '2024-09-11T23:26:54.807420+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24494}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24494': {'gid': 24494, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.159:6839/3843336290', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.159:6838', 'nonce': 3843336290}, {'type': 'v1', 'addr': '172.21.15.159:6839', 'nonce': 3843336290}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24494, 'qdb_cluster': [24494]} 2024-09-11T23:27:03.949 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T23:27:03.949 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-11T23:27:04.207 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:27:04.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:04 smithi005 ceph-mon[31201]: pgmap v292: 129 pgs: 129 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-09-11T23:27:04.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:04 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/2550154546' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:27:04.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:04 smithi159 ceph-mon[34394]: pgmap v292: 129 pgs: 129 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-09-11T23:27:04.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:04 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/2550154546' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:27:04.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:04 smithi172 ceph-mon[34855]: pgmap v292: 129 pgs: 129 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-09-11T23:27:04.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:04 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/2550154546' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:27:04.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.680+0000 7f4e58c94640 1 -- 172.21.15.5:0/3615229882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e54106a60 msgr2=0x7f4e54106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:04.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.680+0000 7f4e58c94640 1 --2- 172.21.15.5:0/3615229882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e54106a60 0x7f4e54106e40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4e44009930 tx=0x7f4e4402a420 comp rx=0 tx=0).stop 2024-09-11T23:27:04.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.680+0000 7f4e58c94640 1 -- 172.21.15.5:0/3615229882 shutdown_connections 2024-09-11T23:27:04.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.680+0000 7f4e58c94640 1 --2- 172.21.15.5:0/3615229882 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e54101400 0x7f4e5410d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:04.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.680+0000 7f4e58c94640 1 --2- 172.21.15.5:0/3615229882 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e54100a60 0x7f4e54100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:04.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.680+0000 7f4e58c94640 1 --2- 172.21.15.5:0/3615229882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e54106a60 0x7f4e54106e40 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:04.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.680+0000 7f4e58c94640 1 -- 172.21.15.5:0/3615229882 >> 172.21.15.5:0/3615229882 conn(0x7f4e540fc780 msgr2=0x7f4e540feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:04.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.680+0000 7f4e58c94640 1 -- 172.21.15.5:0/3615229882 shutdown_connections 2024-09-11T23:27:04.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.680+0000 7f4e58c94640 1 -- 172.21.15.5:0/3615229882 wait complete. 2024-09-11T23:27:04.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.680+0000 7f4e58c94640 1 Processor -- start 2024-09-11T23:27:04.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.681+0000 7f4e58c94640 1 -- start start 2024-09-11T23:27:04.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.681+0000 7f4e58c94640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e54100a60 0x7f4e541991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:04.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.681+0000 7f4e58c94640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e54101400 0x7f4e54199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:04.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.681+0000 7f4e58c94640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e54106a60 0x7f4e541a4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:04.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.681+0000 7f4e58c94640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4e54110d10 con 0x7f4e54106a60 2024-09-11T23:27:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.681+0000 7f4e58c94640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f4e54110b90 con 0x7f4e54101400 2024-09-11T23:27:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.681+0000 7f4e58c94640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4e54110e90 con 0x7f4e54100a60 2024-09-11T23:27:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.681+0000 7f4e52d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e54106a60 0x7f4e541a4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.681+0000 7f4e5259c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e54100a60 0x7f4e541991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.681+0000 7f4e5259c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e54100a60 0x7f4e541991e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.5:51844/0 (socket says 172.21.15.5:51844) 2024-09-11T23:27:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.681+0000 7f4e5259c640 1 -- 172.21.15.5:0/2645147384 learned_addr learned my addr 172.21.15.5:0/2645147384 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:27:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.681+0000 7f4e51d9b640 1 --2- 172.21.15.5:0/2645147384 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e54101400 0x7f4e54199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.681+0000 7f4e52d9d640 1 -- 172.21.15.5:0/2645147384 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e54100a60 msgr2=0x7f4e541991e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.681+0000 7f4e52d9d640 1 --2- 172.21.15.5:0/2645147384 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e54100a60 0x7f4e541991e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.681+0000 7f4e52d9d640 1 -- 172.21.15.5:0/2645147384 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e54101400 msgr2=0x7f4e54199720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.681+0000 7f4e52d9d640 1 --2- 172.21.15.5:0/2645147384 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e54101400 0x7f4e54199720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.681+0000 7f4e52d9d640 1 -- 172.21.15.5:0/2645147384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e541a47a0 con 0x7f4e54106a60 2024-09-11T23:27:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.681+0000 7f4e52d9d640 1 --2- 172.21.15.5:0/2645147384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e54106a60 0x7f4e541a4260 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c00cab0 tx=0x7f4e4c00cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.682+0000 7f4e437fe640 1 -- 172.21.15.5:0/2645147384 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c00ae20 con 0x7f4e54106a60 2024-09-11T23:27:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.682+0000 7f4e437fe640 1 -- 172.21.15.5:0/2645147384 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4e4c00f900 con 0x7f4e54106a60 2024-09-11T23:27:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.682+0000 7f4e58c94640 1 -- 172.21.15.5:0/2645147384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e541a4970 con 0x7f4e54106a60 2024-09-11T23:27:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.682+0000 7f4e437fe640 1 -- 172.21.15.5:0/2645147384 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c018a00 con 0x7f4e54106a60 2024-09-11T23:27:04.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.682+0000 7f4e58c94640 1 -- 172.21.15.5:0/2645147384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e541a4e80 con 0x7f4e54106a60 2024-09-11T23:27:04.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.684+0000 7f4e437fe640 1 -- 172.21.15.5:0/2645147384 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f4e4c00fab0 con 0x7f4e54106a60 2024-09-11T23:27:04.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.684+0000 7f4e5b06d740 1 Processor -- start 2024-09-11T23:27:04.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.684+0000 7f4e5b06d740 1 -- start start 2024-09-11T23:27:04.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.685+0000 7f4e5b06d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5636f96729d0 0x5636f9672db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:04.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.685+0000 7f4e5b06d740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5636f96732f0 0x5636f967d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:04.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.685+0000 7f4e5b06d740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5636f967dbb0 0x5636f967ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:04.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.685+0000 7f4e5b06d740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5636f95d9090 con 0x5636f96732f0 2024-09-11T23:27:04.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.685+0000 7f4e5b06d740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5636f9580a70 con 0x5636f967dbb0 2024-09-11T23:27:04.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.685+0000 7f4e5b06d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5636f95d5050 con 0x5636f96729d0 2024-09-11T23:27:04.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.685+0000 7f4e5259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5636f96732f0 0x5636f967d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:04.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.685+0000 7f4e51d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5636f96729d0 0x5636f9672db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:04.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.685+0000 7f4e5259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5636f96732f0 0x5636f967d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56678/0 (socket says 172.21.15.5:56678) 2024-09-11T23:27:04.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.685+0000 7f4e5259c640 1 -- 172.21.15.5:0/632863187 learned_addr learned my addr 172.21.15.5:0/632863187 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:27:04.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.685+0000 7f4e437fe640 1 --2- 172.21.15.5:0/2645147384 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f4e3c0a2c00 0x7f4e3c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:04.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.685+0000 7f4e51d9b640 1 --2- 172.21.15.5:0/632863187 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5636f967dbb0 0x5636f967ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:04.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.685+0000 7f4e52d9d640 1 --2- 172.21.15.5:0/2645147384 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f4e3c0a2c00 0x7f4e3c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:04.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.685+0000 7f4e5259c640 1 -- 172.21.15.5:0/632863187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5636f96729d0 msgr2=0x5636f9672db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:27:04.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.685+0000 7f4e5259c640 1 --2- 172.21.15.5:0/632863187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5636f96729d0 0x5636f9672db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:04.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.685+0000 7f4e5259c640 1 -- 172.21.15.5:0/632863187 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5636f967dbb0 msgr2=0x5636f967ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:27:04.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.685+0000 7f4e5259c640 1 --2- 172.21.15.5:0/632863187 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5636f967dbb0 0x5636f967ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:04.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.685+0000 7f4e5259c640 1 -- 172.21.15.5:0/632863187 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636f958d130 con 0x5636f96732f0 2024-09-11T23:27:04.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.685+0000 7f4e51d9b640 1 --2- 172.21.15.5:0/632863187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5636f96729d0 0x5636f9672db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:27:04.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.685+0000 7f4e437fe640 1 -- 172.21.15.5:0/2645147384 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9071+0+0 (secure 0 0 0) 0x7f4e4c0cfa50 con 0x7f4e54106a60 2024-09-11T23:27:04.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.685+0000 7f4e5259c640 1 --2- 172.21.15.5:0/632863187 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5636f96732f0 0x5636f967d670 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4e44009230 tx=0x7f4e44031cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68f9b4d09fb6a9b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:04.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.686+0000 7f4e52d9d640 1 --2- 172.21.15.5:0/2645147384 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f4e3c0a2c00 0x7f4e3c0a50c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c09bc70 tx=0x7f4e4c066b40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:04.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.686+0000 7f4e40ff9640 1 -- 172.21.15.5:0/632863187 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e44040070 con 0x5636f96732f0 2024-09-11T23:27:04.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.686+0000 7f4e40ff9640 1 -- 172.21.15.5:0/632863187 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4e440316a0 con 0x5636f96732f0 2024-09-11T23:27:04.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.686+0000 7f4e40ff9640 1 -- 172.21.15.5:0/632863187 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e44035040 con 0x5636f96732f0 2024-09-11T23:27:04.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.686+0000 7f4e5b06d740 1 -- 172.21.15.5:0/632863187 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5636f96732f0 msgr2=0x5636f967d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:04.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.686+0000 7f4e5b06d740 1 --2- 172.21.15.5:0/632863187 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5636f96732f0 0x5636f967d670 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4e44009230 tx=0x7f4e44031cb0 comp rx=0 tx=0).stop 2024-09-11T23:27:04.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.686+0000 7f4e5b06d740 1 -- 172.21.15.5:0/632863187 shutdown_connections 2024-09-11T23:27:04.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.686+0000 7f4e5b06d740 1 --2- 172.21.15.5:0/632863187 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5636f967dbb0 0x5636f967ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:04.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.686+0000 7f4e5b06d740 1 --2- 172.21.15.5:0/632863187 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5636f96732f0 0x5636f967d670 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:04.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.686+0000 7f4e5b06d740 1 --2- 172.21.15.5:0/632863187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5636f96729d0 0x5636f9672db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:04.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.686+0000 7f4e5b06d740 1 -- 172.21.15.5:0/632863187 >> 172.21.15.5:0/632863187 conn(0x5636f966ef60 msgr2=0x5636f966f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:04.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.687+0000 7f4e5b06d740 1 -- 172.21.15.5:0/632863187 shutdown_connections 2024-09-11T23:27:04.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.687+0000 7f4e5b06d740 1 -- 172.21.15.5:0/632863187 wait complete. 2024-09-11T23:27:04.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.687+0000 7f4e5b06d740 1 -- start start 2024-09-11T23:27:04.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.687+0000 7f4e5b06d740 1 Processor -- start 2024-09-11T23:27:04.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.687+0000 7f4e5b06d740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5636f96729d0 0x5636f967d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:04.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.687+0000 7f4e5b06d740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5636f96732f0 0x5636f967a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:04.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.687+0000 7f4e5b06d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5636f967dbb0 0x5636f967ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:04.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.687+0000 7f4e5b06d740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5636f9680780 con 0x5636f96729d0 2024-09-11T23:27:04.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.687+0000 7f4e5b06d740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5636f9593f20 con 0x5636f96732f0 2024-09-11T23:27:04.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.687+0000 7f4e5b06d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5636f9680900 con 0x5636f967dbb0 2024-09-11T23:27:04.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.687+0000 7f4e5b06d740 10 client.0 _ll_register_callbacks cb 0x5636f955d030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:27:04.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.687+0000 7f4e51d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5636f96729d0 0x5636f967d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:04.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.687+0000 7f4e51d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5636f96729d0 0x5636f967d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56682/0 (socket says 172.21.15.5:56682) 2024-09-11T23:27:04.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.687+0000 7f4e51d9b640 1 -- 172.21.15.5:0/3832997683 learned_addr learned my addr 172.21.15.5:0/3832997683 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:27:04.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.687+0000 7f4e51d9b640 1 --2- 172.21.15.5:0/3832997683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5636f967dbb0 0x5636f967ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:04.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.688+0000 7f4e5259c640 1 --2- 172.21.15.5:0/3832997683 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5636f96732f0 0x5636f967a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:04.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.688+0000 7f4e51d9b640 1 -- 172.21.15.5:0/3832997683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5636f967dbb0 msgr2=0x5636f967ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:27:04.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.688+0000 7f4e51d9b640 1 --2- 172.21.15.5:0/3832997683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5636f967dbb0 0x5636f967ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:04.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.688+0000 7f4e51d9b640 1 -- 172.21.15.5:0/3832997683 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5636f96732f0 msgr2=0x5636f967a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:27:04.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.688+0000 7f4e51d9b640 1 --2- 172.21.15.5:0/3832997683 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5636f96732f0 0x5636f967a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:04.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.688+0000 7f4e51d9b640 1 -- 172.21.15.5:0/3832997683 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636f934a2b0 con 0x5636f96729d0 2024-09-11T23:27:04.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.688+0000 7f4e5259c640 1 --2- 172.21.15.5:0/3832997683 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5636f96732f0 0x5636f967a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:27:04.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.688+0000 7f4e51d9b640 1 --2- 172.21.15.5:0/3832997683 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5636f96729d0 0x5636f967d300 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4e4800c780 tx=0x7f4e480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6fc5c54a83485a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:04.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.688+0000 7f4e39ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-11T23:27:04.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.688+0000 7f4e39ffb640 1 -- 172.21.15.5:0/3832997683 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e48011e50 con 0x5636f96729d0 2024-09-11T23:27:04.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.688+0000 7f4e39ffb640 1 -- 172.21.15.5:0/3832997683 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9071+0+0 (secure 0 0 0) 0x7f4e48014110 con 0x5636f96729d0 2024-09-11T23:27:04.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.688+0000 7f4e5b06d740 1 -- 172.21.15.5:0/3832997683 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e440316a0 con 0x5636f96729d0 2024-09-11T23:27:04.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.688+0000 7f4e39ffb640 1 -- 172.21.15.5:0/3832997683 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f4e48028050 con 0x5636f96729d0 2024-09-11T23:27:04.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.688+0000 7f4e5b06d740 10 client.14727 fetch_fsmap learned FSMap version 17 2024-09-11T23:27:04.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.688+0000 7f4e5b06d740 1 -- 172.21.15.5:0/3832997683 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x5636f968bfe0 con 0x5636f96729d0 2024-09-11T23:27:04.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.688+0000 7f4e39ffb640 1 -- 172.21.15.5:0/3832997683 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4e440316a0 con 0x5636f96729d0 2024-09-11T23:27:04.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.688+0000 7f4e39ffb640 1 -- 172.21.15.5:0/3832997683 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f4e48020020 con 0x5636f96729d0 2024-09-11T23:27:04.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.689+0000 7f4e5b06d740 10 client.14727 fetch_fsmap finished waiting for FSMap version 17 2024-09-11T23:27:04.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.689+0000 7f4e5b06d740 10 client.14727 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T23:27:04.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.689+0000 7f4e5b06d740 20 client.14727 populate_metadata read hostname 'smithi005' 2024-09-11T23:27:04.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.689+0000 7f4e5b06d740 1 --2- 172.21.15.5:0/3832997683 >> [v2:172.21.15.159:6838/3843336290,v1:172.21.15.159:6839/3843336290] conn(0x5636f968e5b0 0x5636f968fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:04.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.689+0000 7f4e5b06d740 4 client.14727 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:27:04.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.689+0000 7f4e5b06d740 1 -- 172.21.15.5:0/3832997683 --> [v2:172.21.15.159:6838/3843336290,v1:172.21.15.159:6839/3843336290] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5636f95e6600 con 0x5636f968e5b0 2024-09-11T23:27:04.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.689+0000 7f4e5259c640 1 --2- 172.21.15.5:0/3832997683 >> [v2:172.21.15.159:6838/3843336290,v1:172.21.15.159:6839/3843336290] conn(0x5636f968e5b0 0x5636f968fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:04.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.689+0000 7f4e39ffb640 10 client.14727 ms_handle_connect on v2:172.21.15.159:6838/3843336290 2024-09-11T23:27:04.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.689+0000 7f4e5259c640 1 --2- 172.21.15.5:0/3832997683 >> [v2:172.21.15.159:6838/3843336290,v1:172.21.15.159:6839/3843336290] conn(0x5636f968e5b0 0x5636f968fa20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=334ef53a3c508a57 server_cookie=606520e41d11d907 in_seq=0 out_seq=0 2024-09-11T23:27:04.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.690+0000 7f4e39ffb640 1 -- 172.21.15.5:0/3832997683 <== mds.0 v2:172.21.15.159:6838/3843336290 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5636f95e6600 con 0x5636f968e5b0 2024-09-11T23:27:04.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.690+0000 7f4e39ffb640 10 client.14727 handle_command_reply: tid=0 2024-09-11T23:27:04.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.690+0000 7f4e5b06d740 1 client.14727 shutdown 2024-09-11T23:27:04.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.690+0000 7f4e5b06d740 1 -- 172.21.15.5:0/3832997683 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5636f96729d0 msgr2=0x5636f967d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:04.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.690+0000 7f4e5b06d740 1 --2- 172.21.15.5:0/3832997683 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5636f96729d0 0x5636f967d300 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4e4800c780 tx=0x7f4e480046c0 comp rx=0 tx=0).stop 2024-09-11T23:27:04.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.690+0000 7f4e5b06d740 1 -- 172.21.15.5:0/3832997683 shutdown_connections 2024-09-11T23:27:04.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.690+0000 7f4e5b06d740 1 --2- 172.21.15.5:0/3832997683 >> [v2:172.21.15.159:6838/3843336290,v1:172.21.15.159:6839/3843336290] conn(0x5636f968e5b0 0x5636f968fa20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:04.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.690+0000 7f4e5b06d740 1 --2- 172.21.15.5:0/3832997683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5636f967dbb0 0x5636f967ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:04.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.690+0000 7f4e5b06d740 1 --2- 172.21.15.5:0/3832997683 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5636f96732f0 0x5636f967a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:04.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.690+0000 7f4e39ffb640 0 client.14727 ms_handle_reset on v2:172.21.15.159:6838/3843336290 2024-09-11T23:27:04.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.690+0000 7f4e5b06d740 1 --2- 172.21.15.5:0/3832997683 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5636f96729d0 0x5636f967d300 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:04.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.690+0000 7f4e5b06d740 1 -- 172.21.15.5:0/3832997683 >> 172.21.15.5:0/3832997683 conn(0x5636f966ef60 msgr2=0x5636f9674c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:04.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.690+0000 7f4e5b06d740 1 -- 172.21.15.5:0/3832997683 shutdown_connections 2024-09-11T23:27:04.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.690+0000 7f4e5b06d740 1 -- 172.21.15.5:0/3832997683 wait complete. 2024-09-11T23:27:04.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.690+0000 7f4e5b06d740 20 client.14727 trim_cache size 0 max 16384 2024-09-11T23:27:04.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.708+0000 7f4e5b06d740 1 Processor -- start 2024-09-11T23:27:04.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.708+0000 7f4e5b06d740 1 -- start start 2024-09-11T23:27:04.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.708+0000 7f4e5b06d740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5636f96729d0 0x5636f968ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:04.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.708+0000 7f4e5b06d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5636f96732f0 0x5636f9678f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:04.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.708+0000 7f4e5b06d740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5636f967dbb0 0x5636f9679460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:04.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.708+0000 7f4e5b06d740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5636f968dd60 con 0x5636f967dbb0 2024-09-11T23:27:04.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.708+0000 7f4e5b06d740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5636f968e430 con 0x5636f96729d0 2024-09-11T23:27:04.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.708+0000 7f4e5b06d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5636f968eb00 con 0x5636f96732f0 2024-09-11T23:27:04.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.708+0000 7f4e51d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5636f967dbb0 0x5636f9679460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:04.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.708+0000 7f4e51d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5636f967dbb0 0x5636f9679460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56692/0 (socket says 172.21.15.5:56692) 2024-09-11T23:27:04.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.708+0000 7f4e51d9b640 1 -- 172.21.15.5:0/2546805433 learned_addr learned my addr 172.21.15.5:0/2546805433 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:27:04.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.708+0000 7f4e5259c640 1 --2- 172.21.15.5:0/2546805433 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5636f96732f0 0x5636f9678f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:04.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.708+0000 7f4e51d9b640 1 --2- 172.21.15.5:0/2546805433 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5636f96729d0 0x5636f968ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:04.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.709+0000 7f4e51d9b640 1 -- 172.21.15.5:0/2546805433 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5636f96732f0 msgr2=0x5636f9678f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:27:04.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.709+0000 7f4e51d9b640 1 --2- 172.21.15.5:0/2546805433 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5636f96732f0 0x5636f9678f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:04.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.709+0000 7f4e51d9b640 1 -- 172.21.15.5:0/2546805433 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5636f96729d0 msgr2=0x5636f968ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:27:04.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.709+0000 7f4e51d9b640 1 --2- 172.21.15.5:0/2546805433 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5636f96729d0 0x5636f968ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:04.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.709+0000 7f4e51d9b640 1 -- 172.21.15.5:0/2546805433 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636f966ed90 con 0x5636f967dbb0 2024-09-11T23:27:04.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.709+0000 7f4e51d9b640 1 --2- 172.21.15.5:0/2546805433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5636f967dbb0 0x5636f9679460 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4e48017040 tx=0x7f4e48005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=531d25c9f0c4a63e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:04.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.709+0000 7f4e3bfff640 1 -- 172.21.15.5:0/2546805433 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e48011e50 con 0x5636f967dbb0 2024-09-11T23:27:04.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.709+0000 7f4e3bfff640 1 -- 172.21.15.5:0/2546805433 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4e4800c3b0 con 0x5636f967dbb0 2024-09-11T23:27:04.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.709+0000 7f4e3bfff640 1 -- 172.21.15.5:0/2546805433 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e48003d40 con 0x5636f967dbb0 2024-09-11T23:27:04.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.710+0000 7f4e5b06d740 1 -- 172.21.15.5:0/2546805433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5636f967dbb0 msgr2=0x5636f9679460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:04.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.710+0000 7f4e5b06d740 1 --2- 172.21.15.5:0/2546805433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5636f967dbb0 0x5636f9679460 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4e48017040 tx=0x7f4e48005740 comp rx=0 tx=0).stop 2024-09-11T23:27:04.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.710+0000 7f4e5b06d740 1 -- 172.21.15.5:0/2546805433 shutdown_connections 2024-09-11T23:27:04.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.710+0000 7f4e5b06d740 1 --2- 172.21.15.5:0/2546805433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5636f967dbb0 0x5636f9679460 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:04.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.710+0000 7f4e5b06d740 1 --2- 172.21.15.5:0/2546805433 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5636f96732f0 0x5636f9678f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:04.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.710+0000 7f4e5b06d740 1 --2- 172.21.15.5:0/2546805433 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5636f96729d0 0x5636f968ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:04.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.710+0000 7f4e5b06d740 1 -- 172.21.15.5:0/2546805433 >> 172.21.15.5:0/2546805433 conn(0x5636f966ef60 msgr2=0x5636f967a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:04.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.710+0000 7f4e5b06d740 1 -- 172.21.15.5:0/2546805433 shutdown_connections 2024-09-11T23:27:04.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.710+0000 7f4e5b06d740 1 -- 172.21.15.5:0/2546805433 wait complete. 2024-09-11T23:27:04.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.710+0000 7f4e5b06d740 1 -- start start 2024-09-11T23:27:04.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.710+0000 7f4e5b06d740 1 Processor -- start 2024-09-11T23:27:04.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.711+0000 7f4e5b06d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5636f96729d0 0x5636f96985b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:04.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.711+0000 7f4e5b06d740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5636f96732f0 0x5636f9675090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:04.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.711+0000 7f4e5b06d740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5636f967dbb0 0x5636f96757d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:04.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.711+0000 7f4e5b06d740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5636f968f8a0 con 0x5636f967dbb0 2024-09-11T23:27:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.711+0000 7f4e5b06d740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5636f968f1d0 con 0x5636f96732f0 2024-09-11T23:27:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.711+0000 7f4e5b06d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5636f968ff70 con 0x5636f96729d0 2024-09-11T23:27:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.711+0000 7f4e5b06d740 10 client.0 _ll_register_callbacks cb 0x7f4e4800cd50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:27:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.711+0000 7f4e51d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5636f96729d0 0x5636f96985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.711+0000 7f4e51d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5636f967dbb0 0x5636f96757d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.711+0000 7f4e51d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5636f967dbb0 0x5636f96757d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56702/0 (socket says 172.21.15.5:56702) 2024-09-11T23:27:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.711+0000 7f4e51d9b640 1 -- 172.21.15.5:0/3608504727 learned_addr learned my addr 172.21.15.5:0/3608504727 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:27:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.711+0000 7f4e5259c640 1 --2- 172.21.15.5:0/3608504727 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5636f96732f0 0x5636f9675090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.711+0000 7f4e51d9b640 1 -- 172.21.15.5:0/3608504727 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5636f96729d0 msgr2=0x5636f96985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:27:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.711+0000 7f4e51d9b640 1 --2- 172.21.15.5:0/3608504727 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5636f96729d0 0x5636f96985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.711+0000 7f4e51d9b640 1 -- 172.21.15.5:0/3608504727 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5636f96732f0 msgr2=0x5636f9675090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:27:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.711+0000 7f4e51d9b640 1 --2- 172.21.15.5:0/3608504727 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5636f96732f0 0x5636f9675090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.711+0000 7f4e51d9b640 1 -- 172.21.15.5:0/3608504727 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636f9693f30 con 0x5636f967dbb0 2024-09-11T23:27:04.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.711+0000 7f4e51d9b640 1 --2- 172.21.15.5:0/3608504727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5636f967dbb0 0x5636f96757d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4e4800ce40 tx=0x7f4e48000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=132765afb26c8887 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:04.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.711+0000 7f4e39ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-11T23:27:04.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.711+0000 7f4e39ffb640 1 -- 172.21.15.5:0/3608504727 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e48015020 con 0x5636f967dbb0 2024-09-11T23:27:04.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.712+0000 7f4e39ffb640 1 -- 172.21.15.5:0/3608504727 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9071+0+0 (secure 0 0 0) 0x7f4e480151c0 con 0x5636f967dbb0 2024-09-11T23:27:04.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.712+0000 7f4e5b06d740 1 -- 172.21.15.5:0/3608504727 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e4800c3b0 con 0x5636f967dbb0 2024-09-11T23:27:04.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.712+0000 7f4e39ffb640 1 -- 172.21.15.5:0/3608504727 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f4e48003f20 con 0x5636f967dbb0 2024-09-11T23:27:04.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.712+0000 7f4e5b06d740 10 client.14733 fetch_fsmap learned FSMap version 17 2024-09-11T23:27:04.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.712+0000 7f4e5b06d740 1 -- 172.21.15.5:0/3608504727 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x5636f96f8d20 con 0x5636f967dbb0 2024-09-11T23:27:04.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.712+0000 7f4e39ffb640 1 -- 172.21.15.5:0/3608504727 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4e4800c3b0 con 0x5636f967dbb0 2024-09-11T23:27:04.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.712+0000 7f4e39ffb640 1 -- 172.21.15.5:0/3608504727 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f4e48020040 con 0x5636f967dbb0 2024-09-11T23:27:04.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.712+0000 7f4e5b06d740 10 client.14733 fetch_fsmap finished waiting for FSMap version 17 2024-09-11T23:27:04.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.712+0000 7f4e5b06d740 10 client.14733 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T23:27:04.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.712+0000 7f4e5b06d740 20 client.14733 populate_metadata read hostname 'smithi005' 2024-09-11T23:27:04.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.712+0000 7f4e5b06d740 1 --2- 172.21.15.5:0/3608504727 >> [v2:172.21.15.159:6838/3843336290,v1:172.21.15.159:6839/3843336290] conn(0x5636f96fd710 0x5636f96fc420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:04.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.712+0000 7f4e5b06d740 4 client.14733 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:27:04.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.712+0000 7f4e5b06d740 1 -- 172.21.15.5:0/3608504727 --> [v2:172.21.15.159:6838/3843336290,v1:172.21.15.159:6839/3843336290] -- command(tid 0: {"prefix": "status"}) -- 0x5636f95e0b10 con 0x5636f96fd710 2024-09-11T23:27:04.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.713+0000 7f4e5259c640 1 --2- 172.21.15.5:0/3608504727 >> [v2:172.21.15.159:6838/3843336290,v1:172.21.15.159:6839/3843336290] conn(0x5636f96fd710 0x5636f96fc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:04.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.713+0000 7f4e39ffb640 10 client.14733 ms_handle_connect on v2:172.21.15.159:6838/3843336290 2024-09-11T23:27:04.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.713+0000 7f4e5259c640 1 --2- 172.21.15.5:0/3608504727 >> [v2:172.21.15.159:6838/3843336290,v1:172.21.15.159:6839/3843336290] conn(0x5636f96fd710 0x5636f96fc420 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d40522a76a3b24e3 server_cookie=a56f6ccb56e40a90 in_seq=0 out_seq=0 2024-09-11T23:27:04.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.713+0000 7f4e39ffb640 1 -- 172.21.15.5:0/3608504727 <== mds.0 v2:172.21.15.159:6838/3843336290 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5636f95e0b10 con 0x5636f96fd710 2024-09-11T23:27:04.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.713+0000 7f4e39ffb640 10 client.14733 handle_command_reply: tid=0 2024-09-11T23:27:04.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.713+0000 7f4e5b06d740 1 client.14733 shutdown 2024-09-11T23:27:04.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.713+0000 7f4e5b06d740 1 -- 172.21.15.5:0/3608504727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5636f967dbb0 msgr2=0x5636f96757d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:04.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.713+0000 7f4e5b06d740 1 --2- 172.21.15.5:0/3608504727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5636f967dbb0 0x5636f96757d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4e4800ce40 tx=0x7f4e48000bc0 comp rx=0 tx=0).stop 2024-09-11T23:27:04.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.713+0000 7f4e5b06d740 1 -- 172.21.15.5:0/3608504727 shutdown_connections 2024-09-11T23:27:04.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.713+0000 7f4e5b06d740 1 --2- 172.21.15.5:0/3608504727 >> [v2:172.21.15.159:6838/3843336290,v1:172.21.15.159:6839/3843336290] conn(0x5636f96fd710 0x5636f96fc420 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:04.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.713+0000 7f4e5b06d740 1 --2- 172.21.15.5:0/3608504727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5636f967dbb0 0x5636f96757d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:04.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.713+0000 7f4e5b06d740 1 --2- 172.21.15.5:0/3608504727 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5636f96732f0 0x5636f9675090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:04.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.713+0000 7f4e39ffb640 0 client.14733 ms_handle_reset on v2:172.21.15.159:6838/3843336290 2024-09-11T23:27:04.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.713+0000 7f4e5b06d740 1 --2- 172.21.15.5:0/3608504727 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5636f96729d0 0x5636f96985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:04.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.713+0000 7f4e5b06d740 1 -- 172.21.15.5:0/3608504727 >> 172.21.15.5:0/3608504727 conn(0x5636f966ef60 msgr2=0x5636f9678eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:04.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.713+0000 7f4e5b06d740 1 -- 172.21.15.5:0/3608504727 shutdown_connections 2024-09-11T23:27:04.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.713+0000 7f4e5b06d740 1 -- 172.21.15.5:0/3608504727 wait complete. 2024-09-11T23:27:04.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.713+0000 7f4e5b06d740 20 client.14733 trim_cache size 0 max 16384 2024-09-11T23:27:04.719 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-11T23:27:04.720 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "1f5284d2-7094-11ef-bcea-c7b262605968", 2024-09-11T23:27:04.720 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-09-11T23:27:04.720 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 24494, 2024-09-11T23:27:04.720 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-09-11T23:27:04.720 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-09-11T23:27:04.720 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-09-11T23:27:04.720 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 18.695983693999999, 2024-09-11T23:27:04.720 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 17, 2024-09-11T23:27:04.720 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 86, 2024-09-11T23:27:04.720 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 86, 2024-09-11T23:27:04.720 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 30.058134199000001 2024-09-11T23:27:04.720 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-11T23:27:04.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.714+0000 7f4e58c94640 1 -- 172.21.15.5:0/2645147384 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f4e3c0a2c00 msgr2=0x7f4e3c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:04.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.714+0000 7f4e58c94640 1 --2- 172.21.15.5:0/2645147384 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f4e3c0a2c00 0x7f4e3c0a50c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c09bc70 tx=0x7f4e4c066b40 comp rx=0 tx=0).stop 2024-09-11T23:27:04.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.714+0000 7f4e58c94640 1 -- 172.21.15.5:0/2645147384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e54106a60 msgr2=0x7f4e541a4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:04.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.714+0000 7f4e58c94640 1 --2- 172.21.15.5:0/2645147384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e54106a60 0x7f4e541a4260 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c00cab0 tx=0x7f4e4c00cf70 comp rx=0 tx=0).stop 2024-09-11T23:27:04.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.714+0000 7f4e58c94640 1 -- 172.21.15.5:0/2645147384 shutdown_connections 2024-09-11T23:27:04.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.714+0000 7f4e58c94640 1 --2- 172.21.15.5:0/2645147384 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f4e3c0a2c00 0x7f4e3c0a50c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:04.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.714+0000 7f4e58c94640 1 --2- 172.21.15.5:0/2645147384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e54106a60 0x7f4e541a4260 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:04.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.714+0000 7f4e58c94640 1 --2- 172.21.15.5:0/2645147384 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e54101400 0x7f4e54199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:04.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.714+0000 7f4e58c94640 1 --2- 172.21.15.5:0/2645147384 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e54100a60 0x7f4e541991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:04.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.714+0000 7f4e58c94640 1 -- 172.21.15.5:0/2645147384 >> 172.21.15.5:0/2645147384 conn(0x7f4e540fc780 msgr2=0x7f4e540fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:04.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.714+0000 7f4e58c94640 1 -- 172.21.15.5:0/2645147384 shutdown_connections 2024-09-11T23:27:04.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:04.714+0000 7f4e58c94640 1 -- 172.21.15.5:0/2645147384 wait complete. 2024-09-11T23:27:05.562 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-11T23:27:05.562 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-11T23:27:05.562 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-11T23:27:05.820 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:27:06.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:06 smithi005 ceph-mon[31201]: pgmap v293: 129 pgs: 129 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-09-11T23:27:06.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.343+0000 7fc718479640 1 -- 172.21.15.5:0/3601437122 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc710101de0 msgr2=0x7fc7101021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:06.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.343+0000 7fc718479640 1 --2- 172.21.15.5:0/3601437122 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc710101de0 0x7fc7101021c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc70c009900 tx=0x7fc70c02a410 comp rx=0 tx=0).stop 2024-09-11T23:27:06.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.343+0000 7fc718479640 1 -- 172.21.15.5:0/3601437122 shutdown_connections 2024-09-11T23:27:06.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.343+0000 7fc718479640 1 --2- 172.21.15.5:0/3601437122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc710106f10 0x7fc71010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:06.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.343+0000 7fc718479640 1 --2- 172.21.15.5:0/3601437122 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc710102790 0x7fc7101067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:06.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.343+0000 7fc718479640 1 --2- 172.21.15.5:0/3601437122 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc710101de0 0x7fc7101021c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:06.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.343+0000 7fc718479640 1 -- 172.21.15.5:0/3601437122 >> 172.21.15.5:0/3601437122 conn(0x7fc7100fd8c0 msgr2=0x7fc7100ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:06.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.343+0000 7fc718479640 1 -- 172.21.15.5:0/3601437122 shutdown_connections 2024-09-11T23:27:06.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.343+0000 7fc718479640 1 -- 172.21.15.5:0/3601437122 wait complete. 2024-09-11T23:27:06.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.344+0000 7fc718479640 1 Processor -- start 2024-09-11T23:27:06.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.344+0000 7fc718479640 1 -- start start 2024-09-11T23:27:06.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.344+0000 7fc718479640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc710101de0 0x7fc7101983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:06.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.344+0000 7fc718479640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc710102790 0x7fc710198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:06.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.344+0000 7fc718479640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc710106f10 0x7fc71019ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:06.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.344+0000 7fc718479640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc710111e40 con 0x7fc710106f10 2024-09-11T23:27:06.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.344+0000 7fc718479640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc710111cc0 con 0x7fc710102790 2024-09-11T23:27:06.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.344+0000 7fc718479640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc710111fc0 con 0x7fc710101de0 2024-09-11T23:27:06.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.344+0000 7fc716a16640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc710106f10 0x7fc71019ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:06.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.344+0000 7fc716a16640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc710106f10 0x7fc71019ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56716/0 (socket says 172.21.15.5:56716) 2024-09-11T23:27:06.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.344+0000 7fc716a16640 1 -- 172.21.15.5:0/1861222627 learned_addr learned my addr 172.21.15.5:0/1861222627 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:27:06.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.344+0000 7fc716215640 1 --2- 172.21.15.5:0/1861222627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc710101de0 0x7fc7101983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:06.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.344+0000 7fc715a14640 1 --2- 172.21.15.5:0/1861222627 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc710102790 0x7fc710198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:06.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.344+0000 7fc716a16640 1 -- 172.21.15.5:0/1861222627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc710101de0 msgr2=0x7fc7101983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:06.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.344+0000 7fc716a16640 1 --2- 172.21.15.5:0/1861222627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc710101de0 0x7fc7101983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:06.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.344+0000 7fc716a16640 1 -- 172.21.15.5:0/1861222627 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc710102790 msgr2=0x7fc710198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:06.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.344+0000 7fc716a16640 1 --2- 172.21.15.5:0/1861222627 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc710102790 0x7fc710198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:06.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.344+0000 7fc716a16640 1 -- 172.21.15.5:0/1861222627 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc71019d390 con 0x7fc710106f10 2024-09-11T23:27:06.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.344+0000 7fc716215640 1 --2- 172.21.15.5:0/1861222627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc710101de0 0x7fc7101983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:27:06.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.344+0000 7fc715a14640 1 --2- 172.21.15.5:0/1861222627 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc710102790 0x7fc710198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:27:06.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.345+0000 7fc716a16640 1 --2- 172.21.15.5:0/1861222627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc710106f10 0x7fc71019ccb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc70800b970 tx=0x7fc70800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:06.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.345+0000 7fc7077fe640 1 -- 172.21.15.5:0/1861222627 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc708019070 con 0x7fc710106f10 2024-09-11T23:27:06.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.345+0000 7fc7077fe640 1 -- 172.21.15.5:0/1861222627 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc708014440 con 0x7fc710106f10 2024-09-11T23:27:06.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.345+0000 7fc718479640 1 -- 172.21.15.5:0/1861222627 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc71019d680 con 0x7fc710106f10 2024-09-11T23:27:06.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.345+0000 7fc7077fe640 1 -- 172.21.15.5:0/1861222627 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7080075d0 con 0x7fc710106f10 2024-09-11T23:27:06.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.345+0000 7fc718479640 1 -- 172.21.15.5:0/1861222627 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7101a4f60 con 0x7fc710106f10 2024-09-11T23:27:06.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.346+0000 7fc718479640 1 -- 172.21.15.5:0/1861222627 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7101021c0 con 0x7fc710106f10 2024-09-11T23:27:06.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.347+0000 7fc7077fe640 1 -- 172.21.15.5:0/1861222627 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fc70801c070 con 0x7fc710106f10 2024-09-11T23:27:06.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.348+0000 7fc7077fe640 1 --2- 172.21.15.5:0/1861222627 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fc6fc0a2b80 0x7fc6fc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:06.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.348+0000 7fc716215640 1 --2- 172.21.15.5:0/1861222627 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fc6fc0a2b80 0x7fc6fc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:06.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.348+0000 7fc7077fe640 1 -- 172.21.15.5:0/1861222627 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9071+0+0 (secure 0 0 0) 0x7fc7080cea60 con 0x7fc710106f10 2024-09-11T23:27:06.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.349+0000 7fc716215640 1 --2- 172.21.15.5:0/1861222627 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fc6fc0a2b80 0x7fc6fc0a5040 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc70c031440 tx=0x7fc70c0095f0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:06.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.353+0000 7fc7077fe640 1 -- 172.21.15.5:0/1861222627 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc70809b620 con 0x7fc710106f10 2024-09-11T23:27:06.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:06 smithi159 ceph-mon[34394]: pgmap v293: 129 pgs: 129 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-09-11T23:27:06.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:06 smithi172 ceph-mon[34855]: pgmap v293: 129 pgs: 129 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-09-11T23:27:06.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.564+0000 7fc718479640 1 -- 172.21.15.5:0/1861222627 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc710109b60 con 0x7fc710106f10 2024-09-11T23:27:06.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.564+0000 7fc7077fe640 1 -- 172.21.15.5:0/1861222627 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7fc70809af20 con 0x7fc710106f10 2024-09-11T23:27:06.564 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-11T23:27:06.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.566+0000 7fc718479640 1 -- 172.21.15.5:0/1861222627 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fc6fc0a2b80 msgr2=0x7fc6fc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:06.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.566+0000 7fc718479640 1 --2- 172.21.15.5:0/1861222627 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fc6fc0a2b80 0x7fc6fc0a5040 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc70c031440 tx=0x7fc70c0095f0 comp rx=0 tx=0).stop 2024-09-11T23:27:06.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.566+0000 7fc718479640 1 -- 172.21.15.5:0/1861222627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc710106f10 msgr2=0x7fc71019ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:06.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.566+0000 7fc718479640 1 --2- 172.21.15.5:0/1861222627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc710106f10 0x7fc71019ccb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc70800b970 tx=0x7fc70800be30 comp rx=0 tx=0).stop 2024-09-11T23:27:06.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.567+0000 7fc718479640 1 -- 172.21.15.5:0/1861222627 shutdown_connections 2024-09-11T23:27:06.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.567+0000 7fc718479640 1 --2- 172.21.15.5:0/1861222627 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fc6fc0a2b80 0x7fc6fc0a5040 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:06.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.567+0000 7fc718479640 1 --2- 172.21.15.5:0/1861222627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc710106f10 0x7fc71019ccb0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:06.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.567+0000 7fc718479640 1 --2- 172.21.15.5:0/1861222627 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc710102790 0x7fc710198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:06.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.567+0000 7fc718479640 1 --2- 172.21.15.5:0/1861222627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc710101de0 0x7fc7101983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:06.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.567+0000 7fc718479640 1 -- 172.21.15.5:0/1861222627 >> 172.21.15.5:0/1861222627 conn(0x7fc7100fd8c0 msgr2=0x7fc7100fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:06.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.567+0000 7fc718479640 1 -- 172.21.15.5:0/1861222627 shutdown_connections 2024-09-11T23:27:06.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:06.567+0000 7fc718479640 1 -- 172.21.15.5:0/1861222627 wait complete. 2024-09-11T23:27:07.282 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:07 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/1861222627' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-11T23:27:07.312 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-11T23:27:07.312 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:27:07.312 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-09-11T23:27:07.312 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-11T23:27:07.312 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-11T23:27:07.312 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-11T23:27:07.312 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T23:27:07.312 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:27:07.312 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-11T23:27:07.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:27:07.313 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-09-11T23:27:07.330 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:27:07.330 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:27:07.330 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:27:07.330 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:27:07.330 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-09-11T23:27:07.330 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:27:07.330 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:27:07.330 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-09-11T23:27:07.331 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-09-11T23:27:07.331 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:27:07.331 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-09-11T23:27:07.331 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-09-11T23:27:07.331 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:27:07.331 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:27:07.331 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-09-11T23:27:07.331 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-11T23:27:07.331 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42305sec preferred_lft 42305sec 2024-09-11T23:27:07.331 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2024-09-11T23:27:07.331 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:27:07.331 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:27:07.331 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:27:07.332 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-09-11T23:27:07.332 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-11T23:27:07.332 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:27:07.332 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-09-11T23:27:07.332 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add name ceph-brx type bridge 2024-09-11T23:27:07.332 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr flush dev ceph-brx 2024-09-11T23:27:07.333 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set ceph-brx up 2024-09-11T23:27:07.333 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-11T23:27:07.333 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-09-11T23:27:07.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:07 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/1861222627' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-11T23:27:07.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:07 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/1861222627' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-11T23:27:07.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:27:07.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:27:07.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:27:07.537 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:27:07.563 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-09-11T23:27:07.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:27:07.565 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-09-11T23:27:07.640 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-09-11T23:27:07.640 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:27:07.640 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-11T23:27:07.640 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-11T23:27:07.640 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:27:07.641 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:27:07.641 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-09-11T23:27:07.641 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-11T23:27:07.641 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-11T23:27:07.641 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-11T23:27:07.641 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-09-11T23:27:07.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:27:07.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:27:07.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:27:07.964 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-09-11T23:27:07.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:27:07.982 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list-id 2024-09-11T23:27:08.038 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:27:08.038 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-09-11T23:27:08.038 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T23:27:08.038 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-11T23:27:08.038 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-09-11T23:27:08.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:27:08.135 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:08 smithi005 ceph-mon[31201]: pgmap v294: 129 pgs: 129 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-09-11T23:27:08.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:27:08.158 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-11T23:27:08.158 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:27:08.158 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-09-11T23:27:08.158 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-11T23:27:08.158 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-11T23:27:08.158 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-11T23:27:08.158 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-11T23:27:08.158 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-11T23:27:08.158 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-09-11T23:27:08.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:27:08.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:27:08.285 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:27:08.285 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-09-11T23:27:08.285 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-09-11T23:27:08.285 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set dev brx.0 master ceph-brx 2024-09-11T23:27:08.285 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-09-11T23:27:08.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:27:08.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:27:08.364 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-11T23:27:08.364 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:27:08.364 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-11T23:27:08.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:08 smithi159 ceph-mon[34394]: pgmap v294: 129 pgs: 129 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-09-11T23:27:08.380 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-11T23:27:08.380 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:27:08.380 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-11T23:27:08.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:08 smithi172 ceph-mon[34855]: pgmap v294: 129 pgs: 129 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-09-11T23:27:08.436 DEBUG:teuthology.orchestra.run.smithi005:> sudo modprobe fuse 2024-09-11T23:27:08.504 DEBUG:teuthology.orchestra.run.smithi005:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:27:08.561 INFO:teuthology.orchestra.run.smithi005.stdout:/proc 2024-09-11T23:27:08.562 INFO:teuthology.orchestra.run.smithi005.stdout:/sys 2024-09-11T23:27:08.562 INFO:teuthology.orchestra.run.smithi005.stdout:/dev 2024-09-11T23:27:08.562 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/security 2024-09-11T23:27:08.562 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/shm 2024-09-11T23:27:08.562 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/pts 2024-09-11T23:27:08.562 INFO:teuthology.orchestra.run.smithi005.stdout:/run 2024-09-11T23:27:08.562 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup 2024-09-11T23:27:08.562 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/pstore 2024-09-11T23:27:08.562 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/bpf 2024-09-11T23:27:08.562 INFO:teuthology.orchestra.run.smithi005.stdout:/ 2024-09-11T23:27:08.562 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/selinux 2024-09-11T23:27:08.562 INFO:teuthology.orchestra.run.smithi005.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:27:08.563 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/mqueue 2024-09-11T23:27:08.563 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/hugepages 2024-09-11T23:27:08.563 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/debug 2024-09-11T23:27:08.563 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/tracing 2024-09-11T23:27:08.563 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/fuse/connections 2024-09-11T23:27:08.563 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/config 2024-09-11T23:27:08.563 INFO:teuthology.orchestra.run.smithi005.stdout:/run/credentials/systemd-sysctl.service 2024-09-11T23:27:08.563 INFO:teuthology.orchestra.run.smithi005.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-11T23:27:08.563 INFO:teuthology.orchestra.run.smithi005.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-11T23:27:08.563 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/nfs/rpc_pipefs 2024-09-11T23:27:08.563 INFO:teuthology.orchestra.run.smithi005.stdout:/run/user/1000 2024-09-11T23:27:08.563 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph 2024-09-11T23:27:08.563 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay 2024-09-11T23:27:08.564 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/2798300e339ac8ec192b3550985a7eafd80c8eb993440dedf97c9f2213033162/merged 2024-09-11T23:27:08.564 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/6874d985f2af4489392f5f80c06ba8aa05d3617326fdff057e94d2740d8513d6/merged 2024-09-11T23:27:08.564 INFO:teuthology.orchestra.run.smithi005.stdout:/run/user/0 2024-09-11T23:27:08.564 INFO:teuthology.orchestra.run.smithi005.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:27:08.564 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/cc8a9010b3a33fc2e21b88536f311ae5197b52d2fb00362885e149d786556c1a/merged 2024-09-11T23:27:08.564 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/0c4147d0bcd5cde7194ab1bc6e46e72cae5d9687c34a89c249038749d8d0578b/merged 2024-09-11T23:27:08.564 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/703d8be9262b54853e749bfec1f061ecaa38564d010dd15353a71c145106895d/merged 2024-09-11T23:27:08.564 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/a0ecdfd30d8cf15a40abd03f4bfa2366bdcfba3cf9448575a940322c1b5f9b27/merged 2024-09-11T23:27:08.564 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/853fb62203a4b457d14f86b2012081ddcd014be5a7e3023d4f3ded3c4e16cce7/merged 2024-09-11T23:27:08.564 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/e806458ec95f3a34cbf563cab9681bc7bd0b2a50f7ad8ab3c89dc483098cc083/merged 2024-09-11T23:27:08.564 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/adf9affa946bd5dafb30e9259aae1166b07d01aff27d1d551a12643dff905428/merged 2024-09-11T23:27:08.564 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/ba3e861a6b3c965d0d52e0cb02688b297e8ff50b6250c401b739e5f48407a80b/merged 2024-09-11T23:27:08.564 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns 2024-09-11T23:27:08.565 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T23:27:08.565 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T23:27:08.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:27:08.565 DEBUG:teuthology.orchestra.run.smithi005:> ls /sys/fs/fuse/connections 2024-09-11T23:27:08.617 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-11T23:27:08.618 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-11T23:27:08.661 DEBUG:teuthology.orchestra.run.smithi005:> sudo modprobe fuse 2024-09-11T23:27:08.687 DEBUG:teuthology.orchestra.run.smithi005:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:27:08.744 INFO:teuthology.orchestra.run.smithi005.stdout:/proc 2024-09-11T23:27:08.744 INFO:teuthology.orchestra.run.smithi005.stdout:/sys 2024-09-11T23:27:08.744 INFO:teuthology.orchestra.run.smithi005.stdout:/dev 2024-09-11T23:27:08.744 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/security 2024-09-11T23:27:08.744 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/shm 2024-09-11T23:27:08.745 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/pts 2024-09-11T23:27:08.745 INFO:teuthology.orchestra.run.smithi005.stdout:/run 2024-09-11T23:27:08.745 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup 2024-09-11T23:27:08.745 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/pstore 2024-09-11T23:27:08.745 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/bpf 2024-09-11T23:27:08.745 INFO:teuthology.orchestra.run.smithi005.stdout:/ 2024-09-11T23:27:08.745 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/selinux 2024-09-11T23:27:08.745 INFO:teuthology.orchestra.run.smithi005.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:27:08.745 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/mqueue 2024-09-11T23:27:08.745 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/hugepages 2024-09-11T23:27:08.745 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/debug 2024-09-11T23:27:08.745 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/tracing 2024-09-11T23:27:08.745 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/fuse/connections 2024-09-11T23:27:08.746 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/config 2024-09-11T23:27:08.746 INFO:teuthology.orchestra.run.smithi005.stdout:/run/credentials/systemd-sysctl.service 2024-09-11T23:27:08.746 INFO:teuthology.orchestra.run.smithi005.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-11T23:27:08.746 INFO:teuthology.orchestra.run.smithi005.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-11T23:27:08.746 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/nfs/rpc_pipefs 2024-09-11T23:27:08.746 INFO:teuthology.orchestra.run.smithi005.stdout:/run/user/1000 2024-09-11T23:27:08.746 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph 2024-09-11T23:27:08.746 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay 2024-09-11T23:27:08.746 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/2798300e339ac8ec192b3550985a7eafd80c8eb993440dedf97c9f2213033162/merged 2024-09-11T23:27:08.746 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/6874d985f2af4489392f5f80c06ba8aa05d3617326fdff057e94d2740d8513d6/merged 2024-09-11T23:27:08.746 INFO:teuthology.orchestra.run.smithi005.stdout:/run/user/0 2024-09-11T23:27:08.746 INFO:teuthology.orchestra.run.smithi005.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:27:08.746 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/cc8a9010b3a33fc2e21b88536f311ae5197b52d2fb00362885e149d786556c1a/merged 2024-09-11T23:27:08.747 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/0c4147d0bcd5cde7194ab1bc6e46e72cae5d9687c34a89c249038749d8d0578b/merged 2024-09-11T23:27:08.747 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/703d8be9262b54853e749bfec1f061ecaa38564d010dd15353a71c145106895d/merged 2024-09-11T23:27:08.747 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/a0ecdfd30d8cf15a40abd03f4bfa2366bdcfba3cf9448575a940322c1b5f9b27/merged 2024-09-11T23:27:08.747 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/853fb62203a4b457d14f86b2012081ddcd014be5a7e3023d4f3ded3c4e16cce7/merged 2024-09-11T23:27:08.747 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/e806458ec95f3a34cbf563cab9681bc7bd0b2a50f7ad8ab3c89dc483098cc083/merged 2024-09-11T23:27:08.747 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/adf9affa946bd5dafb30e9259aae1166b07d01aff27d1d551a12643dff905428/merged 2024-09-11T23:27:08.747 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/ba3e861a6b3c965d0d52e0cb02688b297e8ff50b6250c401b739e5f48407a80b/merged 2024-09-11T23:27:08.747 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns 2024-09-11T23:27:08.747 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T23:27:08.747 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T23:27:08.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:27:08.748 DEBUG:teuthology.orchestra.run.smithi005:> ls /sys/fs/fuse/connections 2024-09-11T23:27:08.778 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi005.stderr:2024-09-11T23:27:08.778+0000 7fbf1c127480 -1 init, newargv = 0x556d75b5dad0 newargc=15 2024-09-11T23:27:08.778 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi005.stderr:ceph-fuse[75595]: starting ceph client 2024-09-11T23:27:08.784 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi005.stderr:ceph-fuse[75595]: starting fuse 2024-09-11T23:27:08.794 INFO:teuthology.orchestra.run.smithi005.stdout:120 2024-09-11T23:27:08.794 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-11T23:27:08.795 DEBUG:teuthology.orchestra.run.smithi005:> sudo stdin-killer -- python3 -c ' 2024-09-11T23:27:08.795 DEBUG:teuthology.orchestra.run.smithi005:> import glob 2024-09-11T23:27:08.795 DEBUG:teuthology.orchestra.run.smithi005:> import re 2024-09-11T23:27:08.795 DEBUG:teuthology.orchestra.run.smithi005:> import os 2024-09-11T23:27:08.795 DEBUG:teuthology.orchestra.run.smithi005:> import subprocess 2024-09-11T23:27:08.795 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-11T23:27:08.795 DEBUG:teuthology.orchestra.run.smithi005:> def _find_admin_socket(client_name): 2024-09-11T23:27:08.795 DEBUG:teuthology.orchestra.run.smithi005:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-11T23:27:08.795 DEBUG:teuthology.orchestra.run.smithi005:> files = glob.glob(asok_path) 2024-09-11T23:27:08.795 DEBUG:teuthology.orchestra.run.smithi005:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-11T23:27:08.795 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-11T23:27:08.795 DEBUG:teuthology.orchestra.run.smithi005:> # Given a non-glob path, it better be there 2024-09-11T23:27:08.796 DEBUG:teuthology.orchestra.run.smithi005:> if "*" not in asok_path: 2024-09-11T23:27:08.796 DEBUG:teuthology.orchestra.run.smithi005:> assert(len(files) == 1) 2024-09-11T23:27:08.796 DEBUG:teuthology.orchestra.run.smithi005:> return files[0] 2024-09-11T23:27:08.796 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-11T23:27:08.796 DEBUG:teuthology.orchestra.run.smithi005:> for f in files: 2024-09-11T23:27:08.796 DEBUG:teuthology.orchestra.run.smithi005:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T23:27:08.796 DEBUG:teuthology.orchestra.run.smithi005:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T23:27:08.796 DEBUG:teuthology.orchestra.run.smithi005:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T23:27:08.796 DEBUG:teuthology.orchestra.run.smithi005:> contents = proc_f.read() 2024-09-11T23:27:08.796 DEBUG:teuthology.orchestra.run.smithi005:> if mountpoint in contents: 2024-09-11T23:27:08.796 DEBUG:teuthology.orchestra.run.smithi005:> return f 2024-09-11T23:27:08.796 DEBUG:teuthology.orchestra.run.smithi005:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T23:27:08.796 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-11T23:27:08.796 DEBUG:teuthology.orchestra.run.smithi005:> print(_find_admin_socket("client.admin")) 2024-09-11T23:27:08.797 DEBUG:teuthology.orchestra.run.smithi005:> ' 2024-09-11T23:27:08.915 INFO:teuthology.orchestra.run.smithi005.stdout:/var/run/ceph/ceph-client.admin.75595.asok 2024-09-11T23:27:08.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:27:08.928 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.75595.asok 2024-09-11T23:27:08.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:27:08.929 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.75595.asok status 2024-09-11T23:27:09.063 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-11T23:27:09.063 INFO:teuthology.orchestra.run.smithi005.stdout: "metadata": { 2024-09-11T23:27:09.064 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-11T23:27:09.064 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T23:27:09.064 INFO:teuthology.orchestra.run.smithi005.stdout: "entity_id": "admin", 2024-09-11T23:27:09.064 INFO:teuthology.orchestra.run.smithi005.stdout: "hostname": "smithi005", 2024-09-11T23:27:09.064 INFO:teuthology.orchestra.run.smithi005.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-11T23:27:09.064 INFO:teuthology.orchestra.run.smithi005.stdout: "pid": "75595", 2024-09-11T23:27:09.064 INFO:teuthology.orchestra.run.smithi005.stdout: "root": "/" 2024-09-11T23:27:09.064 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:27:09.064 INFO:teuthology.orchestra.run.smithi005.stdout: "dentry_count": 0, 2024-09-11T23:27:09.064 INFO:teuthology.orchestra.run.smithi005.stdout: "dentry_pinned_count": 0, 2024-09-11T23:27:09.064 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 14745, 2024-09-11T23:27:09.064 INFO:teuthology.orchestra.run.smithi005.stdout: "inst": { 2024-09-11T23:27:09.065 INFO:teuthology.orchestra.run.smithi005.stdout: "name": { 2024-09-11T23:27:09.065 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "client", 2024-09-11T23:27:09.065 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 14745 2024-09-11T23:27:09.065 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:27:09.065 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": { 2024-09-11T23:27:09.065 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-11T23:27:09.065 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "192.168.0.1:0", 2024-09-11T23:27:09.065 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 567755593 2024-09-11T23:27:09.065 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:27:09.065 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:27:09.065 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": { 2024-09-11T23:27:09.065 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-11T23:27:09.065 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "192.168.0.1:0", 2024-09-11T23:27:09.065 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 567755593 2024-09-11T23:27:09.066 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:27:09.066 INFO:teuthology.orchestra.run.smithi005.stdout: "inst_str": "client.14745 192.168.0.1:0/567755593", 2024-09-11T23:27:09.066 INFO:teuthology.orchestra.run.smithi005.stdout: "addr_str": "192.168.0.1:0/567755593", 2024-09-11T23:27:09.066 INFO:teuthology.orchestra.run.smithi005.stdout: "inode_count": 1, 2024-09-11T23:27:09.066 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_epoch": 17, 2024-09-11T23:27:09.066 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_epoch": 86, 2024-09-11T23:27:09.066 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_epoch_barrier": 0, 2024-09-11T23:27:09.066 INFO:teuthology.orchestra.run.smithi005.stdout: "blocklisted": false, 2024-09-11T23:27:09.066 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs" 2024-09-11T23:27:09.066 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-11T23:27:09.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:27:09.072 DEBUG:teuthology.orchestra.run.smithi005:> stat --file-system '--printf=%T 2024-09-11T23:27:09.072 DEBUG:teuthology.orchestra.run.smithi005:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-11T23:27:09.088 INFO:teuthology.orchestra.run.smithi005.stdout:fuseblk 2024-09-11T23:27:09.089 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-11T23:27:09.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:27:09.089 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-11T23:27:09.156 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-11T23:27:09.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:27:09.268 INFO:teuthology.orchestra.run.smithi005.stdout:# file: . 2024-09-11T23:27:09.268 INFO:teuthology.orchestra.run.smithi005.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-11T23:27:09.268 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:27:09.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:27:09.275 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-11T23:27:09.275 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:27:09.292 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-11T23:27:09.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:09 smithi005 ceph-mon[31201]: pgmap v295: 129 pgs: 129 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:27:09.590 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:27:09.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:09 smithi159 ceph-mon[34394]: pgmap v295: 129 pgs: 129 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:27:09.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:09 smithi172 ceph-mon[34855]: pgmap v295: 129 pgs: 129 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:27:10.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.284+0000 7fb6bc7e4640 1 -- 172.21.15.5:0/1275466718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6b4102790 msgr2=0x7fb6b41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:10.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.284+0000 7fb6bc7e4640 1 --2- 172.21.15.5:0/1275466718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6b4102790 0x7fb6b41067e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb6a8009900 tx=0x7fb6a802a410 comp rx=0 tx=0).stop 2024-09-11T23:27:10.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.284+0000 7fb6bc7e4640 1 -- 172.21.15.5:0/1275466718 shutdown_connections 2024-09-11T23:27:10.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.284+0000 7fb6bc7e4640 1 --2- 172.21.15.5:0/1275466718 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6b4106f10 0x7fb6b410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:10.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.284+0000 7fb6bc7e4640 1 --2- 172.21.15.5:0/1275466718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6b4102790 0x7fb6b41067e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:10.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.284+0000 7fb6bc7e4640 1 --2- 172.21.15.5:0/1275466718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6b4101de0 0x7fb6b41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:10.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.284+0000 7fb6bc7e4640 1 -- 172.21.15.5:0/1275466718 >> 172.21.15.5:0/1275466718 conn(0x7fb6b40fd8c0 msgr2=0x7fb6b40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:10.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.284+0000 7fb6bc7e4640 1 -- 172.21.15.5:0/1275466718 shutdown_connections 2024-09-11T23:27:10.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.284+0000 7fb6bc7e4640 1 -- 172.21.15.5:0/1275466718 wait complete. 2024-09-11T23:27:10.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.285+0000 7fb6bc7e4640 1 Processor -- start 2024-09-11T23:27:10.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.285+0000 7fb6bc7e4640 1 -- start start 2024-09-11T23:27:10.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.285+0000 7fb6bc7e4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6b4101de0 0x7fb6b4198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:10.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.285+0000 7fb6bc7e4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6b4102790 0x7fb6b41988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:10.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.285+0000 7fb6bc7e4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6b4106f10 0x7fb6b419cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:10.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.285+0000 7fb6bc7e4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b4111e20 con 0x7fb6b4102790 2024-09-11T23:27:10.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.285+0000 7fb6bc7e4640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b4111ca0 con 0x7fb6b4101de0 2024-09-11T23:27:10.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.285+0000 7fb6bc7e4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b4111fa0 con 0x7fb6b4106f10 2024-09-11T23:27:10.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.285+0000 7fb6b9d7f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6b4102790 0x7fb6b41988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:10.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.285+0000 7fb6b9d7f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6b4102790 0x7fb6b41988b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56732/0 (socket says 172.21.15.5:56732) 2024-09-11T23:27:10.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.285+0000 7fb6b9d7f640 1 -- 172.21.15.5:0/1246748261 learned_addr learned my addr 172.21.15.5:0/1246748261 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:27:10.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.285+0000 7fb6ba580640 1 --2- 172.21.15.5:0/1246748261 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6b4101de0 0x7fb6b4198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:10.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.286+0000 7fb6bad81640 1 --2- 172.21.15.5:0/1246748261 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6b4106f10 0x7fb6b419cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:10.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.286+0000 7fb6b9d7f640 1 -- 172.21.15.5:0/1246748261 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6b4106f10 msgr2=0x7fb6b419cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:10.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.286+0000 7fb6b9d7f640 1 --2- 172.21.15.5:0/1246748261 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6b4106f10 0x7fb6b419cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:10.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.286+0000 7fb6b9d7f640 1 -- 172.21.15.5:0/1246748261 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6b4101de0 msgr2=0x7fb6b4198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:10.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.286+0000 7fb6b9d7f640 1 --2- 172.21.15.5:0/1246748261 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6b4101de0 0x7fb6b4198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:10.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.286+0000 7fb6b9d7f640 1 -- 172.21.15.5:0/1246748261 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6b419d320 con 0x7fb6b4102790 2024-09-11T23:27:10.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.286+0000 7fb6b9d7f640 1 --2- 172.21.15.5:0/1246748261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6b4102790 0x7fb6b41988b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb6a8005940 tx=0x7fb6a80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:10.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.286+0000 7fb6b37fe640 1 -- 172.21.15.5:0/1246748261 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a803f030 con 0x7fb6b4102790 2024-09-11T23:27:10.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.286+0000 7fb6b37fe640 1 -- 172.21.15.5:0/1246748261 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb6a8003cb0 con 0x7fb6b4102790 2024-09-11T23:27:10.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.286+0000 7fb6bc7e4640 1 -- 172.21.15.5:0/1246748261 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6b419d5b0 con 0x7fb6b4102790 2024-09-11T23:27:10.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.286+0000 7fb6b37fe640 1 -- 172.21.15.5:0/1246748261 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a8035070 con 0x7fb6b4102790 2024-09-11T23:27:10.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.286+0000 7fb6bc7e4640 1 -- 172.21.15.5:0/1246748261 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6b41a4ef0 con 0x7fb6b4102790 2024-09-11T23:27:10.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.287+0000 7fb6bc7e4640 1 -- 172.21.15.5:0/1246748261 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6b41032c0 con 0x7fb6b4102790 2024-09-11T23:27:10.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.288+0000 7fb6b37fe640 1 -- 172.21.15.5:0/1246748261 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fb6a8042030 con 0x7fb6b4102790 2024-09-11T23:27:10.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.289+0000 7fb6b37fe640 1 --2- 172.21.15.5:0/1246748261 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fb69c0a2b80 0x7fb69c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:10.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.289+0000 7fb6b37fe640 1 -- 172.21.15.5:0/1246748261 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9071+0+0 (secure 0 0 0) 0x7fb6a80ef7d0 con 0x7fb6b4102790 2024-09-11T23:27:10.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.289+0000 7fb6ba580640 1 --2- 172.21.15.5:0/1246748261 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fb69c0a2b80 0x7fb69c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:10.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.290+0000 7fb6ba580640 1 --2- 172.21.15.5:0/1246748261 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fb69c0a2b80 0x7fb69c0a5040 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac00bbe0 tx=0x7fb6ac00b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:10.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.293+0000 7fb6b37fe640 1 -- 172.21.15.5:0/1246748261 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb6a80bc3f0 con 0x7fb6b4102790 2024-09-11T23:27:10.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.482+0000 7fb6bc7e4640 1 -- 172.21.15.5:0/1246748261 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb6b410a150 con 0x7fb6b4102790 2024-09-11T23:27:10.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.483+0000 7fb6b37fe640 1 -- 172.21.15.5:0/1246748261 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v86) ==== 81+0+582 (secure 0 0 0) 0x7fb6a80bbcf0 con 0x7fb6b4102790 2024-09-11T23:27:10.483 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/2713701762 2024-09-12T23:19:50.031855+0000 2024-09-11T23:27:10.483 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/3135835713 2024-09-12T23:19:50.031855+0000 2024-09-11T23:27:10.483 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/3935034940 2024-09-12T23:19:50.031855+0000 2024-09-11T23:27:10.483 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6801/1790126649 2024-09-12T23:19:50.031855+0000 2024-09-11T23:27:10.483 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6801/1358356358 2024-09-12T23:19:26.149011+0000 2024-09-11T23:27:10.483 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6800/1790126649 2024-09-12T23:19:50.031855+0000 2024-09-11T23:27:10.483 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6800/1358356358 2024-09-12T23:19:26.149011+0000 2024-09-11T23:27:10.483 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/2243688290 2024-09-12T23:19:26.149011+0000 2024-09-11T23:27:10.483 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/1493331899 2024-09-12T23:19:26.149011+0000 2024-09-11T23:27:10.483 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/2329812802 2024-09-12T23:19:26.149011+0000 2024-09-11T23:27:10.483 INFO:teuthology.orchestra.run.smithi005.stderr:listed 10 entries 2024-09-11T23:27:10.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.485+0000 7fb6bc7e4640 1 -- 172.21.15.5:0/1246748261 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fb69c0a2b80 msgr2=0x7fb69c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:10.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.485+0000 7fb6bc7e4640 1 --2- 172.21.15.5:0/1246748261 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fb69c0a2b80 0x7fb69c0a5040 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac00bbe0 tx=0x7fb6ac00b390 comp rx=0 tx=0).stop 2024-09-11T23:27:10.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.485+0000 7fb6bc7e4640 1 -- 172.21.15.5:0/1246748261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6b4102790 msgr2=0x7fb6b41988b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:10.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.485+0000 7fb6bc7e4640 1 --2- 172.21.15.5:0/1246748261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6b4102790 0x7fb6b41988b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb6a8005940 tx=0x7fb6a80042f0 comp rx=0 tx=0).stop 2024-09-11T23:27:10.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.485+0000 7fb6bc7e4640 1 -- 172.21.15.5:0/1246748261 shutdown_connections 2024-09-11T23:27:10.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.485+0000 7fb6bc7e4640 1 --2- 172.21.15.5:0/1246748261 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fb69c0a2b80 0x7fb69c0a5040 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:10.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.485+0000 7fb6bc7e4640 1 --2- 172.21.15.5:0/1246748261 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6b4106f10 0x7fb6b419cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:10.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.485+0000 7fb6bc7e4640 1 --2- 172.21.15.5:0/1246748261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6b4102790 0x7fb6b41988b0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:10.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.485+0000 7fb6bc7e4640 1 --2- 172.21.15.5:0/1246748261 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6b4101de0 0x7fb6b4198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:10.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.485+0000 7fb6bc7e4640 1 -- 172.21.15.5:0/1246748261 >> 172.21.15.5:0/1246748261 conn(0x7fb6b40fd8c0 msgr2=0x7fb6b40fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:10.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.485+0000 7fb6bc7e4640 1 -- 172.21.15.5:0/1246748261 shutdown_connections 2024-09-11T23:27:10.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:10.485+0000 7fb6bc7e4640 1 -- 172.21.15.5:0/1246748261 wait complete. 2024-09-11T23:27:11.172 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-11T23:27:11.172 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:27:11.192 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-11T23:27:11.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:11 smithi005 ceph-mon[31201]: pgmap v296: 129 pgs: 129 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:27:11.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:11 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/1246748261' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-11T23:27:11.496 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:27:11.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:11 smithi159 ceph-mon[34394]: pgmap v296: 129 pgs: 129 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:27:11.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:11 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/1246748261' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-11T23:27:11.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:11 smithi172 ceph-mon[34855]: pgmap v296: 129 pgs: 129 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:27:11.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:11 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/1246748261' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-11T23:27:11.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:11.957+0000 7f61c7a9a640 1 -- 172.21.15.5:0/2353789674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61c0102790 msgr2=0x7f61c01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:11.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:11.957+0000 7f61c7a9a640 1 --2- 172.21.15.5:0/2353789674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61c0102790 0x7f61c01067e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f61b4009900 tx=0x7f61b402a3f0 comp rx=0 tx=0).stop 2024-09-11T23:27:11.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:11.957+0000 7f61c7a9a640 1 -- 172.21.15.5:0/2353789674 shutdown_connections 2024-09-11T23:27:11.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:11.957+0000 7f61c7a9a640 1 --2- 172.21.15.5:0/2353789674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61c0106f10 0x7f61c010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:11.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:11.958+0000 7f61c7a9a640 1 --2- 172.21.15.5:0/2353789674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61c0102790 0x7f61c01067e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:11.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:11.958+0000 7f61c7a9a640 1 --2- 172.21.15.5:0/2353789674 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61c0101de0 0x7f61c01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:11.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:11.958+0000 7f61c7a9a640 1 -- 172.21.15.5:0/2353789674 >> 172.21.15.5:0/2353789674 conn(0x7f61c00fd8c0 msgr2=0x7f61c00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:11.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:11.958+0000 7f61c7a9a640 1 -- 172.21.15.5:0/2353789674 shutdown_connections 2024-09-11T23:27:11.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:11.958+0000 7f61c7a9a640 1 -- 172.21.15.5:0/2353789674 wait complete. 2024-09-11T23:27:11.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:11.958+0000 7f61c7a9a640 1 Processor -- start 2024-09-11T23:27:11.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:11.958+0000 7f61c7a9a640 1 -- start start 2024-09-11T23:27:11.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:11.958+0000 7f61c7a9a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61c0101de0 0x7f61c00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:11.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:11.958+0000 7f61c7a9a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61c0102790 0x7f61c0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:11.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:11.958+0000 7f61c7a9a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61c0106f10 0x7f61c0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:11.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:11.958+0000 7f61c7a9a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f61c0111e20 con 0x7f61c0106f10 2024-09-11T23:27:11.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:11.958+0000 7f61c7a9a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f61c0111ca0 con 0x7f61c0102790 2024-09-11T23:27:11.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:11.958+0000 7f61c7a9a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f61c0111fa0 con 0x7f61c0101de0 2024-09-11T23:27:11.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:11.959+0000 7f61c6037640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61c0106f10 0x7f61c0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:11.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:11.959+0000 7f61c6037640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61c0106f10 0x7f61c0074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56756/0 (socket says 172.21.15.5:56756) 2024-09-11T23:27:11.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:11.959+0000 7f61c6037640 1 -- 172.21.15.5:0/1482738001 learned_addr learned my addr 172.21.15.5:0/1482738001 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:27:11.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:11.959+0000 7f61c5035640 1 --2- 172.21.15.5:0/1482738001 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61c0102790 0x7f61c0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:11.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:11.959+0000 7f61c5836640 1 --2- 172.21.15.5:0/1482738001 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61c0101de0 0x7f61c00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:11.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:11.959+0000 7f61c6037640 1 -- 172.21.15.5:0/1482738001 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61c0101de0 msgr2=0x7f61c00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:11.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:11.959+0000 7f61c6037640 1 --2- 172.21.15.5:0/1482738001 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61c0101de0 0x7f61c00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:11.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:11.959+0000 7f61c6037640 1 -- 172.21.15.5:0/1482738001 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61c0102790 msgr2=0x7f61c0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:11.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:11.959+0000 7f61c6037640 1 --2- 172.21.15.5:0/1482738001 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61c0102790 0x7f61c0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:11.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:11.959+0000 7f61c6037640 1 -- 172.21.15.5:0/1482738001 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61c01a6720 con 0x7f61c0106f10 2024-09-11T23:27:11.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:11.959+0000 7f61c5836640 1 --2- 172.21.15.5:0/1482738001 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61c0101de0 0x7f61c00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:27:11.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:11.959+0000 7f61c6037640 1 --2- 172.21.15.5:0/1482738001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61c0106f10 0x7f61c0074f70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f61b000cce0 tx=0x7f61b000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:11.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:11.959+0000 7f61beffd640 1 -- 172.21.15.5:0/1482738001 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b000f450 con 0x7f61c0106f10 2024-09-11T23:27:11.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:11.959+0000 7f61beffd640 1 -- 172.21.15.5:0/1482738001 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f61b000faa0 con 0x7f61c0106f10 2024-09-11T23:27:11.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:11.959+0000 7f61c7a9a640 1 -- 172.21.15.5:0/1482738001 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61c01a6a10 con 0x7f61c0106f10 2024-09-11T23:27:11.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:11.959+0000 7f61beffd640 1 -- 172.21.15.5:0/1482738001 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b0018b70 con 0x7f61c0106f10 2024-09-11T23:27:11.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:11.959+0000 7f61c7a9a640 1 -- 172.21.15.5:0/1482738001 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61c01a6ed0 con 0x7f61c0106f10 2024-09-11T23:27:11.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:11.960+0000 7f61c7a9a640 1 -- 172.21.15.5:0/1482738001 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61c01021c0 con 0x7f61c0106f10 2024-09-11T23:27:11.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:11.962+0000 7f61beffd640 1 -- 172.21.15.5:0/1482738001 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f61b0018d10 con 0x7f61c0106f10 2024-09-11T23:27:11.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:11.962+0000 7f61beffd640 1 --2- 172.21.15.5:0/1482738001 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f61a80a2b80 0x7f61a80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:11.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:11.962+0000 7f61c5836640 1 --2- 172.21.15.5:0/1482738001 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f61a80a2b80 0x7f61a80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:11.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:11.962+0000 7f61beffd640 1 -- 172.21.15.5:0/1482738001 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9071+0+0 (secure 0 0 0) 0x7f61b00cf750 con 0x7f61c0106f10 2024-09-11T23:27:11.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:11.963+0000 7f61c5836640 1 --2- 172.21.15.5:0/1482738001 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f61a80a2b80 0x7f61a80a5040 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f61b800abe0 tx=0x7f61b800a5c0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:11.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:11.966+0000 7f61beffd640 1 -- 172.21.15.5:0/1482738001 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f61b0014030 con 0x7f61c0106f10 2024-09-11T23:27:12.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:12.154+0000 7f61c7a9a640 1 -- 172.21.15.5:0/1482738001 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f61c010a150 con 0x7f61c0106f10 2024-09-11T23:27:12.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:12.154+0000 7f61beffd640 1 -- 172.21.15.5:0/1482738001 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v86) ==== 81+0+582 (secure 0 0 0) 0x7f61b009c370 con 0x7f61c0106f10 2024-09-11T23:27:12.154 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/2713701762 2024-09-12T23:19:50.031855+0000 2024-09-11T23:27:12.154 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/3135835713 2024-09-12T23:19:50.031855+0000 2024-09-11T23:27:12.154 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/3935034940 2024-09-12T23:19:50.031855+0000 2024-09-11T23:27:12.154 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6801/1790126649 2024-09-12T23:19:50.031855+0000 2024-09-11T23:27:12.154 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6801/1358356358 2024-09-12T23:19:26.149011+0000 2024-09-11T23:27:12.154 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6800/1790126649 2024-09-12T23:19:50.031855+0000 2024-09-11T23:27:12.154 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6800/1358356358 2024-09-12T23:19:26.149011+0000 2024-09-11T23:27:12.154 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/2243688290 2024-09-12T23:19:26.149011+0000 2024-09-11T23:27:12.155 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/1493331899 2024-09-12T23:19:26.149011+0000 2024-09-11T23:27:12.155 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/2329812802 2024-09-12T23:19:26.149011+0000 2024-09-11T23:27:12.155 INFO:teuthology.orchestra.run.smithi005.stderr:listed 10 entries 2024-09-11T23:27:12.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:12.156+0000 7f61c7a9a640 1 -- 172.21.15.5:0/1482738001 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f61a80a2b80 msgr2=0x7f61a80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:12.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:12.156+0000 7f61c7a9a640 1 --2- 172.21.15.5:0/1482738001 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f61a80a2b80 0x7f61a80a5040 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f61b800abe0 tx=0x7f61b800a5c0 comp rx=0 tx=0).stop 2024-09-11T23:27:12.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:12.156+0000 7f61c7a9a640 1 -- 172.21.15.5:0/1482738001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61c0106f10 msgr2=0x7f61c0074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:12.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:12.156+0000 7f61c7a9a640 1 --2- 172.21.15.5:0/1482738001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61c0106f10 0x7f61c0074f70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f61b000cce0 tx=0x7f61b000a620 comp rx=0 tx=0).stop 2024-09-11T23:27:12.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:12.156+0000 7f61c7a9a640 1 -- 172.21.15.5:0/1482738001 shutdown_connections 2024-09-11T23:27:12.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:12.156+0000 7f61c7a9a640 1 --2- 172.21.15.5:0/1482738001 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f61a80a2b80 0x7f61a80a5040 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:12.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:12.156+0000 7f61c7a9a640 1 --2- 172.21.15.5:0/1482738001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61c0106f10 0x7f61c0074f70 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:12.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:12.156+0000 7f61c7a9a640 1 --2- 172.21.15.5:0/1482738001 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f61c0102790 0x7f61c0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:12.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:12.156+0000 7f61c7a9a640 1 --2- 172.21.15.5:0/1482738001 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61c0101de0 0x7f61c00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:12.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:12.156+0000 7f61c7a9a640 1 -- 172.21.15.5:0/1482738001 >> 172.21.15.5:0/1482738001 conn(0x7f61c00fd8c0 msgr2=0x7f61c00fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:12.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:12.156+0000 7f61c7a9a640 1 -- 172.21.15.5:0/1482738001 shutdown_connections 2024-09-11T23:27:12.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:12.156+0000 7f61c7a9a640 1 -- 172.21.15.5:0/1482738001 wait complete. 2024-09-11T23:27:12.903 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi005.front.sepia.ceph.com... 2024-09-11T23:27:12.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:27:12.904 DEBUG:teuthology.orchestra.run.smithi005:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-11T23:27:12.932 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi005.stderr:ceph-fuse[75595]: fuse finished with error 0 and tester_r 0 2024-09-11T23:27:12.934 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:27:12.961 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-09-11T23:27:12.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:27:12.961 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-11T23:27:13.026 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T23:27:13.324 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:27:13.453 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:13 smithi005 ceph-mon[31201]: pgmap v297: 129 pgs: 129 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:27:13.453 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:13 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/1482738001' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-11T23:27:13.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:13 smithi159 ceph-mon[34394]: pgmap v297: 129 pgs: 129 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:27:13.627 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:13 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/1482738001' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-11T23:27:13.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:13 smithi172 ceph-mon[34855]: pgmap v297: 129 pgs: 129 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:27:13.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:13 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/1482738001' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-11T23:27:13.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:13.838+0000 7fac46b6b640 1 -- 172.21.15.5:0/1664573298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac40101420 msgr2=0x7fac4010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:13.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:13.838+0000 7fac46b6b640 1 --2- 172.21.15.5:0/1664573298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac40101420 0x7fac4010d950 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fac38009cd0 tx=0x7fac3802a8e0 comp rx=0 tx=0).stop 2024-09-11T23:27:13.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:13.838+0000 7fac46b6b640 1 -- 172.21.15.5:0/1664573298 shutdown_connections 2024-09-11T23:27:13.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:13.838+0000 7fac46b6b640 1 --2- 172.21.15.5:0/1664573298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac40101420 0x7fac4010d950 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:13.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:13.838+0000 7fac46b6b640 1 --2- 172.21.15.5:0/1664573298 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac40100a80 0x7fac40100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:13.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:13.838+0000 7fac46b6b640 1 --2- 172.21.15.5:0/1664573298 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac40106a80 0x7fac40106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:13.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:13.838+0000 7fac46b6b640 1 -- 172.21.15.5:0/1664573298 >> 172.21.15.5:0/1664573298 conn(0x7fac400fc7a0 msgr2=0x7fac400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:13.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:13.838+0000 7fac46b6b640 1 -- 172.21.15.5:0/1664573298 shutdown_connections 2024-09-11T23:27:13.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:13.838+0000 7fac46b6b640 1 -- 172.21.15.5:0/1664573298 wait complete. 2024-09-11T23:27:13.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:13.839+0000 7fac46b6b640 1 Processor -- start 2024-09-11T23:27:13.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:13.839+0000 7fac46b6b640 1 -- start start 2024-09-11T23:27:13.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:13.839+0000 7fac46b6b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac40100a80 0x7fac40198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:13.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:13.839+0000 7fac46b6b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac40101420 0x7fac401989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:13.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:13.839+0000 7fac46b6b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac40106a80 0x7fac4019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:13.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:13.839+0000 7fac46b6b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fac40111ed0 con 0x7fac40100a80 2024-09-11T23:27:13.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:13.839+0000 7fac46b6b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fac40111d50 con 0x7fac40106a80 2024-09-11T23:27:13.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:13.839+0000 7fac46b6b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fac40112050 con 0x7fac40101420 2024-09-11T23:27:13.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:13.839+0000 7fac44907640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac40100a80 0x7fac40198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:13.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:13.839+0000 7fac44907640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac40100a80 0x7fac40198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60150/0 (socket says 172.21.15.5:60150) 2024-09-11T23:27:13.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:13.839+0000 7fac44907640 1 -- 172.21.15.5:0/4001410166 learned_addr learned my addr 172.21.15.5:0/4001410166 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:27:13.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:13.839+0000 7fac45108640 1 --2- 172.21.15.5:0/4001410166 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac40106a80 0x7fac4019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:13.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:13.840+0000 7fac44907640 1 -- 172.21.15.5:0/4001410166 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac40101420 msgr2=0x7fac401989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:13.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:13.840+0000 7fac3ffff640 1 --2- 172.21.15.5:0/4001410166 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac40101420 0x7fac401989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:13.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:13.840+0000 7fac44907640 1 --2- 172.21.15.5:0/4001410166 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac40101420 0x7fac401989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:13.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:13.840+0000 7fac44907640 1 -- 172.21.15.5:0/4001410166 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac40106a80 msgr2=0x7fac4019cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:13.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:13.840+0000 7fac44907640 1 --2- 172.21.15.5:0/4001410166 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac40106a80 0x7fac4019cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:13.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:13.840+0000 7fac44907640 1 -- 172.21.15.5:0/4001410166 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac4019d440 con 0x7fac40100a80 2024-09-11T23:27:13.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:13.840+0000 7fac44907640 1 --2- 172.21.15.5:0/4001410166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac40100a80 0x7fac40198490 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fac3000b4a0 tx=0x7fac3000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:13.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:13.840+0000 7fac3dffb640 1 -- 172.21.15.5:0/4001410166 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac30014070 con 0x7fac40100a80 2024-09-11T23:27:13.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:13.840+0000 7fac3dffb640 1 -- 172.21.15.5:0/4001410166 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fac30010ac0 con 0x7fac40100a80 2024-09-11T23:27:13.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:13.840+0000 7fac46b6b640 1 -- 172.21.15.5:0/4001410166 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac4019d730 con 0x7fac40100a80 2024-09-11T23:27:13.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:13.840+0000 7fac3dffb640 1 -- 172.21.15.5:0/4001410166 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac30017c30 con 0x7fac40100a80 2024-09-11T23:27:13.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:13.840+0000 7fac46b6b640 1 -- 172.21.15.5:0/4001410166 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac401a5010 con 0x7fac40100a80 2024-09-11T23:27:13.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:13.841+0000 7fac46b6b640 1 -- 172.21.15.5:0/4001410166 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac40100f60 con 0x7fac40100a80 2024-09-11T23:27:13.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:13.842+0000 7fac3dffb640 1 -- 172.21.15.5:0/4001410166 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fac30017070 con 0x7fac40100a80 2024-09-11T23:27:13.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:13.843+0000 7fac3dffb640 1 --2- 172.21.15.5:0/4001410166 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fac2c0a2c00 0x7fac2c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:13.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:13.843+0000 7fac3ffff640 1 --2- 172.21.15.5:0/4001410166 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fac2c0a2c00 0x7fac2c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:13.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:13.843+0000 7fac3dffb640 1 -- 172.21.15.5:0/4001410166 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9071+0+0 (secure 0 0 0) 0x7fac300cea70 con 0x7fac40100a80 2024-09-11T23:27:13.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:13.843+0000 7fac3ffff640 1 --2- 172.21.15.5:0/4001410166 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fac2c0a2c00 0x7fac2c0a50c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fac400fee30 tx=0x7fac28008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:13.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:13.847+0000 7fac3dffb640 1 -- 172.21.15.5:0/4001410166 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fac3009b690 con 0x7fac40100a80 2024-09-11T23:27:14.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:14.025+0000 7fac46b6b640 1 -- 172.21.15.5:0/4001410166 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fac40109070 con 0x7fac40100a80 2024-09-11T23:27:14.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:14.028+0000 7fac3dffb640 1 -- 172.21.15.5:0/4001410166 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24655 (secure 0 0 0) 0x7fac3009af90 con 0x7fac40100a80 2024-09-11T23:27:14.028 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:27:14.028 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":86,"fsid":"1f5284d2-7094-11ef-bcea-c7b262605968","created":"2024-09-11T23:19:00.051813+0000","modified":"2024-09-11T23:26:54.807250+0000","last_up_change":"2024-09-11T23:25:53.433445+0000","last_in_change":"2024-09-11T23:25:29.443287+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:22:04.534014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:26:41.220887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:26:43.664094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T23:26:50.471521+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bf95ced0-780b-482f-87da-0b5e61de62ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6803","nonce":624761084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6805","nonce":624761084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6809","nonce":624761084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6807","nonce":624761084}]},"public_addr":"172.21.15.5:6803/624761084","cluster_addr":"172.21.15.5:6805/624761084","heartbeat_back_addr":"172.21.15.5:6809/624761084","heartbeat_front_addr":"172.21.15.5:6807/624761084","state":["exists","up"]},{"osd":1,"uuid":"d926484f-78a6-497b-843d-f2db54ade4a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6801","nonce":2111290186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6803","nonce":2111290186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6807","nonce":2111290186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6805","nonce":2111290186}]},"public_addr":"172.21.15.159:6801/2111290186","cluster_addr":"172.21.15.159:6803/2111290186","heartbeat_back_addr":"172.21.15.159:6807/2111290186","heartbeat_front_addr":"172.21.15.159:6805/2111290186","state":["exists","up"]},{"osd":2,"uuid":"d92cd431-0ba7-4171-82b8-60fa3d63a64b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6801","nonce":299915717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6803","nonce":299915717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6807","nonce":299915717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6805","nonce":299915717}]},"public_addr":"172.21.15.172:6801/299915717","cluster_addr":"172.21.15.172:6803/299915717","heartbeat_back_addr":"172.21.15.172:6807/299915717","heartbeat_front_addr":"172.21.15.172:6805/299915717","state":["exists","up"]},{"osd":3,"uuid":"0521043b-559c-4671-b11e-9117871cff49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6811","nonce":2080498921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6813","nonce":2080498921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6817","nonce":2080498921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6815","nonce":2080498921}]},"public_addr":"172.21.15.5:6811/2080498921","cluster_addr":"172.21.15.5:6813/2080498921","heartbeat_back_addr":"172.21.15.5:6817/2080498921","heartbeat_front_addr":"172.21.15.5:6815/2080498921","state":["exists","up"]},{"osd":4,"uuid":"b968d762-a46e-4ae2-b19d-8225f82de613","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6809","nonce":4185908786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6811","nonce":4185908786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6815","nonce":4185908786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6813","nonce":4185908786}]},"public_addr":"172.21.15.159:6809/4185908786","cluster_addr":"172.21.15.159:6811/4185908786","heartbeat_back_addr":"172.21.15.159:6815/4185908786","heartbeat_front_addr":"172.21.15.159:6813/4185908786","state":["exists","up"]},{"osd":5,"uuid":"1b0a518a-3d17-4635-81da-52f9ef83a574","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6809","nonce":3742759000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6811","nonce":3742759000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6815","nonce":3742759000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6813","nonce":3742759000}]},"public_addr":"172.21.15.172:6809/3742759000","cluster_addr":"172.21.15.172:6811/3742759000","heartbeat_back_addr":"172.21.15.172:6815/3742759000","heartbeat_front_addr":"172.21.15.172:6813/3742759000","state":["exists","up"]},{"osd":6,"uuid":"c3a2db6c-9189-4e42-aa1e-52189a9c4291","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6819","nonce":4156823423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6821","nonce":4156823423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6825","nonce":4156823423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6823","nonce":4156823423}]},"public_addr":"172.21.15.5:6819/4156823423","cluster_addr":"172.21.15.5:6821/4156823423","heartbeat_back_addr":"172.21.15.5:6825/4156823423","heartbeat_front_addr":"172.21.15.5:6823/4156823423","state":["exists","up"]},{"osd":7,"uuid":"dfaadf28-74ab-4cda-8647-dcb58beb7cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6817","nonce":4222571927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6819","nonce":4222571927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6823","nonce":4222571927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6821","nonce":4222571927}]},"public_addr":"172.21.15.159:6817/4222571927","cluster_addr":"172.21.15.159:6819/4222571927","heartbeat_back_addr":"172.21.15.159:6823/4222571927","heartbeat_front_addr":"172.21.15.159:6821/4222571927","state":["exists","up"]},{"osd":8,"uuid":"47f66651-614c-4613-9793-69c140dbf705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6817","nonce":3661505951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6819","nonce":3661505951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6823","nonce":3661505951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6821","nonce":3661505951}]},"public_addr":"172.21.15.172:6817/3661505951","cluster_addr":"172.21.15.172:6819/3661505951","heartbeat_back_addr":"172.21.15.172:6823/3661505951","heartbeat_front_addr":"172.21.15.172:6821/3661505951","state":["exists","up"]},{"osd":9,"uuid":"c97b8221-8cf9-4fab-9e27-ff7f3bd98152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6827","nonce":72036667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6829","nonce":72036667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6833","nonce":72036667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6831","nonce":72036667}]},"public_addr":"172.21.15.5:6827/72036667","cluster_addr":"172.21.15.5:6829/72036667","heartbeat_back_addr":"172.21.15.5:6833/72036667","heartbeat_front_addr":"172.21.15.5:6831/72036667","state":["exists","up"]},{"osd":10,"uuid":"143376c1-f3f1-4df4-bcd3-a9b46fad8c1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6825","nonce":3334483164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6827","nonce":3334483164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6831","nonce":3334483164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6829","nonce":3334483164}]},"public_addr":"172.21.15.159:6825/3334483164","cluster_addr":"172.21.15.159:6827/3334483164","heartbeat_back_addr":"172.21.15.159:6831/3334483164","heartbeat_front_addr":"172.21.15.159:6829/3334483164","state":["exists","up"]},{"osd":11,"uuid":"5cc91ff9-fc0f-4e7a-8e4d-87df0e7efbeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6825","nonce":1965415663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6827","nonce":1965415663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6831","nonce":1965415663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6829","nonce":1965415663}]},"public_addr":"172.21.15.172:6825/1965415663","cluster_addr":"172.21.15.172:6827/1965415663","heartbeat_back_addr":"172.21.15.172:6831/1965415663","heartbeat_front_addr":"172.21.15.172:6829/1965415663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:21:13.024707+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:21:38.063741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:22:02.221583+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:22:27.919711+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:22:53.870543+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:23:18.539905+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:23:43.694229+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:24:08.984704+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:24:34.378582+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:25:00.102231+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:25:25.367178+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:25:51.439033+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/2713701762":"2024-09-12T23:19:50.031855+0000","172.21.15.5:0/3135835713":"2024-09-12T23:19:50.031855+0000","172.21.15.5:0/3935034940":"2024-09-12T23:19:50.031855+0000","172.21.15.5:6801/1790126649":"2024-09-12T23:19:50.031855+0000","172.21.15.5:6801/1358356358":"2024-09-12T23:19:26.149011+0000","172.21.15.5:6800/1790126649":"2024-09-12T23:19:50.031855+0000","172.21.15.5:6800/1358356358":"2024-09-12T23:19:26.149011+0000","172.21.15.5:0/2243688290":"2024-09-12T23:19:26.149011+0000","172.21.15.5:0/1493331899":"2024-09-12T23:19:26.149011+0000","172.21.15.5:0/2329812802":"2024-09-12T23:19:26.149011+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:27:14.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:14.030+0000 7fac46b6b640 1 -- 172.21.15.5:0/4001410166 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fac2c0a2c00 msgr2=0x7fac2c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:14.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:14.030+0000 7fac46b6b640 1 --2- 172.21.15.5:0/4001410166 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fac2c0a2c00 0x7fac2c0a50c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fac400fee30 tx=0x7fac28008040 comp rx=0 tx=0).stop 2024-09-11T23:27:14.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:14.030+0000 7fac46b6b640 1 -- 172.21.15.5:0/4001410166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac40100a80 msgr2=0x7fac40198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:14.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:14.030+0000 7fac46b6b640 1 --2- 172.21.15.5:0/4001410166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac40100a80 0x7fac40198490 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fac3000b4a0 tx=0x7fac3000b960 comp rx=0 tx=0).stop 2024-09-11T23:27:14.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:14.030+0000 7fac46b6b640 1 -- 172.21.15.5:0/4001410166 shutdown_connections 2024-09-11T23:27:14.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:14.030+0000 7fac46b6b640 1 --2- 172.21.15.5:0/4001410166 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fac2c0a2c00 0x7fac2c0a50c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:14.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:14.030+0000 7fac46b6b640 1 --2- 172.21.15.5:0/4001410166 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac40106a80 0x7fac4019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:14.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:14.030+0000 7fac46b6b640 1 --2- 172.21.15.5:0/4001410166 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac40101420 0x7fac401989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:14.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:14.030+0000 7fac46b6b640 1 --2- 172.21.15.5:0/4001410166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac40100a80 0x7fac40198490 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:14.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:14.030+0000 7fac46b6b640 1 -- 172.21.15.5:0/4001410166 >> 172.21.15.5:0/4001410166 conn(0x7fac400fc7a0 msgr2=0x7fac400fd130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:14.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:14.030+0000 7fac46b6b640 1 -- 172.21.15.5:0/4001410166 shutdown_connections 2024-09-11T23:27:14.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:14.030+0000 7fac46b6b640 1 -- 172.21.15.5:0/4001410166 wait complete. 2024-09-11T23:27:14.351 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:14 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/4001410166' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:27:14.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:14 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/4001410166' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:27:14.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:14 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/4001410166' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:27:14.850 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T23:27:15.112 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:27:15.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:15 smithi172 ceph-mon[34855]: pgmap v298: 129 pgs: 129 active+clean; 581 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-11T23:27:15.403 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:15 smithi005 ceph-mon[31201]: pgmap v298: 129 pgs: 129 active+clean; 581 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-11T23:27:15.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.595+0000 7f49b8be9640 1 -- 172.21.15.5:0/2497634128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49b4102570 msgr2=0x7f49b41029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:15.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.595+0000 7f49b8be9640 1 --2- 172.21.15.5:0/2497634128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49b4102570 0x7f49b41029b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f499c009900 tx=0x7f499c02a480 comp rx=0 tx=0).stop 2024-09-11T23:27:15.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.595+0000 7f49b8be9640 1 -- 172.21.15.5:0/2497634128 shutdown_connections 2024-09-11T23:27:15.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.595+0000 7f49b8be9640 1 --2- 172.21.15.5:0/2497634128 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49b4102ef0 0x7f49b410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:15.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.595+0000 7f49b8be9640 1 --2- 172.21.15.5:0/2497634128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49b4102570 0x7f49b41029b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:15.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.595+0000 7f49b8be9640 1 --2- 172.21.15.5:0/2497634128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49b4100e20 0x7f49b4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:15.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.595+0000 7f49b8be9640 1 -- 172.21.15.5:0/2497634128 >> 172.21.15.5:0/2497634128 conn(0x7f49b40fc7d0 msgr2=0x7f49b40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:15.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.595+0000 7f49b8be9640 1 -- 172.21.15.5:0/2497634128 shutdown_connections 2024-09-11T23:27:15.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.595+0000 7f49b8be9640 1 -- 172.21.15.5:0/2497634128 wait complete. 2024-09-11T23:27:15.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.596+0000 7f49b8be9640 1 Processor -- start 2024-09-11T23:27:15.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.596+0000 7f49b8be9640 1 -- start start 2024-09-11T23:27:15.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.596+0000 7f49b8be9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49b4100e20 0x7f49b4198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:15.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.596+0000 7f49b8be9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49b4102570 0x7f49b4198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:15.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.596+0000 7f49b8be9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49b4102ef0 0x7f49b419ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:15.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.596+0000 7f49b8be9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f49b4110e30 con 0x7f49b4102570 2024-09-11T23:27:15.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.596+0000 7f49b8be9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f49b4110cb0 con 0x7f49b4102ef0 2024-09-11T23:27:15.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.596+0000 7f49b8be9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f49b4110fb0 con 0x7f49b4100e20 2024-09-11T23:27:15.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.596+0000 7f49b1d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49b4102570 0x7f49b4198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:15.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.596+0000 7f49b1d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49b4102570 0x7f49b4198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60162/0 (socket says 172.21.15.5:60162) 2024-09-11T23:27:15.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.596+0000 7f49b1d9b640 1 -- 172.21.15.5:0/1505584286 learned_addr learned my addr 172.21.15.5:0/1505584286 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:27:15.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.596+0000 7f49b259c640 1 --2- 172.21.15.5:0/1505584286 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49b4100e20 0x7f49b4198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:15.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.596+0000 7f49b2d9d640 1 --2- 172.21.15.5:0/1505584286 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49b4102ef0 0x7f49b419ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:15.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.596+0000 7f49b1d9b640 1 -- 172.21.15.5:0/1505584286 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49b4100e20 msgr2=0x7f49b4198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:15.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.596+0000 7f49b1d9b640 1 --2- 172.21.15.5:0/1505584286 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49b4100e20 0x7f49b4198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:15.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.596+0000 7f49b1d9b640 1 -- 172.21.15.5:0/1505584286 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49b4102ef0 msgr2=0x7f49b419ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:15.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.596+0000 7f49b1d9b640 1 --2- 172.21.15.5:0/1505584286 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49b4102ef0 0x7f49b419ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:15.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.596+0000 7f49b1d9b640 1 -- 172.21.15.5:0/1505584286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49b419d3d0 con 0x7f49b4102570 2024-09-11T23:27:15.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.596+0000 7f49b259c640 1 --2- 172.21.15.5:0/1505584286 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49b4100e20 0x7f49b4198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:27:15.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.597+0000 7f49b1d9b640 1 --2- 172.21.15.5:0/1505584286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49b4102570 0x7f49b4198960 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f499c006010 tx=0x7f499c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:15.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.597+0000 7f49ab7fe640 1 -- 172.21.15.5:0/1505584286 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499c03f030 con 0x7f49b4102570 2024-09-11T23:27:15.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.597+0000 7f49b8be9640 1 -- 172.21.15.5:0/1505584286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49b419d660 con 0x7f49b4102570 2024-09-11T23:27:15.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.597+0000 7f49ab7fe640 1 -- 172.21.15.5:0/1505584286 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f499c003cb0 con 0x7f49b4102570 2024-09-11T23:27:15.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.597+0000 7f49ab7fe640 1 -- 172.21.15.5:0/1505584286 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499c035070 con 0x7f49b4102570 2024-09-11T23:27:15.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.597+0000 7f49b8be9640 1 -- 172.21.15.5:0/1505584286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49b41a4fa0 con 0x7f49b4102570 2024-09-11T23:27:15.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.598+0000 7f49b8be9640 1 -- 172.21.15.5:0/1505584286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49b4101200 con 0x7f49b4102570 2024-09-11T23:27:15.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.599+0000 7f49ab7fe640 1 -- 172.21.15.5:0/1505584286 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f499c042030 con 0x7f49b4102570 2024-09-11T23:27:15.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.600+0000 7f49ab7fe640 1 --2- 172.21.15.5:0/1505584286 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f49a00a2b80 0x7f49a00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:15.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.600+0000 7f49b259c640 1 --2- 172.21.15.5:0/1505584286 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f49a00a2b80 0x7f49a00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:15.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.601+0000 7f49ab7fe640 1 -- 172.21.15.5:0/1505584286 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9071+0+0 (secure 0 0 0) 0x7f499c0efb90 con 0x7f49b4102570 2024-09-11T23:27:15.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.601+0000 7f49b259c640 1 --2- 172.21.15.5:0/1505584286 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f49a00a2b80 0x7f49a00a5040 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f49ac005fd0 tx=0x7f49ac009520 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:15.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.604+0000 7f49ab7fe640 1 -- 172.21.15.5:0/1505584286 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f499c0bc7b0 con 0x7f49b4102570 2024-09-11T23:27:15.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:15 smithi159 ceph-mon[34394]: pgmap v298: 129 pgs: 129 active+clean; 581 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-11T23:27:15.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.782+0000 7f49b8be9640 1 -- 172.21.15.5:0/1505584286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f49b41a5170 con 0x7f49b4102570 2024-09-11T23:27:15.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.784+0000 7f49ab7fe640 1 -- 172.21.15.5:0/1505584286 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24655 (secure 0 0 0) 0x7f499c0bc0b0 con 0x7f49b4102570 2024-09-11T23:27:15.784 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:27:15.784 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":86,"fsid":"1f5284d2-7094-11ef-bcea-c7b262605968","created":"2024-09-11T23:19:00.051813+0000","modified":"2024-09-11T23:26:54.807250+0000","last_up_change":"2024-09-11T23:25:53.433445+0000","last_in_change":"2024-09-11T23:25:29.443287+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:22:04.534014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:26:41.220887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:26:43.664094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T23:26:50.471521+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bf95ced0-780b-482f-87da-0b5e61de62ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6803","nonce":624761084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6805","nonce":624761084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6809","nonce":624761084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6807","nonce":624761084}]},"public_addr":"172.21.15.5:6803/624761084","cluster_addr":"172.21.15.5:6805/624761084","heartbeat_back_addr":"172.21.15.5:6809/624761084","heartbeat_front_addr":"172.21.15.5:6807/624761084","state":["exists","up"]},{"osd":1,"uuid":"d926484f-78a6-497b-843d-f2db54ade4a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6801","nonce":2111290186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6803","nonce":2111290186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6807","nonce":2111290186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6805","nonce":2111290186}]},"public_addr":"172.21.15.159:6801/2111290186","cluster_addr":"172.21.15.159:6803/2111290186","heartbeat_back_addr":"172.21.15.159:6807/2111290186","heartbeat_front_addr":"172.21.15.159:6805/2111290186","state":["exists","up"]},{"osd":2,"uuid":"d92cd431-0ba7-4171-82b8-60fa3d63a64b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6801","nonce":299915717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6803","nonce":299915717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6807","nonce":299915717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6805","nonce":299915717}]},"public_addr":"172.21.15.172:6801/299915717","cluster_addr":"172.21.15.172:6803/299915717","heartbeat_back_addr":"172.21.15.172:6807/299915717","heartbeat_front_addr":"172.21.15.172:6805/299915717","state":["exists","up"]},{"osd":3,"uuid":"0521043b-559c-4671-b11e-9117871cff49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6811","nonce":2080498921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6813","nonce":2080498921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6817","nonce":2080498921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6815","nonce":2080498921}]},"public_addr":"172.21.15.5:6811/2080498921","cluster_addr":"172.21.15.5:6813/2080498921","heartbeat_back_addr":"172.21.15.5:6817/2080498921","heartbeat_front_addr":"172.21.15.5:6815/2080498921","state":["exists","up"]},{"osd":4,"uuid":"b968d762-a46e-4ae2-b19d-8225f82de613","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6809","nonce":4185908786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6811","nonce":4185908786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6815","nonce":4185908786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6813","nonce":4185908786}]},"public_addr":"172.21.15.159:6809/4185908786","cluster_addr":"172.21.15.159:6811/4185908786","heartbeat_back_addr":"172.21.15.159:6815/4185908786","heartbeat_front_addr":"172.21.15.159:6813/4185908786","state":["exists","up"]},{"osd":5,"uuid":"1b0a518a-3d17-4635-81da-52f9ef83a574","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6809","nonce":3742759000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6811","nonce":3742759000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6815","nonce":3742759000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6813","nonce":3742759000}]},"public_addr":"172.21.15.172:6809/3742759000","cluster_addr":"172.21.15.172:6811/3742759000","heartbeat_back_addr":"172.21.15.172:6815/3742759000","heartbeat_front_addr":"172.21.15.172:6813/3742759000","state":["exists","up"]},{"osd":6,"uuid":"c3a2db6c-9189-4e42-aa1e-52189a9c4291","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6819","nonce":4156823423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6821","nonce":4156823423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6825","nonce":4156823423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6823","nonce":4156823423}]},"public_addr":"172.21.15.5:6819/4156823423","cluster_addr":"172.21.15.5:6821/4156823423","heartbeat_back_addr":"172.21.15.5:6825/4156823423","heartbeat_front_addr":"172.21.15.5:6823/4156823423","state":["exists","up"]},{"osd":7,"uuid":"dfaadf28-74ab-4cda-8647-dcb58beb7cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6817","nonce":4222571927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6819","nonce":4222571927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6823","nonce":4222571927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6821","nonce":4222571927}]},"public_addr":"172.21.15.159:6817/4222571927","cluster_addr":"172.21.15.159:6819/4222571927","heartbeat_back_addr":"172.21.15.159:6823/4222571927","heartbeat_front_addr":"172.21.15.159:6821/4222571927","state":["exists","up"]},{"osd":8,"uuid":"47f66651-614c-4613-9793-69c140dbf705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6817","nonce":3661505951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6819","nonce":3661505951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6823","nonce":3661505951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6821","nonce":3661505951}]},"public_addr":"172.21.15.172:6817/3661505951","cluster_addr":"172.21.15.172:6819/3661505951","heartbeat_back_addr":"172.21.15.172:6823/3661505951","heartbeat_front_addr":"172.21.15.172:6821/3661505951","state":["exists","up"]},{"osd":9,"uuid":"c97b8221-8cf9-4fab-9e27-ff7f3bd98152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6827","nonce":72036667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6829","nonce":72036667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6833","nonce":72036667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6831","nonce":72036667}]},"public_addr":"172.21.15.5:6827/72036667","cluster_addr":"172.21.15.5:6829/72036667","heartbeat_back_addr":"172.21.15.5:6833/72036667","heartbeat_front_addr":"172.21.15.5:6831/72036667","state":["exists","up"]},{"osd":10,"uuid":"143376c1-f3f1-4df4-bcd3-a9b46fad8c1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6825","nonce":3334483164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6827","nonce":3334483164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6831","nonce":3334483164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6829","nonce":3334483164}]},"public_addr":"172.21.15.159:6825/3334483164","cluster_addr":"172.21.15.159:6827/3334483164","heartbeat_back_addr":"172.21.15.159:6831/3334483164","heartbeat_front_addr":"172.21.15.159:6829/3334483164","state":["exists","up"]},{"osd":11,"uuid":"5cc91ff9-fc0f-4e7a-8e4d-87df0e7efbeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6825","nonce":1965415663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6827","nonce":1965415663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6831","nonce":1965415663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6829","nonce":1965415663}]},"public_addr":"172.21.15.172:6825/1965415663","cluster_addr":"172.21.15.172:6827/1965415663","heartbeat_back_addr":"172.21.15.172:6831/1965415663","heartbeat_front_addr":"172.21.15.172:6829/1965415663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:21:13.024707+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:21:38.063741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:22:02.221583+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:22:27.919711+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:22:53.870543+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:23:18.539905+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:23:43.694229+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:24:08.984704+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:24:34.378582+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:25:00.102231+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:25:25.367178+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:25:51.439033+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/2713701762":"2024-09-12T23:19:50.031855+0000","172.21.15.5:0/3135835713":"2024-09-12T23:19:50.031855+0000","172.21.15.5:0/3935034940":"2024-09-12T23:19:50.031855+0000","172.21.15.5:6801/1790126649":"2024-09-12T23:19:50.031855+0000","172.21.15.5:6801/1358356358":"2024-09-12T23:19:26.149011+0000","172.21.15.5:6800/1790126649":"2024-09-12T23:19:50.031855+0000","172.21.15.5:6800/1358356358":"2024-09-12T23:19:26.149011+0000","172.21.15.5:0/2243688290":"2024-09-12T23:19:26.149011+0000","172.21.15.5:0/1493331899":"2024-09-12T23:19:26.149011+0000","172.21.15.5:0/2329812802":"2024-09-12T23:19:26.149011+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:27:15.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.786+0000 7f49b8be9640 1 -- 172.21.15.5:0/1505584286 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f49a00a2b80 msgr2=0x7f49a00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:15.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.786+0000 7f49b8be9640 1 --2- 172.21.15.5:0/1505584286 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f49a00a2b80 0x7f49a00a5040 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f49ac005fd0 tx=0x7f49ac009520 comp rx=0 tx=0).stop 2024-09-11T23:27:15.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.786+0000 7f49b8be9640 1 -- 172.21.15.5:0/1505584286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49b4102570 msgr2=0x7f49b4198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:15.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.786+0000 7f49b8be9640 1 --2- 172.21.15.5:0/1505584286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49b4102570 0x7f49b4198960 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f499c006010 tx=0x7f499c0042f0 comp rx=0 tx=0).stop 2024-09-11T23:27:15.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.786+0000 7f49b8be9640 1 -- 172.21.15.5:0/1505584286 shutdown_connections 2024-09-11T23:27:15.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.786+0000 7f49b8be9640 1 --2- 172.21.15.5:0/1505584286 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f49a00a2b80 0x7f49a00a5040 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:15.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.786+0000 7f49b8be9640 1 --2- 172.21.15.5:0/1505584286 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49b4102ef0 0x7f49b419ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:15.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.786+0000 7f49b8be9640 1 --2- 172.21.15.5:0/1505584286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49b4102570 0x7f49b4198960 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:15.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.786+0000 7f49b8be9640 1 --2- 172.21.15.5:0/1505584286 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49b4100e20 0x7f49b4198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:15.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.786+0000 7f49b8be9640 1 -- 172.21.15.5:0/1505584286 >> 172.21.15.5:0/1505584286 conn(0x7f49b40fc7d0 msgr2=0x7f49b4069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:15.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.786+0000 7f49b8be9640 1 -- 172.21.15.5:0/1505584286 shutdown_connections 2024-09-11T23:27:15.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:15.787+0000 7f49b8be9640 1 -- 172.21.15.5:0/1505584286 wait complete. 2024-09-11T23:27:16.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:16 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/1505584286' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:27:16.525 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-11T23:27:16.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:16 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/1505584286' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:27:16.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:16 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/1505584286' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:27:16.786 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:27:17.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:17.300+0000 7f7fda2f5640 1 -- 172.21.15.5:0/2966222718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fd4101420 msgr2=0x7f7fd410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:17.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:17.300+0000 7f7fda2f5640 1 --2- 172.21.15.5:0/2966222718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fd4101420 0x7f7fd410d950 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc009cd0 tx=0x7f7fcc02a8e0 comp rx=0 tx=0).stop 2024-09-11T23:27:17.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:17.300+0000 7f7fda2f5640 1 -- 172.21.15.5:0/2966222718 shutdown_connections 2024-09-11T23:27:17.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:17.300+0000 7f7fda2f5640 1 --2- 172.21.15.5:0/2966222718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fd4101420 0x7f7fd410d950 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:17.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:17.300+0000 7f7fda2f5640 1 --2- 172.21.15.5:0/2966222718 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7fd4100a80 0x7f7fd4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:17.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:17.300+0000 7f7fda2f5640 1 --2- 172.21.15.5:0/2966222718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fd4106a80 0x7f7fd4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:17.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:17.300+0000 7f7fda2f5640 1 -- 172.21.15.5:0/2966222718 >> 172.21.15.5:0/2966222718 conn(0x7f7fd40fc7a0 msgr2=0x7f7fd40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:17.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:17.300+0000 7f7fda2f5640 1 -- 172.21.15.5:0/2966222718 shutdown_connections 2024-09-11T23:27:17.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:17.300+0000 7f7fda2f5640 1 -- 172.21.15.5:0/2966222718 wait complete. 2024-09-11T23:27:17.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:17.301+0000 7f7fda2f5640 1 Processor -- start 2024-09-11T23:27:17.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:17.301+0000 7f7fda2f5640 1 -- start start 2024-09-11T23:27:17.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:17.301+0000 7f7fda2f5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fd4100a80 0x7f7fd4197260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:17.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:17.301+0000 7f7fda2f5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fd4101420 0x7f7fd41977a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:17.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:17.302+0000 7f7fda2f5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7fd4106a80 0x7f7fd419bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:17.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:17.302+0000 7f7fda2f5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd4110d80 con 0x7f7fd4100a80 2024-09-11T23:27:17.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:17.302+0000 7f7fda2f5640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd4110c00 con 0x7f7fd4106a80 2024-09-11T23:27:17.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:17.302+0000 7f7fda2f5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd4110f00 con 0x7f7fd4101420 2024-09-11T23:27:17.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:17.302+0000 7f7fd3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fd4100a80 0x7f7fd4197260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:17.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:17.302+0000 7f7fd3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fd4100a80 0x7f7fd4197260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60182/0 (socket says 172.21.15.5:60182) 2024-09-11T23:27:17.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:17.302+0000 7f7fcbfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fd4101420 0x7f7fd41977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:17.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:17.302+0000 7f7fd3fff640 1 -- 172.21.15.5:0/2726877367 learned_addr learned my addr 172.21.15.5:0/2726877367 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:27:17.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:17.302+0000 7f7fd8892640 1 --2- 172.21.15.5:0/2726877367 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7fd4106a80 0x7f7fd419bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:17.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:17.302+0000 7f7fd3fff640 1 -- 172.21.15.5:0/2726877367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fd4101420 msgr2=0x7f7fd41977a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:17.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:17.302+0000 7f7fd3fff640 1 --2- 172.21.15.5:0/2726877367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fd4101420 0x7f7fd41977a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:17.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:17.302+0000 7f7fd3fff640 1 -- 172.21.15.5:0/2726877367 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7fd4106a80 msgr2=0x7f7fd419bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:17.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:17.302+0000 7f7fd3fff640 1 --2- 172.21.15.5:0/2726877367 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7fd4106a80 0x7f7fd419bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:17.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:17.302+0000 7f7fd3fff640 1 -- 172.21.15.5:0/2726877367 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fd419c210 con 0x7f7fd4100a80 2024-09-11T23:27:17.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:17.302+0000 7f7fd3fff640 1 --2- 172.21.15.5:0/2726877367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fd4100a80 0x7f7fd4197260 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7fc400e9f0 tx=0x7f7fc400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:17.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:17.302+0000 7f7fd1ffb640 1 -- 172.21.15.5:0/2726877367 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc400cd80 con 0x7f7fd4100a80 2024-09-11T23:27:17.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:17.302+0000 7f7fd1ffb640 1 -- 172.21.15.5:0/2726877367 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7fc40054d0 con 0x7f7fd4100a80 2024-09-11T23:27:17.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:17.302+0000 7f7fd1ffb640 1 -- 172.21.15.5:0/2726877367 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc4010490 con 0x7f7fd4100a80 2024-09-11T23:27:17.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:17.302+0000 7f7fda2f5640 1 -- 172.21.15.5:0/2726877367 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fd419c500 con 0x7f7fd4100a80 2024-09-11T23:27:17.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:17.303+0000 7f7fda2f5640 1 -- 172.21.15.5:0/2726877367 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fd41a3de0 con 0x7f7fd4100a80 2024-09-11T23:27:17.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:17.303+0000 7f7fda2f5640 1 -- 172.21.15.5:0/2726877367 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fd4100ee0 con 0x7f7fd4100a80 2024-09-11T23:27:17.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:17.305+0000 7f7fd1ffb640 1 -- 172.21.15.5:0/2726877367 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f7fc4005000 con 0x7f7fd4100a80 2024-09-11T23:27:17.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:17.306+0000 7f7fd1ffb640 1 --2- 172.21.15.5:0/2726877367 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f7fc00a2c00 0x7f7fc00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:17.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:17.306+0000 7f7fcbfff640 1 --2- 172.21.15.5:0/2726877367 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f7fc00a2c00 0x7f7fc00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:17.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:17.306+0000 7f7fd1ffb640 1 -- 172.21.15.5:0/2726877367 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9071+0+0 (secure 0 0 0) 0x7f7fc40cf8d0 con 0x7f7fd4100a80 2024-09-11T23:27:17.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:17.306+0000 7f7fcbfff640 1 --2- 172.21.15.5:0/2726877367 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f7fc00a2c00 0x7f7fc00a50c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7fd40feda0 tx=0x7f7fbc00b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:17.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:17.309+0000 7f7fd1ffb640 1 -- 172.21.15.5:0/2726877367 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7fc40541b0 con 0x7f7fd4100a80 2024-09-11T23:27:17.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:17 smithi005 ceph-mon[31201]: pgmap v299: 129 pgs: 129 active+clean; 581 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-11T23:27:17.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:17.526+0000 7f7fda2f5640 1 -- 172.21.15.5:0/2726877367 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f7fd402d7c0 con 0x7f7fd4100a80 2024-09-11T23:27:17.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:17 smithi159 ceph-mon[34394]: pgmap v299: 129 pgs: 129 active+clean; 581 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-11T23:27:17.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:17 smithi172 ceph-mon[34855]: pgmap v299: 129 pgs: 129 active+clean; 581 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-11T23:27:18.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:18.163+0000 7f7fd1ffb640 1 -- 172.21.15.5:0/2726877367 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7f7fc40052f0 con 0x7f7fd4100a80 2024-09-11T23:27:18.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:18.166+0000 7f7fda2f5640 1 -- 172.21.15.5:0/2726877367 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f7fc00a2c00 msgr2=0x7f7fc00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:18.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:18.166+0000 7f7fda2f5640 1 --2- 172.21.15.5:0/2726877367 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f7fc00a2c00 0x7f7fc00a50c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7fd40feda0 tx=0x7f7fbc00b390 comp rx=0 tx=0).stop 2024-09-11T23:27:18.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:18.166+0000 7f7fda2f5640 1 -- 172.21.15.5:0/2726877367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fd4100a80 msgr2=0x7f7fd4197260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:18.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:18.166+0000 7f7fda2f5640 1 --2- 172.21.15.5:0/2726877367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fd4100a80 0x7f7fd4197260 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7fc400e9f0 tx=0x7f7fc400edf0 comp rx=0 tx=0).stop 2024-09-11T23:27:18.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:18.166+0000 7f7fda2f5640 1 -- 172.21.15.5:0/2726877367 shutdown_connections 2024-09-11T23:27:18.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:18.166+0000 7f7fda2f5640 1 --2- 172.21.15.5:0/2726877367 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f7fc00a2c00 0x7f7fc00a50c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:18.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:18.166+0000 7f7fda2f5640 1 --2- 172.21.15.5:0/2726877367 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7fd4106a80 0x7f7fd419bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:18.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:18.166+0000 7f7fda2f5640 1 --2- 172.21.15.5:0/2726877367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fd4101420 0x7f7fd41977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:18.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:18.166+0000 7f7fda2f5640 1 --2- 172.21.15.5:0/2726877367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fd4100a80 0x7f7fd4197260 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:18.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:18.166+0000 7f7fda2f5640 1 -- 172.21.15.5:0/2726877367 >> 172.21.15.5:0/2726877367 conn(0x7f7fd40fc7a0 msgr2=0x7f7fd40fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:18.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:18.166+0000 7f7fda2f5640 1 -- 172.21.15.5:0/2726877367 shutdown_connections 2024-09-11T23:27:18.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:18.166+0000 7f7fda2f5640 1 -- 172.21.15.5:0/2726877367 wait complete. 2024-09-11T23:27:18.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:18 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/2726877367' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-11T23:27:18.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:18 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/2726877367' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-11T23:27:18.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:18 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/2726877367' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-11T23:27:18.897 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-11T23:27:18.898 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-09-11T23:27:19.162 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:27:19.424 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:19 smithi005 ceph-mon[31201]: pgmap v300: 129 pgs: 129 active+clean; 581 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-11T23:27:19.424 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:19 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/2726877367' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-11T23:27:19.424 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:19 smithi005 ceph-mon[31201]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T23:27:19.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:19 smithi159 ceph-mon[34394]: pgmap v300: 129 pgs: 129 active+clean; 581 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-11T23:27:19.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:19 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/2726877367' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-11T23:27:19.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:19 smithi159 ceph-mon[34394]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T23:27:19.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:19 smithi172 ceph-mon[34855]: pgmap v300: 129 pgs: 129 active+clean; 581 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-11T23:27:19.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:19 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/2726877367' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-11T23:27:19.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:19 smithi172 ceph-mon[34855]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T23:27:19.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:19.626+0000 7f9142c0f640 1 -- 172.21.15.5:0/534288818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f913c100a80 msgr2=0x7f913c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:19.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:19.626+0000 7f9142c0f640 1 --2- 172.21.15.5:0/534288818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f913c100a80 0x7f913c100ee0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9128009930 tx=0x7f912802a420 comp rx=0 tx=0).stop 2024-09-11T23:27:19.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:19.626+0000 7f9142c0f640 1 -- 172.21.15.5:0/534288818 shutdown_connections 2024-09-11T23:27:19.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:19.626+0000 7f9142c0f640 1 --2- 172.21.15.5:0/534288818 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f913c101420 0x7f913c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:19.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:19.626+0000 7f9142c0f640 1 --2- 172.21.15.5:0/534288818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f913c100a80 0x7f913c100ee0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:19.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:19.626+0000 7f9142c0f640 1 --2- 172.21.15.5:0/534288818 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f913c106a80 0x7f913c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:19.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:19.626+0000 7f9142c0f640 1 -- 172.21.15.5:0/534288818 >> 172.21.15.5:0/534288818 conn(0x7f913c0fc7a0 msgr2=0x7f913c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:19.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:19.626+0000 7f9142c0f640 1 -- 172.21.15.5:0/534288818 shutdown_connections 2024-09-11T23:27:19.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:19.626+0000 7f9142c0f640 1 -- 172.21.15.5:0/534288818 wait complete. 2024-09-11T23:27:19.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:19.627+0000 7f9142c0f640 1 Processor -- start 2024-09-11T23:27:19.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:19.627+0000 7f9142c0f640 1 -- start start 2024-09-11T23:27:19.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:19.627+0000 7f9142c0f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f913c100a80 0x7f913c19a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:19.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:19.627+0000 7f9142c0f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f913c101420 0x7f913c19aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:19.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:19.627+0000 7f9142c0f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f913c106a80 0x7f913c19ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:19.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:19.627+0000 7f9142c0f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f913c111e50 con 0x7f913c106a80 2024-09-11T23:27:19.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:19.627+0000 7f9142c0f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f913c111cd0 con 0x7f913c100a80 2024-09-11T23:27:19.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:19.627+0000 7f9142c0f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f913c111fd0 con 0x7f913c101420 2024-09-11T23:27:19.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:19.627+0000 7f91411ac640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f913c106a80 0x7f913c19ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:19.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:19.627+0000 7f91411ac640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f913c106a80 0x7f913c19ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60196/0 (socket says 172.21.15.5:60196) 2024-09-11T23:27:19.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:19.627+0000 7f91411ac640 1 -- 172.21.15.5:0/4206668834 learned_addr learned my addr 172.21.15.5:0/4206668834 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:27:19.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:19.627+0000 7f91409ab640 1 --2- 172.21.15.5:0/4206668834 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f913c100a80 0x7f913c19a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:19.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:19.627+0000 7f913bfff640 1 --2- 172.21.15.5:0/4206668834 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f913c101420 0x7f913c19aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:19.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:19.627+0000 7f91411ac640 1 -- 172.21.15.5:0/4206668834 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f913c101420 msgr2=0x7f913c19aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:19.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:19.627+0000 7f91411ac640 1 --2- 172.21.15.5:0/4206668834 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f913c101420 0x7f913c19aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:19.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:19.627+0000 7f91411ac640 1 -- 172.21.15.5:0/4206668834 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f913c100a80 msgr2=0x7f913c19a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:19.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:19.627+0000 7f91411ac640 1 --2- 172.21.15.5:0/4206668834 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f913c100a80 0x7f913c19a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:19.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:19.627+0000 7f91411ac640 1 -- 172.21.15.5:0/4206668834 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f913c19f540 con 0x7f913c106a80 2024-09-11T23:27:19.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:19.628+0000 7f91411ac640 1 --2- 172.21.15.5:0/4206668834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f913c106a80 0x7f913c19ee60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f913400cce0 tx=0x7f913400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:19.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:19.628+0000 7f9139ffb640 1 -- 172.21.15.5:0/4206668834 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913400f450 con 0x7f913c106a80 2024-09-11T23:27:19.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:19.628+0000 7f9139ffb640 1 -- 172.21.15.5:0/4206668834 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f913400faa0 con 0x7f913c106a80 2024-09-11T23:27:19.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:19.628+0000 7f9142c0f640 1 -- 172.21.15.5:0/4206668834 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f913c19f830 con 0x7f913c106a80 2024-09-11T23:27:19.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:19.628+0000 7f9139ffb640 1 -- 172.21.15.5:0/4206668834 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9134018a80 con 0x7f913c106a80 2024-09-11T23:27:19.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:19.628+0000 7f9142c0f640 1 -- 172.21.15.5:0/4206668834 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f913c1a7110 con 0x7f913c106a80 2024-09-11T23:27:19.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:19.629+0000 7f9142c0f640 1 -- 172.21.15.5:0/4206668834 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f913c100ee0 con 0x7f913c106a80 2024-09-11T23:27:19.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:19.630+0000 7f9139ffb640 1 -- 172.21.15.5:0/4206668834 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f913400fc50 con 0x7f913c106a80 2024-09-11T23:27:19.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:19.631+0000 7f9139ffb640 1 --2- 172.21.15.5:0/4206668834 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f912c0a2c00 0x7f912c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:19.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:19.631+0000 7f91409ab640 1 --2- 172.21.15.5:0/4206668834 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f912c0a2c00 0x7f912c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:19.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:19.631+0000 7f9139ffb640 1 -- 172.21.15.5:0/4206668834 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9071+0+0 (secure 0 0 0) 0x7f91340cf7a0 con 0x7f913c106a80 2024-09-11T23:27:19.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:19.631+0000 7f91409ab640 1 --2- 172.21.15.5:0/4206668834 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f912c0a2c00 0x7f912c0a50c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9130009990 tx=0x7f9130009110 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:19.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:19.635+0000 7f9139ffb640 1 -- 172.21.15.5:0/4206668834 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9134014030 con 0x7f913c106a80 2024-09-11T23:27:19.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:19.848+0000 7f9142c0f640 1 -- 172.21.15.5:0/4206668834 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f913c1a73b0 con 0x7f913c106a80 2024-09-11T23:27:20.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:20.021+0000 7f9139ffb640 1 -- 172.21.15.5:0/4206668834 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v19) ==== 105+0+0 (secure 0 0 0) 0x7f913409c360 con 0x7f913c106a80 2024-09-11T23:27:20.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:20.024+0000 7f9142c0f640 1 -- 172.21.15.5:0/4206668834 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f912c0a2c00 msgr2=0x7f912c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:20.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:20.024+0000 7f9142c0f640 1 --2- 172.21.15.5:0/4206668834 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f912c0a2c00 0x7f912c0a50c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9130009990 tx=0x7f9130009110 comp rx=0 tx=0).stop 2024-09-11T23:27:20.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:20.024+0000 7f9142c0f640 1 -- 172.21.15.5:0/4206668834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f913c106a80 msgr2=0x7f913c19ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:20.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:20.024+0000 7f9142c0f640 1 --2- 172.21.15.5:0/4206668834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f913c106a80 0x7f913c19ee60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f913400cce0 tx=0x7f913400a620 comp rx=0 tx=0).stop 2024-09-11T23:27:20.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:20.024+0000 7f9142c0f640 1 -- 172.21.15.5:0/4206668834 shutdown_connections 2024-09-11T23:27:20.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:20.024+0000 7f9142c0f640 1 --2- 172.21.15.5:0/4206668834 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f912c0a2c00 0x7f912c0a50c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:20.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:20.024+0000 7f9142c0f640 1 --2- 172.21.15.5:0/4206668834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f913c106a80 0x7f913c19ee60 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:20.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:20.024+0000 7f9142c0f640 1 --2- 172.21.15.5:0/4206668834 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f913c101420 0x7f913c19aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:20.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:20.024+0000 7f9142c0f640 1 --2- 172.21.15.5:0/4206668834 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f913c100a80 0x7f913c19a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:20.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:20.024+0000 7f9142c0f640 1 -- 172.21.15.5:0/4206668834 >> 172.21.15.5:0/4206668834 conn(0x7f913c0fc7a0 msgr2=0x7f913c0fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:20.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:20.024+0000 7f9142c0f640 1 -- 172.21.15.5:0/4206668834 shutdown_connections 2024-09-11T23:27:20.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:20.024+0000 7f9142c0f640 1 -- 172.21.15.5:0/4206668834 wait complete. 2024-09-11T23:27:20.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:20 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/4206668834' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-11T23:27:20.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:20 smithi005 ceph-mon[31201]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-11T23:27:20.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:20 smithi005 ceph-mon[31201]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-11T23:27:20.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:20 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/4206668834' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-11T23:27:20.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:20 smithi005 ceph-mon[31201]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-11T23:27:20.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:20 smithi005 ceph-mon[31201]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-11T23:27:20.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:20 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/4206668834' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-11T23:27:20.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:20 smithi159 ceph-mon[34394]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-11T23:27:20.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:20 smithi159 ceph-mon[34394]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-11T23:27:20.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:20 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/4206668834' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-11T23:27:20.627 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:20 smithi159 ceph-mon[34394]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-11T23:27:20.627 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:20 smithi159 ceph-mon[34394]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-11T23:27:20.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:20 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/4206668834' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-11T23:27:20.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:20 smithi172 ceph-mon[34855]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-11T23:27:20.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:20 smithi172 ceph-mon[34855]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-11T23:27:20.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:20 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/4206668834' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-11T23:27:20.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:20 smithi172 ceph-mon[34855]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-11T23:27:20.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:20 smithi172 ceph-mon[34855]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-11T23:27:20.788 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-11T23:27:21.050 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:27:21.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:21.537+0000 7fa5fefd2640 1 -- 172.21.15.5:0/2602928406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5f81037a0 msgr2=0x7fa5f810bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:21.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:21.537+0000 7fa5fefd2640 1 --2- 172.21.15.5:0/2602928406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5f81037a0 0x7fa5f810bc00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec009900 tx=0x7fa5ec02a410 comp rx=0 tx=0).stop 2024-09-11T23:27:21.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:21.537+0000 7fa5fefd2640 1 -- 172.21.15.5:0/2602928406 shutdown_connections 2024-09-11T23:27:21.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:21.537+0000 7fa5fefd2640 1 --2- 172.21.15.5:0/2602928406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5f810c2f0 0x7fa5f810e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:21.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:21.537+0000 7fa5fefd2640 1 --2- 172.21.15.5:0/2602928406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5f81037a0 0x7fa5f810bc00 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:21.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:21.537+0000 7fa5fefd2640 1 --2- 172.21.15.5:0/2602928406 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5f8102df0 0x7fa5f81031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:21.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:21.537+0000 7fa5fefd2640 1 -- 172.21.15.5:0/2602928406 >> 172.21.15.5:0/2602928406 conn(0x7fa5f80fc7d0 msgr2=0x7fa5f80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:21.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:21.537+0000 7fa5fefd2640 1 -- 172.21.15.5:0/2602928406 shutdown_connections 2024-09-11T23:27:21.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:21.537+0000 7fa5fefd2640 1 -- 172.21.15.5:0/2602928406 wait complete. 2024-09-11T23:27:21.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:21.538+0000 7fa5fefd2640 1 Processor -- start 2024-09-11T23:27:21.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:21.538+0000 7fa5fefd2640 1 -- start start 2024-09-11T23:27:21.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:21.538+0000 7fa5fefd2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5f8102df0 0x7fa5f8100a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:21.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:21.538+0000 7fa5fefd2640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5f81037a0 0x7fa5f8100f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:21.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:21.538+0000 7fa5fefd2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5f810c2f0 0x7fa5f81014d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:21.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:21.538+0000 7fa5fefd2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f8111f60 con 0x7fa5f810c2f0 2024-09-11T23:27:21.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:21.538+0000 7fa5fefd2640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f8111de0 con 0x7fa5f81037a0 2024-09-11T23:27:21.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:21.538+0000 7fa5fefd2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f81120e0 con 0x7fa5f8102df0 2024-09-11T23:27:21.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:21.538+0000 7fa5fd56f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5f810c2f0 0x7fa5f81014d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:21.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:21.538+0000 7fa5fd56f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5f810c2f0 0x7fa5f81014d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60202/0 (socket says 172.21.15.5:60202) 2024-09-11T23:27:21.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:21.538+0000 7fa5fd56f640 1 -- 172.21.15.5:0/2909891061 learned_addr learned my addr 172.21.15.5:0/2909891061 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:27:21.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:21.538+0000 7fa5f7fff640 1 --2- 172.21.15.5:0/2909891061 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5f81037a0 0x7fa5f8100f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:21.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:21.538+0000 7fa5fcd6e640 1 --2- 172.21.15.5:0/2909891061 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5f8102df0 0x7fa5f8100a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:21.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:21.539+0000 7fa5fd56f640 1 -- 172.21.15.5:0/2909891061 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5f8102df0 msgr2=0x7fa5f8100a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:21.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:21.539+0000 7fa5fd56f640 1 --2- 172.21.15.5:0/2909891061 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5f8102df0 0x7fa5f8100a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:21.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:21.539+0000 7fa5fd56f640 1 -- 172.21.15.5:0/2909891061 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5f81037a0 msgr2=0x7fa5f8100f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:21.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:21.539+0000 7fa5fd56f640 1 --2- 172.21.15.5:0/2909891061 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5f81037a0 0x7fa5f8100f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:21.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:21.539+0000 7fa5fd56f640 1 -- 172.21.15.5:0/2909891061 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5f81a69a0 con 0x7fa5f810c2f0 2024-09-11T23:27:21.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:21.539+0000 7fa5fcd6e640 1 --2- 172.21.15.5:0/2909891061 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5f8102df0 0x7fa5f8100a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:27:21.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:21.539+0000 7fa5f7fff640 1 --2- 172.21.15.5:0/2909891061 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5f81037a0 0x7fa5f8100f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:27:21.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:21.539+0000 7fa5fd56f640 1 --2- 172.21.15.5:0/2909891061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5f810c2f0 0x7fa5f81014d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0009fd0 tx=0x7fa5f000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:21.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:21.539+0000 7fa5f5ffb640 1 -- 172.21.15.5:0/2909891061 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f0017070 con 0x7fa5f810c2f0 2024-09-11T23:27:21.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:21.539+0000 7fa5fefd2640 1 -- 172.21.15.5:0/2909891061 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5f81a6c90 con 0x7fa5f810c2f0 2024-09-11T23:27:21.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:21.539+0000 7fa5f5ffb640 1 -- 172.21.15.5:0/2909891061 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa5f0003e20 con 0x7fa5f810c2f0 2024-09-11T23:27:21.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:21.539+0000 7fa5f5ffb640 1 -- 172.21.15.5:0/2909891061 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f0010460 con 0x7fa5f810c2f0 2024-09-11T23:27:21.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:21.539+0000 7fa5fefd2640 1 -- 172.21.15.5:0/2909891061 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5f81a71a0 con 0x7fa5f810c2f0 2024-09-11T23:27:21.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:21.540+0000 7fa5fefd2640 1 -- 172.21.15.5:0/2909891061 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5f81031d0 con 0x7fa5f810c2f0 2024-09-11T23:27:21.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:21.541+0000 7fa5f5ffb640 1 -- 172.21.15.5:0/2909891061 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fa5f0003970 con 0x7fa5f810c2f0 2024-09-11T23:27:21.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:21.542+0000 7fa5f5ffb640 1 --2- 172.21.15.5:0/2909891061 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fa5e00a2b80 0x7fa5e00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:21.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:21.542+0000 7fa5fcd6e640 1 --2- 172.21.15.5:0/2909891061 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fa5e00a2b80 0x7fa5e00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:21.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:21.542+0000 7fa5f5ffb640 1 -- 172.21.15.5:0/2909891061 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9071+0+0 (secure 0 0 0) 0x7fa5f00cf290 con 0x7fa5f810c2f0 2024-09-11T23:27:21.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:21.543+0000 7fa5fcd6e640 1 --2- 172.21.15.5:0/2909891061 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fa5e00a2b80 0x7fa5e00a5040 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa5e800baa0 tx=0x7fa5e8005d90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:21.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:21.547+0000 7fa5f5ffb640 1 -- 172.21.15.5:0/2909891061 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa5f009be50 con 0x7fa5f810c2f0 2024-09-11T23:27:21.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:21.759+0000 7fa5fefd2640 1 -- 172.21.15.5:0/2909891061 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fa5f81072c0 con 0x7fa5f810c2f0 2024-09-11T23:27:22.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:22.033+0000 7fa5f5ffb640 1 -- 172.21.15.5:0/2909891061 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7fa5f009b750 con 0x7fa5f810c2f0 2024-09-11T23:27:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:22.035+0000 7fa5fefd2640 1 -- 172.21.15.5:0/2909891061 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fa5e00a2b80 msgr2=0x7fa5e00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:22.035+0000 7fa5fefd2640 1 --2- 172.21.15.5:0/2909891061 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fa5e00a2b80 0x7fa5e00a5040 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa5e800baa0 tx=0x7fa5e8005d90 comp rx=0 tx=0).stop 2024-09-11T23:27:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:22.036+0000 7fa5fefd2640 1 -- 172.21.15.5:0/2909891061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5f810c2f0 msgr2=0x7fa5f81014d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:22.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:22.036+0000 7fa5fefd2640 1 --2- 172.21.15.5:0/2909891061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5f810c2f0 0x7fa5f81014d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0009fd0 tx=0x7fa5f000b260 comp rx=0 tx=0).stop 2024-09-11T23:27:22.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:22.036+0000 7fa5fefd2640 1 -- 172.21.15.5:0/2909891061 shutdown_connections 2024-09-11T23:27:22.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:22.036+0000 7fa5fefd2640 1 --2- 172.21.15.5:0/2909891061 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fa5e00a2b80 0x7fa5e00a5040 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:22.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:22.036+0000 7fa5fefd2640 1 --2- 172.21.15.5:0/2909891061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5f810c2f0 0x7fa5f81014d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:22.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:22.036+0000 7fa5fefd2640 1 --2- 172.21.15.5:0/2909891061 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5f81037a0 0x7fa5f8100f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:22.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:22.036+0000 7fa5fefd2640 1 --2- 172.21.15.5:0/2909891061 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5f8102df0 0x7fa5f8100a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:22.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:22.036+0000 7fa5fefd2640 1 -- 172.21.15.5:0/2909891061 >> 172.21.15.5:0/2909891061 conn(0x7fa5f80fc7d0 msgr2=0x7fa5f80fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:22.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:22.036+0000 7fa5fefd2640 1 -- 172.21.15.5:0/2909891061 shutdown_connections 2024-09-11T23:27:22.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:22.036+0000 7fa5fefd2640 1 -- 172.21.15.5:0/2909891061 wait complete. 2024-09-11T23:27:22.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:22 smithi159 ceph-mon[34394]: pgmap v301: 129 pgs: 129 active+clean; 581 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-11T23:27:22.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:22 smithi159 ceph-mon[34394]: mds.? [v2:172.21.15.172:6838/3928313314,v1:172.21.15.172:6839/3928313314] up:active 2024-09-11T23:27:22.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:22 smithi159 ceph-mon[34394]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-11T23:27:22.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:22 smithi159 ceph-mon[34394]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-11T23:27:22.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:22 smithi159 ceph-mon[34394]: Cluster is now healthy 2024-09-11T23:27:22.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:22 smithi159 ceph-mon[34394]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-11T23:27:22.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:22 smithi159 ceph-mon[34394]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-11T23:27:22.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:22 smithi159 ceph-mon[34394]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-11T23:27:22.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:22 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/2909891061' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-11T23:27:22.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:22 smithi172 ceph-mon[34855]: pgmap v301: 129 pgs: 129 active+clean; 581 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-11T23:27:22.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:22 smithi172 ceph-mon[34855]: mds.? [v2:172.21.15.172:6838/3928313314,v1:172.21.15.172:6839/3928313314] up:active 2024-09-11T23:27:22.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:22 smithi172 ceph-mon[34855]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-11T23:27:22.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:22 smithi172 ceph-mon[34855]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-11T23:27:22.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:22 smithi172 ceph-mon[34855]: Cluster is now healthy 2024-09-11T23:27:22.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:22 smithi172 ceph-mon[34855]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-11T23:27:22.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:22 smithi172 ceph-mon[34855]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-11T23:27:22.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:22 smithi172 ceph-mon[34855]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-11T23:27:22.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:22 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/2909891061' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-11T23:27:22.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:22 smithi005 ceph-mon[31201]: pgmap v301: 129 pgs: 129 active+clean; 581 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-11T23:27:22.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:22 smithi005 ceph-mon[31201]: mds.? [v2:172.21.15.172:6838/3928313314,v1:172.21.15.172:6839/3928313314] up:active 2024-09-11T23:27:22.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:22 smithi005 ceph-mon[31201]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-11T23:27:22.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:22 smithi005 ceph-mon[31201]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-11T23:27:22.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:22 smithi005 ceph-mon[31201]: Cluster is now healthy 2024-09-11T23:27:22.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:22 smithi005 ceph-mon[31201]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-11T23:27:22.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:22 smithi005 ceph-mon[31201]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-11T23:27:22.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:22 smithi005 ceph-mon[31201]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-11T23:27:22.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:22 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/2909891061' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-11T23:27:22.961 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-11T23:27:23.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:23 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/2909891061' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-11T23:27:23.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:23 smithi005 ceph-mon[31201]: mds.? [v2:172.21.15.159:6836/4020181017,v1:172.21.15.159:6837/4020181017] up:active 2024-09-11T23:27:23.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:23 smithi005 ceph-mon[31201]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-11T23:27:23.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:23 smithi005 ceph-mon[31201]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T23:27:23.227 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:27:23.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:23 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/2909891061' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-11T23:27:23.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:23 smithi159 ceph-mon[34394]: mds.? [v2:172.21.15.159:6836/4020181017,v1:172.21.15.159:6837/4020181017] up:active 2024-09-11T23:27:23.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:23 smithi159 ceph-mon[34394]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-11T23:27:23.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:23 smithi159 ceph-mon[34394]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T23:27:23.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:23 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/2909891061' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-11T23:27:23.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:23 smithi172 ceph-mon[34855]: mds.? [v2:172.21.15.159:6836/4020181017,v1:172.21.15.159:6837/4020181017] up:active 2024-09-11T23:27:23.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:23 smithi172 ceph-mon[34855]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-11T23:27:23.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:23 smithi172 ceph-mon[34855]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T23:27:23.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:23.682+0000 7fc57db24640 1 -- 172.21.15.5:0/1236366386 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc578106a80 msgr2=0x7fc578106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:23.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:23.682+0000 7fc57db24640 1 --2- 172.21.15.5:0/1236366386 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc578106a80 0x7fc578106e60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc568009930 tx=0x7fc56802a420 comp rx=0 tx=0).stop 2024-09-11T23:27:23.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:23.682+0000 7fc57db24640 1 -- 172.21.15.5:0/1236366386 shutdown_connections 2024-09-11T23:27:23.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:23.682+0000 7fc57db24640 1 --2- 172.21.15.5:0/1236366386 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc578101420 0x7fc57810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:23.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:23.682+0000 7fc57db24640 1 --2- 172.21.15.5:0/1236366386 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc578100a80 0x7fc578100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:23.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:23.682+0000 7fc57db24640 1 --2- 172.21.15.5:0/1236366386 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc578106a80 0x7fc578106e60 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:23.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:23.682+0000 7fc57db24640 1 -- 172.21.15.5:0/1236366386 >> 172.21.15.5:0/1236366386 conn(0x7fc5780fc7a0 msgr2=0x7fc5780febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:23.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:23.682+0000 7fc57db24640 1 -- 172.21.15.5:0/1236366386 shutdown_connections 2024-09-11T23:27:23.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:23.682+0000 7fc57db24640 1 -- 172.21.15.5:0/1236366386 wait complete. 2024-09-11T23:27:23.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:23.683+0000 7fc57db24640 1 Processor -- start 2024-09-11T23:27:23.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:23.683+0000 7fc57db24640 1 -- start start 2024-09-11T23:27:23.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:23.683+0000 7fc57db24640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc578100a80 0x7fc578197150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:23.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:23.683+0000 7fc57db24640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc578101420 0x7fc578197690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:23.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:23.683+0000 7fc57db24640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc578106a80 0x7fc578197bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:23.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:23.683+0000 7fc57db24640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc578110dd0 con 0x7fc578106a80 2024-09-11T23:27:23.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:23.683+0000 7fc57db24640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc578110c50 con 0x7fc578101420 2024-09-11T23:27:23.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:23.683+0000 7fc57db24640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc578110f50 con 0x7fc578100a80 2024-09-11T23:27:23.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:23.683+0000 7fc577fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc578106a80 0x7fc578197bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:23.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:23.683+0000 7fc577fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc578106a80 0x7fc578197bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41024/0 (socket says 172.21.15.5:41024) 2024-09-11T23:27:23.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:23.683+0000 7fc577fff640 1 -- 172.21.15.5:0/4055706695 learned_addr learned my addr 172.21.15.5:0/4055706695 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:27:23.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:23.683+0000 7fc5777fe640 1 --2- 172.21.15.5:0/4055706695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc578100a80 0x7fc578197150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:23.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:23.683+0000 7fc56ffff640 1 --2- 172.21.15.5:0/4055706695 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc578101420 0x7fc578197690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:23.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:23.684+0000 7fc577fff640 1 -- 172.21.15.5:0/4055706695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc578100a80 msgr2=0x7fc578197150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:23.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:23.684+0000 7fc577fff640 1 --2- 172.21.15.5:0/4055706695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc578100a80 0x7fc578197150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:23.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:23.684+0000 7fc577fff640 1 -- 172.21.15.5:0/4055706695 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc578101420 msgr2=0x7fc578197690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:23.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:23.684+0000 7fc577fff640 1 --2- 172.21.15.5:0/4055706695 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc578101420 0x7fc578197690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:23.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:23.684+0000 7fc577fff640 1 -- 172.21.15.5:0/4055706695 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5781a69c0 con 0x7fc578106a80 2024-09-11T23:27:23.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:23.684+0000 7fc577fff640 1 --2- 172.21.15.5:0/4055706695 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc578106a80 0x7fc578197bd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc57000b970 tx=0x7fc57000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:23.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:23.684+0000 7fc5757fa640 1 -- 172.21.15.5:0/4055706695 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc570019070 con 0x7fc578106a80 2024-09-11T23:27:23.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:23.684+0000 7fc5757fa640 1 -- 172.21.15.5:0/4055706695 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc570014440 con 0x7fc578106a80 2024-09-11T23:27:23.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:23.684+0000 7fc57db24640 1 -- 172.21.15.5:0/4055706695 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5781a6cb0 con 0x7fc578106a80 2024-09-11T23:27:23.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:23.684+0000 7fc5757fa640 1 -- 172.21.15.5:0/4055706695 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5700075d0 con 0x7fc578106a80 2024-09-11T23:27:23.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:23.684+0000 7fc57db24640 1 -- 172.21.15.5:0/4055706695 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5781a71f0 con 0x7fc578106a80 2024-09-11T23:27:23.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:23.685+0000 7fc57db24640 1 -- 172.21.15.5:0/4055706695 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc578100f60 con 0x7fc578106a80 2024-09-11T23:27:23.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:23.686+0000 7fc5757fa640 1 -- 172.21.15.5:0/4055706695 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fc57001c070 con 0x7fc578106a80 2024-09-11T23:27:23.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:23.687+0000 7fc5757fa640 1 --2- 172.21.15.5:0/4055706695 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fc5640a2c00 0x7fc5640a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:23.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:23.687+0000 7fc5777fe640 1 --2- 172.21.15.5:0/4055706695 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fc5640a2c00 0x7fc5640a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:23.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:23.687+0000 7fc5757fa640 1 -- 172.21.15.5:0/4055706695 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9071+0+0 (secure 0 0 0) 0x7fc5700ce940 con 0x7fc578106a80 2024-09-11T23:27:23.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:23.688+0000 7fc5777fe640 1 --2- 172.21.15.5:0/4055706695 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fc5640a2c00 0x7fc5640a50c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc568000c00 tx=0x7fc568031400 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:23.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:23.692+0000 7fc5757fa640 1 -- 172.21.15.5:0/4055706695 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc57009b560 con 0x7fc578106a80 2024-09-11T23:27:23.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:23.902+0000 7fc57db24640 1 -- 172.21.15.5:0/4055706695 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fc57802d7c0 con 0x7fc578106a80 2024-09-11T23:27:24.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:24.046+0000 7fc5757fa640 1 -- 172.21.15.5:0/4055706695 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v24) ==== 115+0+0 (secure 0 0 0) 0x7fc57009ae60 con 0x7fc578106a80 2024-09-11T23:27:24.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:24.048+0000 7fc57db24640 1 -- 172.21.15.5:0/4055706695 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fc5640a2c00 msgr2=0x7fc5640a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:24.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:24.048+0000 7fc57db24640 1 --2- 172.21.15.5:0/4055706695 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fc5640a2c00 0x7fc5640a50c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc568000c00 tx=0x7fc568031400 comp rx=0 tx=0).stop 2024-09-11T23:27:24.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:24.048+0000 7fc57db24640 1 -- 172.21.15.5:0/4055706695 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc578106a80 msgr2=0x7fc578197bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:24.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:24.048+0000 7fc57db24640 1 --2- 172.21.15.5:0/4055706695 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc578106a80 0x7fc578197bd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc57000b970 tx=0x7fc57000be30 comp rx=0 tx=0).stop 2024-09-11T23:27:24.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:24.048+0000 7fc57db24640 1 -- 172.21.15.5:0/4055706695 shutdown_connections 2024-09-11T23:27:24.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:24.048+0000 7fc57db24640 1 --2- 172.21.15.5:0/4055706695 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fc5640a2c00 0x7fc5640a50c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:24.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:24.048+0000 7fc57db24640 1 --2- 172.21.15.5:0/4055706695 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc578106a80 0x7fc578197bd0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:24.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:24.048+0000 7fc57db24640 1 --2- 172.21.15.5:0/4055706695 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc578101420 0x7fc578197690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:24.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:24.048+0000 7fc57db24640 1 --2- 172.21.15.5:0/4055706695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc578100a80 0x7fc578197150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:24.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:24.048+0000 7fc57db24640 1 -- 172.21.15.5:0/4055706695 >> 172.21.15.5:0/4055706695 conn(0x7fc5780fc7a0 msgr2=0x7fc5780fd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:24.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:24.048+0000 7fc57db24640 1 -- 172.21.15.5:0/4055706695 shutdown_connections 2024-09-11T23:27:24.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:24.048+0000 7fc57db24640 1 -- 172.21.15.5:0/4055706695 wait complete. 2024-09-11T23:27:24.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:24 smithi005 ceph-mon[31201]: pgmap v302: 129 pgs: 129 active+clean; 582 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 3 op/s 2024-09-11T23:27:24.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:24 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/4055706695' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-11T23:27:24.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:24 smithi159 ceph-mon[34394]: pgmap v302: 129 pgs: 129 active+clean; 582 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 3 op/s 2024-09-11T23:27:24.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:24 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/4055706695' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-11T23:27:24.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:24 smithi172 ceph-mon[34855]: pgmap v302: 129 pgs: 129 active+clean; 582 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 3 op/s 2024-09-11T23:27:24.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:24 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/4055706695' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-11T23:27:24.832 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2024-09-11T23:27:24.832 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-11T23:27:25.094 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:27:25.215 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:25 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/4055706695' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-11T23:27:25.215 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:25 smithi005 ceph-mon[31201]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T23:27:25.376 INFO:journalctl@ceph.mds.b.smithi159.stdout:Sep 11 23:27:25 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-b[64498]: 2024-09-11T23:27:25.031+0000 7f6823cf6640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-11T23:27:25.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:25 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/4055706695' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-11T23:27:25.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:25 smithi159 ceph-mon[34394]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T23:27:25.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:25 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/4055706695' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-11T23:27:25.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:25 smithi172 ceph-mon[34855]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T23:27:25.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.603+0000 7f4d1ef5b640 1 -- 172.21.15.5:0/1000117230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d1810c170 msgr2=0x7f4d1810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:25.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.603+0000 7f4d1ef5b640 1 --2- 172.21.15.5:0/1000117230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d1810c170 0x7f4d1810e610 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4d10009ca0 tx=0x7f4d1002a950 comp rx=0 tx=0).stop 2024-09-11T23:27:25.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.603+0000 7f4d1ef5b640 1 -- 172.21.15.5:0/1000117230 shutdown_connections 2024-09-11T23:27:25.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.603+0000 7f4d1ef5b640 1 --2- 172.21.15.5:0/1000117230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d1810c170 0x7f4d1810e610 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:25.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.603+0000 7f4d1ef5b640 1 --2- 172.21.15.5:0/1000117230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d18103660 0x7f4d1810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:25.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.603+0000 7f4d1ef5b640 1 --2- 172.21.15.5:0/1000117230 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d18102d40 0x7f4d18103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:25.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.603+0000 7f4d1ef5b640 1 -- 172.21.15.5:0/1000117230 >> 172.21.15.5:0/1000117230 conn(0x7f4d180fc7a0 msgr2=0x7f4d180febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:25.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.603+0000 7f4d1ef5b640 1 -- 172.21.15.5:0/1000117230 shutdown_connections 2024-09-11T23:27:25.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.603+0000 7f4d1ef5b640 1 -- 172.21.15.5:0/1000117230 wait complete. 2024-09-11T23:27:25.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.603+0000 7f4d1ef5b640 1 Processor -- start 2024-09-11T23:27:25.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.603+0000 7f4d1ef5b640 1 -- start start 2024-09-11T23:27:25.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.604+0000 7f4d1ef5b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d18102d40 0x7f4d181982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:25.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.604+0000 7f4d1ef5b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d18103660 0x7f4d18198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:25.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.604+0000 7f4d1ef5b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d1810c170 0x7f4d1819cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:25.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.604+0000 7f4d1ef5b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4d18111e60 con 0x7f4d18102d40 2024-09-11T23:27:25.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.604+0000 7f4d1ef5b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f4d18111ce0 con 0x7f4d1810c170 2024-09-11T23:27:25.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.604+0000 7f4d1ef5b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4d18111fe0 con 0x7f4d18103660 2024-09-11T23:27:25.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.604+0000 7f4d1ccf7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d18102d40 0x7f4d181982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:25.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.604+0000 7f4d1ccf7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d18102d40 0x7f4d181982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41038/0 (socket says 172.21.15.5:41038) 2024-09-11T23:27:25.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.604+0000 7f4d1ccf7640 1 -- 172.21.15.5:0/490656296 learned_addr learned my addr 172.21.15.5:0/490656296 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:27:25.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.604+0000 7f4d1d4f8640 1 --2- 172.21.15.5:0/490656296 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d1810c170 0x7f4d1819cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:25.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.604+0000 7f4d17fff640 1 --2- 172.21.15.5:0/490656296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d18103660 0x7f4d18198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:25.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.604+0000 7f4d1ccf7640 1 -- 172.21.15.5:0/490656296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d18103660 msgr2=0x7f4d18198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:25.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.604+0000 7f4d1ccf7640 1 --2- 172.21.15.5:0/490656296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d18103660 0x7f4d18198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:25.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.604+0000 7f4d1ccf7640 1 -- 172.21.15.5:0/490656296 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d1810c170 msgr2=0x7f4d1819cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:25.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.604+0000 7f4d1ccf7640 1 --2- 172.21.15.5:0/490656296 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d1810c170 0x7f4d1819cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:25.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.604+0000 7f4d1ccf7640 1 -- 172.21.15.5:0/490656296 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d1819d290 con 0x7f4d18102d40 2024-09-11T23:27:25.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.604+0000 7f4d17fff640 1 --2- 172.21.15.5:0/490656296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d18103660 0x7f4d18198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:27:25.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.604+0000 7f4d1ccf7640 1 --2- 172.21.15.5:0/490656296 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d18102d40 0x7f4d181982e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4d0800b4a0 tx=0x7f4d0800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:25.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.605+0000 7f4d15ffb640 1 -- 172.21.15.5:0/490656296 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d08014070 con 0x7f4d18102d40 2024-09-11T23:27:25.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.605+0000 7f4d1ef5b640 1 -- 172.21.15.5:0/490656296 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d1819d580 con 0x7f4d18102d40 2024-09-11T23:27:25.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.605+0000 7f4d15ffb640 1 -- 172.21.15.5:0/490656296 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4d08010ac0 con 0x7f4d18102d40 2024-09-11T23:27:25.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.605+0000 7f4d15ffb640 1 -- 172.21.15.5:0/490656296 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d08017c30 con 0x7f4d18102d40 2024-09-11T23:27:25.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.605+0000 7f4d1ef5b640 1 -- 172.21.15.5:0/490656296 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d181a4e60 con 0x7f4d18102d40 2024-09-11T23:27:25.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.606+0000 7f4d1ef5b640 1 -- 172.21.15.5:0/490656296 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d18103120 con 0x7f4d18102d40 2024-09-11T23:27:25.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.607+0000 7f4d15ffb640 1 -- 172.21.15.5:0/490656296 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f4d08017070 con 0x7f4d18102d40 2024-09-11T23:27:25.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.607+0000 7f4d15ffb640 1 --2- 172.21.15.5:0/490656296 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f4d000a2b80 0x7f4d000a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:25.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.608+0000 7f4d17fff640 1 --2- 172.21.15.5:0/490656296 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f4d000a2b80 0x7f4d000a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:25.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.608+0000 7f4d15ffb640 1 -- 172.21.15.5:0/490656296 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9071+0+0 (secure 0 0 0) 0x7f4d080ceb10 con 0x7f4d18102d40 2024-09-11T23:27:25.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.608+0000 7f4d17fff640 1 --2- 172.21.15.5:0/490656296 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f4d000a2b80 0x7f4d000a5040 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4d180fed50 tx=0x7f4d0c005e30 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:25.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.612+0000 7f4d15ffb640 1 -- 172.21.15.5:0/490656296 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4d0809b730 con 0x7f4d18102d40 2024-09-11T23:27:25.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.812+0000 7f4d1ef5b640 1 -- 172.21.15.5:0/490656296 --> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f4d180fe4c0 con 0x7f4d000a2b80 2024-09-11T23:27:25.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.834+0000 7f4d15ffb640 1 -- 172.21.15.5:0/490656296 <== mgr.14148 v2:172.21.15.5:6800/2285128668 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4d180fe4c0 con 0x7f4d000a2b80 2024-09-11T23:27:25.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.836+0000 7f4d1ef5b640 1 -- 172.21.15.5:0/490656296 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f4d000a2b80 msgr2=0x7f4d000a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:25.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.836+0000 7f4d1ef5b640 1 --2- 172.21.15.5:0/490656296 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f4d000a2b80 0x7f4d000a5040 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4d180fed50 tx=0x7f4d0c005e30 comp rx=0 tx=0).stop 2024-09-11T23:27:25.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.836+0000 7f4d1ef5b640 1 -- 172.21.15.5:0/490656296 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d18102d40 msgr2=0x7f4d181982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:25.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.836+0000 7f4d1ef5b640 1 --2- 172.21.15.5:0/490656296 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d18102d40 0x7f4d181982e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4d0800b4a0 tx=0x7f4d0800b960 comp rx=0 tx=0).stop 2024-09-11T23:27:25.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.836+0000 7f4d1ef5b640 1 -- 172.21.15.5:0/490656296 shutdown_connections 2024-09-11T23:27:25.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.836+0000 7f4d1ef5b640 1 --2- 172.21.15.5:0/490656296 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f4d000a2b80 0x7f4d000a5040 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:25.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.836+0000 7f4d1ef5b640 1 --2- 172.21.15.5:0/490656296 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d1810c170 0x7f4d1819cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:25.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.836+0000 7f4d1ef5b640 1 --2- 172.21.15.5:0/490656296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d18103660 0x7f4d18198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:25.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.836+0000 7f4d1ef5b640 1 --2- 172.21.15.5:0/490656296 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d18102d40 0x7f4d181982e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:25.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.836+0000 7f4d1ef5b640 1 -- 172.21.15.5:0/490656296 >> 172.21.15.5:0/490656296 conn(0x7f4d180fc7a0 msgr2=0x7f4d180fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:25.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.836+0000 7f4d1ef5b640 1 -- 172.21.15.5:0/490656296 shutdown_connections 2024-09-11T23:27:25.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:25.836+0000 7f4d1ef5b640 1 -- 172.21.15.5:0/490656296 wait complete. 2024-09-11T23:27:26.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:26 smithi005 ceph-mon[31201]: pgmap v303: 129 pgs: 129 active+clean; 582 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-11T23:27:26.225 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:27:25 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:27:25.817+0000 7fd57c1a2640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:27:26.225 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:27:25 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:27:25.817+0000 7fd57c1a2640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:27:26.225 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:27:25 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:27:25.817+0000 7fd57c1a2640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:27:26.225 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:27:25 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:27:25.817+0000 7fd57c1a2640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:27:26.225 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:27:25 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:27:25.817+0000 7fd57c1a2640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:27:26.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:26 smithi159 ceph-mon[34394]: pgmap v303: 129 pgs: 129 active+clean; 582 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-11T23:27:26.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:26 smithi172 ceph-mon[34855]: pgmap v303: 129 pgs: 129 active+clean; 582 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-11T23:27:26.589 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-11T23:27:26.851 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:27:27.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:27 smithi005 ceph-mon[31201]: from='client.14799 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:27:27.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.316+0000 7fee9b3cf640 1 -- 172.21.15.5:0/2138786600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee9410e500 msgr2=0x7fee94110910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:27.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.316+0000 7fee9b3cf640 1 --2- 172.21.15.5:0/2138786600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee9410e500 0x7fee94110910 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fee84009ca0 tx=0x7fee8402a8c0 comp rx=0 tx=0).stop 2024-09-11T23:27:27.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.316+0000 7fee9b3cf640 1 -- 172.21.15.5:0/2138786600 shutdown_connections 2024-09-11T23:27:27.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.316+0000 7fee9b3cf640 1 --2- 172.21.15.5:0/2138786600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee9410e500 0x7fee94110910 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:27.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.316+0000 7fee9b3cf640 1 --2- 172.21.15.5:0/2138786600 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee94101440 0x7fee9410df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:27.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.316+0000 7fee9b3cf640 1 --2- 172.21.15.5:0/2138786600 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee94100b20 0x7fee94100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:27.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.316+0000 7fee9b3cf640 1 -- 172.21.15.5:0/2138786600 >> 172.21.15.5:0/2138786600 conn(0x7fee940fc7d0 msgr2=0x7fee940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:27.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.316+0000 7fee9b3cf640 1 -- 172.21.15.5:0/2138786600 shutdown_connections 2024-09-11T23:27:27.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.316+0000 7fee9b3cf640 1 -- 172.21.15.5:0/2138786600 wait complete. 2024-09-11T23:27:27.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.316+0000 7fee9b3cf640 1 Processor -- start 2024-09-11T23:27:27.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.316+0000 7fee9b3cf640 1 -- start start 2024-09-11T23:27:27.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.317+0000 7fee9b3cf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee94100b20 0x7fee9419a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:27.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.317+0000 7fee9b3cf640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee94101440 0x7fee9419ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:27.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.317+0000 7fee9b3cf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee9410e500 0x7fee9419efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:27.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.317+0000 7fee9b3cf640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fee94114180 con 0x7fee9410e500 2024-09-11T23:27:27.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.317+0000 7fee9b3cf640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fee94114000 con 0x7fee94101440 2024-09-11T23:27:27.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.317+0000 7fee9b3cf640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fee94114300 con 0x7fee94100b20 2024-09-11T23:27:27.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.317+0000 7fee9996c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee9410e500 0x7fee9419efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:27.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.317+0000 7fee9996c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee9410e500 0x7fee9419efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41074/0 (socket says 172.21.15.5:41074) 2024-09-11T23:27:27.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.317+0000 7fee9996c640 1 -- 172.21.15.5:0/3099605817 learned_addr learned my addr 172.21.15.5:0/3099605817 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:27:27.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.317+0000 7fee9896a640 1 --2- 172.21.15.5:0/3099605817 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee94101440 0x7fee9419ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:27.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.317+0000 7fee9916b640 1 --2- 172.21.15.5:0/3099605817 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee94100b20 0x7fee9419a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:27.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.317+0000 7fee9996c640 1 -- 172.21.15.5:0/3099605817 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee94100b20 msgr2=0x7fee9419a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:27.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.317+0000 7fee9996c640 1 --2- 172.21.15.5:0/3099605817 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee94100b20 0x7fee9419a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:27.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.317+0000 7fee9996c640 1 -- 172.21.15.5:0/3099605817 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee94101440 msgr2=0x7fee9419ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:27.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.317+0000 7fee9996c640 1 --2- 172.21.15.5:0/3099605817 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee94101440 0x7fee9419ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:27.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.317+0000 7fee9996c640 1 -- 172.21.15.5:0/3099605817 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee9419f690 con 0x7fee9410e500 2024-09-11T23:27:27.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.317+0000 7fee9996c640 1 --2- 172.21.15.5:0/3099605817 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee9410e500 0x7fee9419efb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fee840098d0 tx=0x7fee84032ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:27.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.317+0000 7fee927fc640 1 -- 172.21.15.5:0/3099605817 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee84003c70 con 0x7fee9410e500 2024-09-11T23:27:27.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.317+0000 7fee927fc640 1 -- 172.21.15.5:0/3099605817 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fee84003e10 con 0x7fee9410e500 2024-09-11T23:27:27.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.317+0000 7fee9b3cf640 1 -- 172.21.15.5:0/3099605817 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee9419f920 con 0x7fee9410e500 2024-09-11T23:27:27.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.318+0000 7fee927fc640 1 -- 172.21.15.5:0/3099605817 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee84030b50 con 0x7fee9410e500 2024-09-11T23:27:27.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.318+0000 7fee9b3cf640 1 -- 172.21.15.5:0/3099605817 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee941a7260 con 0x7fee9410e500 2024-09-11T23:27:27.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.319+0000 7fee9b3cf640 1 -- 172.21.15.5:0/3099605817 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee94100f00 con 0x7fee9410e500 2024-09-11T23:27:27.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.320+0000 7fee927fc640 1 -- 172.21.15.5:0/3099605817 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fee84030cf0 con 0x7fee9410e500 2024-09-11T23:27:27.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.320+0000 7fee927fc640 1 --2- 172.21.15.5:0/3099605817 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fee7c0a2c90 0x7fee7c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:27.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.321+0000 7fee9916b640 1 --2- 172.21.15.5:0/3099605817 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fee7c0a2c90 0x7fee7c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:27.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.321+0000 7fee927fc640 1 -- 172.21.15.5:0/3099605817 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9071+0+0 (secure 0 0 0) 0x7fee840f0870 con 0x7fee9410e500 2024-09-11T23:27:27.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.321+0000 7fee9916b640 1 --2- 172.21.15.5:0/3099605817 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fee7c0a2c90 0x7fee7c0a5150 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fee8c00bbe0 tx=0x7fee8c00b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:27.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.325+0000 7fee927fc640 1 -- 172.21.15.5:0/3099605817 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fee840bd4d0 con 0x7fee9410e500 2024-09-11T23:27:27.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:27 smithi159 ceph-mon[34394]: from='client.14799 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:27:27.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:27 smithi172 ceph-mon[34855]: from='client.14799 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:27:27.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.526+0000 7fee9b3cf640 1 -- 172.21.15.5:0/3099605817 --> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fee94062630 con 0x7fee7c0a2c90 2024-09-11T23:27:27.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.549+0000 7fee927fc640 1 -- 172.21.15.5:0/3099605817 <== mgr.14148 v2:172.21.15.5:6800/2285128668 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fee94062630 con 0x7fee7c0a2c90 2024-09-11T23:27:27.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.551+0000 7fee9b3cf640 1 -- 172.21.15.5:0/3099605817 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fee7c0a2c90 msgr2=0x7fee7c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:27.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.551+0000 7fee9b3cf640 1 --2- 172.21.15.5:0/3099605817 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fee7c0a2c90 0x7fee7c0a5150 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fee8c00bbe0 tx=0x7fee8c00b390 comp rx=0 tx=0).stop 2024-09-11T23:27:27.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.551+0000 7fee9b3cf640 1 -- 172.21.15.5:0/3099605817 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee9410e500 msgr2=0x7fee9419efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:27.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.551+0000 7fee9b3cf640 1 --2- 172.21.15.5:0/3099605817 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee9410e500 0x7fee9419efb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fee840098d0 tx=0x7fee84032ff0 comp rx=0 tx=0).stop 2024-09-11T23:27:27.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.552+0000 7fee9b3cf640 1 -- 172.21.15.5:0/3099605817 shutdown_connections 2024-09-11T23:27:27.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.552+0000 7fee9b3cf640 1 --2- 172.21.15.5:0/3099605817 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fee7c0a2c90 0x7fee7c0a5150 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:27.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.552+0000 7fee9b3cf640 1 --2- 172.21.15.5:0/3099605817 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee9410e500 0x7fee9419efb0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:27.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.552+0000 7fee9b3cf640 1 --2- 172.21.15.5:0/3099605817 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee94101440 0x7fee9419ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:27.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.552+0000 7fee9b3cf640 1 --2- 172.21.15.5:0/3099605817 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee94100b20 0x7fee9419a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:27.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.552+0000 7fee9b3cf640 1 -- 172.21.15.5:0/3099605817 >> 172.21.15.5:0/3099605817 conn(0x7fee940fc7d0 msgr2=0x7fee9410f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:27.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.552+0000 7fee9b3cf640 1 -- 172.21.15.5:0/3099605817 shutdown_connections 2024-09-11T23:27:27.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:27.552+0000 7fee9b3cf640 1 -- 172.21.15.5:0/3099605817 wait complete. 2024-09-11T23:27:28.175 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:28 smithi005 ceph-mon[31201]: pgmap v304: 129 pgs: 129 active+clean; 584 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 2.1 KiB/s wr, 9 op/s 2024-09-11T23:27:28.175 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:28 smithi005 ceph-mon[31201]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-11T23:27:28.204 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-11T23:27:28.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:28 smithi159 ceph-mon[34394]: pgmap v304: 129 pgs: 129 active+clean; 584 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 2.1 KiB/s wr, 9 op/s 2024-09-11T23:27:28.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:28 smithi159 ceph-mon[34394]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-11T23:27:28.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:28 smithi172 ceph-mon[34855]: pgmap v304: 129 pgs: 129 active+clean; 584 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 2.1 KiB/s wr, 9 op/s 2024-09-11T23:27:28.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:28 smithi172 ceph-mon[34855]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-11T23:27:28.461 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:27:28.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:28.951+0000 7f116a6a7640 1 -- 172.21.15.5:0/3370157086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11641037a0 msgr2=0x7f116410bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:28.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:28.951+0000 7f116a6a7640 1 --2- 172.21.15.5:0/3370157086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11641037a0 0x7f116410bc00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f114c009900 tx=0x7f114c02a410 comp rx=0 tx=0).stop 2024-09-11T23:27:28.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:28.951+0000 7f116a6a7640 1 -- 172.21.15.5:0/3370157086 shutdown_connections 2024-09-11T23:27:28.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:28.951+0000 7f116a6a7640 1 --2- 172.21.15.5:0/3370157086 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f116410c2f0 0x7f116410e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:28.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:28.951+0000 7f116a6a7640 1 --2- 172.21.15.5:0/3370157086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11641037a0 0x7f116410bc00 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:28.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:28.951+0000 7f116a6a7640 1 --2- 172.21.15.5:0/3370157086 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1164102df0 0x7f11641031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:28.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:28.951+0000 7f116a6a7640 1 -- 172.21.15.5:0/3370157086 >> 172.21.15.5:0/3370157086 conn(0x7f11640fc7d0 msgr2=0x7f11640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:28.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:28.951+0000 7f116a6a7640 1 -- 172.21.15.5:0/3370157086 shutdown_connections 2024-09-11T23:27:28.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:28.951+0000 7f116a6a7640 1 -- 172.21.15.5:0/3370157086 wait complete. 2024-09-11T23:27:28.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:28.952+0000 7f116a6a7640 1 Processor -- start 2024-09-11T23:27:28.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:28.952+0000 7f116a6a7640 1 -- start start 2024-09-11T23:27:28.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:28.952+0000 7f116a6a7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1164102df0 0x7f1164100a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:28.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:28.952+0000 7f116a6a7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11641037a0 0x7f1164100f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:28.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:28.952+0000 7f116a6a7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f116410c2f0 0x7f11641014d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:28.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:28.952+0000 7f116a6a7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1164111f60 con 0x7f116410c2f0 2024-09-11T23:27:28.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:28.952+0000 7f116a6a7640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1164111de0 con 0x7f11641037a0 2024-09-11T23:27:28.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:28.952+0000 7f116a6a7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f11641120e0 con 0x7f1164102df0 2024-09-11T23:27:28.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:28.952+0000 7f1168c44640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f116410c2f0 0x7f11641014d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:28.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:28.952+0000 7f1168c44640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f116410c2f0 0x7f11641014d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41084/0 (socket says 172.21.15.5:41084) 2024-09-11T23:27:28.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:28.952+0000 7f1168c44640 1 -- 172.21.15.5:0/1605545629 learned_addr learned my addr 172.21.15.5:0/1605545629 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:27:28.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:28.952+0000 7f1163fff640 1 --2- 172.21.15.5:0/1605545629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1164102df0 0x7f1164100a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:28.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:28.952+0000 7f115bfff640 1 --2- 172.21.15.5:0/1605545629 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11641037a0 0x7f1164100f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:28.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:28.952+0000 7f1168c44640 1 -- 172.21.15.5:0/1605545629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1164102df0 msgr2=0x7f1164100a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:28.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:28.952+0000 7f1168c44640 1 --2- 172.21.15.5:0/1605545629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1164102df0 0x7f1164100a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:28.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:28.952+0000 7f1168c44640 1 -- 172.21.15.5:0/1605545629 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11641037a0 msgr2=0x7f1164100f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:28.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:28.952+0000 7f1168c44640 1 --2- 172.21.15.5:0/1605545629 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11641037a0 0x7f1164100f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:28.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:28.952+0000 7f1168c44640 1 -- 172.21.15.5:0/1605545629 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11641a6a60 con 0x7f116410c2f0 2024-09-11T23:27:28.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:28.952+0000 7f1163fff640 1 --2- 172.21.15.5:0/1605545629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1164102df0 0x7f1164100a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:27:28.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:28.952+0000 7f115bfff640 1 --2- 172.21.15.5:0/1605545629 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11641037a0 0x7f1164100f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:27:28.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:28.953+0000 7f1168c44640 1 --2- 172.21.15.5:0/1605545629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f116410c2f0 0x7f11641014d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f115c00eaa0 tx=0x7f115c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:28.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:28.953+0000 7f1161ffb640 1 -- 172.21.15.5:0/1605545629 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f115c00cdb0 con 0x7f116410c2f0 2024-09-11T23:27:28.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:28.953+0000 7f1161ffb640 1 -- 172.21.15.5:0/1605545629 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f115c005020 con 0x7f116410c2f0 2024-09-11T23:27:28.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:28.953+0000 7f116a6a7640 1 -- 172.21.15.5:0/1605545629 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11641a6d50 con 0x7f116410c2f0 2024-09-11T23:27:28.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:28.953+0000 7f1161ffb640 1 -- 172.21.15.5:0/1605545629 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f115c0116d0 con 0x7f116410c2f0 2024-09-11T23:27:28.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:28.953+0000 7f116a6a7640 1 -- 172.21.15.5:0/1605545629 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11641a7290 con 0x7f116410c2f0 2024-09-11T23:27:28.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:28.954+0000 7f116a6a7640 1 -- 172.21.15.5:0/1605545629 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11641031d0 con 0x7f116410c2f0 2024-09-11T23:27:28.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:28.955+0000 7f1161ffb640 1 -- 172.21.15.5:0/1605545629 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f115c0051d0 con 0x7f116410c2f0 2024-09-11T23:27:28.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:28.956+0000 7f1161ffb640 1 --2- 172.21.15.5:0/1605545629 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f11500a2c90 0x7f11500a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:28.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:28.956+0000 7f1161ffb640 1 -- 172.21.15.5:0/1605545629 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9071+0+0 (secure 0 0 0) 0x7f115c0cfa00 con 0x7f116410c2f0 2024-09-11T23:27:28.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:28.956+0000 7f1163fff640 1 --2- 172.21.15.5:0/1605545629 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f11500a2c90 0x7f11500a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:28.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:28.956+0000 7f1163fff640 1 --2- 172.21.15.5:0/1605545629 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f11500a2c90 0x7f11500a5150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1154005fd0 tx=0x7f115400b5f0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:28.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:28.959+0000 7f1161ffb640 1 -- 172.21.15.5:0/1605545629 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f115c016030 con 0x7f116410c2f0 2024-09-11T23:27:29.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:29.162+0000 7f116a6a7640 1 -- 172.21.15.5:0/1605545629 --> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f1164062630 con 0x7f11500a2c90 2024-09-11T23:27:29.163 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:29 smithi005 ceph-mon[31201]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:27:29.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:29.168+0000 7f1161ffb640 1 -- 172.21.15.5:0/1605545629 <== mgr.14148 v2:172.21.15.5:6800/2285128668 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f1164062630 con 0x7f11500a2c90 2024-09-11T23:27:29.169 INFO:teuthology.orchestra.run.smithi005.stdout:/volumes/qa/sv_0/8efa0809-f9ec-4540-b106-c6b97a1d80bb 2024-09-11T23:27:29.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:29.171+0000 7f116a6a7640 1 -- 172.21.15.5:0/1605545629 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f11500a2c90 msgr2=0x7f11500a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:29.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:29.171+0000 7f116a6a7640 1 --2- 172.21.15.5:0/1605545629 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f11500a2c90 0x7f11500a5150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1154005fd0 tx=0x7f115400b5f0 comp rx=0 tx=0).stop 2024-09-11T23:27:29.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:29.171+0000 7f116a6a7640 1 -- 172.21.15.5:0/1605545629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f116410c2f0 msgr2=0x7f11641014d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:29.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:29.171+0000 7f116a6a7640 1 --2- 172.21.15.5:0/1605545629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f116410c2f0 0x7f11641014d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f115c00eaa0 tx=0x7f115c00ef60 comp rx=0 tx=0).stop 2024-09-11T23:27:29.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:29.171+0000 7f116a6a7640 1 -- 172.21.15.5:0/1605545629 shutdown_connections 2024-09-11T23:27:29.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:29.171+0000 7f116a6a7640 1 --2- 172.21.15.5:0/1605545629 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f11500a2c90 0x7f11500a5150 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:29.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:29.171+0000 7f116a6a7640 1 --2- 172.21.15.5:0/1605545629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f116410c2f0 0x7f11641014d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:29.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:29.171+0000 7f116a6a7640 1 --2- 172.21.15.5:0/1605545629 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11641037a0 0x7f1164100f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:29.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:29.171+0000 7f116a6a7640 1 --2- 172.21.15.5:0/1605545629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1164102df0 0x7f1164100a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:29.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:29.171+0000 7f116a6a7640 1 -- 172.21.15.5:0/1605545629 >> 172.21.15.5:0/1605545629 conn(0x7f11640fc7d0 msgr2=0x7f11640fd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:29.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:29.171+0000 7f116a6a7640 1 -- 172.21.15.5:0/1605545629 shutdown_connections 2024-09-11T23:27:29.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:29.171+0000 7f116a6a7640 1 -- 172.21.15.5:0/1605545629 wait complete. 2024-09-11T23:27:29.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:29 smithi159 ceph-mon[34394]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:27:29.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:29 smithi172 ceph-mon[34855]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:27:29.847 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-11T23:27:30.105 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:27:30.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:30 smithi005 ceph-mon[31201]: pgmap v305: 129 pgs: 129 active+clean; 604 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 4.2 KiB/s wr, 11 op/s 2024-09-11T23:27:30.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:30 smithi159 ceph-mon[34394]: pgmap v305: 129 pgs: 129 active+clean; 604 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 4.2 KiB/s wr, 11 op/s 2024-09-11T23:27:30.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:30 smithi172 ceph-mon[34855]: pgmap v305: 129 pgs: 129 active+clean; 604 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 4.2 KiB/s wr, 11 op/s 2024-09-11T23:27:30.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.592+0000 7fc223a53640 1 -- 172.21.15.5:0/2153885757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc21c103660 msgr2=0x7fc21c10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:30.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.592+0000 7fc223a53640 1 --2- 172.21.15.5:0/2153885757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc21c103660 0x7fc21c10bb50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc20c009900 tx=0x7fc20c02a480 comp rx=0 tx=0).stop 2024-09-11T23:27:30.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.592+0000 7fc223a53640 1 -- 172.21.15.5:0/2153885757 shutdown_connections 2024-09-11T23:27:30.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.592+0000 7fc223a53640 1 --2- 172.21.15.5:0/2153885757 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc21c10c170 0x7fc21c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:30.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.592+0000 7fc223a53640 1 --2- 172.21.15.5:0/2153885757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc21c103660 0x7fc21c10bb50 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:30.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.592+0000 7fc223a53640 1 --2- 172.21.15.5:0/2153885757 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc21c102d40 0x7fc21c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:30.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.592+0000 7fc223a53640 1 -- 172.21.15.5:0/2153885757 >> 172.21.15.5:0/2153885757 conn(0x7fc21c0fc7a0 msgr2=0x7fc21c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:30.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.592+0000 7fc223a53640 1 -- 172.21.15.5:0/2153885757 shutdown_connections 2024-09-11T23:27:30.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.592+0000 7fc223a53640 1 -- 172.21.15.5:0/2153885757 wait complete. 2024-09-11T23:27:30.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.593+0000 7fc223a53640 1 Processor -- start 2024-09-11T23:27:30.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.593+0000 7fc223a53640 1 -- start start 2024-09-11T23:27:30.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.593+0000 7fc223a53640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc21c102d40 0x7fc21c198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:30.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.593+0000 7fc223a53640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc21c103660 0x7fc21c198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:30.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.593+0000 7fc223a53640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc21c10c170 0x7fc21c19cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:30.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.593+0000 7fc223a53640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc21c111e70 con 0x7fc21c10c170 2024-09-11T23:27:30.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.593+0000 7fc223a53640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc21c111cf0 con 0x7fc21c102d40 2024-09-11T23:27:30.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.593+0000 7fc223a53640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc21c111ff0 con 0x7fc21c103660 2024-09-11T23:27:30.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.593+0000 7fc221ff0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc21c10c170 0x7fc21c19cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:30.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.593+0000 7fc221ff0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc21c10c170 0x7fc21c19cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41096/0 (socket says 172.21.15.5:41096) 2024-09-11T23:27:30.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.593+0000 7fc221ff0640 1 -- 172.21.15.5:0/262985315 learned_addr learned my addr 172.21.15.5:0/262985315 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:27:30.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.593+0000 7fc220fee640 1 --2- 172.21.15.5:0/262985315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc21c103660 0x7fc21c198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:30.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.593+0000 7fc2217ef640 1 --2- 172.21.15.5:0/262985315 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc21c102d40 0x7fc21c198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:30.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.594+0000 7fc221ff0640 1 -- 172.21.15.5:0/262985315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc21c103660 msgr2=0x7fc21c198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:30.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.594+0000 7fc221ff0640 1 --2- 172.21.15.5:0/262985315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc21c103660 0x7fc21c198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:30.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.594+0000 7fc221ff0640 1 -- 172.21.15.5:0/262985315 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc21c102d40 msgr2=0x7fc21c198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:30.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.594+0000 7fc221ff0640 1 --2- 172.21.15.5:0/262985315 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc21c102d40 0x7fc21c198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:30.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.594+0000 7fc221ff0640 1 -- 172.21.15.5:0/262985315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc21c19d2e0 con 0x7fc21c10c170 2024-09-11T23:27:30.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.594+0000 7fc221ff0640 1 --2- 172.21.15.5:0/262985315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc21c10c170 0x7fc21c19cc00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc21400cce0 tx=0x7fc21400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:30.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.594+0000 7fc2127fc640 1 -- 172.21.15.5:0/262985315 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc21400f450 con 0x7fc21c10c170 2024-09-11T23:27:30.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.594+0000 7fc223a53640 1 -- 172.21.15.5:0/262985315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc21c19d5d0 con 0x7fc21c10c170 2024-09-11T23:27:30.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.594+0000 7fc2127fc640 1 -- 172.21.15.5:0/262985315 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc21400faa0 con 0x7fc21c10c170 2024-09-11T23:27:30.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.594+0000 7fc2127fc640 1 -- 172.21.15.5:0/262985315 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc214018b70 con 0x7fc21c10c170 2024-09-11T23:27:30.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.594+0000 7fc223a53640 1 -- 172.21.15.5:0/262985315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc21c1a4eb0 con 0x7fc21c10c170 2024-09-11T23:27:30.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.595+0000 7fc223a53640 1 -- 172.21.15.5:0/262985315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc21c103120 con 0x7fc21c10c170 2024-09-11T23:27:30.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.596+0000 7fc2127fc640 1 -- 172.21.15.5:0/262985315 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fc214018d10 con 0x7fc21c10c170 2024-09-11T23:27:30.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.597+0000 7fc2127fc640 1 --2- 172.21.15.5:0/262985315 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fc2080a2c10 0x7fc2080a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:30.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.597+0000 7fc2217ef640 1 --2- 172.21.15.5:0/262985315 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fc2080a2c10 0x7fc2080a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:30.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.597+0000 7fc2127fc640 1 -- 172.21.15.5:0/262985315 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9071+0+0 (secure 0 0 0) 0x7fc2140cf8c0 con 0x7fc21c10c170 2024-09-11T23:27:30.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.597+0000 7fc2217ef640 1 --2- 172.21.15.5:0/262985315 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fc2080a2c10 0x7fc2080a50d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc21800bbe0 tx=0x7fc21800b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:30.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.600+0000 7fc2127fc640 1 -- 172.21.15.5:0/262985315 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc214014030 con 0x7fc21c10c170 2024-09-11T23:27:30.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.803+0000 7fc223a53640 1 -- 172.21.15.5:0/262985315 --> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fc21c0fe590 con 0x7fc2080a2c10 2024-09-11T23:27:30.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.825+0000 7fc2127fc640 1 -- 172.21.15.5:0/262985315 <== mgr.14148 v2:172.21.15.5:6800/2285128668 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc21c0fe590 con 0x7fc2080a2c10 2024-09-11T23:27:30.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.827+0000 7fc223a53640 1 -- 172.21.15.5:0/262985315 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fc2080a2c10 msgr2=0x7fc2080a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:30.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.827+0000 7fc223a53640 1 --2- 172.21.15.5:0/262985315 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fc2080a2c10 0x7fc2080a50d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc21800bbe0 tx=0x7fc21800b390 comp rx=0 tx=0).stop 2024-09-11T23:27:30.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.827+0000 7fc223a53640 1 -- 172.21.15.5:0/262985315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc21c10c170 msgr2=0x7fc21c19cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:30.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.827+0000 7fc223a53640 1 --2- 172.21.15.5:0/262985315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc21c10c170 0x7fc21c19cc00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc21400cce0 tx=0x7fc21400a620 comp rx=0 tx=0).stop 2024-09-11T23:27:30.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.828+0000 7fc223a53640 1 -- 172.21.15.5:0/262985315 shutdown_connections 2024-09-11T23:27:30.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.828+0000 7fc223a53640 1 --2- 172.21.15.5:0/262985315 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fc2080a2c10 0x7fc2080a50d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:30.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.828+0000 7fc223a53640 1 --2- 172.21.15.5:0/262985315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc21c10c170 0x7fc21c19cc00 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:30.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.828+0000 7fc223a53640 1 --2- 172.21.15.5:0/262985315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc21c103660 0x7fc21c198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:30.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.828+0000 7fc223a53640 1 --2- 172.21.15.5:0/262985315 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc21c102d40 0x7fc21c198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:30.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.828+0000 7fc223a53640 1 -- 172.21.15.5:0/262985315 >> 172.21.15.5:0/262985315 conn(0x7fc21c0fc7a0 msgr2=0x7fc21c0fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:30.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.828+0000 7fc223a53640 1 -- 172.21.15.5:0/262985315 shutdown_connections 2024-09-11T23:27:30.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:30.828+0000 7fc223a53640 1 -- 172.21.15.5:0/262985315 wait complete. 2024-09-11T23:27:31.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:31 smithi159 ceph-mon[34394]: from='client.14817 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:27:31.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:31 smithi172 ceph-mon[34855]: from='client.14817 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:27:31.454 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:31 smithi005 ceph-mon[31201]: from='client.14817 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:27:31.483 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-11T23:27:31.738 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:27:32.142 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:32 smithi005 ceph-mon[31201]: pgmap v306: 129 pgs: 129 active+clean; 604 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 4.1 KiB/s wr, 12 op/s 2024-09-11T23:27:32.142 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:32 smithi005 ceph-mon[31201]: from='client.14823 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:27:32.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.231+0000 7f3a06d63640 1 -- 172.21.15.5:0/3639290613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a00102d90 msgr2=0x7f3a00103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:32.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.231+0000 7f3a06d63640 1 --2- 172.21.15.5:0/3639290613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a00102d90 0x7f3a00103170 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f39f8009930 tx=0x7f39f802a420 comp rx=0 tx=0).stop 2024-09-11T23:27:32.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.231+0000 7f3a06d63640 1 -- 172.21.15.5:0/3639290613 shutdown_connections 2024-09-11T23:27:32.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.231+0000 7f3a06d63640 1 --2- 172.21.15.5:0/3639290613 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a00108290 0x7f3a0010ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:32.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.231+0000 7f3a06d63640 1 --2- 172.21.15.5:0/3639290613 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a00103740 0x7f3a00107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:32.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.231+0000 7f3a06d63640 1 --2- 172.21.15.5:0/3639290613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a00102d90 0x7f3a00103170 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:32.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.231+0000 7f3a06d63640 1 -- 172.21.15.5:0/3639290613 >> 172.21.15.5:0/3639290613 conn(0x7f3a000fc7d0 msgr2=0x7f3a000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:32.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.231+0000 7f3a06d63640 1 -- 172.21.15.5:0/3639290613 shutdown_connections 2024-09-11T23:27:32.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.231+0000 7f3a06d63640 1 -- 172.21.15.5:0/3639290613 wait complete. 2024-09-11T23:27:32.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.231+0000 7f3a06d63640 1 Processor -- start 2024-09-11T23:27:32.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.231+0000 7f3a06d63640 1 -- start start 2024-09-11T23:27:32.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.232+0000 7f3a06d63640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a00102d90 0x7f3a001985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:32.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.232+0000 7f3a06d63640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a00103740 0x7f3a00198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:32.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.232+0000 7f3a06d63640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a00108290 0x7f3a0019cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:32.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.232+0000 7f3a06d63640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3a00111fa0 con 0x7f3a00103740 2024-09-11T23:27:32.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.232+0000 7f3a06d63640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3a00111e20 con 0x7f3a00108290 2024-09-11T23:27:32.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.232+0000 7f3a06d63640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3a00112120 con 0x7f3a00102d90 2024-09-11T23:27:32.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.232+0000 7f39fffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a00103740 0x7f3a00198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:32.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.232+0000 7f39fffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a00103740 0x7f3a00198b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41108/0 (socket says 172.21.15.5:41108) 2024-09-11T23:27:32.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.232+0000 7f3a04aff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a00102d90 0x7f3a001985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:32.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.232+0000 7f39fffff640 1 -- 172.21.15.5:0/1949888799 learned_addr learned my addr 172.21.15.5:0/1949888799 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:27:32.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.232+0000 7f3a05300640 1 --2- 172.21.15.5:0/1949888799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a00108290 0x7f3a0019cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:32.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.232+0000 7f39fffff640 1 -- 172.21.15.5:0/1949888799 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a00102d90 msgr2=0x7f3a001985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:32.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.232+0000 7f39fffff640 1 --2- 172.21.15.5:0/1949888799 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a00102d90 0x7f3a001985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:32.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.232+0000 7f39fffff640 1 -- 172.21.15.5:0/1949888799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a00108290 msgr2=0x7f3a0019cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:32.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.232+0000 7f39fffff640 1 --2- 172.21.15.5:0/1949888799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a00108290 0x7f3a0019cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:32.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.232+0000 7f39fffff640 1 -- 172.21.15.5:0/1949888799 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a0019d580 con 0x7f3a00103740 2024-09-11T23:27:32.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.232+0000 7f3a05300640 1 --2- 172.21.15.5:0/1949888799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a00108290 0x7f3a0019cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:27:32.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.232+0000 7f39fffff640 1 --2- 172.21.15.5:0/1949888799 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a00103740 0x7f3a00198b10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f39e800b450 tx=0x7f39e800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:32.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.232+0000 7f39fdffb640 1 -- 172.21.15.5:0/1949888799 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e8015020 con 0x7f3a00103740 2024-09-11T23:27:32.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.232+0000 7f3a06d63640 1 -- 172.21.15.5:0/1949888799 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a0019d870 con 0x7f3a00103740 2024-09-11T23:27:32.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.232+0000 7f39fdffb640 1 -- 172.21.15.5:0/1949888799 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f39e8011d40 con 0x7f3a00103740 2024-09-11T23:27:32.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.232+0000 7f39fdffb640 1 -- 172.21.15.5:0/1949888799 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e800f340 con 0x7f3a00103740 2024-09-11T23:27:32.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.233+0000 7f3a06d63640 1 -- 172.21.15.5:0/1949888799 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a001a5150 con 0x7f3a00103740 2024-09-11T23:27:32.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.234+0000 7f3a06d63640 1 -- 172.21.15.5:0/1949888799 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a0006a7f0 con 0x7f3a00103740 2024-09-11T23:27:32.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.235+0000 7f39fdffb640 1 -- 172.21.15.5:0/1949888799 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f39e8018020 con 0x7f3a00103740 2024-09-11T23:27:32.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.235+0000 7f39fdffb640 1 --2- 172.21.15.5:0/1949888799 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f39ec0a2c10 0x7f39ec0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:32.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.235+0000 7f3a04aff640 1 --2- 172.21.15.5:0/1949888799 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f39ec0a2c10 0x7f39ec0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:32.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.235+0000 7f39fdffb640 1 -- 172.21.15.5:0/1949888799 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9071+0+0 (secure 0 0 0) 0x7f39e80ceed0 con 0x7f3a00103740 2024-09-11T23:27:32.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.236+0000 7f3a04aff640 1 --2- 172.21.15.5:0/1949888799 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f39ec0a2c10 0x7f39ec0a50d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f39f8006010 tx=0x7f39f8000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:32.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.240+0000 7f39fdffb640 1 -- 172.21.15.5:0/1949888799 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f39e801f020 con 0x7f3a00103740 2024-09-11T23:27:32.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:32 smithi159 ceph-mon[34394]: pgmap v306: 129 pgs: 129 active+clean; 604 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 4.1 KiB/s wr, 12 op/s 2024-09-11T23:27:32.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:32 smithi159 ceph-mon[34394]: from='client.14823 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:27:32.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:32 smithi172 ceph-mon[34855]: pgmap v306: 129 pgs: 129 active+clean; 604 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 4.1 KiB/s wr, 12 op/s 2024-09-11T23:27:32.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:32 smithi172 ceph-mon[34855]: from='client.14823 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:27:32.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.442+0000 7f3a06d63640 1 -- 172.21.15.5:0/1949888799 --> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f3a00062630 con 0x7f39ec0a2c10 2024-09-11T23:27:32.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.446+0000 7f39fdffb640 1 -- 172.21.15.5:0/1949888799 <== mgr.14148 v2:172.21.15.5:6800/2285128668 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f3a00062630 con 0x7f39ec0a2c10 2024-09-11T23:27:32.447 INFO:teuthology.orchestra.run.smithi005.stdout:/volumes/qa/sv_1/764ccb59-7833-443b-8bee-0575103480a8 2024-09-11T23:27:32.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.449+0000 7f3a06d63640 1 -- 172.21.15.5:0/1949888799 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f39ec0a2c10 msgr2=0x7f39ec0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:32.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.449+0000 7f3a06d63640 1 --2- 172.21.15.5:0/1949888799 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f39ec0a2c10 0x7f39ec0a50d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f39f8006010 tx=0x7f39f8000bc0 comp rx=0 tx=0).stop 2024-09-11T23:27:32.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.449+0000 7f3a06d63640 1 -- 172.21.15.5:0/1949888799 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a00103740 msgr2=0x7f3a00198b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:32.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.449+0000 7f3a06d63640 1 --2- 172.21.15.5:0/1949888799 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a00103740 0x7f3a00198b10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f39e800b450 tx=0x7f39e800b910 comp rx=0 tx=0).stop 2024-09-11T23:27:32.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.449+0000 7f3a06d63640 1 -- 172.21.15.5:0/1949888799 shutdown_connections 2024-09-11T23:27:32.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.449+0000 7f3a06d63640 1 --2- 172.21.15.5:0/1949888799 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f39ec0a2c10 0x7f39ec0a50d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:32.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.449+0000 7f3a06d63640 1 --2- 172.21.15.5:0/1949888799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a00108290 0x7f3a0019cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:32.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.449+0000 7f3a06d63640 1 --2- 172.21.15.5:0/1949888799 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a00103740 0x7f3a00198b10 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:32.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.449+0000 7f3a06d63640 1 --2- 172.21.15.5:0/1949888799 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a00102d90 0x7f3a001985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:32.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.449+0000 7f3a06d63640 1 -- 172.21.15.5:0/1949888799 >> 172.21.15.5:0/1949888799 conn(0x7f3a000fc7d0 msgr2=0x7f3a00105e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:32.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.449+0000 7f3a06d63640 1 -- 172.21.15.5:0/1949888799 shutdown_connections 2024-09-11T23:27:32.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:32.449+0000 7f3a06d63640 1 -- 172.21.15.5:0/1949888799 wait complete. 2024-09-11T23:27:33.182 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:27:33.441 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:27:33.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:33.918+0000 7feb5a672640 1 -- 172.21.15.5:0/3983702376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb54102570 msgr2=0x7feb541029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:33.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:33.918+0000 7feb5a672640 1 --2- 172.21.15.5:0/3983702376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb54102570 0x7feb541029b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7feb48009900 tx=0x7feb4802a480 comp rx=0 tx=0).stop 2024-09-11T23:27:33.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:33.918+0000 7feb5a672640 1 -- 172.21.15.5:0/3983702376 shutdown_connections 2024-09-11T23:27:33.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:33.918+0000 7feb5a672640 1 --2- 172.21.15.5:0/3983702376 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb54102ef0 0x7feb5410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:33.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:33.918+0000 7feb5a672640 1 --2- 172.21.15.5:0/3983702376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb54102570 0x7feb541029b0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:33.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:33.918+0000 7feb5a672640 1 --2- 172.21.15.5:0/3983702376 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb54100e20 0x7feb54101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:33.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:33.918+0000 7feb5a672640 1 -- 172.21.15.5:0/3983702376 >> 172.21.15.5:0/3983702376 conn(0x7feb540fc7d0 msgr2=0x7feb540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:33.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:33.918+0000 7feb5a672640 1 -- 172.21.15.5:0/3983702376 shutdown_connections 2024-09-11T23:27:33.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:33.918+0000 7feb5a672640 1 -- 172.21.15.5:0/3983702376 wait complete. 2024-09-11T23:27:33.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:33.919+0000 7feb5a672640 1 Processor -- start 2024-09-11T23:27:33.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:33.919+0000 7feb5a672640 1 -- start start 2024-09-11T23:27:33.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:33.919+0000 7feb5a672640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb54100e20 0x7feb54197060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:33.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:33.919+0000 7feb5a672640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb54102570 0x7feb541975a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:33.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:33.919+0000 7feb5a672640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb54102ef0 0x7feb54197ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:33.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:33.919+0000 7feb5a672640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7feb54110e30 con 0x7feb54102570 2024-09-11T23:27:33.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:33.919+0000 7feb5a672640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7feb54110cb0 con 0x7feb54102ef0 2024-09-11T23:27:33.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:33.919+0000 7feb5a672640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7feb54110fb0 con 0x7feb54100e20 2024-09-11T23:27:33.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:33.919+0000 7feb537fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb54102570 0x7feb541975a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:33.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:33.919+0000 7feb537fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb54102570 0x7feb541975a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44308/0 (socket says 172.21.15.5:44308) 2024-09-11T23:27:33.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:33.919+0000 7feb537fe640 1 -- 172.21.15.5:0/696167203 learned_addr learned my addr 172.21.15.5:0/696167203 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:27:33.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:33.919+0000 7feb53fff640 1 --2- 172.21.15.5:0/696167203 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb54100e20 0x7feb54197060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:33.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:33.919+0000 7feb58c0f640 1 --2- 172.21.15.5:0/696167203 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb54102ef0 0x7feb54197ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:33.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:33.919+0000 7feb537fe640 1 -- 172.21.15.5:0/696167203 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb54100e20 msgr2=0x7feb54197060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:33.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:33.920+0000 7feb537fe640 1 --2- 172.21.15.5:0/696167203 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb54100e20 0x7feb54197060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:33.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:33.920+0000 7feb537fe640 1 -- 172.21.15.5:0/696167203 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb54102ef0 msgr2=0x7feb54197ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:33.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:33.920+0000 7feb537fe640 1 --2- 172.21.15.5:0/696167203 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb54102ef0 0x7feb54197ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:33.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:33.920+0000 7feb537fe640 1 -- 172.21.15.5:0/696167203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb541a68d0 con 0x7feb54102570 2024-09-11T23:27:33.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:33.920+0000 7feb537fe640 1 --2- 172.21.15.5:0/696167203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb54102570 0x7feb541975a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7feb48006010 tx=0x7feb48004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:33.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:33.920+0000 7feb517fa640 1 -- 172.21.15.5:0/696167203 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb4803f030 con 0x7feb54102570 2024-09-11T23:27:33.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:33.920+0000 7feb5a672640 1 -- 172.21.15.5:0/696167203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb541a6b60 con 0x7feb54102570 2024-09-11T23:27:33.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:33.920+0000 7feb517fa640 1 -- 172.21.15.5:0/696167203 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feb48003aa0 con 0x7feb54102570 2024-09-11T23:27:33.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:33.920+0000 7feb517fa640 1 -- 172.21.15.5:0/696167203 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb48035070 con 0x7feb54102570 2024-09-11T23:27:33.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:33.920+0000 7feb5a672640 1 -- 172.21.15.5:0/696167203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb541a7040 con 0x7feb54102570 2024-09-11T23:27:33.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:33.921+0000 7feb5a672640 1 -- 172.21.15.5:0/696167203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb54101200 con 0x7feb54102570 2024-09-11T23:27:33.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:33.922+0000 7feb517fa640 1 -- 172.21.15.5:0/696167203 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7feb48042030 con 0x7feb54102570 2024-09-11T23:27:33.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:33.923+0000 7feb517fa640 1 --2- 172.21.15.5:0/696167203 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7feb3c0a2c10 0x7feb3c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:33.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:33.923+0000 7feb53fff640 1 --2- 172.21.15.5:0/696167203 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7feb3c0a2c10 0x7feb3c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:33.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:33.923+0000 7feb517fa640 1 -- 172.21.15.5:0/696167203 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9071+0+0 (secure 0 0 0) 0x7feb480efa80 con 0x7feb54102570 2024-09-11T23:27:33.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:33.923+0000 7feb53fff640 1 --2- 172.21.15.5:0/696167203 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7feb3c0a2c10 0x7feb3c0a50d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7feb44009bd0 tx=0x7feb44005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:33.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:33.927+0000 7feb517fa640 1 -- 172.21.15.5:0/696167203 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feb480f1e20 con 0x7feb54102570 2024-09-11T23:27:34.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:34.140+0000 7feb5a672640 1 -- 172.21.15.5:0/696167203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feb54108b00 con 0x7feb54102570 2024-09-11T23:27:34.141 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:34 smithi005 ceph-mon[31201]: pgmap v307: 129 pgs: 129 active+clean; 604 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-09-11T23:27:34.141 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:34 smithi005 ceph-mon[31201]: from='client.14829 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:27:34.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:34.141+0000 7feb517fa640 1 -- 172.21.15.5:0/696167203 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11918 (secure 0 0 0) 0x7feb480bbe90 con 0x7feb54102570 2024-09-11T23:27:34.142 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:27:34.142 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":24,"btime":"2024-09-11T23:27:24:041243+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3865435482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3865435482},{"type":"v1","addr":"172.21.15.5:6835","nonce":3865435482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1323314897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":1323314897},{"type":"v1","addr":"172.21.15.5:6837","nonce":1323314897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14610,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6839/4140073288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":4140073288},{"type":"v1","addr":"172.21.15.5:6839","nonce":4140073288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6841/1162578713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":1162578713},{"type":"v1","addr":"172.21.15.5:6841","nonce":1162578713}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3113658116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3113658116},{"type":"v1","addr":"172.21.15.172:6833","nonce":3113658116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3887336060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3887336060},{"type":"v1","addr":"172.21.15.159:6833","nonce":3887336060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:26:45.305894+0000","modified":"2024-09-11T23:27:23.903504+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24475,"mds_2":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24440":{"gid":24440,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.159:6835/2539263301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2539263301},{"type":"v1","addr":"172.21.15.159:6835","nonce":2539263301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/4240913699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":4240913699},{"type":"v1","addr":"172.21.15.172:6835","nonce":4240913699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/4200951601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":4200951601},{"type":"v1","addr":"172.21.15.172:6837","nonce":4200951601}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":16,"addr":"172.21.15.159:6837/4020181017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":4020181017},{"type":"v1","addr":"172.21.15.159:6837","nonce":4020181017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.172:6839/3928313314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3928313314},{"type":"v1","addr":"172.21.15.172:6839","nonce":3928313314}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.159:6839/3843336290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3843336290},{"type":"v1","addr":"172.21.15.159:6839","nonce":3843336290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24461,24475,24494]},"id":1}]} 2024-09-11T23:27:34.143 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 24 2024-09-11T23:27:34.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:34.143+0000 7feb5a672640 1 -- 172.21.15.5:0/696167203 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7feb3c0a2c10 msgr2=0x7feb3c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:34.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:34.143+0000 7feb5a672640 1 --2- 172.21.15.5:0/696167203 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7feb3c0a2c10 0x7feb3c0a50d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7feb44009bd0 tx=0x7feb44005f90 comp rx=0 tx=0).stop 2024-09-11T23:27:34.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:34.143+0000 7feb5a672640 1 -- 172.21.15.5:0/696167203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb54102570 msgr2=0x7feb541975a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:34.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:34.143+0000 7feb5a672640 1 --2- 172.21.15.5:0/696167203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb54102570 0x7feb541975a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7feb48006010 tx=0x7feb48004270 comp rx=0 tx=0).stop 2024-09-11T23:27:34.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:34.143+0000 7feb5a672640 1 -- 172.21.15.5:0/696167203 shutdown_connections 2024-09-11T23:27:34.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:34.143+0000 7feb5a672640 1 --2- 172.21.15.5:0/696167203 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7feb3c0a2c10 0x7feb3c0a50d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:34.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:34.143+0000 7feb5a672640 1 --2- 172.21.15.5:0/696167203 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb54102ef0 0x7feb54197ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:34.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:34.143+0000 7feb5a672640 1 --2- 172.21.15.5:0/696167203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb54102570 0x7feb541975a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:34.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:34.143+0000 7feb5a672640 1 --2- 172.21.15.5:0/696167203 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb54100e20 0x7feb54197060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:34.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:34.143+0000 7feb5a672640 1 -- 172.21.15.5:0/696167203 >> 172.21.15.5:0/696167203 conn(0x7feb540fc7d0 msgr2=0x7feb540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:34.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:34.143+0000 7feb5a672640 1 -- 172.21.15.5:0/696167203 shutdown_connections 2024-09-11T23:27:34.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:34.143+0000 7feb5a672640 1 -- 172.21.15.5:0/696167203 wait complete. 2024-09-11T23:27:34.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:34 smithi159 ceph-mon[34394]: pgmap v307: 129 pgs: 129 active+clean; 604 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-09-11T23:27:34.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:34 smithi159 ceph-mon[34394]: from='client.14829 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:27:34.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:34 smithi172 ceph-mon[34855]: pgmap v307: 129 pgs: 129 active+clean; 604 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-09-11T23:27:34.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:34 smithi172 ceph-mon[34855]: from='client.14829 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:27:34.827 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T23:27:35.092 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:27:35.353 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:35 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/696167203' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:27:35.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:35 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/696167203' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:27:35.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:35 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/696167203' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:27:35.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.527+0000 7f25598e9640 1 -- 172.21.15.5:0/2922002151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2554102ef0 msgr2=0x7f255410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:35.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.527+0000 7f25598e9640 1 --2- 172.21.15.5:0/2922002151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2554102ef0 0x7f255410da40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f254c009ca0 tx=0x7f254c02a950 comp rx=0 tx=0).stop 2024-09-11T23:27:35.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.527+0000 7f25598e9640 1 -- 172.21.15.5:0/2922002151 shutdown_connections 2024-09-11T23:27:35.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.527+0000 7f25598e9640 1 --2- 172.21.15.5:0/2922002151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2554102ef0 0x7f255410da40 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:35.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.527+0000 7f25598e9640 1 --2- 172.21.15.5:0/2922002151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2554102570 0x7f25541029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:35.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.527+0000 7f25598e9640 1 --2- 172.21.15.5:0/2922002151 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2554100e20 0x7f2554101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:35.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.527+0000 7f25598e9640 1 -- 172.21.15.5:0/2922002151 >> 172.21.15.5:0/2922002151 conn(0x7f25540fc7d0 msgr2=0x7f25540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:35.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.527+0000 7f25598e9640 1 -- 172.21.15.5:0/2922002151 shutdown_connections 2024-09-11T23:27:35.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.527+0000 7f25598e9640 1 -- 172.21.15.5:0/2922002151 wait complete. 2024-09-11T23:27:35.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.528+0000 7f25598e9640 1 Processor -- start 2024-09-11T23:27:35.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.528+0000 7f25598e9640 1 -- start start 2024-09-11T23:27:35.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.528+0000 7f25598e9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2554100e20 0x7f2554197350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:35.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.528+0000 7f25598e9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2554102570 0x7f2554197890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:35.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.528+0000 7f25598e9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2554102ef0 0x7f255419bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:35.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.528+0000 7f25598e9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2554110e30 con 0x7f2554102ef0 2024-09-11T23:27:35.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.528+0000 7f25598e9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f2554110cb0 con 0x7f2554102570 2024-09-11T23:27:35.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.528+0000 7f25598e9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2554110fb0 con 0x7f2554100e20 2024-09-11T23:27:35.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.528+0000 7f25537fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2554102ef0 0x7f255419bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:35.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.528+0000 7f25537fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2554102ef0 0x7f255419bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44316/0 (socket says 172.21.15.5:44316) 2024-09-11T23:27:35.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.528+0000 7f25537fe640 1 -- 172.21.15.5:0/2683762910 learned_addr learned my addr 172.21.15.5:0/2683762910 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:27:35.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.529+0000 7f2552ffd640 1 --2- 172.21.15.5:0/2683762910 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2554100e20 0x7f2554197350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:35.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.529+0000 7f25527fc640 1 --2- 172.21.15.5:0/2683762910 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2554102570 0x7f2554197890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:35.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.529+0000 7f25537fe640 1 -- 172.21.15.5:0/2683762910 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2554100e20 msgr2=0x7f2554197350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:35.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.529+0000 7f25537fe640 1 --2- 172.21.15.5:0/2683762910 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2554100e20 0x7f2554197350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:35.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.529+0000 7f25537fe640 1 -- 172.21.15.5:0/2683762910 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2554102570 msgr2=0x7f2554197890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:35.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.529+0000 7f25537fe640 1 --2- 172.21.15.5:0/2683762910 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2554102570 0x7f2554197890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:35.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.529+0000 7f25537fe640 1 -- 172.21.15.5:0/2683762910 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f255419c300 con 0x7f2554102ef0 2024-09-11T23:27:35.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.529+0000 7f25537fe640 1 --2- 172.21.15.5:0/2683762910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2554102ef0 0x7f255419bc20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f254c004af0 tx=0x7f254c02f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:35.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.529+0000 7f25588e7640 1 -- 172.21.15.5:0/2683762910 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254c034040 con 0x7f2554102ef0 2024-09-11T23:27:35.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.529+0000 7f25598e9640 1 -- 172.21.15.5:0/2683762910 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f255419c590 con 0x7f2554102ef0 2024-09-11T23:27:35.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.529+0000 7f25588e7640 1 -- 172.21.15.5:0/2683762910 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f254c0308f0 con 0x7f2554102ef0 2024-09-11T23:27:35.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.529+0000 7f25588e7640 1 -- 172.21.15.5:0/2683762910 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254c004670 con 0x7f2554102ef0 2024-09-11T23:27:35.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.529+0000 7f25598e9640 1 -- 172.21.15.5:0/2683762910 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25541a3ed0 con 0x7f2554102ef0 2024-09-11T23:27:35.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.530+0000 7f25598e9640 1 -- 172.21.15.5:0/2683762910 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2554101200 con 0x7f2554102ef0 2024-09-11T23:27:35.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.532+0000 7f25588e7640 1 -- 172.21.15.5:0/2683762910 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f254c037020 con 0x7f2554102ef0 2024-09-11T23:27:35.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.532+0000 7f25588e7640 1 --2- 172.21.15.5:0/2683762910 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f253c0a2c10 0x7f253c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:35.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.532+0000 7f25588e7640 1 -- 172.21.15.5:0/2683762910 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9071+0+0 (secure 0 0 0) 0x7f254c0f02f0 con 0x7f2554102ef0 2024-09-11T23:27:35.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.532+0000 7f2552ffd640 1 --2- 172.21.15.5:0/2683762910 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f253c0a2c10 0x7f253c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:35.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.533+0000 7f2552ffd640 1 --2- 172.21.15.5:0/2683762910 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f253c0a2c10 0x7f253c0a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2544009bd0 tx=0x7f2544005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:35.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.535+0000 7f25588e7640 1 -- 172.21.15.5:0/2683762910 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f254c0bcff0 con 0x7f2554102ef0 2024-09-11T23:27:35.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.714+0000 7f25598e9640 1 -- 172.21.15.5:0/2683762910 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2554109090 con 0x7f2554102ef0 2024-09-11T23:27:35.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.715+0000 7f25588e7640 1 -- 172.21.15.5:0/2683762910 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24655 (secure 0 0 0) 0x7f254c0bc8f0 con 0x7f2554102ef0 2024-09-11T23:27:35.716 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:27:35.717 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":86,"fsid":"1f5284d2-7094-11ef-bcea-c7b262605968","created":"2024-09-11T23:19:00.051813+0000","modified":"2024-09-11T23:26:54.807250+0000","last_up_change":"2024-09-11T23:25:53.433445+0000","last_in_change":"2024-09-11T23:25:29.443287+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:22:04.534014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:26:41.220887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:26:43.664094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T23:26:50.471521+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bf95ced0-780b-482f-87da-0b5e61de62ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6803","nonce":624761084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6805","nonce":624761084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6809","nonce":624761084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6807","nonce":624761084}]},"public_addr":"172.21.15.5:6803/624761084","cluster_addr":"172.21.15.5:6805/624761084","heartbeat_back_addr":"172.21.15.5:6809/624761084","heartbeat_front_addr":"172.21.15.5:6807/624761084","state":["exists","up"]},{"osd":1,"uuid":"d926484f-78a6-497b-843d-f2db54ade4a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6801","nonce":2111290186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6803","nonce":2111290186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6807","nonce":2111290186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6805","nonce":2111290186}]},"public_addr":"172.21.15.159:6801/2111290186","cluster_addr":"172.21.15.159:6803/2111290186","heartbeat_back_addr":"172.21.15.159:6807/2111290186","heartbeat_front_addr":"172.21.15.159:6805/2111290186","state":["exists","up"]},{"osd":2,"uuid":"d92cd431-0ba7-4171-82b8-60fa3d63a64b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6801","nonce":299915717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6803","nonce":299915717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6807","nonce":299915717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6805","nonce":299915717}]},"public_addr":"172.21.15.172:6801/299915717","cluster_addr":"172.21.15.172:6803/299915717","heartbeat_back_addr":"172.21.15.172:6807/299915717","heartbeat_front_addr":"172.21.15.172:6805/299915717","state":["exists","up"]},{"osd":3,"uuid":"0521043b-559c-4671-b11e-9117871cff49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6811","nonce":2080498921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6813","nonce":2080498921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6817","nonce":2080498921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6815","nonce":2080498921}]},"public_addr":"172.21.15.5:6811/2080498921","cluster_addr":"172.21.15.5:6813/2080498921","heartbeat_back_addr":"172.21.15.5:6817/2080498921","heartbeat_front_addr":"172.21.15.5:6815/2080498921","state":["exists","up"]},{"osd":4,"uuid":"b968d762-a46e-4ae2-b19d-8225f82de613","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6809","nonce":4185908786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6811","nonce":4185908786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6815","nonce":4185908786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6813","nonce":4185908786}]},"public_addr":"172.21.15.159:6809/4185908786","cluster_addr":"172.21.15.159:6811/4185908786","heartbeat_back_addr":"172.21.15.159:6815/4185908786","heartbeat_front_addr":"172.21.15.159:6813/4185908786","state":["exists","up"]},{"osd":5,"uuid":"1b0a518a-3d17-4635-81da-52f9ef83a574","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6809","nonce":3742759000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6811","nonce":3742759000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6815","nonce":3742759000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6813","nonce":3742759000}]},"public_addr":"172.21.15.172:6809/3742759000","cluster_addr":"172.21.15.172:6811/3742759000","heartbeat_back_addr":"172.21.15.172:6815/3742759000","heartbeat_front_addr":"172.21.15.172:6813/3742759000","state":["exists","up"]},{"osd":6,"uuid":"c3a2db6c-9189-4e42-aa1e-52189a9c4291","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6819","nonce":4156823423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6821","nonce":4156823423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6825","nonce":4156823423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6823","nonce":4156823423}]},"public_addr":"172.21.15.5:6819/4156823423","cluster_addr":"172.21.15.5:6821/4156823423","heartbeat_back_addr":"172.21.15.5:6825/4156823423","heartbeat_front_addr":"172.21.15.5:6823/4156823423","state":["exists","up"]},{"osd":7,"uuid":"dfaadf28-74ab-4cda-8647-dcb58beb7cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6817","nonce":4222571927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6819","nonce":4222571927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6823","nonce":4222571927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6821","nonce":4222571927}]},"public_addr":"172.21.15.159:6817/4222571927","cluster_addr":"172.21.15.159:6819/4222571927","heartbeat_back_addr":"172.21.15.159:6823/4222571927","heartbeat_front_addr":"172.21.15.159:6821/4222571927","state":["exists","up"]},{"osd":8,"uuid":"47f66651-614c-4613-9793-69c140dbf705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6817","nonce":3661505951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6819","nonce":3661505951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6823","nonce":3661505951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6821","nonce":3661505951}]},"public_addr":"172.21.15.172:6817/3661505951","cluster_addr":"172.21.15.172:6819/3661505951","heartbeat_back_addr":"172.21.15.172:6823/3661505951","heartbeat_front_addr":"172.21.15.172:6821/3661505951","state":["exists","up"]},{"osd":9,"uuid":"c97b8221-8cf9-4fab-9e27-ff7f3bd98152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6827","nonce":72036667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6829","nonce":72036667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6833","nonce":72036667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6831","nonce":72036667}]},"public_addr":"172.21.15.5:6827/72036667","cluster_addr":"172.21.15.5:6829/72036667","heartbeat_back_addr":"172.21.15.5:6833/72036667","heartbeat_front_addr":"172.21.15.5:6831/72036667","state":["exists","up"]},{"osd":10,"uuid":"143376c1-f3f1-4df4-bcd3-a9b46fad8c1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6825","nonce":3334483164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6827","nonce":3334483164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6831","nonce":3334483164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6829","nonce":3334483164}]},"public_addr":"172.21.15.159:6825/3334483164","cluster_addr":"172.21.15.159:6827/3334483164","heartbeat_back_addr":"172.21.15.159:6831/3334483164","heartbeat_front_addr":"172.21.15.159:6829/3334483164","state":["exists","up"]},{"osd":11,"uuid":"5cc91ff9-fc0f-4e7a-8e4d-87df0e7efbeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6825","nonce":1965415663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6827","nonce":1965415663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6831","nonce":1965415663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6829","nonce":1965415663}]},"public_addr":"172.21.15.172:6825/1965415663","cluster_addr":"172.21.15.172:6827/1965415663","heartbeat_back_addr":"172.21.15.172:6831/1965415663","heartbeat_front_addr":"172.21.15.172:6829/1965415663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:21:13.024707+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:21:38.063741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:22:02.221583+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:22:27.919711+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:22:53.870543+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:23:18.539905+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:23:43.694229+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:24:08.984704+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:24:34.378582+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:25:00.102231+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:25:25.367178+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:25:51.439033+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/2713701762":"2024-09-12T23:19:50.031855+0000","172.21.15.5:0/3135835713":"2024-09-12T23:19:50.031855+0000","172.21.15.5:0/3935034940":"2024-09-12T23:19:50.031855+0000","172.21.15.5:6801/1790126649":"2024-09-12T23:19:50.031855+0000","172.21.15.5:6801/1358356358":"2024-09-12T23:19:26.149011+0000","172.21.15.5:6800/1790126649":"2024-09-12T23:19:50.031855+0000","172.21.15.5:6800/1358356358":"2024-09-12T23:19:26.149011+0000","172.21.15.5:0/2243688290":"2024-09-12T23:19:26.149011+0000","172.21.15.5:0/1493331899":"2024-09-12T23:19:26.149011+0000","172.21.15.5:0/2329812802":"2024-09-12T23:19:26.149011+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:27:35.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.718+0000 7f25598e9640 1 -- 172.21.15.5:0/2683762910 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f253c0a2c10 msgr2=0x7f253c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:35.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.718+0000 7f25598e9640 1 --2- 172.21.15.5:0/2683762910 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f253c0a2c10 0x7f253c0a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2544009bd0 tx=0x7f2544005f90 comp rx=0 tx=0).stop 2024-09-11T23:27:35.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.718+0000 7f25598e9640 1 -- 172.21.15.5:0/2683762910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2554102ef0 msgr2=0x7f255419bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:35.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.718+0000 7f25598e9640 1 --2- 172.21.15.5:0/2683762910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2554102ef0 0x7f255419bc20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f254c004af0 tx=0x7f254c02f5d0 comp rx=0 tx=0).stop 2024-09-11T23:27:35.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.718+0000 7f25598e9640 1 -- 172.21.15.5:0/2683762910 shutdown_connections 2024-09-11T23:27:35.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.718+0000 7f25598e9640 1 --2- 172.21.15.5:0/2683762910 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f253c0a2c10 0x7f253c0a50d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:35.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.718+0000 7f25598e9640 1 --2- 172.21.15.5:0/2683762910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2554102ef0 0x7f255419bc20 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:35.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.718+0000 7f25598e9640 1 --2- 172.21.15.5:0/2683762910 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2554102570 0x7f2554197890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:35.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.718+0000 7f25598e9640 1 --2- 172.21.15.5:0/2683762910 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2554100e20 0x7f2554197350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:35.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.718+0000 7f25598e9640 1 -- 172.21.15.5:0/2683762910 >> 172.21.15.5:0/2683762910 conn(0x7f25540fc7d0 msgr2=0x7f25540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:35.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.718+0000 7f25598e9640 1 -- 172.21.15.5:0/2683762910 shutdown_connections 2024-09-11T23:27:35.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:35.718+0000 7f25598e9640 1 -- 172.21.15.5:0/2683762910 wait complete. 2024-09-11T23:27:36.361 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:36 smithi005 ceph-mon[31201]: pgmap v308: 129 pgs: 129 active+clean; 623 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.4 KiB/s wr, 13 op/s 2024-09-11T23:27:36.361 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:36 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/2683762910' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:27:36.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:36 smithi159 ceph-mon[34394]: pgmap v308: 129 pgs: 129 active+clean; 623 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.4 KiB/s wr, 13 op/s 2024-09-11T23:27:36.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:36 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/2683762910' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:27:36.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:36 smithi172 ceph-mon[34855]: pgmap v308: 129 pgs: 129 active+clean; 623 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.4 KiB/s wr, 13 op/s 2024-09-11T23:27:36.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:36 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/2683762910' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:27:36.390 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-11T23:27:36.391 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T23:27:36.647 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:27:37.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.168+0000 7f1d00a39640 1 -- 172.21.15.5:0/1271482846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1cfc100e20 msgr2=0x7f1cfc101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:37.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.168+0000 7f1d00a39640 1 --2- 172.21.15.5:0/1271482846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1cfc100e20 0x7f1cfc101200 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1cec009900 tx=0x7f1cec02a480 comp rx=0 tx=0).stop 2024-09-11T23:27:37.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.168+0000 7f1d00a39640 1 -- 172.21.15.5:0/1271482846 shutdown_connections 2024-09-11T23:27:37.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.168+0000 7f1d00a39640 1 --2- 172.21.15.5:0/1271482846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1cfc102ef0 0x7f1cfc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:37.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.168+0000 7f1d00a39640 1 --2- 172.21.15.5:0/1271482846 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cfc102570 0x7f1cfc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:37.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.168+0000 7f1d00a39640 1 --2- 172.21.15.5:0/1271482846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1cfc100e20 0x7f1cfc101200 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:37.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.168+0000 7f1d00a39640 1 -- 172.21.15.5:0/1271482846 >> 172.21.15.5:0/1271482846 conn(0x7f1cfc0fc7d0 msgr2=0x7f1cfc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:37.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.168+0000 7f1d00a39640 1 -- 172.21.15.5:0/1271482846 shutdown_connections 2024-09-11T23:27:37.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.168+0000 7f1d00a39640 1 -- 172.21.15.5:0/1271482846 wait complete. 2024-09-11T23:27:37.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.169+0000 7f1d00a39640 1 Processor -- start 2024-09-11T23:27:37.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.169+0000 7f1d00a39640 1 -- start start 2024-09-11T23:27:37.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.169+0000 7f1d00a39640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1cfc100e20 0x7f1cfc1983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:37.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.169+0000 7f1d00a39640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cfc102570 0x7f1cfc198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:37.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.169+0000 7f1d00a39640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1cfc102ef0 0x7f1cfc19ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:37.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.169+0000 7f1d00a39640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1cfc110e50 con 0x7f1cfc102ef0 2024-09-11T23:27:37.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.169+0000 7f1d00a39640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1cfc110cd0 con 0x7f1cfc102570 2024-09-11T23:27:37.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.169+0000 7f1d00a39640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1cfc110fd0 con 0x7f1cfc100e20 2024-09-11T23:27:37.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.170+0000 7f1cfad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1cfc102ef0 0x7f1cfc19ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:37.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.170+0000 7f1cfad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1cfc102ef0 0x7f1cfc19ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44336/0 (socket says 172.21.15.5:44336) 2024-09-11T23:27:37.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.170+0000 7f1cfad9d640 1 -- 172.21.15.5:0/2112384935 learned_addr learned my addr 172.21.15.5:0/2112384935 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:27:37.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.170+0000 7f1cfa59c640 1 --2- 172.21.15.5:0/2112384935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1cfc100e20 0x7f1cfc1983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:37.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.170+0000 7f1cf9d9b640 1 --2- 172.21.15.5:0/2112384935 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cfc102570 0x7f1cfc198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:37.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.170+0000 7f1cfad9d640 1 -- 172.21.15.5:0/2112384935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1cfc100e20 msgr2=0x7f1cfc1983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:37.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.170+0000 7f1cfad9d640 1 --2- 172.21.15.5:0/2112384935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1cfc100e20 0x7f1cfc1983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:37.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.170+0000 7f1cfad9d640 1 -- 172.21.15.5:0/2112384935 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cfc102570 msgr2=0x7f1cfc198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:37.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.170+0000 7f1cfad9d640 1 --2- 172.21.15.5:0/2112384935 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cfc102570 0x7f1cfc198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:37.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.170+0000 7f1cfad9d640 1 -- 172.21.15.5:0/2112384935 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cfc19d3a0 con 0x7f1cfc102ef0 2024-09-11T23:27:37.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.170+0000 7f1cfad9d640 1 --2- 172.21.15.5:0/2112384935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1cfc102ef0 0x7f1cfc19ccc0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1cf400cce0 tx=0x7f1cf400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:37.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.170+0000 7f1ceb7fe640 1 -- 172.21.15.5:0/2112384935 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf400f450 con 0x7f1cfc102ef0 2024-09-11T23:27:37.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.170+0000 7f1d00a39640 1 -- 172.21.15.5:0/2112384935 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cfc19d690 con 0x7f1cfc102ef0 2024-09-11T23:27:37.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.170+0000 7f1ceb7fe640 1 -- 172.21.15.5:0/2112384935 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1cf400faa0 con 0x7f1cfc102ef0 2024-09-11T23:27:37.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.170+0000 7f1ceb7fe640 1 -- 172.21.15.5:0/2112384935 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf4018b70 con 0x7f1cfc102ef0 2024-09-11T23:27:37.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.171+0000 7f1d00a39640 1 -- 172.21.15.5:0/2112384935 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cfc1a4f70 con 0x7f1cfc102ef0 2024-09-11T23:27:37.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.172+0000 7f1d00a39640 1 -- 172.21.15.5:0/2112384935 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cfc101200 con 0x7f1cfc102ef0 2024-09-11T23:27:37.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.173+0000 7f1ceb7fe640 1 -- 172.21.15.5:0/2112384935 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f1cf4018d10 con 0x7f1cfc102ef0 2024-09-11T23:27:37.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.173+0000 7f1ceb7fe640 1 --2- 172.21.15.5:0/2112384935 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f1ce40a2c10 0x7f1ce40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:37.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.174+0000 7f1ceb7fe640 1 -- 172.21.15.5:0/2112384935 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9071+0+0 (secure 0 0 0) 0x7f1cf40cfa70 con 0x7f1cfc102ef0 2024-09-11T23:27:37.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.174+0000 7f1cfa59c640 1 --2- 172.21.15.5:0/2112384935 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f1ce40a2c10 0x7f1ce40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:37.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.174+0000 7f1cfa59c640 1 --2- 172.21.15.5:0/2112384935 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f1ce40a2c10 0x7f1ce40a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1cec009230 tx=0x7f1cec0058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:37.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.181+0000 7f1ceb7fe640 1 -- 172.21.15.5:0/2112384935 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1cf4014030 con 0x7f1cfc102ef0 2024-09-11T23:27:37.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.354+0000 7f1d00a39640 1 -- 172.21.15.5:0/2112384935 --> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1cfc062630 con 0x7f1ce40a2c10 2024-09-11T23:27:37.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.364+0000 7f1ceb7fe640 1 -- 172.21.15.5:0/2112384935 <== mgr.14148 v2:172.21.15.5:6800/2285128668 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340568 (secure 0 0 0) 0x7f1cfc062630 con 0x7f1ce40a2c10 2024-09-11T23:27:37.368 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:27:37.370 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-11T23:27:37.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.368+0000 7f1d00a39640 1 -- 172.21.15.5:0/2112384935 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f1ce40a2c10 msgr2=0x7f1ce40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:37.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.368+0000 7f1d00a39640 1 --2- 172.21.15.5:0/2112384935 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f1ce40a2c10 0x7f1ce40a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1cec009230 tx=0x7f1cec0058d0 comp rx=0 tx=0).stop 2024-09-11T23:27:37.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.368+0000 7f1d00a39640 1 -- 172.21.15.5:0/2112384935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1cfc102ef0 msgr2=0x7f1cfc19ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:37.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.368+0000 7f1d00a39640 1 --2- 172.21.15.5:0/2112384935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1cfc102ef0 0x7f1cfc19ccc0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1cf400cce0 tx=0x7f1cf400a620 comp rx=0 tx=0).stop 2024-09-11T23:27:37.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.368+0000 7f1d00a39640 1 -- 172.21.15.5:0/2112384935 shutdown_connections 2024-09-11T23:27:37.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.368+0000 7f1d00a39640 1 --2- 172.21.15.5:0/2112384935 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f1ce40a2c10 0x7f1ce40a50d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:37.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.368+0000 7f1d00a39640 1 --2- 172.21.15.5:0/2112384935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1cfc102ef0 0x7f1cfc19ccc0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:37.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.368+0000 7f1d00a39640 1 --2- 172.21.15.5:0/2112384935 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cfc102570 0x7f1cfc198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:37.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.368+0000 7f1d00a39640 1 --2- 172.21.15.5:0/2112384935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1cfc100e20 0x7f1cfc1983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:37.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.368+0000 7f1d00a39640 1 -- 172.21.15.5:0/2112384935 >> 172.21.15.5:0/2112384935 conn(0x7f1cfc0fc7d0 msgr2=0x7f1cfc06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:37.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.368+0000 7f1d00a39640 1 -- 172.21.15.5:0/2112384935 shutdown_connections 2024-09-11T23:27:37.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:37.368+0000 7f1d00a39640 1 -- 172.21.15.5:0/2112384935 wait complete. 2024-09-11T23:27:38.179 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":309,"stamp":"2024-09-11T23:27:36.127265+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":637557,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":223,"num_read_kb":208,"num_write":333,"num_write_kb":3031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":269,"ondisk_log_size":269,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":369108,"kb_used_data":11540,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124572716,"statfs":{"total":1151940427776,"available":1151562461184,"internally_reserved":0,"allocated":11816960,"data_stored":7666600,"data_compressed":322218,"data_compressed_allocated":430080,"data_compressed_original":2359296,"omap_allocated":19142,"internal_metadata":365933882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":41141,"num_objects":17,"num_object_clones":0,"num_object_copies":53,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":86,"num_read_kb":89,"num_write":49,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003263"},"pg_stats":[{"pgid":"2.1f","version":"86'9","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:27:21.045368+0000","last_change":"2024-09-11T23:26:42.617529+0000","last_active":"2024-09-11T23:27:21.045368+0000","last_peered":"2024-09-11T23:27:21.045368+0000","last_clean":"2024-09-11T23:27:21.045368+0000","last_became_active":"2024-09-11T23:26:42.616841+0000","last_became_peered":"2024-09-11T23:26:42.616841+0000","last_unstale":"2024-09-11T23:27:21.045368+0000","last_undegraded":"2024-09-11T23:27:21.045368+0000","last_fullsized":"2024-09-11T23:27:21.045368+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:32.464566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.062126+0000","last_change":"2024-09-11T23:26:44.700282+0000","last_active":"2024-09-11T23:26:55.062126+0000","last_peered":"2024-09-11T23:26:55.062126+0000","last_clean":"2024-09-11T23:26:55.062126+0000","last_became_active":"2024-09-11T23:26:44.700046+0000","last_became_peered":"2024-09-11T23:26:44.700046+0000","last_unstale":"2024-09-11T23:26:55.062126+0000","last_undegraded":"2024-09-11T23:26:55.062126+0000","last_fullsized":"2024-09-11T23:26:55.062126+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:10.211467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:56.191676+0000","last_change":"2024-09-11T23:26:52.070566+0000","last_active":"2024-09-11T23:26:56.191676+0000","last_peered":"2024-09-11T23:26:56.191676+0000","last_clean":"2024-09-11T23:26:56.191676+0000","last_became_active":"2024-09-11T23:26:52.070083+0000","last_became_peered":"2024-09-11T23:26:52.070083+0000","last_unstale":"2024-09-11T23:26:56.191676+0000","last_undegraded":"2024-09-11T23:26:56.191676+0000","last_fullsized":"2024-09-11T23:26:56.191676+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:02.857063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.062344+0000","last_change":"2024-09-11T23:26:42.645941+0000","last_active":"2024-09-11T23:26:55.062344+0000","last_peered":"2024-09-11T23:26:55.062344+0000","last_clean":"2024-09-11T23:26:55.062344+0000","last_became_active":"2024-09-11T23:26:42.645590+0000","last_became_peered":"2024-09-11T23:26:42.645590+0000","last_unstale":"2024-09-11T23:26:55.062344+0000","last_undegraded":"2024-09-11T23:26:55.062344+0000","last_fullsized":"2024-09-11T23:26:55.062344+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:20.374936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.757428+0000","last_change":"2024-09-11T23:26:44.684678+0000","last_active":"2024-09-11T23:26:55.757428+0000","last_peered":"2024-09-11T23:26:55.757428+0000","last_clean":"2024-09-11T23:26:55.757428+0000","last_became_active":"2024-09-11T23:26:44.684001+0000","last_became_peered":"2024-09-11T23:26:44.684001+0000","last_unstale":"2024-09-11T23:26:55.757428+0000","last_undegraded":"2024-09-11T23:26:55.757428+0000","last_fullsized":"2024-09-11T23:26:55.757428+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:57.773985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.064478+0000","last_change":"2024-09-11T23:26:52.073563+0000","last_active":"2024-09-11T23:26:55.064478+0000","last_peered":"2024-09-11T23:26:55.064478+0000","last_clean":"2024-09-11T23:26:55.064478+0000","last_became_active":"2024-09-11T23:26:52.072851+0000","last_became_peered":"2024-09-11T23:26:52.072851+0000","last_unstale":"2024-09-11T23:26:55.064478+0000","last_undegraded":"2024-09-11T23:26:55.064478+0000","last_fullsized":"2024-09-11T23:26:55.064478+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:25.711274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"86'4","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:27:21.044326+0000","last_change":"2024-09-11T23:26:42.618190+0000","last_active":"2024-09-11T23:27:21.044326+0000","last_peered":"2024-09-11T23:27:21.044326+0000","last_clean":"2024-09-11T23:27:21.044326+0000","last_became_active":"2024-09-11T23:26:42.617797+0000","last_became_peered":"2024-09-11T23:26:42.617797+0000","last_unstale":"2024-09-11T23:27:21.044326+0000","last_undegraded":"2024-09-11T23:27:21.044326+0000","last_fullsized":"2024-09-11T23:27:21.044326+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:47.800168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.775386+0000","last_change":"2024-09-11T23:26:44.690899+0000","last_active":"2024-09-11T23:26:55.775386+0000","last_peered":"2024-09-11T23:26:55.775386+0000","last_clean":"2024-09-11T23:26:55.775386+0000","last_became_active":"2024-09-11T23:26:44.690552+0000","last_became_peered":"2024-09-11T23:26:44.690552+0000","last_unstale":"2024-09-11T23:26:55.775386+0000","last_undegraded":"2024-09-11T23:26:55.775386+0000","last_fullsized":"2024-09-11T23:26:55.775386+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:02.148342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.064904+0000","last_change":"2024-09-11T23:26:52.072228+0000","last_active":"2024-09-11T23:26:55.064904+0000","last_peered":"2024-09-11T23:26:55.064904+0000","last_clean":"2024-09-11T23:26:55.064904+0000","last_became_active":"2024-09-11T23:26:52.071793+0000","last_became_peered":"2024-09-11T23:26:52.071793+0000","last_unstale":"2024-09-11T23:26:55.064904+0000","last_undegraded":"2024-09-11T23:26:55.064904+0000","last_fullsized":"2024-09-11T23:26:55.064904+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:34.795083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.085817+0000","last_change":"2024-09-11T23:26:52.072018+0000","last_active":"2024-09-11T23:26:55.085817+0000","last_peered":"2024-09-11T23:26:55.085817+0000","last_clean":"2024-09-11T23:26:55.085817+0000","last_became_active":"2024-09-11T23:26:52.062541+0000","last_became_peered":"2024-09-11T23:26:52.062541+0000","last_unstale":"2024-09-11T23:26:55.085817+0000","last_undegraded":"2024-09-11T23:26:55.085817+0000","last_fullsized":"2024-09-11T23:26:55.085817+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:38.371660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.604944+0000","last_change":"2024-09-11T23:26:52.068090+0000","last_active":"2024-09-11T23:26:55.604944+0000","last_peered":"2024-09-11T23:26:55.604944+0000","last_clean":"2024-09-11T23:26:55.604944+0000","last_became_active":"2024-09-11T23:26:52.067755+0000","last_became_peered":"2024-09-11T23:26:52.067755+0000","last_unstale":"2024-09-11T23:26:55.604944+0000","last_undegraded":"2024-09-11T23:26:55.604944+0000","last_fullsized":"2024-09-11T23:26:55.604944+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:09.250735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.064506+0000","last_change":"2024-09-11T23:26:52.063609+0000","last_active":"2024-09-11T23:26:55.064506+0000","last_peered":"2024-09-11T23:26:55.064506+0000","last_clean":"2024-09-11T23:26:55.064506+0000","last_became_active":"2024-09-11T23:26:52.063212+0000","last_became_peered":"2024-09-11T23:26:52.063212+0000","last_unstale":"2024-09-11T23:26:55.064506+0000","last_undegraded":"2024-09-11T23:26:55.064506+0000","last_fullsized":"2024-09-11T23:26:55.064506+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:51.706288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.074417+0000","last_change":"2024-09-11T23:26:44.700390+0000","last_active":"2024-09-11T23:26:57.074417+0000","last_peered":"2024-09-11T23:26:57.074417+0000","last_clean":"2024-09-11T23:26:57.074417+0000","last_became_active":"2024-09-11T23:26:44.700062+0000","last_became_peered":"2024-09-11T23:26:44.700062+0000","last_unstale":"2024-09-11T23:26:57.074417+0000","last_undegraded":"2024-09-11T23:26:57.074417+0000","last_fullsized":"2024-09-11T23:26:57.074417+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:50.934552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:27:20.034228+0000","last_change":"2024-09-11T23:26:42.616879+0000","last_active":"2024-09-11T23:27:20.034228+0000","last_peered":"2024-09-11T23:27:20.034228+0000","last_clean":"2024-09-11T23:27:20.034228+0000","last_became_active":"2024-09-11T23:26:42.616522+0000","last_became_peered":"2024-09-11T23:26:42.616522+0000","last_unstale":"2024-09-11T23:27:20.034228+0000","last_undegraded":"2024-09-11T23:27:20.034228+0000","last_fullsized":"2024-09-11T23:27:20.034228+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:47.903838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.064815+0000","last_change":"2024-09-11T23:26:52.064232+0000","last_active":"2024-09-11T23:26:55.064815+0000","last_peered":"2024-09-11T23:26:55.064815+0000","last_clean":"2024-09-11T23:26:55.064815+0000","last_became_active":"2024-09-11T23:26:52.063559+0000","last_became_peered":"2024-09-11T23:26:52.063559+0000","last_unstale":"2024-09-11T23:26:55.064815+0000","last_undegraded":"2024-09-11T23:26:55.064815+0000","last_fullsized":"2024-09-11T23:26:55.064815+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:48.967531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.061885+0000","last_change":"2024-09-11T23:26:44.691634+0000","last_active":"2024-09-11T23:26:55.061885+0000","last_peered":"2024-09-11T23:26:55.061885+0000","last_clean":"2024-09-11T23:26:55.061885+0000","last_became_active":"2024-09-11T23:26:44.690900+0000","last_became_peered":"2024-09-11T23:26:44.690900+0000","last_unstale":"2024-09-11T23:26:55.061885+0000","last_undegraded":"2024-09-11T23:26:55.061885+0000","last_fullsized":"2024-09-11T23:26:55.061885+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:37.129433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"86'1","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:56.191812+0000","last_change":"2024-09-11T23:26:42.613452+0000","last_active":"2024-09-11T23:26:56.191812+0000","last_peered":"2024-09-11T23:26:56.191812+0000","last_clean":"2024-09-11T23:26:56.191812+0000","last_became_active":"2024-09-11T23:26:42.612943+0000","last_became_peered":"2024-09-11T23:26:42.612943+0000","last_unstale":"2024-09-11T23:26:56.191812+0000","last_undegraded":"2024-09-11T23:26:56.191812+0000","last_fullsized":"2024-09-11T23:26:56.191812+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:57.337796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"86'1","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:56.039973+0000","last_change":"2024-09-11T23:26:52.072930+0000","last_active":"2024-09-11T23:26:56.039973+0000","last_peered":"2024-09-11T23:26:56.039973+0000","last_clean":"2024-09-11T23:26:56.039973+0000","last_became_active":"2024-09-11T23:26:52.071512+0000","last_became_peered":"2024-09-11T23:26:52.071512+0000","last_unstale":"2024-09-11T23:26:56.039973+0000","last_undegraded":"2024-09-11T23:26:56.039973+0000","last_fullsized":"2024-09-11T23:26:56.039973+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:48.913194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.085701+0000","last_change":"2024-09-11T23:26:44.705318+0000","last_active":"2024-09-11T23:26:55.085701+0000","last_peered":"2024-09-11T23:26:55.085701+0000","last_clean":"2024-09-11T23:26:55.085701+0000","last_became_active":"2024-09-11T23:26:44.704974+0000","last_became_peered":"2024-09-11T23:26:44.704974+0000","last_unstale":"2024-09-11T23:26:55.085701+0000","last_undegraded":"2024-09-11T23:26:55.085701+0000","last_fullsized":"2024-09-11T23:26:55.085701+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:44.252769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"86'3","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:27:20.032310+0000","last_change":"2024-09-11T23:26:42.615528+0000","last_active":"2024-09-11T23:27:20.032310+0000","last_peered":"2024-09-11T23:27:20.032310+0000","last_clean":"2024-09-11T23:27:20.032310+0000","last_became_active":"2024-09-11T23:26:42.615182+0000","last_became_peered":"2024-09-11T23:26:42.615182+0000","last_unstale":"2024-09-11T23:27:20.032310+0000","last_undegraded":"2024-09-11T23:27:20.032310+0000","last_fullsized":"2024-09-11T23:27:20.032310+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:40.491178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.074778+0000","last_change":"2024-09-11T23:26:52.074907+0000","last_active":"2024-09-11T23:26:57.074778+0000","last_peered":"2024-09-11T23:26:57.074778+0000","last_clean":"2024-09-11T23:26:57.074778+0000","last_became_active":"2024-09-11T23:26:52.074645+0000","last_became_peered":"2024-09-11T23:26:52.074645+0000","last_unstale":"2024-09-11T23:26:57.074778+0000","last_undegraded":"2024-09-11T23:26:57.074778+0000","last_fullsized":"2024-09-11T23:26:57.074778+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:37.885656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.062497+0000","last_change":"2024-09-11T23:26:44.700291+0000","last_active":"2024-09-11T23:26:55.062497+0000","last_peered":"2024-09-11T23:26:55.062497+0000","last_clean":"2024-09-11T23:26:55.062497+0000","last_became_active":"2024-09-11T23:26:44.699965+0000","last_became_peered":"2024-09-11T23:26:44.699965+0000","last_unstale":"2024-09-11T23:26:55.062497+0000","last_undegraded":"2024-09-11T23:26:55.062497+0000","last_fullsized":"2024-09-11T23:26:55.062497+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:10.526254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:27:20.032438+0000","last_change":"2024-09-11T23:26:42.645574+0000","last_active":"2024-09-11T23:27:20.032438+0000","last_peered":"2024-09-11T23:27:20.032438+0000","last_clean":"2024-09-11T23:27:20.032438+0000","last_became_active":"2024-09-11T23:26:42.645266+0000","last_became_peered":"2024-09-11T23:26:42.645266+0000","last_unstale":"2024-09-11T23:27:20.032438+0000","last_undegraded":"2024-09-11T23:27:20.032438+0000","last_fullsized":"2024-09-11T23:27:20.032438+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:54.343564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.065033+0000","last_change":"2024-09-11T23:26:52.072072+0000","last_active":"2024-09-11T23:26:55.065033+0000","last_peered":"2024-09-11T23:26:55.065033+0000","last_clean":"2024-09-11T23:26:55.065033+0000","last_became_active":"2024-09-11T23:26:52.071488+0000","last_became_peered":"2024-09-11T23:26:52.071488+0000","last_unstale":"2024-09-11T23:26:55.065033+0000","last_undegraded":"2024-09-11T23:26:55.065033+0000","last_fullsized":"2024-09-11T23:26:55.065033+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:22.788819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.757468+0000","last_change":"2024-09-11T23:26:44.692168+0000","last_active":"2024-09-11T23:26:55.757468+0000","last_peered":"2024-09-11T23:26:55.757468+0000","last_clean":"2024-09-11T23:26:55.757468+0000","last_became_active":"2024-09-11T23:26:44.691842+0000","last_became_peered":"2024-09-11T23:26:44.691842+0000","last_unstale":"2024-09-11T23:26:55.757468+0000","last_undegraded":"2024-09-11T23:26:55.757468+0000","last_fullsized":"2024-09-11T23:26:55.757468+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:58.143490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"86'4","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:27:20.033642+0000","last_change":"2024-09-11T23:26:42.640164+0000","last_active":"2024-09-11T23:27:20.033642+0000","last_peered":"2024-09-11T23:27:20.033642+0000","last_clean":"2024-09-11T23:27:20.033642+0000","last_became_active":"2024-09-11T23:26:42.639827+0000","last_became_peered":"2024-09-11T23:26:42.639827+0000","last_unstale":"2024-09-11T23:27:20.033642+0000","last_undegraded":"2024-09-11T23:27:20.033642+0000","last_fullsized":"2024-09-11T23:27:20.033642+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:18.250513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:56.191625+0000","last_change":"2024-09-11T23:26:52.063970+0000","last_active":"2024-09-11T23:26:56.191625+0000","last_peered":"2024-09-11T23:26:56.191625+0000","last_clean":"2024-09-11T23:26:56.191625+0000","last_became_active":"2024-09-11T23:26:52.063575+0000","last_became_peered":"2024-09-11T23:26:52.063575+0000","last_unstale":"2024-09-11T23:26:56.191625+0000","last_undegraded":"2024-09-11T23:26:56.191625+0000","last_fullsized":"2024-09-11T23:26:56.191625+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:59.828888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.062264+0000","last_change":"2024-09-11T23:26:44.696709+0000","last_active":"2024-09-11T23:26:55.062264+0000","last_peered":"2024-09-11T23:26:55.062264+0000","last_clean":"2024-09-11T23:26:55.062264+0000","last_became_active":"2024-09-11T23:26:44.696401+0000","last_became_peered":"2024-09-11T23:26:44.696401+0000","last_unstale":"2024-09-11T23:26:55.062264+0000","last_undegraded":"2024-09-11T23:26:55.062264+0000","last_fullsized":"2024-09-11T23:26:55.062264+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:58:23.823664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"86'7","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:27:30.029028+0000","last_change":"2024-09-11T23:26:42.611182+0000","last_active":"2024-09-11T23:27:30.029028+0000","last_peered":"2024-09-11T23:27:30.029028+0000","last_clean":"2024-09-11T23:27:30.029028+0000","last_became_active":"2024-09-11T23:26:42.610843+0000","last_became_peered":"2024-09-11T23:26:42.610843+0000","last_unstale":"2024-09-11T23:27:30.029028+0000","last_undegraded":"2024-09-11T23:27:30.029028+0000","last_fullsized":"2024-09-11T23:27:30.029028+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:14.099591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.061573+0000","last_change":"2024-09-11T23:26:52.061367+0000","last_active":"2024-09-11T23:26:55.061573+0000","last_peered":"2024-09-11T23:26:55.061573+0000","last_clean":"2024-09-11T23:26:55.061573+0000","last_became_active":"2024-09-11T23:26:52.061005+0000","last_became_peered":"2024-09-11T23:26:52.061005+0000","last_unstale":"2024-09-11T23:26:55.061573+0000","last_undegraded":"2024-09-11T23:26:55.061573+0000","last_fullsized":"2024-09-11T23:26:55.061573+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:19.705133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.073992+0000","last_change":"2024-09-11T23:26:44.699122+0000","last_active":"2024-09-11T23:26:57.073992+0000","last_peered":"2024-09-11T23:26:57.073992+0000","last_clean":"2024-09-11T23:26:57.073992+0000","last_became_active":"2024-09-11T23:26:44.698813+0000","last_became_peered":"2024-09-11T23:26:44.698813+0000","last_unstale":"2024-09-11T23:26:57.073992+0000","last_undegraded":"2024-09-11T23:26:57.073992+0000","last_fullsized":"2024-09-11T23:26:57.073992+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:42.286431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"86'1","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:27:20.032146+0000","last_change":"2024-09-11T23:26:42.645612+0000","last_active":"2024-09-11T23:27:20.032146+0000","last_peered":"2024-09-11T23:27:20.032146+0000","last_clean":"2024-09-11T23:27:20.032146+0000","last_became_active":"2024-09-11T23:26:42.645228+0000","last_became_peered":"2024-09-11T23:26:42.645228+0000","last_unstale":"2024-09-11T23:27:20.032146+0000","last_undegraded":"2024-09-11T23:27:20.032146+0000","last_fullsized":"2024-09-11T23:27:20.032146+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:12.068952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.085851+0000","last_change":"2024-09-11T23:26:52.062843+0000","last_active":"2024-09-11T23:26:55.085851+0000","last_peered":"2024-09-11T23:26:55.085851+0000","last_clean":"2024-09-11T23:26:55.085851+0000","last_became_active":"2024-09-11T23:26:52.062446+0000","last_became_peered":"2024-09-11T23:26:52.062446+0000","last_unstale":"2024-09-11T23:26:55.085851+0000","last_undegraded":"2024-09-11T23:26:55.085851+0000","last_fullsized":"2024-09-11T23:26:55.085851+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:03.934877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.074423+0000","last_change":"2024-09-11T23:26:44.690179+0000","last_active":"2024-09-11T23:26:57.074423+0000","last_peered":"2024-09-11T23:26:57.074423+0000","last_clean":"2024-09-11T23:26:57.074423+0000","last_became_active":"2024-09-11T23:26:44.689856+0000","last_became_peered":"2024-09-11T23:26:44.689856+0000","last_unstale":"2024-09-11T23:26:57.074423+0000","last_undegraded":"2024-09-11T23:26:57.074423+0000","last_fullsized":"2024-09-11T23:26:57.074423+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:46.546000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.074716+0000","last_change":"2024-09-11T23:26:42.646678+0000","last_active":"2024-09-11T23:26:57.074716+0000","last_peered":"2024-09-11T23:26:57.074716+0000","last_clean":"2024-09-11T23:26:57.074716+0000","last_became_active":"2024-09-11T23:26:42.645748+0000","last_became_peered":"2024-09-11T23:26:42.645748+0000","last_unstale":"2024-09-11T23:26:57.074716+0000","last_undegraded":"2024-09-11T23:26:57.074716+0000","last_fullsized":"2024-09-11T23:26:57.074716+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:41.497025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.062830+0000","last_change":"2024-09-11T23:26:52.065357+0000","last_active":"2024-09-11T23:26:55.062830+0000","last_peered":"2024-09-11T23:26:55.062830+0000","last_clean":"2024-09-11T23:26:55.062830+0000","last_became_active":"2024-09-11T23:26:52.065004+0000","last_became_peered":"2024-09-11T23:26:52.065004+0000","last_unstale":"2024-09-11T23:26:55.062830+0000","last_undegraded":"2024-09-11T23:26:55.062830+0000","last_fullsized":"2024-09-11T23:26:55.062830+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:30.975294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.074040+0000","last_change":"2024-09-11T23:26:44.694358+0000","last_active":"2024-09-11T23:26:57.074040+0000","last_peered":"2024-09-11T23:26:57.074040+0000","last_clean":"2024-09-11T23:26:57.074040+0000","last_became_active":"2024-09-11T23:26:44.693305+0000","last_became_peered":"2024-09-11T23:26:44.693305+0000","last_unstale":"2024-09-11T23:26:57.074040+0000","last_undegraded":"2024-09-11T23:26:57.074040+0000","last_fullsized":"2024-09-11T23:26:57.074040+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:48.107696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'1","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.074638+0000","last_change":"2024-09-11T23:26:42.619221+0000","last_active":"2024-09-11T23:26:57.074638+0000","last_peered":"2024-09-11T23:26:57.074638+0000","last_clean":"2024-09-11T23:26:57.074638+0000","last_became_active":"2024-09-11T23:26:42.618833+0000","last_became_peered":"2024-09-11T23:26:42.618833+0000","last_unstale":"2024-09-11T23:26:57.074638+0000","last_undegraded":"2024-09-11T23:26:57.074638+0000","last_fullsized":"2024-09-11T23:26:57.074638+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:40.584145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.073795+0000","last_change":"2024-09-11T23:26:52.061287+0000","last_active":"2024-09-11T23:26:57.073795+0000","last_peered":"2024-09-11T23:26:57.073795+0000","last_clean":"2024-09-11T23:26:57.073795+0000","last_became_active":"2024-09-11T23:26:52.060904+0000","last_became_peered":"2024-09-11T23:26:52.060904+0000","last_unstale":"2024-09-11T23:26:57.073795+0000","last_undegraded":"2024-09-11T23:26:57.073795+0000","last_fullsized":"2024-09-11T23:26:57.073795+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:49.456325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.604377+0000","last_change":"2024-09-11T23:26:44.696624+0000","last_active":"2024-09-11T23:26:55.604377+0000","last_peered":"2024-09-11T23:26:55.604377+0000","last_clean":"2024-09-11T23:26:55.604377+0000","last_became_active":"2024-09-11T23:26:44.695521+0000","last_became_peered":"2024-09-11T23:26:44.695521+0000","last_unstale":"2024-09-11T23:26:55.604377+0000","last_undegraded":"2024-09-11T23:26:55.604377+0000","last_fullsized":"2024-09-11T23:26:55.604377+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:42.026975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'4","reported_seq":48,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:27:34.062912+0000","last_change":"2024-09-11T23:26:42.645319+0000","last_active":"2024-09-11T23:27:34.062912+0000","last_peered":"2024-09-11T23:27:34.062912+0000","last_clean":"2024-09-11T23:27:34.062912+0000","last_became_active":"2024-09-11T23:26:42.644986+0000","last_became_peered":"2024-09-11T23:26:42.644986+0000","last_unstale":"2024-09-11T23:27:34.062912+0000","last_undegraded":"2024-09-11T23:27:34.062912+0000","last_fullsized":"2024-09-11T23:27:34.062912+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:06.020663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.073861+0000","last_change":"2024-09-11T23:26:52.061235+0000","last_active":"2024-09-11T23:26:57.073861+0000","last_peered":"2024-09-11T23:26:57.073861+0000","last_clean":"2024-09-11T23:26:57.073861+0000","last_became_active":"2024-09-11T23:26:52.060827+0000","last_became_peered":"2024-09-11T23:26:52.060827+0000","last_unstale":"2024-09-11T23:26:57.073861+0000","last_undegraded":"2024-09-11T23:26:57.073861+0000","last_fullsized":"2024-09-11T23:26:57.073861+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:52.354881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.073430+0000","last_change":"2024-09-11T23:26:44.694777+0000","last_active":"2024-09-11T23:26:57.073430+0000","last_peered":"2024-09-11T23:26:57.073430+0000","last_clean":"2024-09-11T23:26:57.073430+0000","last_became_active":"2024-09-11T23:26:44.694485+0000","last_became_peered":"2024-09-11T23:26:44.694485+0000","last_unstale":"2024-09-11T23:26:57.073430+0000","last_undegraded":"2024-09-11T23:26:57.073430+0000","last_fullsized":"2024-09-11T23:26:57.073430+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:58:19.913909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'3","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:27:21.044799+0000","last_change":"2024-09-11T23:26:42.619902+0000","last_active":"2024-09-11T23:27:21.044799+0000","last_peered":"2024-09-11T23:27:21.044799+0000","last_clean":"2024-09-11T23:27:21.044799+0000","last_became_active":"2024-09-11T23:26:42.619405+0000","last_became_peered":"2024-09-11T23:26:42.619405+0000","last_unstale":"2024-09-11T23:27:21.044799+0000","last_undegraded":"2024-09-11T23:27:21.044799+0000","last_fullsized":"2024-09-11T23:27:21.044799+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:30.584258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.604910+0000","last_change":"2024-09-11T23:26:52.065829+0000","last_active":"2024-09-11T23:26:55.604910+0000","last_peered":"2024-09-11T23:26:55.604910+0000","last_clean":"2024-09-11T23:26:55.604910+0000","last_became_active":"2024-09-11T23:26:52.065190+0000","last_became_peered":"2024-09-11T23:26:52.065190+0000","last_unstale":"2024-09-11T23:26:55.604910+0000","last_undegraded":"2024-09-11T23:26:55.604910+0000","last_fullsized":"2024-09-11T23:26:55.604910+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:53.032343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.061852+0000","last_change":"2024-09-11T23:26:44.690426+0000","last_active":"2024-09-11T23:26:55.061852+0000","last_peered":"2024-09-11T23:26:55.061852+0000","last_clean":"2024-09-11T23:26:55.061852+0000","last_became_active":"2024-09-11T23:26:44.690127+0000","last_became_peered":"2024-09-11T23:26:44.690127+0000","last_unstale":"2024-09-11T23:26:55.061852+0000","last_undegraded":"2024-09-11T23:26:55.061852+0000","last_fullsized":"2024-09-11T23:26:55.061852+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:42.750965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'3","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:27:22.042680+0000","last_change":"2024-09-11T23:26:42.617589+0000","last_active":"2024-09-11T23:27:22.042680+0000","last_peered":"2024-09-11T23:27:22.042680+0000","last_clean":"2024-09-11T23:27:22.042680+0000","last_became_active":"2024-09-11T23:26:42.616853+0000","last_became_peered":"2024-09-11T23:26:42.616853+0000","last_unstale":"2024-09-11T23:27:22.042680+0000","last_undegraded":"2024-09-11T23:27:22.042680+0000","last_fullsized":"2024-09-11T23:27:22.042680+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:57.689231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":345,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.074730+0000","last_change":"2024-09-11T23:25:30.452649+0000","last_active":"2024-09-11T23:26:57.074730+0000","last_peered":"2024-09-11T23:26:57.074730+0000","last_clean":"2024-09-11T23:26:57.074730+0000","last_became_active":"2024-09-11T23:25:30.452234+0000","last_became_peered":"2024-09-11T23:25:30.452234+0000","last_unstale":"2024-09-11T23:26:57.074730+0000","last_undegraded":"2024-09-11T23:26:57.074730+0000","last_fullsized":"2024-09-11T23:26:57.074730+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:04.900818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:04.900818+0000","last_clean_scrub_stamp":"2024-09-11T23:22:04.900818+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:39.029859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"86'1","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.074437+0000","last_change":"2024-09-11T23:26:52.066339+0000","last_active":"2024-09-11T23:26:57.074437+0000","last_peered":"2024-09-11T23:26:57.074437+0000","last_clean":"2024-09-11T23:26:57.074437+0000","last_became_active":"2024-09-11T23:26:52.065945+0000","last_became_peered":"2024-09-11T23:26:52.065945+0000","last_unstale":"2024-09-11T23:26:57.074437+0000","last_undegraded":"2024-09-11T23:26:57.074437+0000","last_fullsized":"2024-09-11T23:26:57.074437+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:49.597372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.074561+0000","last_change":"2024-09-11T23:26:44.700943+0000","last_active":"2024-09-11T23:26:57.074561+0000","last_peered":"2024-09-11T23:26:57.074561+0000","last_clean":"2024-09-11T23:26:57.074561+0000","last_became_active":"2024-09-11T23:26:44.700418+0000","last_became_peered":"2024-09-11T23:26:44.700418+0000","last_unstale":"2024-09-11T23:26:57.074561+0000","last_undegraded":"2024-09-11T23:26:57.074561+0000","last_fullsized":"2024-09-11T23:26:57.074561+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:18.474520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'3","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:27:21.044749+0000","last_change":"2024-09-11T23:26:42.645889+0000","last_active":"2024-09-11T23:27:21.044749+0000","last_peered":"2024-09-11T23:27:21.044749+0000","last_clean":"2024-09-11T23:27:21.044749+0000","last_became_active":"2024-09-11T23:26:42.645530+0000","last_became_peered":"2024-09-11T23:26:42.645530+0000","last_unstale":"2024-09-11T23:27:21.044749+0000","last_undegraded":"2024-09-11T23:27:21.044749+0000","last_fullsized":"2024-09-11T23:27:21.044749+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:27.311459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.775415+0000","last_change":"2024-09-11T23:26:52.066911+0000","last_active":"2024-09-11T23:26:55.775415+0000","last_peered":"2024-09-11T23:26:55.775415+0000","last_clean":"2024-09-11T23:26:55.775415+0000","last_became_active":"2024-09-11T23:26:52.065969+0000","last_became_peered":"2024-09-11T23:26:52.065969+0000","last_unstale":"2024-09-11T23:26:55.775415+0000","last_undegraded":"2024-09-11T23:26:55.775415+0000","last_fullsized":"2024-09-11T23:26:55.775415+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:26.406644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.074128+0000","last_change":"2024-09-11T23:26:44.696945+0000","last_active":"2024-09-11T23:26:57.074128+0000","last_peered":"2024-09-11T23:26:57.074128+0000","last_clean":"2024-09-11T23:26:57.074128+0000","last_became_active":"2024-09-11T23:26:44.696546+0000","last_became_peered":"2024-09-11T23:26:44.696546+0000","last_unstale":"2024-09-11T23:26:57.074128+0000","last_undegraded":"2024-09-11T23:26:57.074128+0000","last_fullsized":"2024-09-11T23:26:57.074128+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:52.428610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.605176+0000","last_change":"2024-09-11T23:26:42.616991+0000","last_active":"2024-09-11T23:26:55.605176+0000","last_peered":"2024-09-11T23:26:55.605176+0000","last_clean":"2024-09-11T23:26:55.605176+0000","last_became_active":"2024-09-11T23:26:42.616576+0000","last_became_peered":"2024-09-11T23:26:42.616576+0000","last_unstale":"2024-09-11T23:26:55.605176+0000","last_undegraded":"2024-09-11T23:26:55.605176+0000","last_fullsized":"2024-09-11T23:26:55.605176+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:07.142958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.757382+0000","last_change":"2024-09-11T23:26:52.066240+0000","last_active":"2024-09-11T23:26:55.757382+0000","last_peered":"2024-09-11T23:26:55.757382+0000","last_clean":"2024-09-11T23:26:55.757382+0000","last_became_active":"2024-09-11T23:26:52.065873+0000","last_became_peered":"2024-09-11T23:26:52.065873+0000","last_unstale":"2024-09-11T23:26:55.757382+0000","last_undegraded":"2024-09-11T23:26:55.757382+0000","last_fullsized":"2024-09-11T23:26:55.757382+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:51.175750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.074155+0000","last_change":"2024-09-11T23:26:44.699302+0000","last_active":"2024-09-11T23:26:57.074155+0000","last_peered":"2024-09-11T23:26:57.074155+0000","last_clean":"2024-09-11T23:26:57.074155+0000","last_became_active":"2024-09-11T23:26:44.698948+0000","last_became_peered":"2024-09-11T23:26:44.698948+0000","last_unstale":"2024-09-11T23:26:57.074155+0000","last_undegraded":"2024-09-11T23:26:57.074155+0000","last_fullsized":"2024-09-11T23:26:57.074155+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:31.262407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.073976+0000","last_change":"2024-09-11T23:26:52.077450+0000","last_active":"2024-09-11T23:26:57.073976+0000","last_peered":"2024-09-11T23:26:57.073976+0000","last_clean":"2024-09-11T23:26:57.073976+0000","last_became_active":"2024-09-11T23:26:52.065052+0000","last_became_peered":"2024-09-11T23:26:52.065052+0000","last_unstale":"2024-09-11T23:26:57.073976+0000","last_undegraded":"2024-09-11T23:26:57.073976+0000","last_fullsized":"2024-09-11T23:26:57.073976+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:27.541991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.604288+0000","last_change":"2024-09-11T23:26:52.064296+0000","last_active":"2024-09-11T23:26:55.604288+0000","last_peered":"2024-09-11T23:26:55.604288+0000","last_clean":"2024-09-11T23:26:55.604288+0000","last_became_active":"2024-09-11T23:26:52.063488+0000","last_became_peered":"2024-09-11T23:26:52.063488+0000","last_unstale":"2024-09-11T23:26:55.604288+0000","last_undegraded":"2024-09-11T23:26:55.604288+0000","last_fullsized":"2024-09-11T23:26:55.604288+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:39.815984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.086086+0000","last_change":"2024-09-11T23:26:52.071603+0000","last_active":"2024-09-11T23:26:55.086086+0000","last_peered":"2024-09-11T23:26:55.086086+0000","last_clean":"2024-09-11T23:26:55.086086+0000","last_became_active":"2024-09-11T23:26:52.071190+0000","last_became_peered":"2024-09-11T23:26:52.071190+0000","last_unstale":"2024-09-11T23:26:55.086086+0000","last_undegraded":"2024-09-11T23:26:55.086086+0000","last_fullsized":"2024-09-11T23:26:55.086086+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:52.171622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:27:22.040981+0000","last_change":"2024-09-11T23:26:42.612493+0000","last_active":"2024-09-11T23:27:22.040981+0000","last_peered":"2024-09-11T23:27:22.040981+0000","last_clean":"2024-09-11T23:27:22.040981+0000","last_became_active":"2024-09-11T23:26:42.612018+0000","last_became_peered":"2024-09-11T23:26:42.612018+0000","last_unstale":"2024-09-11T23:27:22.040981+0000","last_undegraded":"2024-09-11T23:27:22.040981+0000","last_fullsized":"2024-09-11T23:27:22.040981+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:08.590684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.604543+0000","last_change":"2024-09-11T23:26:52.063634+0000","last_active":"2024-09-11T23:26:55.604543+0000","last_peered":"2024-09-11T23:26:55.604543+0000","last_clean":"2024-09-11T23:26:55.604543+0000","last_became_active":"2024-09-11T23:26:52.063205+0000","last_became_peered":"2024-09-11T23:26:52.063205+0000","last_unstale":"2024-09-11T23:26:55.604543+0000","last_undegraded":"2024-09-11T23:26:55.604543+0000","last_fullsized":"2024-09-11T23:26:55.604543+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:12.371238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.604564+0000","last_change":"2024-09-11T23:26:44.692776+0000","last_active":"2024-09-11T23:26:55.604564+0000","last_peered":"2024-09-11T23:26:55.604564+0000","last_clean":"2024-09-11T23:26:55.604564+0000","last_became_active":"2024-09-11T23:26:44.691989+0000","last_became_peered":"2024-09-11T23:26:44.691989+0000","last_unstale":"2024-09-11T23:26:55.604564+0000","last_undegraded":"2024-09-11T23:26:55.604564+0000","last_fullsized":"2024-09-11T23:26:55.604564+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:41.781016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"86'15","reported_seq":62,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:27:21.045138+0000","last_change":"2024-09-11T23:26:52.075909+0000","last_active":"2024-09-11T23:27:21.045138+0000","last_peered":"2024-09-11T23:27:21.045138+0000","last_clean":"2024-09-11T23:27:21.045138+0000","last_became_active":"2024-09-11T23:26:52.061277+0000","last_became_peered":"2024-09-11T23:26:52.061277+0000","last_unstale":"2024-09-11T23:27:21.045138+0000","last_undegraded":"2024-09-11T23:27:21.045138+0000","last_fullsized":"2024-09-11T23:27:21.045138+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:11.940951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.073991+0000","last_change":"2024-09-11T23:26:52.064172+0000","last_active":"2024-09-11T23:26:57.073991+0000","last_peered":"2024-09-11T23:26:57.073991+0000","last_clean":"2024-09-11T23:26:57.073991+0000","last_became_active":"2024-09-11T23:26:52.063807+0000","last_became_peered":"2024-09-11T23:26:52.063807+0000","last_unstale":"2024-09-11T23:26:57.073991+0000","last_undegraded":"2024-09-11T23:26:57.073991+0000","last_fullsized":"2024-09-11T23:26:57.073991+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:32.134115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.073746+0000","last_change":"2024-09-11T23:26:44.703624+0000","last_active":"2024-09-11T23:26:57.073746+0000","last_peered":"2024-09-11T23:26:57.073746+0000","last_clean":"2024-09-11T23:26:57.073746+0000","last_became_active":"2024-09-11T23:26:44.703298+0000","last_became_peered":"2024-09-11T23:26:44.703298+0000","last_unstale":"2024-09-11T23:26:57.073746+0000","last_undegraded":"2024-09-11T23:26:57.073746+0000","last_fullsized":"2024-09-11T23:26:57.073746+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:17.441926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'3","reported_seq":49,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:27:34.063476+0000","last_change":"2024-09-11T23:26:42.618328+0000","last_active":"2024-09-11T23:27:34.063476+0000","last_peered":"2024-09-11T23:27:34.063476+0000","last_clean":"2024-09-11T23:27:34.063476+0000","last_became_active":"2024-09-11T23:26:42.618005+0000","last_became_peered":"2024-09-11T23:26:42.618005+0000","last_unstale":"2024-09-11T23:27:34.063476+0000","last_undegraded":"2024-09-11T23:27:34.063476+0000","last_fullsized":"2024-09-11T23:27:34.063476+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:58.593887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.074861+0000","last_change":"2024-09-11T23:26:52.069824+0000","last_active":"2024-09-11T23:26:57.074861+0000","last_peered":"2024-09-11T23:26:57.074861+0000","last_clean":"2024-09-11T23:26:57.074861+0000","last_became_active":"2024-09-11T23:26:52.069341+0000","last_became_peered":"2024-09-11T23:26:52.069341+0000","last_unstale":"2024-09-11T23:26:57.074861+0000","last_undegraded":"2024-09-11T23:26:57.074861+0000","last_fullsized":"2024-09-11T23:26:57.074861+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:10.922896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.074245+0000","last_change":"2024-09-11T23:26:44.696963+0000","last_active":"2024-09-11T23:26:57.074245+0000","last_peered":"2024-09-11T23:26:57.074245+0000","last_clean":"2024-09-11T23:26:57.074245+0000","last_became_active":"2024-09-11T23:26:44.696543+0000","last_became_peered":"2024-09-11T23:26:44.696543+0000","last_unstale":"2024-09-11T23:26:57.074245+0000","last_undegraded":"2024-09-11T23:26:57.074245+0000","last_fullsized":"2024-09-11T23:26:57.074245+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:14.502969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"86'3","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:27:20.034566+0000","last_change":"2024-09-11T23:26:42.615454+0000","last_active":"2024-09-11T23:27:20.034566+0000","last_peered":"2024-09-11T23:27:20.034566+0000","last_clean":"2024-09-11T23:27:20.034566+0000","last_became_active":"2024-09-11T23:26:42.614948+0000","last_became_peered":"2024-09-11T23:26:42.614948+0000","last_unstale":"2024-09-11T23:27:20.034566+0000","last_undegraded":"2024-09-11T23:27:20.034566+0000","last_fullsized":"2024-09-11T23:27:20.034566+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:59.056748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.085889+0000","last_change":"2024-09-11T23:26:52.069846+0000","last_active":"2024-09-11T23:26:55.085889+0000","last_peered":"2024-09-11T23:26:55.085889+0000","last_clean":"2024-09-11T23:26:55.085889+0000","last_became_active":"2024-09-11T23:26:52.069398+0000","last_became_peered":"2024-09-11T23:26:52.069398+0000","last_unstale":"2024-09-11T23:26:55.085889+0000","last_undegraded":"2024-09-11T23:26:55.085889+0000","last_fullsized":"2024-09-11T23:26:55.085889+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:31.931388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.073691+0000","last_change":"2024-09-11T23:26:44.697114+0000","last_active":"2024-09-11T23:26:57.073691+0000","last_peered":"2024-09-11T23:26:57.073691+0000","last_clean":"2024-09-11T23:26:57.073691+0000","last_became_active":"2024-09-11T23:26:44.696811+0000","last_became_peered":"2024-09-11T23:26:44.696811+0000","last_unstale":"2024-09-11T23:26:57.073691+0000","last_undegraded":"2024-09-11T23:26:57.073691+0000","last_fullsized":"2024-09-11T23:26:57.073691+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:47:52.650877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"86'6","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:27:21.045264+0000","last_change":"2024-09-11T23:26:42.616377+0000","last_active":"2024-09-11T23:27:21.045264+0000","last_peered":"2024-09-11T23:27:21.045264+0000","last_clean":"2024-09-11T23:27:21.045264+0000","last_became_active":"2024-09-11T23:26:42.615887+0000","last_became_peered":"2024-09-11T23:26:42.615887+0000","last_unstale":"2024-09-11T23:27:21.045264+0000","last_undegraded":"2024-09-11T23:27:21.045264+0000","last_fullsized":"2024-09-11T23:27:21.045264+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:48.089178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.604964+0000","last_change":"2024-09-11T23:26:52.068340+0000","last_active":"2024-09-11T23:26:55.604964+0000","last_peered":"2024-09-11T23:26:55.604964+0000","last_clean":"2024-09-11T23:26:55.604964+0000","last_became_active":"2024-09-11T23:26:52.067905+0000","last_became_peered":"2024-09-11T23:26:52.067905+0000","last_unstale":"2024-09-11T23:26:55.604964+0000","last_undegraded":"2024-09-11T23:26:55.604964+0000","last_fullsized":"2024-09-11T23:26:55.604964+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:15.517992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.062900+0000","last_change":"2024-09-11T23:26:44.704570+0000","last_active":"2024-09-11T23:26:55.062900+0000","last_peered":"2024-09-11T23:26:55.062900+0000","last_clean":"2024-09-11T23:26:55.062900+0000","last_became_active":"2024-09-11T23:26:44.704263+0000","last_became_peered":"2024-09-11T23:26:44.704263+0000","last_unstale":"2024-09-11T23:26:55.062900+0000","last_undegraded":"2024-09-11T23:26:55.062900+0000","last_fullsized":"2024-09-11T23:26:55.062900+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:25.112831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"86'25","reported_seq":83,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:27:32.063440+0000","last_change":"2024-09-11T23:26:42.620726+0000","last_active":"2024-09-11T23:27:32.063440+0000","last_peered":"2024-09-11T23:27:32.063440+0000","last_clean":"2024-09-11T23:27:32.063440+0000","last_became_active":"2024-09-11T23:26:42.620381+0000","last_became_peered":"2024-09-11T23:26:42.620381+0000","last_unstale":"2024-09-11T23:27:32.063440+0000","last_undegraded":"2024-09-11T23:27:32.063440+0000","last_fullsized":"2024-09-11T23:27:32.063440+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:41.001056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43345,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":56,"num_write":26,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.074459+0000","last_change":"2024-09-11T23:26:52.073830+0000","last_active":"2024-09-11T23:26:57.074459+0000","last_peered":"2024-09-11T23:26:57.074459+0000","last_clean":"2024-09-11T23:26:57.074459+0000","last_became_active":"2024-09-11T23:26:52.073415+0000","last_became_peered":"2024-09-11T23:26:52.073415+0000","last_unstale":"2024-09-11T23:26:57.074459+0000","last_undegraded":"2024-09-11T23:26:57.074459+0000","last_fullsized":"2024-09-11T23:26:57.074459+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:25.310980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.775432+0000","last_change":"2024-09-11T23:26:44.694203+0000","last_active":"2024-09-11T23:26:55.775432+0000","last_peered":"2024-09-11T23:26:55.775432+0000","last_clean":"2024-09-11T23:26:55.775432+0000","last_became_active":"2024-09-11T23:26:44.693827+0000","last_became_peered":"2024-09-11T23:26:44.693827+0000","last_unstale":"2024-09-11T23:26:55.775432+0000","last_undegraded":"2024-09-11T23:26:55.775432+0000","last_fullsized":"2024-09-11T23:26:55.775432+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:29.929206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"86'4","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:27:20.032794+0000","last_change":"2024-09-11T23:26:42.646046+0000","last_active":"2024-09-11T23:27:20.032794+0000","last_peered":"2024-09-11T23:27:20.032794+0000","last_clean":"2024-09-11T23:27:20.032794+0000","last_became_active":"2024-09-11T23:26:42.645735+0000","last_became_peered":"2024-09-11T23:26:42.645735+0000","last_unstale":"2024-09-11T23:27:20.032794+0000","last_undegraded":"2024-09-11T23:27:20.032794+0000","last_fullsized":"2024-09-11T23:27:20.032794+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:12.159712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.065105+0000","last_change":"2024-09-11T23:26:52.069732+0000","last_active":"2024-09-11T23:26:55.065105+0000","last_peered":"2024-09-11T23:26:55.065105+0000","last_clean":"2024-09-11T23:26:55.065105+0000","last_became_active":"2024-09-11T23:26:52.069230+0000","last_became_peered":"2024-09-11T23:26:52.069230+0000","last_unstale":"2024-09-11T23:26:55.065105+0000","last_undegraded":"2024-09-11T23:26:55.065105+0000","last_fullsized":"2024-09-11T23:26:55.065105+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:50:17.304900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.757478+0000","last_change":"2024-09-11T23:26:44.691704+0000","last_active":"2024-09-11T23:26:55.757478+0000","last_peered":"2024-09-11T23:26:55.757478+0000","last_clean":"2024-09-11T23:26:55.757478+0000","last_became_active":"2024-09-11T23:26:44.690686+0000","last_became_peered":"2024-09-11T23:26:44.690686+0000","last_unstale":"2024-09-11T23:26:55.757478+0000","last_undegraded":"2024-09-11T23:26:55.757478+0000","last_fullsized":"2024-09-11T23:26:55.757478+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:44.046933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"86'2","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:27:20.033027+0000","last_change":"2024-09-11T23:26:42.616271+0000","last_active":"2024-09-11T23:27:20.033027+0000","last_peered":"2024-09-11T23:27:20.033027+0000","last_clean":"2024-09-11T23:27:20.033027+0000","last_became_active":"2024-09-11T23:26:42.615870+0000","last_became_peered":"2024-09-11T23:26:42.615870+0000","last_unstale":"2024-09-11T23:27:20.033027+0000","last_undegraded":"2024-09-11T23:27:20.033027+0000","last_fullsized":"2024-09-11T23:27:20.033027+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:08.573352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.073540+0000","last_change":"2024-09-11T23:26:52.072615+0000","last_active":"2024-09-11T23:26:57.073540+0000","last_peered":"2024-09-11T23:26:57.073540+0000","last_clean":"2024-09-11T23:26:57.073540+0000","last_became_active":"2024-09-11T23:26:52.072219+0000","last_became_peered":"2024-09-11T23:26:52.072219+0000","last_unstale":"2024-09-11T23:26:57.073540+0000","last_undegraded":"2024-09-11T23:26:57.073540+0000","last_fullsized":"2024-09-11T23:26:57.073540+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:57.598375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.775540+0000","last_change":"2024-09-11T23:26:44.690099+0000","last_active":"2024-09-11T23:26:55.775540+0000","last_peered":"2024-09-11T23:26:55.775540+0000","last_clean":"2024-09-11T23:26:55.775540+0000","last_became_active":"2024-09-11T23:26:44.689763+0000","last_became_peered":"2024-09-11T23:26:44.689763+0000","last_unstale":"2024-09-11T23:26:55.775540+0000","last_undegraded":"2024-09-11T23:26:55.775540+0000","last_fullsized":"2024-09-11T23:26:55.775540+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:45.316508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"86'3","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:27:31.059249+0000","last_change":"2024-09-11T23:26:42.620930+0000","last_active":"2024-09-11T23:27:31.059249+0000","last_peered":"2024-09-11T23:27:31.059249+0000","last_clean":"2024-09-11T23:27:31.059249+0000","last_became_active":"2024-09-11T23:26:42.620544+0000","last_became_peered":"2024-09-11T23:26:42.620544+0000","last_unstale":"2024-09-11T23:27:31.059249+0000","last_undegraded":"2024-09-11T23:27:31.059249+0000","last_fullsized":"2024-09-11T23:27:31.059249+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:26.625004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.061798+0000","last_change":"2024-09-11T23:26:52.065014+0000","last_active":"2024-09-11T23:26:55.061798+0000","last_peered":"2024-09-11T23:26:55.061798+0000","last_clean":"2024-09-11T23:26:55.061798+0000","last_became_active":"2024-09-11T23:26:52.064570+0000","last_became_peered":"2024-09-11T23:26:52.064570+0000","last_unstale":"2024-09-11T23:26:55.061798+0000","last_undegraded":"2024-09-11T23:26:55.061798+0000","last_fullsized":"2024-09-11T23:26:55.061798+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:53.658310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.757407+0000","last_change":"2024-09-11T23:26:52.065559+0000","last_active":"2024-09-11T23:26:55.757407+0000","last_peered":"2024-09-11T23:26:55.757407+0000","last_clean":"2024-09-11T23:26:55.757407+0000","last_became_active":"2024-09-11T23:26:52.065197+0000","last_became_peered":"2024-09-11T23:26:52.065197+0000","last_unstale":"2024-09-11T23:26:55.757407+0000","last_undegraded":"2024-09-11T23:26:55.757407+0000","last_fullsized":"2024-09-11T23:26:55.757407+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:19.371054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.074331+0000","last_change":"2024-09-11T23:26:44.691726+0000","last_active":"2024-09-11T23:26:57.074331+0000","last_peered":"2024-09-11T23:26:57.074331+0000","last_clean":"2024-09-11T23:26:57.074331+0000","last_became_active":"2024-09-11T23:26:44.691417+0000","last_became_peered":"2024-09-11T23:26:44.691417+0000","last_unstale":"2024-09-11T23:26:57.074331+0000","last_undegraded":"2024-09-11T23:26:57.074331+0000","last_fullsized":"2024-09-11T23:26:57.074331+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:38.139576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"86'1","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.604751+0000","last_change":"2024-09-11T23:26:42.615287+0000","last_active":"2024-09-11T23:26:55.604751+0000","last_peered":"2024-09-11T23:26:55.604751+0000","last_clean":"2024-09-11T23:26:55.604751+0000","last_became_active":"2024-09-11T23:26:42.614939+0000","last_became_peered":"2024-09-11T23:26:42.614939+0000","last_unstale":"2024-09-11T23:26:55.604751+0000","last_undegraded":"2024-09-11T23:26:55.604751+0000","last_fullsized":"2024-09-11T23:26:55.604751+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:23.250573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.086150+0000","last_change":"2024-09-11T23:26:52.069773+0000","last_active":"2024-09-11T23:26:55.086150+0000","last_peered":"2024-09-11T23:26:55.086150+0000","last_clean":"2024-09-11T23:26:55.086150+0000","last_became_active":"2024-09-11T23:26:52.069365+0000","last_became_peered":"2024-09-11T23:26:52.069365+0000","last_unstale":"2024-09-11T23:26:55.086150+0000","last_undegraded":"2024-09-11T23:26:55.086150+0000","last_fullsized":"2024-09-11T23:26:55.086150+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:00.101851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.061711+0000","last_change":"2024-09-11T23:26:44.689869+0000","last_active":"2024-09-11T23:26:55.061711+0000","last_peered":"2024-09-11T23:26:55.061711+0000","last_clean":"2024-09-11T23:26:55.061711+0000","last_became_active":"2024-09-11T23:26:44.689474+0000","last_became_peered":"2024-09-11T23:26:44.689474+0000","last_unstale":"2024-09-11T23:26:55.061711+0000","last_undegraded":"2024-09-11T23:26:55.061711+0000","last_fullsized":"2024-09-11T23:26:55.061711+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:10.255840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"86'2","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:27:21.044988+0000","last_change":"2024-09-11T23:26:42.609857+0000","last_active":"2024-09-11T23:27:21.044988+0000","last_peered":"2024-09-11T23:27:21.044988+0000","last_clean":"2024-09-11T23:27:21.044988+0000","last_became_active":"2024-09-11T23:26:42.609536+0000","last_became_peered":"2024-09-11T23:26:42.609536+0000","last_unstale":"2024-09-11T23:27:21.044988+0000","last_undegraded":"2024-09-11T23:27:21.044988+0000","last_fullsized":"2024-09-11T23:27:21.044988+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:17.751298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"86'3","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:27:21.045394+0000","last_change":"2024-09-11T23:26:52.061076+0000","last_active":"2024-09-11T23:27:21.045394+0000","last_peered":"2024-09-11T23:27:21.045394+0000","last_clean":"2024-09-11T23:27:21.045394+0000","last_became_active":"2024-09-11T23:26:52.060543+0000","last_became_peered":"2024-09-11T23:26:52.060543+0000","last_unstale":"2024-09-11T23:27:21.045394+0000","last_undegraded":"2024-09-11T23:27:21.045394+0000","last_fullsized":"2024-09-11T23:27:21.045394+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:10.566235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.604822+0000","last_change":"2024-09-11T23:26:44.690699+0000","last_active":"2024-09-11T23:26:55.604822+0000","last_peered":"2024-09-11T23:26:55.604822+0000","last_clean":"2024-09-11T23:26:55.604822+0000","last_became_active":"2024-09-11T23:26:44.690142+0000","last_became_peered":"2024-09-11T23:26:44.690142+0000","last_unstale":"2024-09-11T23:26:55.604822+0000","last_undegraded":"2024-09-11T23:26:55.604822+0000","last_fullsized":"2024-09-11T23:26:55.604822+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:20.790171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:56.191762+0000","last_change":"2024-09-11T23:26:52.071172+0000","last_active":"2024-09-11T23:26:56.191762+0000","last_peered":"2024-09-11T23:26:56.191762+0000","last_clean":"2024-09-11T23:26:56.191762+0000","last_became_active":"2024-09-11T23:26:52.070803+0000","last_became_peered":"2024-09-11T23:26:52.070803+0000","last_unstale":"2024-09-11T23:26:56.191762+0000","last_undegraded":"2024-09-11T23:26:56.191762+0000","last_fullsized":"2024-09-11T23:26:56.191762+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:09.509750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"86'5","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:27:32.061336+0000","last_change":"2024-09-11T23:26:52.059895+0000","last_active":"2024-09-11T23:27:32.061336+0000","last_peered":"2024-09-11T23:27:32.061336+0000","last_clean":"2024-09-11T23:27:32.061336+0000","last_became_active":"2024-09-11T23:26:52.059431+0000","last_became_peered":"2024-09-11T23:26:52.059431+0000","last_unstale":"2024-09-11T23:27:32.061336+0000","last_undegraded":"2024-09-11T23:27:32.061336+0000","last_fullsized":"2024-09-11T23:27:32.061336+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:58.922483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.062619+0000","last_change":"2024-09-11T23:26:44.690449+0000","last_active":"2024-09-11T23:26:55.062619+0000","last_peered":"2024-09-11T23:26:55.062619+0000","last_clean":"2024-09-11T23:26:55.062619+0000","last_became_active":"2024-09-11T23:26:44.690102+0000","last_became_peered":"2024-09-11T23:26:44.690102+0000","last_unstale":"2024-09-11T23:26:55.062619+0000","last_undegraded":"2024-09-11T23:26:55.062619+0000","last_fullsized":"2024-09-11T23:26:55.062619+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:49.730602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:56.191883+0000","last_change":"2024-09-11T23:26:52.062826+0000","last_active":"2024-09-11T23:26:56.191883+0000","last_peered":"2024-09-11T23:26:56.191883+0000","last_clean":"2024-09-11T23:26:56.191883+0000","last_became_active":"2024-09-11T23:26:52.062405+0000","last_became_peered":"2024-09-11T23:26:52.062405+0000","last_unstale":"2024-09-11T23:26:56.191883+0000","last_undegraded":"2024-09-11T23:26:56.191883+0000","last_fullsized":"2024-09-11T23:26:56.191883+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:46.141117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.085602+0000","last_change":"2024-09-11T23:26:44.707056+0000","last_active":"2024-09-11T23:26:55.085602+0000","last_peered":"2024-09-11T23:26:55.085602+0000","last_clean":"2024-09-11T23:26:55.085602+0000","last_became_active":"2024-09-11T23:26:44.706704+0000","last_became_peered":"2024-09-11T23:26:44.706704+0000","last_unstale":"2024-09-11T23:26:55.085602+0000","last_undegraded":"2024-09-11T23:26:55.085602+0000","last_fullsized":"2024-09-11T23:26:55.085602+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:29.221070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:56.192069+0000","last_change":"2024-09-11T23:26:44.699807+0000","last_active":"2024-09-11T23:26:56.192069+0000","last_peered":"2024-09-11T23:26:56.192069+0000","last_clean":"2024-09-11T23:26:56.192069+0000","last_became_active":"2024-09-11T23:26:44.699497+0000","last_became_peered":"2024-09-11T23:26:44.699497+0000","last_unstale":"2024-09-11T23:26:56.192069+0000","last_undegraded":"2024-09-11T23:26:56.192069+0000","last_fullsized":"2024-09-11T23:26:56.192069+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:17.954048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:56.191594+0000","last_change":"2024-09-11T23:26:44.698751+0000","last_active":"2024-09-11T23:26:56.191594+0000","last_peered":"2024-09-11T23:26:56.191594+0000","last_clean":"2024-09-11T23:26:56.191594+0000","last_became_active":"2024-09-11T23:26:44.698429+0000","last_became_peered":"2024-09-11T23:26:44.698429+0000","last_unstale":"2024-09-11T23:26:56.191594+0000","last_undegraded":"2024-09-11T23:26:56.191594+0000","last_fullsized":"2024-09-11T23:26:56.191594+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:25.452225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.757351+0000","last_change":"2024-09-11T23:26:44.690356+0000","last_active":"2024-09-11T23:26:55.757351+0000","last_peered":"2024-09-11T23:26:55.757351+0000","last_clean":"2024-09-11T23:26:55.757351+0000","last_became_active":"2024-09-11T23:26:44.690057+0000","last_became_peered":"2024-09-11T23:26:44.690057+0000","last_unstale":"2024-09-11T23:26:55.757351+0000","last_undegraded":"2024-09-11T23:26:55.757351+0000","last_fullsized":"2024-09-11T23:26:55.757351+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:38.950284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.073974+0000","last_change":"2024-09-11T23:26:44.691251+0000","last_active":"2024-09-11T23:26:57.073974+0000","last_peered":"2024-09-11T23:26:57.073974+0000","last_clean":"2024-09-11T23:26:57.073974+0000","last_became_active":"2024-09-11T23:26:44.690905+0000","last_became_peered":"2024-09-11T23:26:44.690905+0000","last_unstale":"2024-09-11T23:26:57.073974+0000","last_undegraded":"2024-09-11T23:26:57.073974+0000","last_fullsized":"2024-09-11T23:26:57.073974+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:18.509826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.086105+0000","last_change":"2024-09-11T23:26:44.707581+0000","last_active":"2024-09-11T23:26:55.086105+0000","last_peered":"2024-09-11T23:26:55.086105+0000","last_clean":"2024-09-11T23:26:55.086105+0000","last_became_active":"2024-09-11T23:26:44.707266+0000","last_became_peered":"2024-09-11T23:26:44.707266+0000","last_unstale":"2024-09-11T23:26:55.086105+0000","last_undegraded":"2024-09-11T23:26:55.086105+0000","last_fullsized":"2024-09-11T23:26:55.086105+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:40:28.248560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:56.192101+0000","last_change":"2024-09-11T23:26:44.704003+0000","last_active":"2024-09-11T23:26:56.192101+0000","last_peered":"2024-09-11T23:26:56.192101+0000","last_clean":"2024-09-11T23:26:56.192101+0000","last_became_active":"2024-09-11T23:26:44.703702+0000","last_became_peered":"2024-09-11T23:26:44.703702+0000","last_unstale":"2024-09-11T23:26:56.192101+0000","last_undegraded":"2024-09-11T23:26:56.192101+0000","last_fullsized":"2024-09-11T23:26:56.192101+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:28:17.511868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.062207+0000","last_change":"2024-09-11T23:26:44.694601+0000","last_active":"2024-09-11T23:26:55.062207+0000","last_peered":"2024-09-11T23:26:55.062207+0000","last_clean":"2024-09-11T23:26:55.062207+0000","last_became_active":"2024-09-11T23:26:44.694304+0000","last_became_peered":"2024-09-11T23:26:44.694304+0000","last_unstale":"2024-09-11T23:26:55.062207+0000","last_undegraded":"2024-09-11T23:26:55.062207+0000","last_fullsized":"2024-09-11T23:26:55.062207+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:32:04.171439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.604370+0000","last_change":"2024-09-11T23:26:44.691565+0000","last_active":"2024-09-11T23:26:55.604370+0000","last_peered":"2024-09-11T23:26:55.604370+0000","last_clean":"2024-09-11T23:26:55.604370+0000","last_became_active":"2024-09-11T23:26:44.691237+0000","last_became_peered":"2024-09-11T23:26:44.691237+0000","last_unstale":"2024-09-11T23:26:55.604370+0000","last_undegraded":"2024-09-11T23:26:55.604370+0000","last_fullsized":"2024-09-11T23:26:55.604370+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:01.413447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.061790+0000","last_change":"2024-09-11T23:26:44.699372+0000","last_active":"2024-09-11T23:26:55.061790+0000","last_peered":"2024-09-11T23:26:55.061790+0000","last_clean":"2024-09-11T23:26:55.061790+0000","last_became_active":"2024-09-11T23:26:44.698934+0000","last_became_peered":"2024-09-11T23:26:44.698934+0000","last_unstale":"2024-09-11T23:26:55.061790+0000","last_undegraded":"2024-09-11T23:26:55.061790+0000","last_fullsized":"2024-09-11T23:26:55.061790+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:44:41.486314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.775382+0000","last_change":"2024-09-11T23:26:44.698595+0000","last_active":"2024-09-11T23:26:55.775382+0000","last_peered":"2024-09-11T23:26:55.775382+0000","last_clean":"2024-09-11T23:26:55.775382+0000","last_became_active":"2024-09-11T23:26:44.698268+0000","last_became_peered":"2024-09-11T23:26:44.698268+0000","last_unstale":"2024-09-11T23:26:55.775382+0000","last_undegraded":"2024-09-11T23:26:55.775382+0000","last_fullsized":"2024-09-11T23:26:55.775382+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:57:55.304720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.073981+0000","last_change":"2024-09-11T23:26:44.697049+0000","last_active":"2024-09-11T23:26:57.073981+0000","last_peered":"2024-09-11T23:26:57.073981+0000","last_clean":"2024-09-11T23:26:57.073981+0000","last_became_active":"2024-09-11T23:26:44.696748+0000","last_became_peered":"2024-09-11T23:26:44.696748+0000","last_unstale":"2024-09-11T23:26:57.073981+0000","last_undegraded":"2024-09-11T23:26:57.073981+0000","last_fullsized":"2024-09-11T23:26:57.073981+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:55.486695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.085891+0000","last_change":"2024-09-11T23:26:44.705094+0000","last_active":"2024-09-11T23:26:55.085891+0000","last_peered":"2024-09-11T23:26:55.085891+0000","last_clean":"2024-09-11T23:26:55.085891+0000","last_became_active":"2024-09-11T23:26:44.704750+0000","last_became_peered":"2024-09-11T23:26:44.704750+0000","last_unstale":"2024-09-11T23:26:55.085891+0000","last_undegraded":"2024-09-11T23:26:55.085891+0000","last_fullsized":"2024-09-11T23:26:55.085891+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:19.058557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:56.192009+0000","last_change":"2024-09-11T23:26:52.070615+0000","last_active":"2024-09-11T23:26:56.192009+0000","last_peered":"2024-09-11T23:26:56.192009+0000","last_clean":"2024-09-11T23:26:56.192009+0000","last_became_active":"2024-09-11T23:26:52.070182+0000","last_became_peered":"2024-09-11T23:26:52.070182+0000","last_unstale":"2024-09-11T23:26:56.192009+0000","last_undegraded":"2024-09-11T23:26:56.192009+0000","last_fullsized":"2024-09-11T23:26:56.192009+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:37.888276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,6],"acting":[2,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.074925+0000","last_change":"2024-09-11T23:26:44.690032+0000","last_active":"2024-09-11T23:26:57.074925+0000","last_peered":"2024-09-11T23:26:57.074925+0000","last_clean":"2024-09-11T23:26:57.074925+0000","last_became_active":"2024-09-11T23:26:44.689715+0000","last_became_peered":"2024-09-11T23:26:44.689715+0000","last_unstale":"2024-09-11T23:26:57.074925+0000","last_undegraded":"2024-09-11T23:26:57.074925+0000","last_fullsized":"2024-09-11T23:26:57.074925+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:10.325376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.086231+0000","last_change":"2024-09-11T23:26:44.707675+0000","last_active":"2024-09-11T23:26:55.086231+0000","last_peered":"2024-09-11T23:26:55.086231+0000","last_clean":"2024-09-11T23:26:55.086231+0000","last_became_active":"2024-09-11T23:26:44.707063+0000","last_became_peered":"2024-09-11T23:26:44.707063+0000","last_unstale":"2024-09-11T23:26:55.086231+0000","last_undegraded":"2024-09-11T23:26:55.086231+0000","last_fullsized":"2024-09-11T23:26:55.086231+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:52.289558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.774898+0000","last_change":"2024-09-11T23:26:44.697512+0000","last_active":"2024-09-11T23:26:55.774898+0000","last_peered":"2024-09-11T23:26:55.774898+0000","last_clean":"2024-09-11T23:26:55.774898+0000","last_became_active":"2024-09-11T23:26:44.697208+0000","last_became_peered":"2024-09-11T23:26:44.697208+0000","last_unstale":"2024-09-11T23:26:55.774898+0000","last_undegraded":"2024-09-11T23:26:55.774898+0000","last_fullsized":"2024-09-11T23:26:55.774898+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:57.001816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.757044+0000","last_change":"2024-09-11T23:26:44.700661+0000","last_active":"2024-09-11T23:26:55.757044+0000","last_peered":"2024-09-11T23:26:55.757044+0000","last_clean":"2024-09-11T23:26:55.757044+0000","last_became_active":"2024-09-11T23:26:44.700298+0000","last_became_peered":"2024-09-11T23:26:44.700298+0000","last_unstale":"2024-09-11T23:26:55.757044+0000","last_undegraded":"2024-09-11T23:26:55.757044+0000","last_fullsized":"2024-09-11T23:26:55.757044+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:03.774789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.757031+0000","last_change":"2024-09-11T23:26:44.695295+0000","last_active":"2024-09-11T23:26:55.757031+0000","last_peered":"2024-09-11T23:26:55.757031+0000","last_clean":"2024-09-11T23:26:55.757031+0000","last_became_active":"2024-09-11T23:26:44.694905+0000","last_became_peered":"2024-09-11T23:26:44.694905+0000","last_unstale":"2024-09-11T23:26:55.757031+0000","last_undegraded":"2024-09-11T23:26:55.757031+0000","last_fullsized":"2024-09-11T23:26:55.757031+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:59.016335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.073876+0000","last_change":"2024-09-11T23:26:44.689876+0000","last_active":"2024-09-11T23:26:57.073876+0000","last_peered":"2024-09-11T23:26:57.073876+0000","last_clean":"2024-09-11T23:26:57.073876+0000","last_became_active":"2024-09-11T23:26:44.689541+0000","last_became_peered":"2024-09-11T23:26:44.689541+0000","last_unstale":"2024-09-11T23:26:57.073876+0000","last_undegraded":"2024-09-11T23:26:57.073876+0000","last_fullsized":"2024-09-11T23:26:57.073876+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:18.693201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.065151+0000","last_change":"2024-09-11T23:26:44.696308+0000","last_active":"2024-09-11T23:26:55.065151+0000","last_peered":"2024-09-11T23:26:55.065151+0000","last_clean":"2024-09-11T23:26:55.065151+0000","last_became_active":"2024-09-11T23:26:44.695973+0000","last_became_peered":"2024-09-11T23:26:44.695973+0000","last_unstale":"2024-09-11T23:26:55.065151+0000","last_undegraded":"2024-09-11T23:26:55.065151+0000","last_fullsized":"2024-09-11T23:26:55.065151+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:46.890624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.074495+0000","last_change":"2024-09-11T23:26:44.703180+0000","last_active":"2024-09-11T23:26:57.074495+0000","last_peered":"2024-09-11T23:26:57.074495+0000","last_clean":"2024-09-11T23:26:57.074495+0000","last_became_active":"2024-09-11T23:26:44.702843+0000","last_became_peered":"2024-09-11T23:26:44.702843+0000","last_unstale":"2024-09-11T23:26:57.074495+0000","last_undegraded":"2024-09-11T23:26:57.074495+0000","last_fullsized":"2024-09-11T23:26:57.074495+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:35.425199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.074923+0000","last_change":"2024-09-11T23:26:52.069650+0000","last_active":"2024-09-11T23:26:57.074923+0000","last_peered":"2024-09-11T23:26:57.074923+0000","last_clean":"2024-09-11T23:26:57.074923+0000","last_became_active":"2024-09-11T23:26:52.069258+0000","last_became_peered":"2024-09-11T23:26:52.069258+0000","last_unstale":"2024-09-11T23:26:57.074923+0000","last_undegraded":"2024-09-11T23:26:57.074923+0000","last_fullsized":"2024-09-11T23:26:57.074923+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:29.073360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.775514+0000","last_change":"2024-09-11T23:26:44.701547+0000","last_active":"2024-09-11T23:26:55.775514+0000","last_peered":"2024-09-11T23:26:55.775514+0000","last_clean":"2024-09-11T23:26:55.775514+0000","last_became_active":"2024-09-11T23:26:44.701215+0000","last_became_peered":"2024-09-11T23:26:44.701215+0000","last_unstale":"2024-09-11T23:26:55.775514+0000","last_undegraded":"2024-09-11T23:26:55.775514+0000","last_fullsized":"2024-09-11T23:26:55.775514+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:39.774757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.061657+0000","last_change":"2024-09-11T23:26:44.696446+0000","last_active":"2024-09-11T23:26:55.061657+0000","last_peered":"2024-09-11T23:26:55.061657+0000","last_clean":"2024-09-11T23:26:55.061657+0000","last_became_active":"2024-09-11T23:26:44.696129+0000","last_became_peered":"2024-09-11T23:26:44.696129+0000","last_unstale":"2024-09-11T23:26:55.061657+0000","last_undegraded":"2024-09-11T23:26:55.061657+0000","last_fullsized":"2024-09-11T23:26:55.061657+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:02.441274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.073947+0000","last_change":"2024-09-11T23:26:44.702036+0000","last_active":"2024-09-11T23:26:57.073947+0000","last_peered":"2024-09-11T23:26:57.073947+0000","last_clean":"2024-09-11T23:26:57.073947+0000","last_became_active":"2024-09-11T23:26:44.701517+0000","last_became_peered":"2024-09-11T23:26:44.701517+0000","last_unstale":"2024-09-11T23:26:57.073947+0000","last_undegraded":"2024-09-11T23:26:57.073947+0000","last_fullsized":"2024-09-11T23:26:57.073947+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:56.577107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.074114+0000","last_change":"2024-09-11T23:26:44.693533+0000","last_active":"2024-09-11T23:26:57.074114+0000","last_peered":"2024-09-11T23:26:57.074114+0000","last_clean":"2024-09-11T23:26:57.074114+0000","last_became_active":"2024-09-11T23:26:44.693199+0000","last_became_peered":"2024-09-11T23:26:44.693199+0000","last_unstale":"2024-09-11T23:26:57.074114+0000","last_undegraded":"2024-09-11T23:26:57.074114+0000","last_fullsized":"2024-09-11T23:26:57.074114+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:33.125162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.062609+0000","last_change":"2024-09-11T23:26:44.691525+0000","last_active":"2024-09-11T23:26:55.062609+0000","last_peered":"2024-09-11T23:26:55.062609+0000","last_clean":"2024-09-11T23:26:55.062609+0000","last_became_active":"2024-09-11T23:26:44.691186+0000","last_became_peered":"2024-09-11T23:26:44.691186+0000","last_unstale":"2024-09-11T23:26:55.062609+0000","last_undegraded":"2024-09-11T23:26:55.062609+0000","last_fullsized":"2024-09-11T23:26:55.062609+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:05.002600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.065035+0000","last_change":"2024-09-11T23:26:44.700076+0000","last_active":"2024-09-11T23:26:55.065035+0000","last_peered":"2024-09-11T23:26:55.065035+0000","last_clean":"2024-09-11T23:26:55.065035+0000","last_became_active":"2024-09-11T23:26:44.699746+0000","last_became_peered":"2024-09-11T23:26:44.699746+0000","last_unstale":"2024-09-11T23:26:55.065035+0000","last_undegraded":"2024-09-11T23:26:55.065035+0000","last_fullsized":"2024-09-11T23:26:55.065035+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:49.311174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.757168+0000","last_change":"2024-09-11T23:26:44.699385+0000","last_active":"2024-09-11T23:26:55.757168+0000","last_peered":"2024-09-11T23:26:55.757168+0000","last_clean":"2024-09-11T23:26:55.757168+0000","last_became_active":"2024-09-11T23:26:44.699095+0000","last_became_peered":"2024-09-11T23:26:44.699095+0000","last_unstale":"2024-09-11T23:26:55.757168+0000","last_undegraded":"2024-09-11T23:26:55.757168+0000","last_fullsized":"2024-09-11T23:26:55.757168+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:40:30.583732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.757470+0000","last_change":"2024-09-11T23:26:44.696893+0000","last_active":"2024-09-11T23:26:55.757470+0000","last_peered":"2024-09-11T23:26:55.757470+0000","last_clean":"2024-09-11T23:26:55.757470+0000","last_became_active":"2024-09-11T23:26:44.696493+0000","last_became_peered":"2024-09-11T23:26:44.696493+0000","last_unstale":"2024-09-11T23:26:55.757470+0000","last_undegraded":"2024-09-11T23:26:55.757470+0000","last_fullsized":"2024-09-11T23:26:55.757470+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:32.320327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.086193+0000","last_change":"2024-09-11T23:26:44.707902+0000","last_active":"2024-09-11T23:26:55.086193+0000","last_peered":"2024-09-11T23:26:55.086193+0000","last_clean":"2024-09-11T23:26:55.086193+0000","last_became_active":"2024-09-11T23:26:44.706664+0000","last_became_peered":"2024-09-11T23:26:44.706664+0000","last_unstale":"2024-09-11T23:26:55.086193+0000","last_undegraded":"2024-09-11T23:26:55.086193+0000","last_fullsized":"2024-09-11T23:26:55.086193+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:57.865640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":46955,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":97,"num_read_kb":99,"num_write":150,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":162967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":3542208,"data_compressed":214348,"data_compressed_allocated":270336,"data_compressed_original":3506176,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579927,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32116,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713036,"statfs":{"total":95995035648,"available":95962148864,"internally_reserved":0,"allocated":954368,"data_stored":481201,"data_compressed":17784,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808860,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1073152,"data_stored":1111192,"data_compressed":54054,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972385,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36288,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708864,"statfs":{"total":95995035648,"available":95957876736,"internally_reserved":0,"allocated":966656,"data_stored":484911,"data_compressed":17784,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201318,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":480735,"data_compressed":17784,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430251,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1011712,"data_stored":1076253,"data_compressed":54054,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626480,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36264,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708888,"statfs":{"total":95995035648,"available":95957901312,"internally_reserved":0,"allocated":942080,"data_stored":475991,"data_compressed":17784,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855414,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":1071219,"data_compressed":54054,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018939,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":480753,"data_compressed":17784,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247871,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36276,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708876,"statfs":{"total":95995035648,"available":95957889024,"internally_reserved":0,"allocated":954368,"data_stored":476185,"data_compressed":17784,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444101,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1007616,"data_stored":520484,"data_compressed":17784,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":530297,"data_compressed":17784,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":477379,"data_compressed":17784,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34634,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34634,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36270,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36270,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36270,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36270,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":54396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":55634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":44923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:27:38.185 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T23:27:38.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:38 smithi159 ceph-mon[34394]: pgmap v309: 129 pgs: 129 active+clean; 623 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.2 KiB/s wr, 11 op/s 2024-09-11T23:27:38.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:38 smithi172 ceph-mon[34855]: pgmap v309: 129 pgs: 129 active+clean; 623 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.2 KiB/s wr, 11 op/s 2024-09-11T23:27:38.448 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:27:38.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:38 smithi005 ceph-mon[31201]: pgmap v309: 129 pgs: 129 active+clean; 623 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.2 KiB/s wr, 11 op/s 2024-09-11T23:27:38.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:38.898+0000 7f528415b640 1 -- 172.21.15.5:0/3628941487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f527c101420 msgr2=0x7f527c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:38.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:38.898+0000 7f528415b640 1 --2- 172.21.15.5:0/3628941487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f527c101420 0x7f527c10d950 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5274009cd0 tx=0x7f527402a8e0 comp rx=0 tx=0).stop 2024-09-11T23:27:38.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:38.898+0000 7f528415b640 1 -- 172.21.15.5:0/3628941487 shutdown_connections 2024-09-11T23:27:38.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:38.898+0000 7f528415b640 1 --2- 172.21.15.5:0/3628941487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f527c101420 0x7f527c10d950 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:38.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:38.898+0000 7f528415b640 1 --2- 172.21.15.5:0/3628941487 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f527c100a80 0x7f527c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:38.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:38.898+0000 7f528415b640 1 --2- 172.21.15.5:0/3628941487 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f527c106a80 0x7f527c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:38.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:38.898+0000 7f528415b640 1 -- 172.21.15.5:0/3628941487 >> 172.21.15.5:0/3628941487 conn(0x7f527c0fc7a0 msgr2=0x7f527c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:38.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:38.898+0000 7f528415b640 1 -- 172.21.15.5:0/3628941487 shutdown_connections 2024-09-11T23:27:38.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:38.898+0000 7f528415b640 1 -- 172.21.15.5:0/3628941487 wait complete. 2024-09-11T23:27:38.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:38.899+0000 7f528415b640 1 Processor -- start 2024-09-11T23:27:38.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:38.899+0000 7f528415b640 1 -- start start 2024-09-11T23:27:38.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:38.899+0000 7f528415b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f527c100a80 0x7f527c1983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:38.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:38.899+0000 7f528415b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f527c101420 0x7f527c1988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:38.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:38.899+0000 7f528415b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f527c106a80 0x7f527c19cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:38.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:38.899+0000 7f528415b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f527c110d50 con 0x7f527c101420 2024-09-11T23:27:38.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:38.899+0000 7f528415b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f527c110bd0 con 0x7f527c106a80 2024-09-11T23:27:38.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:38.899+0000 7f528415b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f527c110ed0 con 0x7f527c100a80 2024-09-11T23:27:38.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:38.899+0000 7f52816f6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f527c101420 0x7f527c1988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:38.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:38.899+0000 7f52816f6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f527c101420 0x7f527c1988f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44352/0 (socket says 172.21.15.5:44352) 2024-09-11T23:27:38.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:38.899+0000 7f52816f6640 1 -- 172.21.15.5:0/2003781505 learned_addr learned my addr 172.21.15.5:0/2003781505 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:27:38.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:38.900+0000 7f52826f8640 1 --2- 172.21.15.5:0/2003781505 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f527c106a80 0x7f527c19cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:38.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:38.900+0000 7f5281ef7640 1 --2- 172.21.15.5:0/2003781505 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f527c100a80 0x7f527c1983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:38.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:38.900+0000 7f52816f6640 1 -- 172.21.15.5:0/2003781505 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f527c100a80 msgr2=0x7f527c1983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:38.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:38.900+0000 7f52816f6640 1 --2- 172.21.15.5:0/2003781505 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f527c100a80 0x7f527c1983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:38.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:38.900+0000 7f52816f6640 1 -- 172.21.15.5:0/2003781505 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f527c106a80 msgr2=0x7f527c19cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:38.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:38.900+0000 7f52816f6640 1 --2- 172.21.15.5:0/2003781505 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f527c106a80 0x7f527c19cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:38.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:38.900+0000 7f52816f6640 1 -- 172.21.15.5:0/2003781505 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f527c19d360 con 0x7f527c101420 2024-09-11T23:27:38.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:38.900+0000 7f52826f8640 1 --2- 172.21.15.5:0/2003781505 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f527c106a80 0x7f527c19cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:27:38.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:38.900+0000 7f52816f6640 1 --2- 172.21.15.5:0/2003781505 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f527c101420 0x7f527c1988f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f526c00c920 tx=0x7f526c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:38.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:38.900+0000 7f5272ffd640 1 -- 172.21.15.5:0/2003781505 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526c007c70 con 0x7f527c101420 2024-09-11T23:27:38.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:38.900+0000 7f528415b640 1 -- 172.21.15.5:0/2003781505 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f527c19d650 con 0x7f527c101420 2024-09-11T23:27:38.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:38.900+0000 7f5272ffd640 1 -- 172.21.15.5:0/2003781505 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f526c007e10 con 0x7f527c101420 2024-09-11T23:27:38.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:38.900+0000 7f5272ffd640 1 -- 172.21.15.5:0/2003781505 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526c018820 con 0x7f527c101420 2024-09-11T23:27:38.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:38.900+0000 7f528415b640 1 -- 172.21.15.5:0/2003781505 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f527c1a4f30 con 0x7f527c101420 2024-09-11T23:27:38.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:38.901+0000 7f528415b640 1 -- 172.21.15.5:0/2003781505 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f527c100ee0 con 0x7f527c101420 2024-09-11T23:27:38.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:38.902+0000 7f5272ffd640 1 -- 172.21.15.5:0/2003781505 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f526c0189c0 con 0x7f527c101420 2024-09-11T23:27:38.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:38.903+0000 7f5272ffd640 1 --2- 172.21.15.5:0/2003781505 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f52680a2c10 0x7f52680a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:38.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:38.903+0000 7f5281ef7640 1 --2- 172.21.15.5:0/2003781505 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f52680a2c10 0x7f52680a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:38.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:38.904+0000 7f5272ffd640 1 -- 172.21.15.5:0/2003781505 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9071+0+0 (secure 0 0 0) 0x7f526c0cf730 con 0x7f527c101420 2024-09-11T23:27:38.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:38.904+0000 7f5281ef7640 1 --2- 172.21.15.5:0/2003781505 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f52680a2c10 0x7f52680a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5278009890 tx=0x7f5278008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:38.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:38.908+0000 7f5272ffd640 1 -- 172.21.15.5:0/2003781505 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f526c014030 con 0x7f527c101420 2024-09-11T23:27:39.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:39.080+0000 7f528415b640 1 -- 172.21.15.5:0/2003781505 --> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f527c10a050 con 0x7f52680a2c10 2024-09-11T23:27:39.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:39.088+0000 7f5272ffd640 1 -- 172.21.15.5:0/2003781505 <== mgr.14148 v2:172.21.15.5:6800/2285128668 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340571 (secure 0 0 0) 0x7f527c10a050 con 0x7f52680a2c10 2024-09-11T23:27:39.092 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:27:39.094 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-11T23:27:39.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:39.091+0000 7f528415b640 1 -- 172.21.15.5:0/2003781505 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f52680a2c10 msgr2=0x7f52680a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:39.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:39.091+0000 7f528415b640 1 --2- 172.21.15.5:0/2003781505 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f52680a2c10 0x7f52680a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5278009890 tx=0x7f5278008040 comp rx=0 tx=0).stop 2024-09-11T23:27:39.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:39.091+0000 7f528415b640 1 -- 172.21.15.5:0/2003781505 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f527c101420 msgr2=0x7f527c1988f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:39.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:39.091+0000 7f528415b640 1 --2- 172.21.15.5:0/2003781505 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f527c101420 0x7f527c1988f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f526c00c920 tx=0x7f526c00cde0 comp rx=0 tx=0).stop 2024-09-11T23:27:39.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:39.091+0000 7f528415b640 1 -- 172.21.15.5:0/2003781505 shutdown_connections 2024-09-11T23:27:39.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:39.092+0000 7f528415b640 1 --2- 172.21.15.5:0/2003781505 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f52680a2c10 0x7f52680a50d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:39.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:39.092+0000 7f528415b640 1 --2- 172.21.15.5:0/2003781505 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f527c106a80 0x7f527c19cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:39.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:39.092+0000 7f528415b640 1 --2- 172.21.15.5:0/2003781505 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f527c101420 0x7f527c1988f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:39.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:39.092+0000 7f528415b640 1 --2- 172.21.15.5:0/2003781505 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f527c100a80 0x7f527c1983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:39.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:39.092+0000 7f528415b640 1 -- 172.21.15.5:0/2003781505 >> 172.21.15.5:0/2003781505 conn(0x7f527c0fc7a0 msgr2=0x7f527c06aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:39.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:39.092+0000 7f528415b640 1 -- 172.21.15.5:0/2003781505 shutdown_connections 2024-09-11T23:27:39.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:39.092+0000 7f528415b640 1 -- 172.21.15.5:0/2003781505 wait complete. 2024-09-11T23:27:39.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:39 smithi159 ceph-mon[34394]: from='client.14847 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:27:39.392 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:39 smithi172 ceph-mon[34855]: from='client.14847 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:27:39.412 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:39 smithi005 ceph-mon[31201]: from='client.14847 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:27:39.775 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":310,"stamp":"2024-09-11T23:27:38.127906+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":648608,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":239,"num_read_kb":229,"num_write":345,"num_write_kb":3045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":369120,"kb_used_data":11552,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124572704,"statfs":{"total":1151940427776,"available":1151562448896,"internally_reserved":0,"allocated":11829248,"data_stored":7677651,"data_compressed":322218,"data_compressed_allocated":430080,"data_compressed_original":2359296,"omap_allocated":19142,"internal_metadata":365933882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":50786,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":78,"num_read_kb":90,"num_write":35,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003414"},"pg_stats":[{"pgid":"2.1f","version":"86'9","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:27:21.045368+0000","last_change":"2024-09-11T23:26:42.617529+0000","last_active":"2024-09-11T23:27:21.045368+0000","last_peered":"2024-09-11T23:27:21.045368+0000","last_clean":"2024-09-11T23:27:21.045368+0000","last_became_active":"2024-09-11T23:26:42.616841+0000","last_became_peered":"2024-09-11T23:26:42.616841+0000","last_unstale":"2024-09-11T23:27:21.045368+0000","last_undegraded":"2024-09-11T23:27:21.045368+0000","last_fullsized":"2024-09-11T23:27:21.045368+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:32.464566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.062126+0000","last_change":"2024-09-11T23:26:44.700282+0000","last_active":"2024-09-11T23:26:55.062126+0000","last_peered":"2024-09-11T23:26:55.062126+0000","last_clean":"2024-09-11T23:26:55.062126+0000","last_became_active":"2024-09-11T23:26:44.700046+0000","last_became_peered":"2024-09-11T23:26:44.700046+0000","last_unstale":"2024-09-11T23:26:55.062126+0000","last_undegraded":"2024-09-11T23:26:55.062126+0000","last_fullsized":"2024-09-11T23:26:55.062126+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:10.211467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:56.191676+0000","last_change":"2024-09-11T23:26:52.070566+0000","last_active":"2024-09-11T23:26:56.191676+0000","last_peered":"2024-09-11T23:26:56.191676+0000","last_clean":"2024-09-11T23:26:56.191676+0000","last_became_active":"2024-09-11T23:26:52.070083+0000","last_became_peered":"2024-09-11T23:26:52.070083+0000","last_unstale":"2024-09-11T23:26:56.191676+0000","last_undegraded":"2024-09-11T23:26:56.191676+0000","last_fullsized":"2024-09-11T23:26:56.191676+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:02.857063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.062344+0000","last_change":"2024-09-11T23:26:42.645941+0000","last_active":"2024-09-11T23:26:55.062344+0000","last_peered":"2024-09-11T23:26:55.062344+0000","last_clean":"2024-09-11T23:26:55.062344+0000","last_became_active":"2024-09-11T23:26:42.645590+0000","last_became_peered":"2024-09-11T23:26:42.645590+0000","last_unstale":"2024-09-11T23:26:55.062344+0000","last_undegraded":"2024-09-11T23:26:55.062344+0000","last_fullsized":"2024-09-11T23:26:55.062344+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:20.374936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.757428+0000","last_change":"2024-09-11T23:26:44.684678+0000","last_active":"2024-09-11T23:26:55.757428+0000","last_peered":"2024-09-11T23:26:55.757428+0000","last_clean":"2024-09-11T23:26:55.757428+0000","last_became_active":"2024-09-11T23:26:44.684001+0000","last_became_peered":"2024-09-11T23:26:44.684001+0000","last_unstale":"2024-09-11T23:26:55.757428+0000","last_undegraded":"2024-09-11T23:26:55.757428+0000","last_fullsized":"2024-09-11T23:26:55.757428+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:57.773985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.064478+0000","last_change":"2024-09-11T23:26:52.073563+0000","last_active":"2024-09-11T23:26:55.064478+0000","last_peered":"2024-09-11T23:26:55.064478+0000","last_clean":"2024-09-11T23:26:55.064478+0000","last_became_active":"2024-09-11T23:26:52.072851+0000","last_became_peered":"2024-09-11T23:26:52.072851+0000","last_unstale":"2024-09-11T23:26:55.064478+0000","last_undegraded":"2024-09-11T23:26:55.064478+0000","last_fullsized":"2024-09-11T23:26:55.064478+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:25.711274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"86'4","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:27:21.044326+0000","last_change":"2024-09-11T23:26:42.618190+0000","last_active":"2024-09-11T23:27:21.044326+0000","last_peered":"2024-09-11T23:27:21.044326+0000","last_clean":"2024-09-11T23:27:21.044326+0000","last_became_active":"2024-09-11T23:26:42.617797+0000","last_became_peered":"2024-09-11T23:26:42.617797+0000","last_unstale":"2024-09-11T23:27:21.044326+0000","last_undegraded":"2024-09-11T23:27:21.044326+0000","last_fullsized":"2024-09-11T23:27:21.044326+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:47.800168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.775386+0000","last_change":"2024-09-11T23:26:44.690899+0000","last_active":"2024-09-11T23:26:55.775386+0000","last_peered":"2024-09-11T23:26:55.775386+0000","last_clean":"2024-09-11T23:26:55.775386+0000","last_became_active":"2024-09-11T23:26:44.690552+0000","last_became_peered":"2024-09-11T23:26:44.690552+0000","last_unstale":"2024-09-11T23:26:55.775386+0000","last_undegraded":"2024-09-11T23:26:55.775386+0000","last_fullsized":"2024-09-11T23:26:55.775386+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:02.148342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.064904+0000","last_change":"2024-09-11T23:26:52.072228+0000","last_active":"2024-09-11T23:26:55.064904+0000","last_peered":"2024-09-11T23:26:55.064904+0000","last_clean":"2024-09-11T23:26:55.064904+0000","last_became_active":"2024-09-11T23:26:52.071793+0000","last_became_peered":"2024-09-11T23:26:52.071793+0000","last_unstale":"2024-09-11T23:26:55.064904+0000","last_undegraded":"2024-09-11T23:26:55.064904+0000","last_fullsized":"2024-09-11T23:26:55.064904+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:34.795083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.085817+0000","last_change":"2024-09-11T23:26:52.072018+0000","last_active":"2024-09-11T23:26:55.085817+0000","last_peered":"2024-09-11T23:26:55.085817+0000","last_clean":"2024-09-11T23:26:55.085817+0000","last_became_active":"2024-09-11T23:26:52.062541+0000","last_became_peered":"2024-09-11T23:26:52.062541+0000","last_unstale":"2024-09-11T23:26:55.085817+0000","last_undegraded":"2024-09-11T23:26:55.085817+0000","last_fullsized":"2024-09-11T23:26:55.085817+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:38.371660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.604944+0000","last_change":"2024-09-11T23:26:52.068090+0000","last_active":"2024-09-11T23:26:55.604944+0000","last_peered":"2024-09-11T23:26:55.604944+0000","last_clean":"2024-09-11T23:26:55.604944+0000","last_became_active":"2024-09-11T23:26:52.067755+0000","last_became_peered":"2024-09-11T23:26:52.067755+0000","last_unstale":"2024-09-11T23:26:55.604944+0000","last_undegraded":"2024-09-11T23:26:55.604944+0000","last_fullsized":"2024-09-11T23:26:55.604944+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:09.250735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.064506+0000","last_change":"2024-09-11T23:26:52.063609+0000","last_active":"2024-09-11T23:26:55.064506+0000","last_peered":"2024-09-11T23:26:55.064506+0000","last_clean":"2024-09-11T23:26:55.064506+0000","last_became_active":"2024-09-11T23:26:52.063212+0000","last_became_peered":"2024-09-11T23:26:52.063212+0000","last_unstale":"2024-09-11T23:26:55.064506+0000","last_undegraded":"2024-09-11T23:26:55.064506+0000","last_fullsized":"2024-09-11T23:26:55.064506+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:51.706288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.074417+0000","last_change":"2024-09-11T23:26:44.700390+0000","last_active":"2024-09-11T23:26:57.074417+0000","last_peered":"2024-09-11T23:26:57.074417+0000","last_clean":"2024-09-11T23:26:57.074417+0000","last_became_active":"2024-09-11T23:26:44.700062+0000","last_became_peered":"2024-09-11T23:26:44.700062+0000","last_unstale":"2024-09-11T23:26:57.074417+0000","last_undegraded":"2024-09-11T23:26:57.074417+0000","last_fullsized":"2024-09-11T23:26:57.074417+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:50.934552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:27:20.034228+0000","last_change":"2024-09-11T23:26:42.616879+0000","last_active":"2024-09-11T23:27:20.034228+0000","last_peered":"2024-09-11T23:27:20.034228+0000","last_clean":"2024-09-11T23:27:20.034228+0000","last_became_active":"2024-09-11T23:26:42.616522+0000","last_became_peered":"2024-09-11T23:26:42.616522+0000","last_unstale":"2024-09-11T23:27:20.034228+0000","last_undegraded":"2024-09-11T23:27:20.034228+0000","last_fullsized":"2024-09-11T23:27:20.034228+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:47.903838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.064815+0000","last_change":"2024-09-11T23:26:52.064232+0000","last_active":"2024-09-11T23:26:55.064815+0000","last_peered":"2024-09-11T23:26:55.064815+0000","last_clean":"2024-09-11T23:26:55.064815+0000","last_became_active":"2024-09-11T23:26:52.063559+0000","last_became_peered":"2024-09-11T23:26:52.063559+0000","last_unstale":"2024-09-11T23:26:55.064815+0000","last_undegraded":"2024-09-11T23:26:55.064815+0000","last_fullsized":"2024-09-11T23:26:55.064815+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:48.967531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.061885+0000","last_change":"2024-09-11T23:26:44.691634+0000","last_active":"2024-09-11T23:26:55.061885+0000","last_peered":"2024-09-11T23:26:55.061885+0000","last_clean":"2024-09-11T23:26:55.061885+0000","last_became_active":"2024-09-11T23:26:44.690900+0000","last_became_peered":"2024-09-11T23:26:44.690900+0000","last_unstale":"2024-09-11T23:26:55.061885+0000","last_undegraded":"2024-09-11T23:26:55.061885+0000","last_fullsized":"2024-09-11T23:26:55.061885+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:37.129433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"86'1","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:56.191812+0000","last_change":"2024-09-11T23:26:42.613452+0000","last_active":"2024-09-11T23:26:56.191812+0000","last_peered":"2024-09-11T23:26:56.191812+0000","last_clean":"2024-09-11T23:26:56.191812+0000","last_became_active":"2024-09-11T23:26:42.612943+0000","last_became_peered":"2024-09-11T23:26:42.612943+0000","last_unstale":"2024-09-11T23:26:56.191812+0000","last_undegraded":"2024-09-11T23:26:56.191812+0000","last_fullsized":"2024-09-11T23:26:56.191812+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:57.337796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"86'1","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:56.039973+0000","last_change":"2024-09-11T23:26:52.072930+0000","last_active":"2024-09-11T23:26:56.039973+0000","last_peered":"2024-09-11T23:26:56.039973+0000","last_clean":"2024-09-11T23:26:56.039973+0000","last_became_active":"2024-09-11T23:26:52.071512+0000","last_became_peered":"2024-09-11T23:26:52.071512+0000","last_unstale":"2024-09-11T23:26:56.039973+0000","last_undegraded":"2024-09-11T23:26:56.039973+0000","last_fullsized":"2024-09-11T23:26:56.039973+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:48.913194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.085701+0000","last_change":"2024-09-11T23:26:44.705318+0000","last_active":"2024-09-11T23:26:55.085701+0000","last_peered":"2024-09-11T23:26:55.085701+0000","last_clean":"2024-09-11T23:26:55.085701+0000","last_became_active":"2024-09-11T23:26:44.704974+0000","last_became_peered":"2024-09-11T23:26:44.704974+0000","last_unstale":"2024-09-11T23:26:55.085701+0000","last_undegraded":"2024-09-11T23:26:55.085701+0000","last_fullsized":"2024-09-11T23:26:55.085701+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:44.252769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"86'3","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:27:20.032310+0000","last_change":"2024-09-11T23:26:42.615528+0000","last_active":"2024-09-11T23:27:20.032310+0000","last_peered":"2024-09-11T23:27:20.032310+0000","last_clean":"2024-09-11T23:27:20.032310+0000","last_became_active":"2024-09-11T23:26:42.615182+0000","last_became_peered":"2024-09-11T23:26:42.615182+0000","last_unstale":"2024-09-11T23:27:20.032310+0000","last_undegraded":"2024-09-11T23:27:20.032310+0000","last_fullsized":"2024-09-11T23:27:20.032310+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:40.491178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.074778+0000","last_change":"2024-09-11T23:26:52.074907+0000","last_active":"2024-09-11T23:26:57.074778+0000","last_peered":"2024-09-11T23:26:57.074778+0000","last_clean":"2024-09-11T23:26:57.074778+0000","last_became_active":"2024-09-11T23:26:52.074645+0000","last_became_peered":"2024-09-11T23:26:52.074645+0000","last_unstale":"2024-09-11T23:26:57.074778+0000","last_undegraded":"2024-09-11T23:26:57.074778+0000","last_fullsized":"2024-09-11T23:26:57.074778+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:37.885656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.062497+0000","last_change":"2024-09-11T23:26:44.700291+0000","last_active":"2024-09-11T23:26:55.062497+0000","last_peered":"2024-09-11T23:26:55.062497+0000","last_clean":"2024-09-11T23:26:55.062497+0000","last_became_active":"2024-09-11T23:26:44.699965+0000","last_became_peered":"2024-09-11T23:26:44.699965+0000","last_unstale":"2024-09-11T23:26:55.062497+0000","last_undegraded":"2024-09-11T23:26:55.062497+0000","last_fullsized":"2024-09-11T23:26:55.062497+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:10.526254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:27:20.032438+0000","last_change":"2024-09-11T23:26:42.645574+0000","last_active":"2024-09-11T23:27:20.032438+0000","last_peered":"2024-09-11T23:27:20.032438+0000","last_clean":"2024-09-11T23:27:20.032438+0000","last_became_active":"2024-09-11T23:26:42.645266+0000","last_became_peered":"2024-09-11T23:26:42.645266+0000","last_unstale":"2024-09-11T23:27:20.032438+0000","last_undegraded":"2024-09-11T23:27:20.032438+0000","last_fullsized":"2024-09-11T23:27:20.032438+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:54.343564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.065033+0000","last_change":"2024-09-11T23:26:52.072072+0000","last_active":"2024-09-11T23:26:55.065033+0000","last_peered":"2024-09-11T23:26:55.065033+0000","last_clean":"2024-09-11T23:26:55.065033+0000","last_became_active":"2024-09-11T23:26:52.071488+0000","last_became_peered":"2024-09-11T23:26:52.071488+0000","last_unstale":"2024-09-11T23:26:55.065033+0000","last_undegraded":"2024-09-11T23:26:55.065033+0000","last_fullsized":"2024-09-11T23:26:55.065033+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:22.788819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.757468+0000","last_change":"2024-09-11T23:26:44.692168+0000","last_active":"2024-09-11T23:26:55.757468+0000","last_peered":"2024-09-11T23:26:55.757468+0000","last_clean":"2024-09-11T23:26:55.757468+0000","last_became_active":"2024-09-11T23:26:44.691842+0000","last_became_peered":"2024-09-11T23:26:44.691842+0000","last_unstale":"2024-09-11T23:26:55.757468+0000","last_undegraded":"2024-09-11T23:26:55.757468+0000","last_fullsized":"2024-09-11T23:26:55.757468+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:58.143490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"86'4","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:27:20.033642+0000","last_change":"2024-09-11T23:26:42.640164+0000","last_active":"2024-09-11T23:27:20.033642+0000","last_peered":"2024-09-11T23:27:20.033642+0000","last_clean":"2024-09-11T23:27:20.033642+0000","last_became_active":"2024-09-11T23:26:42.639827+0000","last_became_peered":"2024-09-11T23:26:42.639827+0000","last_unstale":"2024-09-11T23:27:20.033642+0000","last_undegraded":"2024-09-11T23:27:20.033642+0000","last_fullsized":"2024-09-11T23:27:20.033642+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:18.250513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:56.191625+0000","last_change":"2024-09-11T23:26:52.063970+0000","last_active":"2024-09-11T23:26:56.191625+0000","last_peered":"2024-09-11T23:26:56.191625+0000","last_clean":"2024-09-11T23:26:56.191625+0000","last_became_active":"2024-09-11T23:26:52.063575+0000","last_became_peered":"2024-09-11T23:26:52.063575+0000","last_unstale":"2024-09-11T23:26:56.191625+0000","last_undegraded":"2024-09-11T23:26:56.191625+0000","last_fullsized":"2024-09-11T23:26:56.191625+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:59.828888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.062264+0000","last_change":"2024-09-11T23:26:44.696709+0000","last_active":"2024-09-11T23:26:55.062264+0000","last_peered":"2024-09-11T23:26:55.062264+0000","last_clean":"2024-09-11T23:26:55.062264+0000","last_became_active":"2024-09-11T23:26:44.696401+0000","last_became_peered":"2024-09-11T23:26:44.696401+0000","last_unstale":"2024-09-11T23:26:55.062264+0000","last_undegraded":"2024-09-11T23:26:55.062264+0000","last_fullsized":"2024-09-11T23:26:55.062264+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:58:23.823664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"86'10","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:27:35.029946+0000","last_change":"2024-09-11T23:26:42.611182+0000","last_active":"2024-09-11T23:27:35.029946+0000","last_peered":"2024-09-11T23:27:35.029946+0000","last_clean":"2024-09-11T23:27:35.029946+0000","last_became_active":"2024-09-11T23:26:42.610843+0000","last_became_peered":"2024-09-11T23:26:42.610843+0000","last_unstale":"2024-09-11T23:27:35.029946+0000","last_undegraded":"2024-09-11T23:27:35.029946+0000","last_fullsized":"2024-09-11T23:27:35.029946+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:14.099591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.061573+0000","last_change":"2024-09-11T23:26:52.061367+0000","last_active":"2024-09-11T23:26:55.061573+0000","last_peered":"2024-09-11T23:26:55.061573+0000","last_clean":"2024-09-11T23:26:55.061573+0000","last_became_active":"2024-09-11T23:26:52.061005+0000","last_became_peered":"2024-09-11T23:26:52.061005+0000","last_unstale":"2024-09-11T23:26:55.061573+0000","last_undegraded":"2024-09-11T23:26:55.061573+0000","last_fullsized":"2024-09-11T23:26:55.061573+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:19.705133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.073992+0000","last_change":"2024-09-11T23:26:44.699122+0000","last_active":"2024-09-11T23:26:57.073992+0000","last_peered":"2024-09-11T23:26:57.073992+0000","last_clean":"2024-09-11T23:26:57.073992+0000","last_became_active":"2024-09-11T23:26:44.698813+0000","last_became_peered":"2024-09-11T23:26:44.698813+0000","last_unstale":"2024-09-11T23:26:57.073992+0000","last_undegraded":"2024-09-11T23:26:57.073992+0000","last_fullsized":"2024-09-11T23:26:57.073992+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:42.286431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"86'1","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:27:20.032146+0000","last_change":"2024-09-11T23:26:42.645612+0000","last_active":"2024-09-11T23:27:20.032146+0000","last_peered":"2024-09-11T23:27:20.032146+0000","last_clean":"2024-09-11T23:27:20.032146+0000","last_became_active":"2024-09-11T23:26:42.645228+0000","last_became_peered":"2024-09-11T23:26:42.645228+0000","last_unstale":"2024-09-11T23:27:20.032146+0000","last_undegraded":"2024-09-11T23:27:20.032146+0000","last_fullsized":"2024-09-11T23:27:20.032146+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:12.068952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.085851+0000","last_change":"2024-09-11T23:26:52.062843+0000","last_active":"2024-09-11T23:26:55.085851+0000","last_peered":"2024-09-11T23:26:55.085851+0000","last_clean":"2024-09-11T23:26:55.085851+0000","last_became_active":"2024-09-11T23:26:52.062446+0000","last_became_peered":"2024-09-11T23:26:52.062446+0000","last_unstale":"2024-09-11T23:26:55.085851+0000","last_undegraded":"2024-09-11T23:26:55.085851+0000","last_fullsized":"2024-09-11T23:26:55.085851+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:03.934877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.074423+0000","last_change":"2024-09-11T23:26:44.690179+0000","last_active":"2024-09-11T23:26:57.074423+0000","last_peered":"2024-09-11T23:26:57.074423+0000","last_clean":"2024-09-11T23:26:57.074423+0000","last_became_active":"2024-09-11T23:26:44.689856+0000","last_became_peered":"2024-09-11T23:26:44.689856+0000","last_unstale":"2024-09-11T23:26:57.074423+0000","last_undegraded":"2024-09-11T23:26:57.074423+0000","last_fullsized":"2024-09-11T23:26:57.074423+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:46.546000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.074716+0000","last_change":"2024-09-11T23:26:42.646678+0000","last_active":"2024-09-11T23:26:57.074716+0000","last_peered":"2024-09-11T23:26:57.074716+0000","last_clean":"2024-09-11T23:26:57.074716+0000","last_became_active":"2024-09-11T23:26:42.645748+0000","last_became_peered":"2024-09-11T23:26:42.645748+0000","last_unstale":"2024-09-11T23:26:57.074716+0000","last_undegraded":"2024-09-11T23:26:57.074716+0000","last_fullsized":"2024-09-11T23:26:57.074716+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:41.497025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.062830+0000","last_change":"2024-09-11T23:26:52.065357+0000","last_active":"2024-09-11T23:26:55.062830+0000","last_peered":"2024-09-11T23:26:55.062830+0000","last_clean":"2024-09-11T23:26:55.062830+0000","last_became_active":"2024-09-11T23:26:52.065004+0000","last_became_peered":"2024-09-11T23:26:52.065004+0000","last_unstale":"2024-09-11T23:26:55.062830+0000","last_undegraded":"2024-09-11T23:26:55.062830+0000","last_fullsized":"2024-09-11T23:26:55.062830+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:30.975294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.074040+0000","last_change":"2024-09-11T23:26:44.694358+0000","last_active":"2024-09-11T23:26:57.074040+0000","last_peered":"2024-09-11T23:26:57.074040+0000","last_clean":"2024-09-11T23:26:57.074040+0000","last_became_active":"2024-09-11T23:26:44.693305+0000","last_became_peered":"2024-09-11T23:26:44.693305+0000","last_unstale":"2024-09-11T23:26:57.074040+0000","last_undegraded":"2024-09-11T23:26:57.074040+0000","last_fullsized":"2024-09-11T23:26:57.074040+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:48.107696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'1","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.074638+0000","last_change":"2024-09-11T23:26:42.619221+0000","last_active":"2024-09-11T23:26:57.074638+0000","last_peered":"2024-09-11T23:26:57.074638+0000","last_clean":"2024-09-11T23:26:57.074638+0000","last_became_active":"2024-09-11T23:26:42.618833+0000","last_became_peered":"2024-09-11T23:26:42.618833+0000","last_unstale":"2024-09-11T23:26:57.074638+0000","last_undegraded":"2024-09-11T23:26:57.074638+0000","last_fullsized":"2024-09-11T23:26:57.074638+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:40.584145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.073795+0000","last_change":"2024-09-11T23:26:52.061287+0000","last_active":"2024-09-11T23:26:57.073795+0000","last_peered":"2024-09-11T23:26:57.073795+0000","last_clean":"2024-09-11T23:26:57.073795+0000","last_became_active":"2024-09-11T23:26:52.060904+0000","last_became_peered":"2024-09-11T23:26:52.060904+0000","last_unstale":"2024-09-11T23:26:57.073795+0000","last_undegraded":"2024-09-11T23:26:57.073795+0000","last_fullsized":"2024-09-11T23:26:57.073795+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:49.456325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.604377+0000","last_change":"2024-09-11T23:26:44.696624+0000","last_active":"2024-09-11T23:26:55.604377+0000","last_peered":"2024-09-11T23:26:55.604377+0000","last_clean":"2024-09-11T23:26:55.604377+0000","last_became_active":"2024-09-11T23:26:44.695521+0000","last_became_peered":"2024-09-11T23:26:44.695521+0000","last_unstale":"2024-09-11T23:26:55.604377+0000","last_undegraded":"2024-09-11T23:26:55.604377+0000","last_fullsized":"2024-09-11T23:26:55.604377+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:42.026975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'4","reported_seq":48,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:27:34.062912+0000","last_change":"2024-09-11T23:26:42.645319+0000","last_active":"2024-09-11T23:27:34.062912+0000","last_peered":"2024-09-11T23:27:34.062912+0000","last_clean":"2024-09-11T23:27:34.062912+0000","last_became_active":"2024-09-11T23:26:42.644986+0000","last_became_peered":"2024-09-11T23:26:42.644986+0000","last_unstale":"2024-09-11T23:27:34.062912+0000","last_undegraded":"2024-09-11T23:27:34.062912+0000","last_fullsized":"2024-09-11T23:27:34.062912+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:06.020663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.073861+0000","last_change":"2024-09-11T23:26:52.061235+0000","last_active":"2024-09-11T23:26:57.073861+0000","last_peered":"2024-09-11T23:26:57.073861+0000","last_clean":"2024-09-11T23:26:57.073861+0000","last_became_active":"2024-09-11T23:26:52.060827+0000","last_became_peered":"2024-09-11T23:26:52.060827+0000","last_unstale":"2024-09-11T23:26:57.073861+0000","last_undegraded":"2024-09-11T23:26:57.073861+0000","last_fullsized":"2024-09-11T23:26:57.073861+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:52.354881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.073430+0000","last_change":"2024-09-11T23:26:44.694777+0000","last_active":"2024-09-11T23:26:57.073430+0000","last_peered":"2024-09-11T23:26:57.073430+0000","last_clean":"2024-09-11T23:26:57.073430+0000","last_became_active":"2024-09-11T23:26:44.694485+0000","last_became_peered":"2024-09-11T23:26:44.694485+0000","last_unstale":"2024-09-11T23:26:57.073430+0000","last_undegraded":"2024-09-11T23:26:57.073430+0000","last_fullsized":"2024-09-11T23:26:57.073430+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:58:19.913909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'3","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:27:21.044799+0000","last_change":"2024-09-11T23:26:42.619902+0000","last_active":"2024-09-11T23:27:21.044799+0000","last_peered":"2024-09-11T23:27:21.044799+0000","last_clean":"2024-09-11T23:27:21.044799+0000","last_became_active":"2024-09-11T23:26:42.619405+0000","last_became_peered":"2024-09-11T23:26:42.619405+0000","last_unstale":"2024-09-11T23:27:21.044799+0000","last_undegraded":"2024-09-11T23:27:21.044799+0000","last_fullsized":"2024-09-11T23:27:21.044799+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:30.584258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.604910+0000","last_change":"2024-09-11T23:26:52.065829+0000","last_active":"2024-09-11T23:26:55.604910+0000","last_peered":"2024-09-11T23:26:55.604910+0000","last_clean":"2024-09-11T23:26:55.604910+0000","last_became_active":"2024-09-11T23:26:52.065190+0000","last_became_peered":"2024-09-11T23:26:52.065190+0000","last_unstale":"2024-09-11T23:26:55.604910+0000","last_undegraded":"2024-09-11T23:26:55.604910+0000","last_fullsized":"2024-09-11T23:26:55.604910+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:53.032343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.061852+0000","last_change":"2024-09-11T23:26:44.690426+0000","last_active":"2024-09-11T23:26:55.061852+0000","last_peered":"2024-09-11T23:26:55.061852+0000","last_clean":"2024-09-11T23:26:55.061852+0000","last_became_active":"2024-09-11T23:26:44.690127+0000","last_became_peered":"2024-09-11T23:26:44.690127+0000","last_unstale":"2024-09-11T23:26:55.061852+0000","last_undegraded":"2024-09-11T23:26:55.061852+0000","last_fullsized":"2024-09-11T23:26:55.061852+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:42.750965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'3","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:27:22.042680+0000","last_change":"2024-09-11T23:26:42.617589+0000","last_active":"2024-09-11T23:27:22.042680+0000","last_peered":"2024-09-11T23:27:22.042680+0000","last_clean":"2024-09-11T23:27:22.042680+0000","last_became_active":"2024-09-11T23:26:42.616853+0000","last_became_peered":"2024-09-11T23:26:42.616853+0000","last_unstale":"2024-09-11T23:27:22.042680+0000","last_undegraded":"2024-09-11T23:27:22.042680+0000","last_fullsized":"2024-09-11T23:27:22.042680+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:57.689231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":345,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.074730+0000","last_change":"2024-09-11T23:25:30.452649+0000","last_active":"2024-09-11T23:26:57.074730+0000","last_peered":"2024-09-11T23:26:57.074730+0000","last_clean":"2024-09-11T23:26:57.074730+0000","last_became_active":"2024-09-11T23:25:30.452234+0000","last_became_peered":"2024-09-11T23:25:30.452234+0000","last_unstale":"2024-09-11T23:26:57.074730+0000","last_undegraded":"2024-09-11T23:26:57.074730+0000","last_fullsized":"2024-09-11T23:26:57.074730+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:04.900818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:04.900818+0000","last_clean_scrub_stamp":"2024-09-11T23:22:04.900818+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:39.029859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"86'1","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.074437+0000","last_change":"2024-09-11T23:26:52.066339+0000","last_active":"2024-09-11T23:26:57.074437+0000","last_peered":"2024-09-11T23:26:57.074437+0000","last_clean":"2024-09-11T23:26:57.074437+0000","last_became_active":"2024-09-11T23:26:52.065945+0000","last_became_peered":"2024-09-11T23:26:52.065945+0000","last_unstale":"2024-09-11T23:26:57.074437+0000","last_undegraded":"2024-09-11T23:26:57.074437+0000","last_fullsized":"2024-09-11T23:26:57.074437+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:49.597372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.074561+0000","last_change":"2024-09-11T23:26:44.700943+0000","last_active":"2024-09-11T23:26:57.074561+0000","last_peered":"2024-09-11T23:26:57.074561+0000","last_clean":"2024-09-11T23:26:57.074561+0000","last_became_active":"2024-09-11T23:26:44.700418+0000","last_became_peered":"2024-09-11T23:26:44.700418+0000","last_unstale":"2024-09-11T23:26:57.074561+0000","last_undegraded":"2024-09-11T23:26:57.074561+0000","last_fullsized":"2024-09-11T23:26:57.074561+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:18.474520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'3","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:27:21.044749+0000","last_change":"2024-09-11T23:26:42.645889+0000","last_active":"2024-09-11T23:27:21.044749+0000","last_peered":"2024-09-11T23:27:21.044749+0000","last_clean":"2024-09-11T23:27:21.044749+0000","last_became_active":"2024-09-11T23:26:42.645530+0000","last_became_peered":"2024-09-11T23:26:42.645530+0000","last_unstale":"2024-09-11T23:27:21.044749+0000","last_undegraded":"2024-09-11T23:27:21.044749+0000","last_fullsized":"2024-09-11T23:27:21.044749+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:27.311459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.775415+0000","last_change":"2024-09-11T23:26:52.066911+0000","last_active":"2024-09-11T23:26:55.775415+0000","last_peered":"2024-09-11T23:26:55.775415+0000","last_clean":"2024-09-11T23:26:55.775415+0000","last_became_active":"2024-09-11T23:26:52.065969+0000","last_became_peered":"2024-09-11T23:26:52.065969+0000","last_unstale":"2024-09-11T23:26:55.775415+0000","last_undegraded":"2024-09-11T23:26:55.775415+0000","last_fullsized":"2024-09-11T23:26:55.775415+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:26.406644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.074128+0000","last_change":"2024-09-11T23:26:44.696945+0000","last_active":"2024-09-11T23:26:57.074128+0000","last_peered":"2024-09-11T23:26:57.074128+0000","last_clean":"2024-09-11T23:26:57.074128+0000","last_became_active":"2024-09-11T23:26:44.696546+0000","last_became_peered":"2024-09-11T23:26:44.696546+0000","last_unstale":"2024-09-11T23:26:57.074128+0000","last_undegraded":"2024-09-11T23:26:57.074128+0000","last_fullsized":"2024-09-11T23:26:57.074128+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:52.428610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.605176+0000","last_change":"2024-09-11T23:26:42.616991+0000","last_active":"2024-09-11T23:26:55.605176+0000","last_peered":"2024-09-11T23:26:55.605176+0000","last_clean":"2024-09-11T23:26:55.605176+0000","last_became_active":"2024-09-11T23:26:42.616576+0000","last_became_peered":"2024-09-11T23:26:42.616576+0000","last_unstale":"2024-09-11T23:26:55.605176+0000","last_undegraded":"2024-09-11T23:26:55.605176+0000","last_fullsized":"2024-09-11T23:26:55.605176+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:07.142958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.757382+0000","last_change":"2024-09-11T23:26:52.066240+0000","last_active":"2024-09-11T23:26:55.757382+0000","last_peered":"2024-09-11T23:26:55.757382+0000","last_clean":"2024-09-11T23:26:55.757382+0000","last_became_active":"2024-09-11T23:26:52.065873+0000","last_became_peered":"2024-09-11T23:26:52.065873+0000","last_unstale":"2024-09-11T23:26:55.757382+0000","last_undegraded":"2024-09-11T23:26:55.757382+0000","last_fullsized":"2024-09-11T23:26:55.757382+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:51.175750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.074155+0000","last_change":"2024-09-11T23:26:44.699302+0000","last_active":"2024-09-11T23:26:57.074155+0000","last_peered":"2024-09-11T23:26:57.074155+0000","last_clean":"2024-09-11T23:26:57.074155+0000","last_became_active":"2024-09-11T23:26:44.698948+0000","last_became_peered":"2024-09-11T23:26:44.698948+0000","last_unstale":"2024-09-11T23:26:57.074155+0000","last_undegraded":"2024-09-11T23:26:57.074155+0000","last_fullsized":"2024-09-11T23:26:57.074155+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:31.262407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.073976+0000","last_change":"2024-09-11T23:26:52.077450+0000","last_active":"2024-09-11T23:26:57.073976+0000","last_peered":"2024-09-11T23:26:57.073976+0000","last_clean":"2024-09-11T23:26:57.073976+0000","last_became_active":"2024-09-11T23:26:52.065052+0000","last_became_peered":"2024-09-11T23:26:52.065052+0000","last_unstale":"2024-09-11T23:26:57.073976+0000","last_undegraded":"2024-09-11T23:26:57.073976+0000","last_fullsized":"2024-09-11T23:26:57.073976+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:27.541991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.604288+0000","last_change":"2024-09-11T23:26:52.064296+0000","last_active":"2024-09-11T23:26:55.604288+0000","last_peered":"2024-09-11T23:26:55.604288+0000","last_clean":"2024-09-11T23:26:55.604288+0000","last_became_active":"2024-09-11T23:26:52.063488+0000","last_became_peered":"2024-09-11T23:26:52.063488+0000","last_unstale":"2024-09-11T23:26:55.604288+0000","last_undegraded":"2024-09-11T23:26:55.604288+0000","last_fullsized":"2024-09-11T23:26:55.604288+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:39.815984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.086086+0000","last_change":"2024-09-11T23:26:52.071603+0000","last_active":"2024-09-11T23:26:55.086086+0000","last_peered":"2024-09-11T23:26:55.086086+0000","last_clean":"2024-09-11T23:26:55.086086+0000","last_became_active":"2024-09-11T23:26:52.071190+0000","last_became_peered":"2024-09-11T23:26:52.071190+0000","last_unstale":"2024-09-11T23:26:55.086086+0000","last_undegraded":"2024-09-11T23:26:55.086086+0000","last_fullsized":"2024-09-11T23:26:55.086086+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:52.171622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:27:22.040981+0000","last_change":"2024-09-11T23:26:42.612493+0000","last_active":"2024-09-11T23:27:22.040981+0000","last_peered":"2024-09-11T23:27:22.040981+0000","last_clean":"2024-09-11T23:27:22.040981+0000","last_became_active":"2024-09-11T23:26:42.612018+0000","last_became_peered":"2024-09-11T23:26:42.612018+0000","last_unstale":"2024-09-11T23:27:22.040981+0000","last_undegraded":"2024-09-11T23:27:22.040981+0000","last_fullsized":"2024-09-11T23:27:22.040981+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:08.590684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.604543+0000","last_change":"2024-09-11T23:26:52.063634+0000","last_active":"2024-09-11T23:26:55.604543+0000","last_peered":"2024-09-11T23:26:55.604543+0000","last_clean":"2024-09-11T23:26:55.604543+0000","last_became_active":"2024-09-11T23:26:52.063205+0000","last_became_peered":"2024-09-11T23:26:52.063205+0000","last_unstale":"2024-09-11T23:26:55.604543+0000","last_undegraded":"2024-09-11T23:26:55.604543+0000","last_fullsized":"2024-09-11T23:26:55.604543+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:12.371238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.604564+0000","last_change":"2024-09-11T23:26:44.692776+0000","last_active":"2024-09-11T23:26:55.604564+0000","last_peered":"2024-09-11T23:26:55.604564+0000","last_clean":"2024-09-11T23:26:55.604564+0000","last_became_active":"2024-09-11T23:26:44.691989+0000","last_became_peered":"2024-09-11T23:26:44.691989+0000","last_unstale":"2024-09-11T23:26:55.604564+0000","last_undegraded":"2024-09-11T23:26:55.604564+0000","last_fullsized":"2024-09-11T23:26:55.604564+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:41.781016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"86'15","reported_seq":62,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:27:21.045138+0000","last_change":"2024-09-11T23:26:52.075909+0000","last_active":"2024-09-11T23:27:21.045138+0000","last_peered":"2024-09-11T23:27:21.045138+0000","last_clean":"2024-09-11T23:27:21.045138+0000","last_became_active":"2024-09-11T23:26:52.061277+0000","last_became_peered":"2024-09-11T23:26:52.061277+0000","last_unstale":"2024-09-11T23:27:21.045138+0000","last_undegraded":"2024-09-11T23:27:21.045138+0000","last_fullsized":"2024-09-11T23:27:21.045138+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:11.940951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.073991+0000","last_change":"2024-09-11T23:26:52.064172+0000","last_active":"2024-09-11T23:26:57.073991+0000","last_peered":"2024-09-11T23:26:57.073991+0000","last_clean":"2024-09-11T23:26:57.073991+0000","last_became_active":"2024-09-11T23:26:52.063807+0000","last_became_peered":"2024-09-11T23:26:52.063807+0000","last_unstale":"2024-09-11T23:26:57.073991+0000","last_undegraded":"2024-09-11T23:26:57.073991+0000","last_fullsized":"2024-09-11T23:26:57.073991+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:32.134115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.073746+0000","last_change":"2024-09-11T23:26:44.703624+0000","last_active":"2024-09-11T23:26:57.073746+0000","last_peered":"2024-09-11T23:26:57.073746+0000","last_clean":"2024-09-11T23:26:57.073746+0000","last_became_active":"2024-09-11T23:26:44.703298+0000","last_became_peered":"2024-09-11T23:26:44.703298+0000","last_unstale":"2024-09-11T23:26:57.073746+0000","last_undegraded":"2024-09-11T23:26:57.073746+0000","last_fullsized":"2024-09-11T23:26:57.073746+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:17.441926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'3","reported_seq":49,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:27:34.063476+0000","last_change":"2024-09-11T23:26:42.618328+0000","last_active":"2024-09-11T23:27:34.063476+0000","last_peered":"2024-09-11T23:27:34.063476+0000","last_clean":"2024-09-11T23:27:34.063476+0000","last_became_active":"2024-09-11T23:26:42.618005+0000","last_became_peered":"2024-09-11T23:26:42.618005+0000","last_unstale":"2024-09-11T23:27:34.063476+0000","last_undegraded":"2024-09-11T23:27:34.063476+0000","last_fullsized":"2024-09-11T23:27:34.063476+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:58.593887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.074861+0000","last_change":"2024-09-11T23:26:52.069824+0000","last_active":"2024-09-11T23:26:57.074861+0000","last_peered":"2024-09-11T23:26:57.074861+0000","last_clean":"2024-09-11T23:26:57.074861+0000","last_became_active":"2024-09-11T23:26:52.069341+0000","last_became_peered":"2024-09-11T23:26:52.069341+0000","last_unstale":"2024-09-11T23:26:57.074861+0000","last_undegraded":"2024-09-11T23:26:57.074861+0000","last_fullsized":"2024-09-11T23:26:57.074861+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:10.922896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.074245+0000","last_change":"2024-09-11T23:26:44.696963+0000","last_active":"2024-09-11T23:26:57.074245+0000","last_peered":"2024-09-11T23:26:57.074245+0000","last_clean":"2024-09-11T23:26:57.074245+0000","last_became_active":"2024-09-11T23:26:44.696543+0000","last_became_peered":"2024-09-11T23:26:44.696543+0000","last_unstale":"2024-09-11T23:26:57.074245+0000","last_undegraded":"2024-09-11T23:26:57.074245+0000","last_fullsized":"2024-09-11T23:26:57.074245+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:14.502969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"86'3","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:27:20.034566+0000","last_change":"2024-09-11T23:26:42.615454+0000","last_active":"2024-09-11T23:27:20.034566+0000","last_peered":"2024-09-11T23:27:20.034566+0000","last_clean":"2024-09-11T23:27:20.034566+0000","last_became_active":"2024-09-11T23:26:42.614948+0000","last_became_peered":"2024-09-11T23:26:42.614948+0000","last_unstale":"2024-09-11T23:27:20.034566+0000","last_undegraded":"2024-09-11T23:27:20.034566+0000","last_fullsized":"2024-09-11T23:27:20.034566+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:59.056748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.085889+0000","last_change":"2024-09-11T23:26:52.069846+0000","last_active":"2024-09-11T23:26:55.085889+0000","last_peered":"2024-09-11T23:26:55.085889+0000","last_clean":"2024-09-11T23:26:55.085889+0000","last_became_active":"2024-09-11T23:26:52.069398+0000","last_became_peered":"2024-09-11T23:26:52.069398+0000","last_unstale":"2024-09-11T23:26:55.085889+0000","last_undegraded":"2024-09-11T23:26:55.085889+0000","last_fullsized":"2024-09-11T23:26:55.085889+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:31.931388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.073691+0000","last_change":"2024-09-11T23:26:44.697114+0000","last_active":"2024-09-11T23:26:57.073691+0000","last_peered":"2024-09-11T23:26:57.073691+0000","last_clean":"2024-09-11T23:26:57.073691+0000","last_became_active":"2024-09-11T23:26:44.696811+0000","last_became_peered":"2024-09-11T23:26:44.696811+0000","last_unstale":"2024-09-11T23:26:57.073691+0000","last_undegraded":"2024-09-11T23:26:57.073691+0000","last_fullsized":"2024-09-11T23:26:57.073691+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:47:52.650877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"86'6","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:27:21.045264+0000","last_change":"2024-09-11T23:26:42.616377+0000","last_active":"2024-09-11T23:27:21.045264+0000","last_peered":"2024-09-11T23:27:21.045264+0000","last_clean":"2024-09-11T23:27:21.045264+0000","last_became_active":"2024-09-11T23:26:42.615887+0000","last_became_peered":"2024-09-11T23:26:42.615887+0000","last_unstale":"2024-09-11T23:27:21.045264+0000","last_undegraded":"2024-09-11T23:27:21.045264+0000","last_fullsized":"2024-09-11T23:27:21.045264+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:48.089178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.604964+0000","last_change":"2024-09-11T23:26:52.068340+0000","last_active":"2024-09-11T23:26:55.604964+0000","last_peered":"2024-09-11T23:26:55.604964+0000","last_clean":"2024-09-11T23:26:55.604964+0000","last_became_active":"2024-09-11T23:26:52.067905+0000","last_became_peered":"2024-09-11T23:26:52.067905+0000","last_unstale":"2024-09-11T23:26:55.604964+0000","last_undegraded":"2024-09-11T23:26:55.604964+0000","last_fullsized":"2024-09-11T23:26:55.604964+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:15.517992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.062900+0000","last_change":"2024-09-11T23:26:44.704570+0000","last_active":"2024-09-11T23:26:55.062900+0000","last_peered":"2024-09-11T23:26:55.062900+0000","last_clean":"2024-09-11T23:26:55.062900+0000","last_became_active":"2024-09-11T23:26:44.704263+0000","last_became_peered":"2024-09-11T23:26:44.704263+0000","last_unstale":"2024-09-11T23:26:55.062900+0000","last_undegraded":"2024-09-11T23:26:55.062900+0000","last_fullsized":"2024-09-11T23:26:55.062900+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:25.112831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"86'30","reported_seq":99,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:27:37.070470+0000","last_change":"2024-09-11T23:26:42.620726+0000","last_active":"2024-09-11T23:27:37.070470+0000","last_peered":"2024-09-11T23:27:37.070470+0000","last_clean":"2024-09-11T23:27:37.070470+0000","last_became_active":"2024-09-11T23:26:42.620381+0000","last_became_peered":"2024-09-11T23:26:42.620381+0000","last_unstale":"2024-09-11T23:27:37.070470+0000","last_undegraded":"2024-09-11T23:27:37.070470+0000","last_fullsized":"2024-09-11T23:27:37.070470+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:41.001056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54396,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":39,"num_read_kb":72,"num_write":31,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.074459+0000","last_change":"2024-09-11T23:26:52.073830+0000","last_active":"2024-09-11T23:26:57.074459+0000","last_peered":"2024-09-11T23:26:57.074459+0000","last_clean":"2024-09-11T23:26:57.074459+0000","last_became_active":"2024-09-11T23:26:52.073415+0000","last_became_peered":"2024-09-11T23:26:52.073415+0000","last_unstale":"2024-09-11T23:26:57.074459+0000","last_undegraded":"2024-09-11T23:26:57.074459+0000","last_fullsized":"2024-09-11T23:26:57.074459+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:25.310980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.775432+0000","last_change":"2024-09-11T23:26:44.694203+0000","last_active":"2024-09-11T23:26:55.775432+0000","last_peered":"2024-09-11T23:26:55.775432+0000","last_clean":"2024-09-11T23:26:55.775432+0000","last_became_active":"2024-09-11T23:26:44.693827+0000","last_became_peered":"2024-09-11T23:26:44.693827+0000","last_unstale":"2024-09-11T23:26:55.775432+0000","last_undegraded":"2024-09-11T23:26:55.775432+0000","last_fullsized":"2024-09-11T23:26:55.775432+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:29.929206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"86'4","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:27:20.032794+0000","last_change":"2024-09-11T23:26:42.646046+0000","last_active":"2024-09-11T23:27:20.032794+0000","last_peered":"2024-09-11T23:27:20.032794+0000","last_clean":"2024-09-11T23:27:20.032794+0000","last_became_active":"2024-09-11T23:26:42.645735+0000","last_became_peered":"2024-09-11T23:26:42.645735+0000","last_unstale":"2024-09-11T23:27:20.032794+0000","last_undegraded":"2024-09-11T23:27:20.032794+0000","last_fullsized":"2024-09-11T23:27:20.032794+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:12.159712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.065105+0000","last_change":"2024-09-11T23:26:52.069732+0000","last_active":"2024-09-11T23:26:55.065105+0000","last_peered":"2024-09-11T23:26:55.065105+0000","last_clean":"2024-09-11T23:26:55.065105+0000","last_became_active":"2024-09-11T23:26:52.069230+0000","last_became_peered":"2024-09-11T23:26:52.069230+0000","last_unstale":"2024-09-11T23:26:55.065105+0000","last_undegraded":"2024-09-11T23:26:55.065105+0000","last_fullsized":"2024-09-11T23:26:55.065105+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:50:17.304900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.757478+0000","last_change":"2024-09-11T23:26:44.691704+0000","last_active":"2024-09-11T23:26:55.757478+0000","last_peered":"2024-09-11T23:26:55.757478+0000","last_clean":"2024-09-11T23:26:55.757478+0000","last_became_active":"2024-09-11T23:26:44.690686+0000","last_became_peered":"2024-09-11T23:26:44.690686+0000","last_unstale":"2024-09-11T23:26:55.757478+0000","last_undegraded":"2024-09-11T23:26:55.757478+0000","last_fullsized":"2024-09-11T23:26:55.757478+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:44.046933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"86'2","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:27:20.033027+0000","last_change":"2024-09-11T23:26:42.616271+0000","last_active":"2024-09-11T23:27:20.033027+0000","last_peered":"2024-09-11T23:27:20.033027+0000","last_clean":"2024-09-11T23:27:20.033027+0000","last_became_active":"2024-09-11T23:26:42.615870+0000","last_became_peered":"2024-09-11T23:26:42.615870+0000","last_unstale":"2024-09-11T23:27:20.033027+0000","last_undegraded":"2024-09-11T23:27:20.033027+0000","last_fullsized":"2024-09-11T23:27:20.033027+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:08.573352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.073540+0000","last_change":"2024-09-11T23:26:52.072615+0000","last_active":"2024-09-11T23:26:57.073540+0000","last_peered":"2024-09-11T23:26:57.073540+0000","last_clean":"2024-09-11T23:26:57.073540+0000","last_became_active":"2024-09-11T23:26:52.072219+0000","last_became_peered":"2024-09-11T23:26:52.072219+0000","last_unstale":"2024-09-11T23:26:57.073540+0000","last_undegraded":"2024-09-11T23:26:57.073540+0000","last_fullsized":"2024-09-11T23:26:57.073540+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:57.598375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.775540+0000","last_change":"2024-09-11T23:26:44.690099+0000","last_active":"2024-09-11T23:26:55.775540+0000","last_peered":"2024-09-11T23:26:55.775540+0000","last_clean":"2024-09-11T23:26:55.775540+0000","last_became_active":"2024-09-11T23:26:44.689763+0000","last_became_peered":"2024-09-11T23:26:44.689763+0000","last_unstale":"2024-09-11T23:26:55.775540+0000","last_undegraded":"2024-09-11T23:26:55.775540+0000","last_fullsized":"2024-09-11T23:26:55.775540+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:45.316508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"86'3","reported_seq":49,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:27:36.066499+0000","last_change":"2024-09-11T23:26:42.620930+0000","last_active":"2024-09-11T23:27:36.066499+0000","last_peered":"2024-09-11T23:27:36.066499+0000","last_clean":"2024-09-11T23:27:36.066499+0000","last_became_active":"2024-09-11T23:26:42.620544+0000","last_became_peered":"2024-09-11T23:26:42.620544+0000","last_unstale":"2024-09-11T23:27:36.066499+0000","last_undegraded":"2024-09-11T23:27:36.066499+0000","last_fullsized":"2024-09-11T23:27:36.066499+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:26.625004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.061798+0000","last_change":"2024-09-11T23:26:52.065014+0000","last_active":"2024-09-11T23:26:55.061798+0000","last_peered":"2024-09-11T23:26:55.061798+0000","last_clean":"2024-09-11T23:26:55.061798+0000","last_became_active":"2024-09-11T23:26:52.064570+0000","last_became_peered":"2024-09-11T23:26:52.064570+0000","last_unstale":"2024-09-11T23:26:55.061798+0000","last_undegraded":"2024-09-11T23:26:55.061798+0000","last_fullsized":"2024-09-11T23:26:55.061798+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:53.658310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.757407+0000","last_change":"2024-09-11T23:26:52.065559+0000","last_active":"2024-09-11T23:26:55.757407+0000","last_peered":"2024-09-11T23:26:55.757407+0000","last_clean":"2024-09-11T23:26:55.757407+0000","last_became_active":"2024-09-11T23:26:52.065197+0000","last_became_peered":"2024-09-11T23:26:52.065197+0000","last_unstale":"2024-09-11T23:26:55.757407+0000","last_undegraded":"2024-09-11T23:26:55.757407+0000","last_fullsized":"2024-09-11T23:26:55.757407+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:19.371054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.074331+0000","last_change":"2024-09-11T23:26:44.691726+0000","last_active":"2024-09-11T23:26:57.074331+0000","last_peered":"2024-09-11T23:26:57.074331+0000","last_clean":"2024-09-11T23:26:57.074331+0000","last_became_active":"2024-09-11T23:26:44.691417+0000","last_became_peered":"2024-09-11T23:26:44.691417+0000","last_unstale":"2024-09-11T23:26:57.074331+0000","last_undegraded":"2024-09-11T23:26:57.074331+0000","last_fullsized":"2024-09-11T23:26:57.074331+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:38.139576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"86'1","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.604751+0000","last_change":"2024-09-11T23:26:42.615287+0000","last_active":"2024-09-11T23:26:55.604751+0000","last_peered":"2024-09-11T23:26:55.604751+0000","last_clean":"2024-09-11T23:26:55.604751+0000","last_became_active":"2024-09-11T23:26:42.614939+0000","last_became_peered":"2024-09-11T23:26:42.614939+0000","last_unstale":"2024-09-11T23:26:55.604751+0000","last_undegraded":"2024-09-11T23:26:55.604751+0000","last_fullsized":"2024-09-11T23:26:55.604751+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:23.250573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.086150+0000","last_change":"2024-09-11T23:26:52.069773+0000","last_active":"2024-09-11T23:26:55.086150+0000","last_peered":"2024-09-11T23:26:55.086150+0000","last_clean":"2024-09-11T23:26:55.086150+0000","last_became_active":"2024-09-11T23:26:52.069365+0000","last_became_peered":"2024-09-11T23:26:52.069365+0000","last_unstale":"2024-09-11T23:26:55.086150+0000","last_undegraded":"2024-09-11T23:26:55.086150+0000","last_fullsized":"2024-09-11T23:26:55.086150+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:00.101851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.061711+0000","last_change":"2024-09-11T23:26:44.689869+0000","last_active":"2024-09-11T23:26:55.061711+0000","last_peered":"2024-09-11T23:26:55.061711+0000","last_clean":"2024-09-11T23:26:55.061711+0000","last_became_active":"2024-09-11T23:26:44.689474+0000","last_became_peered":"2024-09-11T23:26:44.689474+0000","last_unstale":"2024-09-11T23:26:55.061711+0000","last_undegraded":"2024-09-11T23:26:55.061711+0000","last_fullsized":"2024-09-11T23:26:55.061711+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:10.255840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"86'2","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:27:21.044988+0000","last_change":"2024-09-11T23:26:42.609857+0000","last_active":"2024-09-11T23:27:21.044988+0000","last_peered":"2024-09-11T23:27:21.044988+0000","last_clean":"2024-09-11T23:27:21.044988+0000","last_became_active":"2024-09-11T23:26:42.609536+0000","last_became_peered":"2024-09-11T23:26:42.609536+0000","last_unstale":"2024-09-11T23:27:21.044988+0000","last_undegraded":"2024-09-11T23:27:21.044988+0000","last_fullsized":"2024-09-11T23:27:21.044988+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:17.751298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"86'3","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:27:21.045394+0000","last_change":"2024-09-11T23:26:52.061076+0000","last_active":"2024-09-11T23:27:21.045394+0000","last_peered":"2024-09-11T23:27:21.045394+0000","last_clean":"2024-09-11T23:27:21.045394+0000","last_became_active":"2024-09-11T23:26:52.060543+0000","last_became_peered":"2024-09-11T23:26:52.060543+0000","last_unstale":"2024-09-11T23:27:21.045394+0000","last_undegraded":"2024-09-11T23:27:21.045394+0000","last_fullsized":"2024-09-11T23:27:21.045394+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:10.566235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.604822+0000","last_change":"2024-09-11T23:26:44.690699+0000","last_active":"2024-09-11T23:26:55.604822+0000","last_peered":"2024-09-11T23:26:55.604822+0000","last_clean":"2024-09-11T23:26:55.604822+0000","last_became_active":"2024-09-11T23:26:44.690142+0000","last_became_peered":"2024-09-11T23:26:44.690142+0000","last_unstale":"2024-09-11T23:26:55.604822+0000","last_undegraded":"2024-09-11T23:26:55.604822+0000","last_fullsized":"2024-09-11T23:26:55.604822+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:20.790171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:56.191762+0000","last_change":"2024-09-11T23:26:52.071172+0000","last_active":"2024-09-11T23:26:56.191762+0000","last_peered":"2024-09-11T23:26:56.191762+0000","last_clean":"2024-09-11T23:26:56.191762+0000","last_became_active":"2024-09-11T23:26:52.070803+0000","last_became_peered":"2024-09-11T23:26:52.070803+0000","last_unstale":"2024-09-11T23:26:56.191762+0000","last_undegraded":"2024-09-11T23:26:56.191762+0000","last_fullsized":"2024-09-11T23:26:56.191762+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:09.509750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"86'5","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:27:32.061336+0000","last_change":"2024-09-11T23:26:52.059895+0000","last_active":"2024-09-11T23:27:32.061336+0000","last_peered":"2024-09-11T23:27:32.061336+0000","last_clean":"2024-09-11T23:27:32.061336+0000","last_became_active":"2024-09-11T23:26:52.059431+0000","last_became_peered":"2024-09-11T23:26:52.059431+0000","last_unstale":"2024-09-11T23:27:32.061336+0000","last_undegraded":"2024-09-11T23:27:32.061336+0000","last_fullsized":"2024-09-11T23:27:32.061336+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:58.922483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.062619+0000","last_change":"2024-09-11T23:26:44.690449+0000","last_active":"2024-09-11T23:26:55.062619+0000","last_peered":"2024-09-11T23:26:55.062619+0000","last_clean":"2024-09-11T23:26:55.062619+0000","last_became_active":"2024-09-11T23:26:44.690102+0000","last_became_peered":"2024-09-11T23:26:44.690102+0000","last_unstale":"2024-09-11T23:26:55.062619+0000","last_undegraded":"2024-09-11T23:26:55.062619+0000","last_fullsized":"2024-09-11T23:26:55.062619+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:49.730602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:56.191883+0000","last_change":"2024-09-11T23:26:52.062826+0000","last_active":"2024-09-11T23:26:56.191883+0000","last_peered":"2024-09-11T23:26:56.191883+0000","last_clean":"2024-09-11T23:26:56.191883+0000","last_became_active":"2024-09-11T23:26:52.062405+0000","last_became_peered":"2024-09-11T23:26:52.062405+0000","last_unstale":"2024-09-11T23:26:56.191883+0000","last_undegraded":"2024-09-11T23:26:56.191883+0000","last_fullsized":"2024-09-11T23:26:56.191883+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:46.141117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.085602+0000","last_change":"2024-09-11T23:26:44.707056+0000","last_active":"2024-09-11T23:26:55.085602+0000","last_peered":"2024-09-11T23:26:55.085602+0000","last_clean":"2024-09-11T23:26:55.085602+0000","last_became_active":"2024-09-11T23:26:44.706704+0000","last_became_peered":"2024-09-11T23:26:44.706704+0000","last_unstale":"2024-09-11T23:26:55.085602+0000","last_undegraded":"2024-09-11T23:26:55.085602+0000","last_fullsized":"2024-09-11T23:26:55.085602+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:29.221070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:56.192069+0000","last_change":"2024-09-11T23:26:44.699807+0000","last_active":"2024-09-11T23:26:56.192069+0000","last_peered":"2024-09-11T23:26:56.192069+0000","last_clean":"2024-09-11T23:26:56.192069+0000","last_became_active":"2024-09-11T23:26:44.699497+0000","last_became_peered":"2024-09-11T23:26:44.699497+0000","last_unstale":"2024-09-11T23:26:56.192069+0000","last_undegraded":"2024-09-11T23:26:56.192069+0000","last_fullsized":"2024-09-11T23:26:56.192069+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:17.954048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:56.191594+0000","last_change":"2024-09-11T23:26:44.698751+0000","last_active":"2024-09-11T23:26:56.191594+0000","last_peered":"2024-09-11T23:26:56.191594+0000","last_clean":"2024-09-11T23:26:56.191594+0000","last_became_active":"2024-09-11T23:26:44.698429+0000","last_became_peered":"2024-09-11T23:26:44.698429+0000","last_unstale":"2024-09-11T23:26:56.191594+0000","last_undegraded":"2024-09-11T23:26:56.191594+0000","last_fullsized":"2024-09-11T23:26:56.191594+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:25.452225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.757351+0000","last_change":"2024-09-11T23:26:44.690356+0000","last_active":"2024-09-11T23:26:55.757351+0000","last_peered":"2024-09-11T23:26:55.757351+0000","last_clean":"2024-09-11T23:26:55.757351+0000","last_became_active":"2024-09-11T23:26:44.690057+0000","last_became_peered":"2024-09-11T23:26:44.690057+0000","last_unstale":"2024-09-11T23:26:55.757351+0000","last_undegraded":"2024-09-11T23:26:55.757351+0000","last_fullsized":"2024-09-11T23:26:55.757351+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:38.950284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.073974+0000","last_change":"2024-09-11T23:26:44.691251+0000","last_active":"2024-09-11T23:26:57.073974+0000","last_peered":"2024-09-11T23:26:57.073974+0000","last_clean":"2024-09-11T23:26:57.073974+0000","last_became_active":"2024-09-11T23:26:44.690905+0000","last_became_peered":"2024-09-11T23:26:44.690905+0000","last_unstale":"2024-09-11T23:26:57.073974+0000","last_undegraded":"2024-09-11T23:26:57.073974+0000","last_fullsized":"2024-09-11T23:26:57.073974+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:18.509826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.086105+0000","last_change":"2024-09-11T23:26:44.707581+0000","last_active":"2024-09-11T23:26:55.086105+0000","last_peered":"2024-09-11T23:26:55.086105+0000","last_clean":"2024-09-11T23:26:55.086105+0000","last_became_active":"2024-09-11T23:26:44.707266+0000","last_became_peered":"2024-09-11T23:26:44.707266+0000","last_unstale":"2024-09-11T23:26:55.086105+0000","last_undegraded":"2024-09-11T23:26:55.086105+0000","last_fullsized":"2024-09-11T23:26:55.086105+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:40:28.248560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:56.192101+0000","last_change":"2024-09-11T23:26:44.704003+0000","last_active":"2024-09-11T23:26:56.192101+0000","last_peered":"2024-09-11T23:26:56.192101+0000","last_clean":"2024-09-11T23:26:56.192101+0000","last_became_active":"2024-09-11T23:26:44.703702+0000","last_became_peered":"2024-09-11T23:26:44.703702+0000","last_unstale":"2024-09-11T23:26:56.192101+0000","last_undegraded":"2024-09-11T23:26:56.192101+0000","last_fullsized":"2024-09-11T23:26:56.192101+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:28:17.511868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.062207+0000","last_change":"2024-09-11T23:26:44.694601+0000","last_active":"2024-09-11T23:26:55.062207+0000","last_peered":"2024-09-11T23:26:55.062207+0000","last_clean":"2024-09-11T23:26:55.062207+0000","last_became_active":"2024-09-11T23:26:44.694304+0000","last_became_peered":"2024-09-11T23:26:44.694304+0000","last_unstale":"2024-09-11T23:26:55.062207+0000","last_undegraded":"2024-09-11T23:26:55.062207+0000","last_fullsized":"2024-09-11T23:26:55.062207+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:32:04.171439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.604370+0000","last_change":"2024-09-11T23:26:44.691565+0000","last_active":"2024-09-11T23:26:55.604370+0000","last_peered":"2024-09-11T23:26:55.604370+0000","last_clean":"2024-09-11T23:26:55.604370+0000","last_became_active":"2024-09-11T23:26:44.691237+0000","last_became_peered":"2024-09-11T23:26:44.691237+0000","last_unstale":"2024-09-11T23:26:55.604370+0000","last_undegraded":"2024-09-11T23:26:55.604370+0000","last_fullsized":"2024-09-11T23:26:55.604370+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:01.413447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.061790+0000","last_change":"2024-09-11T23:26:44.699372+0000","last_active":"2024-09-11T23:26:55.061790+0000","last_peered":"2024-09-11T23:26:55.061790+0000","last_clean":"2024-09-11T23:26:55.061790+0000","last_became_active":"2024-09-11T23:26:44.698934+0000","last_became_peered":"2024-09-11T23:26:44.698934+0000","last_unstale":"2024-09-11T23:26:55.061790+0000","last_undegraded":"2024-09-11T23:26:55.061790+0000","last_fullsized":"2024-09-11T23:26:55.061790+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:44:41.486314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.775382+0000","last_change":"2024-09-11T23:26:44.698595+0000","last_active":"2024-09-11T23:26:55.775382+0000","last_peered":"2024-09-11T23:26:55.775382+0000","last_clean":"2024-09-11T23:26:55.775382+0000","last_became_active":"2024-09-11T23:26:44.698268+0000","last_became_peered":"2024-09-11T23:26:44.698268+0000","last_unstale":"2024-09-11T23:26:55.775382+0000","last_undegraded":"2024-09-11T23:26:55.775382+0000","last_fullsized":"2024-09-11T23:26:55.775382+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:57:55.304720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.073981+0000","last_change":"2024-09-11T23:26:44.697049+0000","last_active":"2024-09-11T23:26:57.073981+0000","last_peered":"2024-09-11T23:26:57.073981+0000","last_clean":"2024-09-11T23:26:57.073981+0000","last_became_active":"2024-09-11T23:26:44.696748+0000","last_became_peered":"2024-09-11T23:26:44.696748+0000","last_unstale":"2024-09-11T23:26:57.073981+0000","last_undegraded":"2024-09-11T23:26:57.073981+0000","last_fullsized":"2024-09-11T23:26:57.073981+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:55.486695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.085891+0000","last_change":"2024-09-11T23:26:44.705094+0000","last_active":"2024-09-11T23:26:55.085891+0000","last_peered":"2024-09-11T23:26:55.085891+0000","last_clean":"2024-09-11T23:26:55.085891+0000","last_became_active":"2024-09-11T23:26:44.704750+0000","last_became_peered":"2024-09-11T23:26:44.704750+0000","last_unstale":"2024-09-11T23:26:55.085891+0000","last_undegraded":"2024-09-11T23:26:55.085891+0000","last_fullsized":"2024-09-11T23:26:55.085891+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:19.058557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:56.192009+0000","last_change":"2024-09-11T23:26:52.070615+0000","last_active":"2024-09-11T23:26:56.192009+0000","last_peered":"2024-09-11T23:26:56.192009+0000","last_clean":"2024-09-11T23:26:56.192009+0000","last_became_active":"2024-09-11T23:26:52.070182+0000","last_became_peered":"2024-09-11T23:26:52.070182+0000","last_unstale":"2024-09-11T23:26:56.192009+0000","last_undegraded":"2024-09-11T23:26:56.192009+0000","last_fullsized":"2024-09-11T23:26:56.192009+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:37.888276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,6],"acting":[2,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.074925+0000","last_change":"2024-09-11T23:26:44.690032+0000","last_active":"2024-09-11T23:26:57.074925+0000","last_peered":"2024-09-11T23:26:57.074925+0000","last_clean":"2024-09-11T23:26:57.074925+0000","last_became_active":"2024-09-11T23:26:44.689715+0000","last_became_peered":"2024-09-11T23:26:44.689715+0000","last_unstale":"2024-09-11T23:26:57.074925+0000","last_undegraded":"2024-09-11T23:26:57.074925+0000","last_fullsized":"2024-09-11T23:26:57.074925+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:10.325376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.086231+0000","last_change":"2024-09-11T23:26:44.707675+0000","last_active":"2024-09-11T23:26:55.086231+0000","last_peered":"2024-09-11T23:26:55.086231+0000","last_clean":"2024-09-11T23:26:55.086231+0000","last_became_active":"2024-09-11T23:26:44.707063+0000","last_became_peered":"2024-09-11T23:26:44.707063+0000","last_unstale":"2024-09-11T23:26:55.086231+0000","last_undegraded":"2024-09-11T23:26:55.086231+0000","last_fullsized":"2024-09-11T23:26:55.086231+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:52.289558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.774898+0000","last_change":"2024-09-11T23:26:44.697512+0000","last_active":"2024-09-11T23:26:55.774898+0000","last_peered":"2024-09-11T23:26:55.774898+0000","last_clean":"2024-09-11T23:26:55.774898+0000","last_became_active":"2024-09-11T23:26:44.697208+0000","last_became_peered":"2024-09-11T23:26:44.697208+0000","last_unstale":"2024-09-11T23:26:55.774898+0000","last_undegraded":"2024-09-11T23:26:55.774898+0000","last_fullsized":"2024-09-11T23:26:55.774898+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:57.001816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.757044+0000","last_change":"2024-09-11T23:26:44.700661+0000","last_active":"2024-09-11T23:26:55.757044+0000","last_peered":"2024-09-11T23:26:55.757044+0000","last_clean":"2024-09-11T23:26:55.757044+0000","last_became_active":"2024-09-11T23:26:44.700298+0000","last_became_peered":"2024-09-11T23:26:44.700298+0000","last_unstale":"2024-09-11T23:26:55.757044+0000","last_undegraded":"2024-09-11T23:26:55.757044+0000","last_fullsized":"2024-09-11T23:26:55.757044+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:03.774789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.757031+0000","last_change":"2024-09-11T23:26:44.695295+0000","last_active":"2024-09-11T23:26:55.757031+0000","last_peered":"2024-09-11T23:26:55.757031+0000","last_clean":"2024-09-11T23:26:55.757031+0000","last_became_active":"2024-09-11T23:26:44.694905+0000","last_became_peered":"2024-09-11T23:26:44.694905+0000","last_unstale":"2024-09-11T23:26:55.757031+0000","last_undegraded":"2024-09-11T23:26:55.757031+0000","last_fullsized":"2024-09-11T23:26:55.757031+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:59.016335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.073876+0000","last_change":"2024-09-11T23:26:44.689876+0000","last_active":"2024-09-11T23:26:57.073876+0000","last_peered":"2024-09-11T23:26:57.073876+0000","last_clean":"2024-09-11T23:26:57.073876+0000","last_became_active":"2024-09-11T23:26:44.689541+0000","last_became_peered":"2024-09-11T23:26:44.689541+0000","last_unstale":"2024-09-11T23:26:57.073876+0000","last_undegraded":"2024-09-11T23:26:57.073876+0000","last_fullsized":"2024-09-11T23:26:57.073876+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:18.693201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.065151+0000","last_change":"2024-09-11T23:26:44.696308+0000","last_active":"2024-09-11T23:26:55.065151+0000","last_peered":"2024-09-11T23:26:55.065151+0000","last_clean":"2024-09-11T23:26:55.065151+0000","last_became_active":"2024-09-11T23:26:44.695973+0000","last_became_peered":"2024-09-11T23:26:44.695973+0000","last_unstale":"2024-09-11T23:26:55.065151+0000","last_undegraded":"2024-09-11T23:26:55.065151+0000","last_fullsized":"2024-09-11T23:26:55.065151+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:46.890624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.074495+0000","last_change":"2024-09-11T23:26:44.703180+0000","last_active":"2024-09-11T23:26:57.074495+0000","last_peered":"2024-09-11T23:26:57.074495+0000","last_clean":"2024-09-11T23:26:57.074495+0000","last_became_active":"2024-09-11T23:26:44.702843+0000","last_became_peered":"2024-09-11T23:26:44.702843+0000","last_unstale":"2024-09-11T23:26:57.074495+0000","last_undegraded":"2024-09-11T23:26:57.074495+0000","last_fullsized":"2024-09-11T23:26:57.074495+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:35.425199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.074923+0000","last_change":"2024-09-11T23:26:52.069650+0000","last_active":"2024-09-11T23:26:57.074923+0000","last_peered":"2024-09-11T23:26:57.074923+0000","last_clean":"2024-09-11T23:26:57.074923+0000","last_became_active":"2024-09-11T23:26:52.069258+0000","last_became_peered":"2024-09-11T23:26:52.069258+0000","last_unstale":"2024-09-11T23:26:57.074923+0000","last_undegraded":"2024-09-11T23:26:57.074923+0000","last_fullsized":"2024-09-11T23:26:57.074923+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:29.073360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.775514+0000","last_change":"2024-09-11T23:26:44.701547+0000","last_active":"2024-09-11T23:26:55.775514+0000","last_peered":"2024-09-11T23:26:55.775514+0000","last_clean":"2024-09-11T23:26:55.775514+0000","last_became_active":"2024-09-11T23:26:44.701215+0000","last_became_peered":"2024-09-11T23:26:44.701215+0000","last_unstale":"2024-09-11T23:26:55.775514+0000","last_undegraded":"2024-09-11T23:26:55.775514+0000","last_fullsized":"2024-09-11T23:26:55.775514+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:39.774757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.061657+0000","last_change":"2024-09-11T23:26:44.696446+0000","last_active":"2024-09-11T23:26:55.061657+0000","last_peered":"2024-09-11T23:26:55.061657+0000","last_clean":"2024-09-11T23:26:55.061657+0000","last_became_active":"2024-09-11T23:26:44.696129+0000","last_became_peered":"2024-09-11T23:26:44.696129+0000","last_unstale":"2024-09-11T23:26:55.061657+0000","last_undegraded":"2024-09-11T23:26:55.061657+0000","last_fullsized":"2024-09-11T23:26:55.061657+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:02.441274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.073947+0000","last_change":"2024-09-11T23:26:44.702036+0000","last_active":"2024-09-11T23:26:57.073947+0000","last_peered":"2024-09-11T23:26:57.073947+0000","last_clean":"2024-09-11T23:26:57.073947+0000","last_became_active":"2024-09-11T23:26:44.701517+0000","last_became_peered":"2024-09-11T23:26:44.701517+0000","last_unstale":"2024-09-11T23:26:57.073947+0000","last_undegraded":"2024-09-11T23:26:57.073947+0000","last_fullsized":"2024-09-11T23:26:57.073947+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:56.577107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:57.074114+0000","last_change":"2024-09-11T23:26:44.693533+0000","last_active":"2024-09-11T23:26:57.074114+0000","last_peered":"2024-09-11T23:26:57.074114+0000","last_clean":"2024-09-11T23:26:57.074114+0000","last_became_active":"2024-09-11T23:26:44.693199+0000","last_became_peered":"2024-09-11T23:26:44.693199+0000","last_unstale":"2024-09-11T23:26:57.074114+0000","last_undegraded":"2024-09-11T23:26:57.074114+0000","last_fullsized":"2024-09-11T23:26:57.074114+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:33.125162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.062609+0000","last_change":"2024-09-11T23:26:44.691525+0000","last_active":"2024-09-11T23:26:55.062609+0000","last_peered":"2024-09-11T23:26:55.062609+0000","last_clean":"2024-09-11T23:26:55.062609+0000","last_became_active":"2024-09-11T23:26:44.691186+0000","last_became_peered":"2024-09-11T23:26:44.691186+0000","last_unstale":"2024-09-11T23:26:55.062609+0000","last_undegraded":"2024-09-11T23:26:55.062609+0000","last_fullsized":"2024-09-11T23:26:55.062609+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:05.002600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.065035+0000","last_change":"2024-09-11T23:26:44.700076+0000","last_active":"2024-09-11T23:26:55.065035+0000","last_peered":"2024-09-11T23:26:55.065035+0000","last_clean":"2024-09-11T23:26:55.065035+0000","last_became_active":"2024-09-11T23:26:44.699746+0000","last_became_peered":"2024-09-11T23:26:44.699746+0000","last_unstale":"2024-09-11T23:26:55.065035+0000","last_undegraded":"2024-09-11T23:26:55.065035+0000","last_fullsized":"2024-09-11T23:26:55.065035+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:49.311174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.757168+0000","last_change":"2024-09-11T23:26:44.699385+0000","last_active":"2024-09-11T23:26:55.757168+0000","last_peered":"2024-09-11T23:26:55.757168+0000","last_clean":"2024-09-11T23:26:55.757168+0000","last_became_active":"2024-09-11T23:26:44.699095+0000","last_became_peered":"2024-09-11T23:26:44.699095+0000","last_unstale":"2024-09-11T23:26:55.757168+0000","last_undegraded":"2024-09-11T23:26:55.757168+0000","last_fullsized":"2024-09-11T23:26:55.757168+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:40:30.583732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.757470+0000","last_change":"2024-09-11T23:26:44.696893+0000","last_active":"2024-09-11T23:26:55.757470+0000","last_peered":"2024-09-11T23:26:55.757470+0000","last_clean":"2024-09-11T23:26:55.757470+0000","last_became_active":"2024-09-11T23:26:44.696493+0000","last_became_peered":"2024-09-11T23:26:44.696493+0000","last_unstale":"2024-09-11T23:26:55.757470+0000","last_undegraded":"2024-09-11T23:26:55.757470+0000","last_fullsized":"2024-09-11T23:26:55.757470+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:32.320327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-11T23:26:55.086193+0000","last_change":"2024-09-11T23:26:44.707902+0000","last_active":"2024-09-11T23:26:55.086193+0000","last_peered":"2024-09-11T23:26:55.086193+0000","last_clean":"2024-09-11T23:26:55.086193+0000","last_became_active":"2024-09-11T23:26:44.706664+0000","last_became_peered":"2024-09-11T23:26:44.706664+0000","last_unstale":"2024-09-11T23:26:55.086193+0000","last_undegraded":"2024-09-11T23:26:55.086193+0000","last_fullsized":"2024-09-11T23:26:55.086193+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:57.865640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":58006,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":113,"num_read_kb":120,"num_write":162,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":174018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":3542208,"data_compressed":214348,"data_compressed_allocated":270336,"data_compressed_original":3506176,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579927,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32116,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713036,"statfs":{"total":95995035648,"available":95962148864,"internally_reserved":0,"allocated":954368,"data_stored":481201,"data_compressed":17784,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808861,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28084,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717068,"statfs":{"total":95995035648,"available":95966277632,"internally_reserved":0,"allocated":1085440,"data_stored":1122243,"data_compressed":54054,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972386,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36288,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708864,"statfs":{"total":95995035648,"available":95957876736,"internally_reserved":0,"allocated":966656,"data_stored":484911,"data_compressed":17784,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201318,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":480735,"data_compressed":17784,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430252,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1011712,"data_stored":1076253,"data_compressed":54054,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626480,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36264,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708888,"statfs":{"total":95995035648,"available":95957901312,"internally_reserved":0,"allocated":942080,"data_stored":475991,"data_compressed":17784,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855414,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":1071219,"data_compressed":54054,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018939,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":480753,"data_compressed":17784,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247871,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36276,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708876,"statfs":{"total":95995035648,"available":95957889024,"internally_reserved":0,"allocated":954368,"data_stored":476185,"data_compressed":17784,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444101,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1007616,"data_stored":520484,"data_compressed":17784,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":530297,"data_compressed":17784,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":477379,"data_compressed":17784,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34634,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34634,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36270,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36270,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36270,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36270,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":54396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":55634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":55974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:27:39.781 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-11T23:27:39.782 INFO:tasks.cephadm:Setting up client nodes... 2024-09-11T23:27:39.782 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-11T23:27:40.039 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:27:40.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:40 smithi159 ceph-mon[34394]: pgmap v310: 129 pgs: 129 active+clean; 633 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.3 KiB/s wr, 9 op/s 2024-09-11T23:27:40.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:40 smithi159 ceph-mon[34394]: from='client.14853 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:27:40.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:40 smithi172 ceph-mon[34855]: pgmap v310: 129 pgs: 129 active+clean; 633 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.3 KiB/s wr, 9 op/s 2024-09-11T23:27:40.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:40 smithi172 ceph-mon[34855]: from='client.14853 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:27:40.442 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:40 smithi005 ceph-mon[31201]: pgmap v310: 129 pgs: 129 active+clean; 633 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.3 KiB/s wr, 9 op/s 2024-09-11T23:27:40.443 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:40 smithi005 ceph-mon[31201]: from='client.14853 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:27:40.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.533+0000 7f3491a8d640 1 -- 172.21.15.5:0/2259715993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f348c1037c0 msgr2=0x7f348c10a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:40.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.533+0000 7f3491a8d640 1 --2- 172.21.15.5:0/2259715993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f348c1037c0 0x7f348c10a050 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3484009ca0 tx=0x7f348402a8c0 comp rx=0 tx=0).stop 2024-09-11T23:27:40.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.533+0000 7f3491a8d640 1 -- 172.21.15.5:0/2259715993 shutdown_connections 2024-09-11T23:27:40.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.533+0000 7f3491a8d640 1 --2- 172.21.15.5:0/2259715993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f348c1037c0 0x7f348c10a050 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:40.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.533+0000 7f3491a8d640 1 --2- 172.21.15.5:0/2259715993 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f348c102e00 0x7f348c103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:40.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.533+0000 7f3491a8d640 1 --2- 172.21.15.5:0/2259715993 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f348c101c00 0x7f348c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:40.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.533+0000 7f3491a8d640 1 -- 172.21.15.5:0/2259715993 >> 172.21.15.5:0/2259715993 conn(0x7f348c0fd390 msgr2=0x7f348c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:40.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.534+0000 7f3491a8d640 1 -- 172.21.15.5:0/2259715993 shutdown_connections 2024-09-11T23:27:40.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.534+0000 7f3491a8d640 1 -- 172.21.15.5:0/2259715993 wait complete. 2024-09-11T23:27:40.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.534+0000 7f3491a8d640 1 Processor -- start 2024-09-11T23:27:40.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.535+0000 7f3491a8d640 1 -- start start 2024-09-11T23:27:40.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.535+0000 7f3491a8d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f348c101c00 0x7f348c197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:40.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.535+0000 7f3491a8d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f348c102e00 0x7f348c198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:40.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.535+0000 7f3491a8d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f348c1037c0 0x7f348c19f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:40.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.535+0000 7f3491a8d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f348c10d790 con 0x7f348c1037c0 2024-09-11T23:27:40.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.535+0000 7f3491a8d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f348c10d610 con 0x7f348c101c00 2024-09-11T23:27:40.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.535+0000 7f3491a8d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f348c10d910 con 0x7f348c102e00 2024-09-11T23:27:40.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.535+0000 7f348bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f348c1037c0 0x7f348c19f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:40.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.535+0000 7f348bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f348c1037c0 0x7f348c19f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44372/0 (socket says 172.21.15.5:44372) 2024-09-11T23:27:40.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.535+0000 7f348bfff640 1 -- 172.21.15.5:0/1440526008 learned_addr learned my addr 172.21.15.5:0/1440526008 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:27:40.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.535+0000 7f348b7fe640 1 --2- 172.21.15.5:0/1440526008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f348c101c00 0x7f348c197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:40.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.535+0000 7f348affd640 1 --2- 172.21.15.5:0/1440526008 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f348c102e00 0x7f348c198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:40.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.535+0000 7f348bfff640 1 -- 172.21.15.5:0/1440526008 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f348c102e00 msgr2=0x7f348c198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:40.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.535+0000 7f348bfff640 1 --2- 172.21.15.5:0/1440526008 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f348c102e00 0x7f348c198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:40.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.535+0000 7f348bfff640 1 -- 172.21.15.5:0/1440526008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f348c101c00 msgr2=0x7f348c197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:40.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.535+0000 7f348bfff640 1 --2- 172.21.15.5:0/1440526008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f348c101c00 0x7f348c197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:40.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.535+0000 7f348bfff640 1 -- 172.21.15.5:0/1440526008 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f348c19fa70 con 0x7f348c1037c0 2024-09-11T23:27:40.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.536+0000 7f348bfff640 1 --2- 172.21.15.5:0/1440526008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f348c1037c0 0x7f348c19f400 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3484009dc0 tx=0x7f3484003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:40.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.536+0000 7f3488ff9640 1 -- 172.21.15.5:0/1440526008 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3484004040 con 0x7f348c1037c0 2024-09-11T23:27:40.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.536+0000 7f3491a8d640 1 -- 172.21.15.5:0/1440526008 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f348c19fd00 con 0x7f348c1037c0 2024-09-11T23:27:40.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.536+0000 7f3488ff9640 1 -- 172.21.15.5:0/1440526008 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3484004690 con 0x7f348c1037c0 2024-09-11T23:27:40.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.536+0000 7f3488ff9640 1 -- 172.21.15.5:0/1440526008 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f348402f4c0 con 0x7f348c1037c0 2024-09-11T23:27:40.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.536+0000 7f3491a8d640 1 -- 172.21.15.5:0/1440526008 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f348c1a01e0 con 0x7f348c1037c0 2024-09-11T23:27:40.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.537+0000 7f3491a8d640 1 -- 172.21.15.5:0/1440526008 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f348c109050 con 0x7f348c1037c0 2024-09-11T23:27:40.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.538+0000 7f3488ff9640 1 -- 172.21.15.5:0/1440526008 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f34840305c0 con 0x7f348c1037c0 2024-09-11T23:27:40.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.539+0000 7f3488ff9640 1 --2- 172.21.15.5:0/1440526008 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f34780a2c40 0x7f34780a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:40.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.539+0000 7f348b7fe640 1 --2- 172.21.15.5:0/1440526008 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f34780a2c40 0x7f34780a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:40.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.539+0000 7f3488ff9640 1 -- 172.21.15.5:0/1440526008 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9071+0+0 (secure 0 0 0) 0x7f34840f0b60 con 0x7f348c1037c0 2024-09-11T23:27:40.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.539+0000 7f348b7fe640 1 --2- 172.21.15.5:0/1440526008 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f34780a2c40 0x7f34780a5100 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f348c102c60 tx=0x7f347c00a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:40.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.543+0000 7f3488ff9640 1 -- 172.21.15.5:0/1440526008 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f34840bd6d0 con 0x7f348c1037c0 2024-09-11T23:27:40.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.792+0000 7f3491a8d640 1 -- 172.21.15.5:0/1440526008 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f348c02d7c0 con 0x7f348c1037c0 2024-09-11T23:27:40.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.794+0000 7f3488ff9640 1 -- 172.21.15.5:0/1440526008 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f34840bcfd0 con 0x7f348c1037c0 2024-09-11T23:27:40.794 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2024-09-11T23:27:40.794 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBsJ+JmgDBULxAAtbEqJME0YQPfK89NPoPxNQ== 2024-09-11T23:27:40.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.797+0000 7f3491a8d640 1 -- 172.21.15.5:0/1440526008 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f34780a2c40 msgr2=0x7f34780a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:40.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.797+0000 7f3491a8d640 1 --2- 172.21.15.5:0/1440526008 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f34780a2c40 0x7f34780a5100 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f348c102c60 tx=0x7f347c00a2d0 comp rx=0 tx=0).stop 2024-09-11T23:27:40.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.797+0000 7f3491a8d640 1 -- 172.21.15.5:0/1440526008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f348c1037c0 msgr2=0x7f348c19f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:40.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.797+0000 7f3491a8d640 1 --2- 172.21.15.5:0/1440526008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f348c1037c0 0x7f348c19f400 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3484009dc0 tx=0x7f3484003ba0 comp rx=0 tx=0).stop 2024-09-11T23:27:40.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.797+0000 7f3491a8d640 1 -- 172.21.15.5:0/1440526008 shutdown_connections 2024-09-11T23:27:40.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.797+0000 7f3491a8d640 1 --2- 172.21.15.5:0/1440526008 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f34780a2c40 0x7f34780a5100 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:40.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.797+0000 7f3491a8d640 1 --2- 172.21.15.5:0/1440526008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f348c1037c0 0x7f348c19f400 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:40.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.797+0000 7f3491a8d640 1 --2- 172.21.15.5:0/1440526008 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f348c102e00 0x7f348c198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:40.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.797+0000 7f3491a8d640 1 --2- 172.21.15.5:0/1440526008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f348c101c00 0x7f348c197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:40.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.797+0000 7f3491a8d640 1 -- 172.21.15.5:0/1440526008 >> 172.21.15.5:0/1440526008 conn(0x7f348c0fd390 msgr2=0x7f348c106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:40.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.797+0000 7f3491a8d640 1 -- 172.21.15.5:0/1440526008 shutdown_connections 2024-09-11T23:27:40.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:40.797+0000 7f3491a8d640 1 -- 172.21.15.5:0/1440526008 wait complete. 2024-09-11T23:27:41.360 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:41 smithi159 ceph-mon[34394]: pgmap v311: 129 pgs: 129 active+clean; 633 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-09-11T23:27:41.360 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:41 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:27:41.360 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:41 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/1440526008' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-11T23:27:41.360 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:41 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/1440526008' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-11T23:27:41.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:41 smithi172 ceph-mon[34855]: pgmap v311: 129 pgs: 129 active+clean; 633 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-09-11T23:27:41.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:41 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:27:41.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:41 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/1440526008' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-11T23:27:41.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:41 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/1440526008' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-11T23:27:41.473 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:41 smithi005 ceph-mon[31201]: pgmap v311: 129 pgs: 129 active+clean; 633 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-09-11T23:27:41.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:41 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:27:41.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:41 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/1440526008' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-11T23:27:41.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:41 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/1440526008' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-11T23:27:41.503 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-11T23:27:41.503 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-11T23:27:41.503 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-11T23:27:41.547 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-11T23:27:41.547 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-11T23:27:41.547 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph mgr dump --format=json 2024-09-11T23:27:42.326 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:27:42.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:42.850+0000 7f9658a89640 1 -- 172.21.15.5:0/3300629134 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9654101de0 msgr2=0x7f96541021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:42.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:42.850+0000 7f9658a89640 1 --2- 172.21.15.5:0/3300629134 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9654101de0 0x7f96541021c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9644009ca0 tx=0x7f964402a8c0 comp rx=0 tx=0).stop 2024-09-11T23:27:42.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:42.850+0000 7f9658a89640 1 -- 172.21.15.5:0/3300629134 shutdown_connections 2024-09-11T23:27:42.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:42.850+0000 7f9658a89640 1 --2- 172.21.15.5:0/3300629134 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9654106f10 0x7f965410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:42.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:42.851+0000 7f9658a89640 1 --2- 172.21.15.5:0/3300629134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9654102790 0x7f96541067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:42.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:42.851+0000 7f9658a89640 1 --2- 172.21.15.5:0/3300629134 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9654101de0 0x7f96541021c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:42.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:42.851+0000 7f9658a89640 1 -- 172.21.15.5:0/3300629134 >> 172.21.15.5:0/3300629134 conn(0x7f96540fd8c0 msgr2=0x7f96540ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:42.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:42.851+0000 7f9658a89640 1 -- 172.21.15.5:0/3300629134 shutdown_connections 2024-09-11T23:27:42.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:42.851+0000 7f9658a89640 1 -- 172.21.15.5:0/3300629134 wait complete. 2024-09-11T23:27:42.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:42.851+0000 7f9658a89640 1 Processor -- start 2024-09-11T23:27:42.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:42.851+0000 7f9658a89640 1 -- start start 2024-09-11T23:27:42.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:42.852+0000 7f9658a89640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9654101de0 0x7f96541983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:42.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:42.852+0000 7f9658a89640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9654102790 0x7f9654198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:42.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:42.852+0000 7f9658a89640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9654106f10 0x7f965419cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:42.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:42.852+0000 7f9658a89640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9654111de0 con 0x7f9654106f10 2024-09-11T23:27:42.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:42.852+0000 7f9658a89640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9654111c60 con 0x7f9654102790 2024-09-11T23:27:42.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:42.852+0000 7f9658a89640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9654111f60 con 0x7f9654101de0 2024-09-11T23:27:42.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:42.852+0000 7f9652d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9654106f10 0x7f965419cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:42.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:42.852+0000 7f9652d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9654106f10 0x7f965419cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44388/0 (socket says 172.21.15.5:44388) 2024-09-11T23:27:42.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:42.852+0000 7f9652d9d640 1 -- 172.21.15.5:0/376066558 learned_addr learned my addr 172.21.15.5:0/376066558 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:27:42.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:42.852+0000 7f965259c640 1 --2- 172.21.15.5:0/376066558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9654101de0 0x7f96541983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:42.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:42.852+0000 7f9652d9d640 1 -- 172.21.15.5:0/376066558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9654101de0 msgr2=0x7f96541983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:42.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:42.852+0000 7f9652d9d640 1 --2- 172.21.15.5:0/376066558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9654101de0 0x7f96541983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:42.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:42.852+0000 7f9651d9b640 1 --2- 172.21.15.5:0/376066558 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9654102790 0x7f9654198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:42.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:42.852+0000 7f9652d9d640 1 -- 172.21.15.5:0/376066558 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9654102790 msgr2=0x7f9654198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:42.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:42.852+0000 7f9652d9d640 1 --2- 172.21.15.5:0/376066558 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9654102790 0x7f9654198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:42.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:42.852+0000 7f9652d9d640 1 -- 172.21.15.5:0/376066558 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f965419d370 con 0x7f9654106f10 2024-09-11T23:27:42.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:42.852+0000 7f9651d9b640 1 --2- 172.21.15.5:0/376066558 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9654102790 0x7f9654198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:27:42.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:42.852+0000 7f9652d9d640 1 --2- 172.21.15.5:0/376066558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9654106f10 0x7f965419cc90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f964c00c970 tx=0x7f964c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:42.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:42.852+0000 7f96437fe640 1 -- 172.21.15.5:0/376066558 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f964c007bb0 con 0x7f9654106f10 2024-09-11T23:27:42.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:42.852+0000 7f96437fe640 1 -- 172.21.15.5:0/376066558 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f964c007d50 con 0x7f9654106f10 2024-09-11T23:27:42.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:42.852+0000 7f9658a89640 1 -- 172.21.15.5:0/376066558 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f965419d660 con 0x7f9654106f10 2024-09-11T23:27:42.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:42.852+0000 7f96437fe640 1 -- 172.21.15.5:0/376066558 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f964c004e10 con 0x7f9654106f10 2024-09-11T23:27:42.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:42.853+0000 7f9658a89640 1 -- 172.21.15.5:0/376066558 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96541a4f40 con 0x7f9654106f10 2024-09-11T23:27:42.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:42.854+0000 7f9658a89640 1 -- 172.21.15.5:0/376066558 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96541021c0 con 0x7f9654106f10 2024-09-11T23:27:42.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:42.855+0000 7f96437fe640 1 -- 172.21.15.5:0/376066558 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f964c005020 con 0x7f9654106f10 2024-09-11T23:27:42.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:42.855+0000 7f96437fe640 1 --2- 172.21.15.5:0/376066558 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f963c0a2c10 0x7f963c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:42.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:42.855+0000 7f965259c640 1 --2- 172.21.15.5:0/376066558 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f963c0a2c10 0x7f963c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:42.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:42.855+0000 7f96437fe640 1 -- 172.21.15.5:0/376066558 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9071+0+0 (secure 0 0 0) 0x7f964c0cf180 con 0x7f9654106f10 2024-09-11T23:27:42.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:42.856+0000 7f965259c640 1 --2- 172.21.15.5:0/376066558 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f963c0a2c10 0x7f963c0a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9644005e30 tx=0x7f9644031000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:42.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:42.859+0000 7f96437fe640 1 -- 172.21.15.5:0/376066558 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f964c014030 con 0x7f9654106f10 2024-09-11T23:27:43.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:43.103+0000 7f9658a89640 1 -- 172.21.15.5:0/376066558 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f9654199720 con 0x7f9654106f10 2024-09-11T23:27:43.104 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:43 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:27:43.104 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:43 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:27:43.104 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:43 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:27:43.104 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:43 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:27:43.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:43.108+0000 7f96437fe640 1 -- 172.21.15.5:0/376066558 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+263191 (secure 0 0 0) 0x7f964c09bc40 con 0x7f9654106f10 2024-09-11T23:27:43.112 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:27:43.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:43.111+0000 7f9658a89640 1 -- 172.21.15.5:0/376066558 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f963c0a2c10 msgr2=0x7f963c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:43.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:43.111+0000 7f9658a89640 1 --2- 172.21.15.5:0/376066558 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f963c0a2c10 0x7f963c0a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9644005e30 tx=0x7f9644031000 comp rx=0 tx=0).stop 2024-09-11T23:27:43.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:43.111+0000 7f9658a89640 1 -- 172.21.15.5:0/376066558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9654106f10 msgr2=0x7f965419cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:43.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:43.111+0000 7f9658a89640 1 --2- 172.21.15.5:0/376066558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9654106f10 0x7f965419cc90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f964c00c970 tx=0x7f964c00ce30 comp rx=0 tx=0).stop 2024-09-11T23:27:43.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:43.111+0000 7f9658a89640 1 -- 172.21.15.5:0/376066558 shutdown_connections 2024-09-11T23:27:43.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:43.111+0000 7f9658a89640 1 --2- 172.21.15.5:0/376066558 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f963c0a2c10 0x7f963c0a50d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:43.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:43.111+0000 7f9658a89640 1 --2- 172.21.15.5:0/376066558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9654106f10 0x7f965419cc90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:43.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:43.111+0000 7f9658a89640 1 --2- 172.21.15.5:0/376066558 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9654102790 0x7f9654198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:43.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:43.111+0000 7f9658a89640 1 --2- 172.21.15.5:0/376066558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9654101de0 0x7f96541983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:43.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:43.111+0000 7f9658a89640 1 -- 172.21.15.5:0/376066558 >> 172.21.15.5:0/376066558 conn(0x7f96540fd8c0 msgr2=0x7f96540fed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:43.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:43.111+0000 7f9658a89640 1 -- 172.21.15.5:0/376066558 shutdown_connections 2024-09-11T23:27:43.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:43.111+0000 7f9658a89640 1 -- 172.21.15.5:0/376066558 wait complete. 2024-09-11T23:27:43.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:43 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:27:43.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:43 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:27:43.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:43 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:27:43.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:43 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:27:43.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:43 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:27:43.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:43 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:27:43.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:43 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:27:43.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:43 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:27:43.833 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":17,"flags":0,"active_gid":14148,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2285128668},{"type":"v1","addr":"172.21.15.5:6801","nonce":2285128668}]},"active_addr":"172.21.15.5:6801/2285128668","active_change":"2024-09-11T23:19:50.032000+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24110,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.5:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":4216758797}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":778150446}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":3011211624}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":2120208310}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":3718015822}]}]} 2024-09-11T23:27:43.839 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-11T23:27:43.839 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-11T23:27:43.839 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T23:27:44.077 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:44 smithi005 ceph-mon[31201]: pgmap v312: 129 pgs: 129 active+clean; 633 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2024-09-11T23:27:44.078 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:44 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/376066558' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-11T23:27:44.078 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:44 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:27:44.078 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:44 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:27:44.130 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:27:44.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:44 smithi159 ceph-mon[34394]: pgmap v312: 129 pgs: 129 active+clean; 633 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2024-09-11T23:27:44.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:44 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/376066558' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-11T23:27:44.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:44 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:27:44.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:44 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:27:44.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:44 smithi172 ceph-mon[34855]: pgmap v312: 129 pgs: 129 active+clean; 633 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2024-09-11T23:27:44.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:44 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/376066558' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-11T23:27:44.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:44 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:27:44.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:44 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:27:44.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.597+0000 7f75c484b640 1 -- 172.21.15.5:0/1068570021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75c01037a0 msgr2=0x7f75c010bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:44.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.597+0000 7f75c484b640 1 --2- 172.21.15.5:0/1068570021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75c01037a0 0x7f75c010bc00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f75b4009900 tx=0x7f75b402a410 comp rx=0 tx=0).stop 2024-09-11T23:27:44.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.597+0000 7f75c484b640 1 -- 172.21.15.5:0/1068570021 shutdown_connections 2024-09-11T23:27:44.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.597+0000 7f75c484b640 1 --2- 172.21.15.5:0/1068570021 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75c010c2f0 0x7f75c010e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:44.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.597+0000 7f75c484b640 1 --2- 172.21.15.5:0/1068570021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75c01037a0 0x7f75c010bc00 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:44.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.597+0000 7f75c484b640 1 --2- 172.21.15.5:0/1068570021 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75c0102df0 0x7f75c01031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:44.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.597+0000 7f75c484b640 1 -- 172.21.15.5:0/1068570021 >> 172.21.15.5:0/1068570021 conn(0x7f75c00fc7d0 msgr2=0x7f75c00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:44.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.597+0000 7f75c484b640 1 -- 172.21.15.5:0/1068570021 shutdown_connections 2024-09-11T23:27:44.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.597+0000 7f75c484b640 1 -- 172.21.15.5:0/1068570021 wait complete. 2024-09-11T23:27:44.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.598+0000 7f75c484b640 1 Processor -- start 2024-09-11T23:27:44.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.598+0000 7f75c484b640 1 -- start start 2024-09-11T23:27:44.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.598+0000 7f75c484b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75c0102df0 0x7f75c0198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:44.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.598+0000 7f75c484b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75c01037a0 0x7f75c0198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:44.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.598+0000 7f75c484b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75c010c2f0 0x7f75c019ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:44.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.598+0000 7f75c484b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f75c0111f80 con 0x7f75c010c2f0 2024-09-11T23:27:44.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.598+0000 7f75c484b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f75c0111e00 con 0x7f75c0102df0 2024-09-11T23:27:44.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.598+0000 7f75c484b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f75c0112100 con 0x7f75c01037a0 2024-09-11T23:27:44.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.598+0000 7f75bed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75c010c2f0 0x7f75c019ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:44.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.598+0000 7f75bed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75c010c2f0 0x7f75c019ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42610/0 (socket says 172.21.15.5:42610) 2024-09-11T23:27:44.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.598+0000 7f75bed9d640 1 -- 172.21.15.5:0/1013669175 learned_addr learned my addr 172.21.15.5:0/1013669175 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:27:44.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.599+0000 7f75be59c640 1 --2- 172.21.15.5:0/1013669175 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75c0102df0 0x7f75c0198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:44.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.599+0000 7f75bdd9b640 1 --2- 172.21.15.5:0/1013669175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75c01037a0 0x7f75c0198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:44.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.599+0000 7f75bed9d640 1 -- 172.21.15.5:0/1013669175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75c01037a0 msgr2=0x7f75c0198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:44.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.599+0000 7f75bed9d640 1 --2- 172.21.15.5:0/1013669175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75c01037a0 0x7f75c0198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:44.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.599+0000 7f75bed9d640 1 -- 172.21.15.5:0/1013669175 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75c0102df0 msgr2=0x7f75c0198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:44.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.599+0000 7f75bed9d640 1 --2- 172.21.15.5:0/1013669175 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75c0102df0 0x7f75c0198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:44.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.599+0000 7f75bed9d640 1 -- 172.21.15.5:0/1013669175 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75c019d530 con 0x7f75c010c2f0 2024-09-11T23:27:44.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.599+0000 7f75bdd9b640 1 --2- 172.21.15.5:0/1013669175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75c01037a0 0x7f75c0198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:27:44.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.599+0000 7f75bed9d640 1 --2- 172.21.15.5:0/1013669175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75c010c2f0 0x7f75c019ce50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f75b800eaa0 tx=0x7f75b800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:44.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.599+0000 7f75af7fe640 1 -- 172.21.15.5:0/1013669175 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b800cdb0 con 0x7f75c010c2f0 2024-09-11T23:27:44.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.599+0000 7f75c484b640 1 -- 172.21.15.5:0/1013669175 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75c019d820 con 0x7f75c010c2f0 2024-09-11T23:27:44.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.599+0000 7f75af7fe640 1 -- 172.21.15.5:0/1013669175 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f75b8005020 con 0x7f75c010c2f0 2024-09-11T23:27:44.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.599+0000 7f75af7fe640 1 -- 172.21.15.5:0/1013669175 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b80116d0 con 0x7f75c010c2f0 2024-09-11T23:27:44.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.599+0000 7f75c484b640 1 -- 172.21.15.5:0/1013669175 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75c01a5100 con 0x7f75c010c2f0 2024-09-11T23:27:44.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.600+0000 7f75c484b640 1 -- 172.21.15.5:0/1013669175 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75c01031d0 con 0x7f75c010c2f0 2024-09-11T23:27:44.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.602+0000 7f75af7fe640 1 -- 172.21.15.5:0/1013669175 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f75b80051d0 con 0x7f75c010c2f0 2024-09-11T23:27:44.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.603+0000 7f75af7fe640 1 --2- 172.21.15.5:0/1013669175 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f75a80a2c90 0x7f75a80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:44.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.603+0000 7f75be59c640 1 --2- 172.21.15.5:0/1013669175 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f75a80a2c90 0x7f75a80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:44.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.603+0000 7f75af7fe640 1 -- 172.21.15.5:0/1013669175 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9071+0+0 (secure 0 0 0) 0x7f75b80cf9a0 con 0x7f75c010c2f0 2024-09-11T23:27:44.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.603+0000 7f75be59c640 1 --2- 172.21.15.5:0/1013669175 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f75a80a2c90 0x7f75a80a5150 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f75b0009bd0 tx=0x7f75b0005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:44.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.606+0000 7f75af7fe640 1 -- 172.21.15.5:0/1013669175 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f75b8016030 con 0x7f75c010c2f0 2024-09-11T23:27:44.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.782+0000 7f75c484b640 1 -- 172.21.15.5:0/1013669175 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f75c01998e0 con 0x7f75c010c2f0 2024-09-11T23:27:44.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.784+0000 7f75af7fe640 1 -- 172.21.15.5:0/1013669175 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24655 (secure 0 0 0) 0x7f75b809c4e0 con 0x7f75c010c2f0 2024-09-11T23:27:44.785 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:27:44.785 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":86,"fsid":"1f5284d2-7094-11ef-bcea-c7b262605968","created":"2024-09-11T23:19:00.051813+0000","modified":"2024-09-11T23:26:54.807250+0000","last_up_change":"2024-09-11T23:25:53.433445+0000","last_in_change":"2024-09-11T23:25:29.443287+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:22:04.534014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:26:41.220887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:26:43.664094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T23:26:50.471521+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bf95ced0-780b-482f-87da-0b5e61de62ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6803","nonce":624761084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6805","nonce":624761084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6809","nonce":624761084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6807","nonce":624761084}]},"public_addr":"172.21.15.5:6803/624761084","cluster_addr":"172.21.15.5:6805/624761084","heartbeat_back_addr":"172.21.15.5:6809/624761084","heartbeat_front_addr":"172.21.15.5:6807/624761084","state":["exists","up"]},{"osd":1,"uuid":"d926484f-78a6-497b-843d-f2db54ade4a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6801","nonce":2111290186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6803","nonce":2111290186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6807","nonce":2111290186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6805","nonce":2111290186}]},"public_addr":"172.21.15.159:6801/2111290186","cluster_addr":"172.21.15.159:6803/2111290186","heartbeat_back_addr":"172.21.15.159:6807/2111290186","heartbeat_front_addr":"172.21.15.159:6805/2111290186","state":["exists","up"]},{"osd":2,"uuid":"d92cd431-0ba7-4171-82b8-60fa3d63a64b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6801","nonce":299915717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6803","nonce":299915717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6807","nonce":299915717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6805","nonce":299915717}]},"public_addr":"172.21.15.172:6801/299915717","cluster_addr":"172.21.15.172:6803/299915717","heartbeat_back_addr":"172.21.15.172:6807/299915717","heartbeat_front_addr":"172.21.15.172:6805/299915717","state":["exists","up"]},{"osd":3,"uuid":"0521043b-559c-4671-b11e-9117871cff49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6811","nonce":2080498921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6813","nonce":2080498921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6817","nonce":2080498921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6815","nonce":2080498921}]},"public_addr":"172.21.15.5:6811/2080498921","cluster_addr":"172.21.15.5:6813/2080498921","heartbeat_back_addr":"172.21.15.5:6817/2080498921","heartbeat_front_addr":"172.21.15.5:6815/2080498921","state":["exists","up"]},{"osd":4,"uuid":"b968d762-a46e-4ae2-b19d-8225f82de613","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6809","nonce":4185908786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6811","nonce":4185908786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6815","nonce":4185908786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6813","nonce":4185908786}]},"public_addr":"172.21.15.159:6809/4185908786","cluster_addr":"172.21.15.159:6811/4185908786","heartbeat_back_addr":"172.21.15.159:6815/4185908786","heartbeat_front_addr":"172.21.15.159:6813/4185908786","state":["exists","up"]},{"osd":5,"uuid":"1b0a518a-3d17-4635-81da-52f9ef83a574","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6809","nonce":3742759000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6811","nonce":3742759000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6815","nonce":3742759000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6813","nonce":3742759000}]},"public_addr":"172.21.15.172:6809/3742759000","cluster_addr":"172.21.15.172:6811/3742759000","heartbeat_back_addr":"172.21.15.172:6815/3742759000","heartbeat_front_addr":"172.21.15.172:6813/3742759000","state":["exists","up"]},{"osd":6,"uuid":"c3a2db6c-9189-4e42-aa1e-52189a9c4291","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6819","nonce":4156823423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6821","nonce":4156823423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6825","nonce":4156823423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6823","nonce":4156823423}]},"public_addr":"172.21.15.5:6819/4156823423","cluster_addr":"172.21.15.5:6821/4156823423","heartbeat_back_addr":"172.21.15.5:6825/4156823423","heartbeat_front_addr":"172.21.15.5:6823/4156823423","state":["exists","up"]},{"osd":7,"uuid":"dfaadf28-74ab-4cda-8647-dcb58beb7cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6817","nonce":4222571927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6819","nonce":4222571927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6823","nonce":4222571927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6821","nonce":4222571927}]},"public_addr":"172.21.15.159:6817/4222571927","cluster_addr":"172.21.15.159:6819/4222571927","heartbeat_back_addr":"172.21.15.159:6823/4222571927","heartbeat_front_addr":"172.21.15.159:6821/4222571927","state":["exists","up"]},{"osd":8,"uuid":"47f66651-614c-4613-9793-69c140dbf705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6817","nonce":3661505951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6819","nonce":3661505951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6823","nonce":3661505951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6821","nonce":3661505951}]},"public_addr":"172.21.15.172:6817/3661505951","cluster_addr":"172.21.15.172:6819/3661505951","heartbeat_back_addr":"172.21.15.172:6823/3661505951","heartbeat_front_addr":"172.21.15.172:6821/3661505951","state":["exists","up"]},{"osd":9,"uuid":"c97b8221-8cf9-4fab-9e27-ff7f3bd98152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6827","nonce":72036667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6829","nonce":72036667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6833","nonce":72036667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6831","nonce":72036667}]},"public_addr":"172.21.15.5:6827/72036667","cluster_addr":"172.21.15.5:6829/72036667","heartbeat_back_addr":"172.21.15.5:6833/72036667","heartbeat_front_addr":"172.21.15.5:6831/72036667","state":["exists","up"]},{"osd":10,"uuid":"143376c1-f3f1-4df4-bcd3-a9b46fad8c1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6825","nonce":3334483164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6827","nonce":3334483164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6831","nonce":3334483164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6829","nonce":3334483164}]},"public_addr":"172.21.15.159:6825/3334483164","cluster_addr":"172.21.15.159:6827/3334483164","heartbeat_back_addr":"172.21.15.159:6831/3334483164","heartbeat_front_addr":"172.21.15.159:6829/3334483164","state":["exists","up"]},{"osd":11,"uuid":"5cc91ff9-fc0f-4e7a-8e4d-87df0e7efbeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6825","nonce":1965415663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6827","nonce":1965415663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6831","nonce":1965415663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6829","nonce":1965415663}]},"public_addr":"172.21.15.172:6825/1965415663","cluster_addr":"172.21.15.172:6827/1965415663","heartbeat_back_addr":"172.21.15.172:6831/1965415663","heartbeat_front_addr":"172.21.15.172:6829/1965415663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:21:13.024707+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:21:38.063741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:22:02.221583+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:22:27.919711+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:22:53.870543+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:23:18.539905+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:23:43.694229+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:24:08.984704+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:24:34.378582+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:25:00.102231+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:25:25.367178+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:25:51.439033+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/2713701762":"2024-09-12T23:19:50.031855+0000","172.21.15.5:0/3135835713":"2024-09-12T23:19:50.031855+0000","172.21.15.5:0/3935034940":"2024-09-12T23:19:50.031855+0000","172.21.15.5:6801/1790126649":"2024-09-12T23:19:50.031855+0000","172.21.15.5:6801/1358356358":"2024-09-12T23:19:26.149011+0000","172.21.15.5:6800/1790126649":"2024-09-12T23:19:50.031855+0000","172.21.15.5:6800/1358356358":"2024-09-12T23:19:26.149011+0000","172.21.15.5:0/2243688290":"2024-09-12T23:19:26.149011+0000","172.21.15.5:0/1493331899":"2024-09-12T23:19:26.149011+0000","172.21.15.5:0/2329812802":"2024-09-12T23:19:26.149011+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:27:44.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.786+0000 7f75c484b640 1 -- 172.21.15.5:0/1013669175 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f75a80a2c90 msgr2=0x7f75a80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:44.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.786+0000 7f75c484b640 1 --2- 172.21.15.5:0/1013669175 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f75a80a2c90 0x7f75a80a5150 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f75b0009bd0 tx=0x7f75b0005f90 comp rx=0 tx=0).stop 2024-09-11T23:27:44.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.786+0000 7f75c484b640 1 -- 172.21.15.5:0/1013669175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75c010c2f0 msgr2=0x7f75c019ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:44.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.786+0000 7f75c484b640 1 --2- 172.21.15.5:0/1013669175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75c010c2f0 0x7f75c019ce50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f75b800eaa0 tx=0x7f75b800ef60 comp rx=0 tx=0).stop 2024-09-11T23:27:44.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.786+0000 7f75c484b640 1 -- 172.21.15.5:0/1013669175 shutdown_connections 2024-09-11T23:27:44.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.786+0000 7f75c484b640 1 --2- 172.21.15.5:0/1013669175 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f75a80a2c90 0x7f75a80a5150 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:44.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.786+0000 7f75c484b640 1 --2- 172.21.15.5:0/1013669175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75c010c2f0 0x7f75c019ce50 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:44.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.786+0000 7f75c484b640 1 --2- 172.21.15.5:0/1013669175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75c01037a0 0x7f75c0198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:44.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.786+0000 7f75c484b640 1 --2- 172.21.15.5:0/1013669175 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f75c0102df0 0x7f75c0198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:44.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.786+0000 7f75c484b640 1 -- 172.21.15.5:0/1013669175 >> 172.21.15.5:0/1013669175 conn(0x7f75c00fc7d0 msgr2=0x7f75c00fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:44.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.786+0000 7f75c484b640 1 -- 172.21.15.5:0/1013669175 shutdown_connections 2024-09-11T23:27:44.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:44.786+0000 7f75c484b640 1 -- 172.21.15.5:0/1013669175 wait complete. 2024-09-11T23:27:45.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:45 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:27:45.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:45 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:27:45.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:45 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:27:45.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:45 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/1013669175' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:27:45.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:45 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:27:45.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:45 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:27:45.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:45 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:27:45.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:45 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/1013669175' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:27:45.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:45 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:27:45.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:45 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:27:45.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:45 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:27:45.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:45 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/1013669175' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:27:45.516 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-11T23:27:45.516 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T23:27:45.779 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:27:46.153 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:46 smithi005 ceph-mon[31201]: pgmap v313: 129 pgs: 129 active+clean; 641 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.7 KiB/s wr, 9 op/s 2024-09-11T23:27:46.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.240+0000 7f5067357640 1 -- 172.21.15.5:0/2232511592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5060102df0 msgr2=0x7f50601031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:46.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.240+0000 7f5067357640 1 --2- 172.21.15.5:0/2232511592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5060102df0 0x7f50601031d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f505c009900 tx=0x7f505c02a410 comp rx=0 tx=0).stop 2024-09-11T23:27:46.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.240+0000 7f5067357640 1 -- 172.21.15.5:0/2232511592 shutdown_connections 2024-09-11T23:27:46.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.240+0000 7f5067357640 1 --2- 172.21.15.5:0/2232511592 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f506010c2f0 0x7f506010e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:46.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.240+0000 7f5067357640 1 --2- 172.21.15.5:0/2232511592 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50601037a0 0x7f506010bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:46.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.240+0000 7f5067357640 1 --2- 172.21.15.5:0/2232511592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5060102df0 0x7f50601031d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:46.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.240+0000 7f5067357640 1 -- 172.21.15.5:0/2232511592 >> 172.21.15.5:0/2232511592 conn(0x7f50600fc7d0 msgr2=0x7f50600febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:46.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.240+0000 7f5067357640 1 -- 172.21.15.5:0/2232511592 shutdown_connections 2024-09-11T23:27:46.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.240+0000 7f5067357640 1 -- 172.21.15.5:0/2232511592 wait complete. 2024-09-11T23:27:46.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.241+0000 7f5067357640 1 Processor -- start 2024-09-11T23:27:46.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.241+0000 7f5067357640 1 -- start start 2024-09-11T23:27:46.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.241+0000 7f5067357640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5060102df0 0x7f5060100a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:46.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.241+0000 7f5067357640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50601037a0 0x7f5060100f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:46.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.241+0000 7f5067357640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f506010c2f0 0x7f50601014d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:46.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.241+0000 7f5067357640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5060112020 con 0x7f5060102df0 2024-09-11T23:27:46.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.241+0000 7f5067357640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5060111ea0 con 0x7f50601037a0 2024-09-11T23:27:46.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.241+0000 7f5067357640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f50601121a0 con 0x7f506010c2f0 2024-09-11T23:27:46.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.241+0000 7f50650f3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5060102df0 0x7f5060100a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:46.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.241+0000 7f50650f3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5060102df0 0x7f5060100a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42624/0 (socket says 172.21.15.5:42624) 2024-09-11T23:27:46.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.241+0000 7f50650f3640 1 -- 172.21.15.5:0/951822161 learned_addr learned my addr 172.21.15.5:0/951822161 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:27:46.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.242+0000 7f50648f2640 1 --2- 172.21.15.5:0/951822161 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50601037a0 0x7f5060100f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:46.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.242+0000 7f50650f3640 1 -- 172.21.15.5:0/951822161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f506010c2f0 msgr2=0x7f50601014d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:46.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.242+0000 7f50658f4640 1 --2- 172.21.15.5:0/951822161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f506010c2f0 0x7f50601014d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:46.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.242+0000 7f50650f3640 1 --2- 172.21.15.5:0/951822161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f506010c2f0 0x7f50601014d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:46.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.242+0000 7f50650f3640 1 -- 172.21.15.5:0/951822161 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50601037a0 msgr2=0x7f5060100f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:46.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.242+0000 7f50650f3640 1 --2- 172.21.15.5:0/951822161 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50601037a0 0x7f5060100f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:46.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.242+0000 7f50650f3640 1 -- 172.21.15.5:0/951822161 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50601a6b10 con 0x7f5060102df0 2024-09-11T23:27:46.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.242+0000 7f50650f3640 1 --2- 172.21.15.5:0/951822161 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5060102df0 0x7f5060100a50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f505c005940 tx=0x7f505c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:46.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.242+0000 7f50567fc640 1 -- 172.21.15.5:0/951822161 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f505c03f030 con 0x7f5060102df0 2024-09-11T23:27:46.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.242+0000 7f50567fc640 1 -- 172.21.15.5:0/951822161 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f505c003aa0 con 0x7f5060102df0 2024-09-11T23:27:46.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.242+0000 7f5067357640 1 -- 172.21.15.5:0/951822161 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50601a6da0 con 0x7f5060102df0 2024-09-11T23:27:46.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.242+0000 7f50567fc640 1 -- 172.21.15.5:0/951822161 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f505c035070 con 0x7f5060102df0 2024-09-11T23:27:46.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.242+0000 7f5067357640 1 -- 172.21.15.5:0/951822161 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50601a7220 con 0x7f5060102df0 2024-09-11T23:27:46.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.243+0000 7f5067357640 1 -- 172.21.15.5:0/951822161 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50601031d0 con 0x7f5060102df0 2024-09-11T23:27:46.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.244+0000 7f50567fc640 1 -- 172.21.15.5:0/951822161 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f505c042030 con 0x7f5060102df0 2024-09-11T23:27:46.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.245+0000 7f50567fc640 1 --2- 172.21.15.5:0/951822161 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f504c0a2c10 0x7f504c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:46.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.245+0000 7f50648f2640 1 --2- 172.21.15.5:0/951822161 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f504c0a2c10 0x7f504c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:46.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.245+0000 7f50567fc640 1 -- 172.21.15.5:0/951822161 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9071+0+0 (secure 0 0 0) 0x7f505c0efd20 con 0x7f5060102df0 2024-09-11T23:27:46.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.246+0000 7f50648f2640 1 --2- 172.21.15.5:0/951822161 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f504c0a2c10 0x7f504c0a50d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f50601024e0 tx=0x7f5050008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:46.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.250+0000 7f50567fc640 1 -- 172.21.15.5:0/951822161 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f505c0bc7e0 con 0x7f5060102df0 2024-09-11T23:27:46.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:46 smithi159 ceph-mon[34394]: pgmap v313: 129 pgs: 129 active+clean; 641 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.7 KiB/s wr, 9 op/s 2024-09-11T23:27:46.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:46 smithi172 ceph-mon[34855]: pgmap v313: 129 pgs: 129 active+clean; 641 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.7 KiB/s wr, 9 op/s 2024-09-11T23:27:46.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.428+0000 7f5067357640 1 -- 172.21.15.5:0/951822161 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f50601072c0 con 0x7f5060102df0 2024-09-11T23:27:46.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.429+0000 7f50567fc640 1 -- 172.21.15.5:0/951822161 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24655 (secure 0 0 0) 0x7f505c0bc0e0 con 0x7f5060102df0 2024-09-11T23:27:46.430 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:27:46.431 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":86,"fsid":"1f5284d2-7094-11ef-bcea-c7b262605968","created":"2024-09-11T23:19:00.051813+0000","modified":"2024-09-11T23:26:54.807250+0000","last_up_change":"2024-09-11T23:25:53.433445+0000","last_in_change":"2024-09-11T23:25:29.443287+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:22:04.534014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:26:41.220887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:26:43.664094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T23:26:50.471521+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bf95ced0-780b-482f-87da-0b5e61de62ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6803","nonce":624761084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6805","nonce":624761084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6809","nonce":624761084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6807","nonce":624761084}]},"public_addr":"172.21.15.5:6803/624761084","cluster_addr":"172.21.15.5:6805/624761084","heartbeat_back_addr":"172.21.15.5:6809/624761084","heartbeat_front_addr":"172.21.15.5:6807/624761084","state":["exists","up"]},{"osd":1,"uuid":"d926484f-78a6-497b-843d-f2db54ade4a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6801","nonce":2111290186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6803","nonce":2111290186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6807","nonce":2111290186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6805","nonce":2111290186}]},"public_addr":"172.21.15.159:6801/2111290186","cluster_addr":"172.21.15.159:6803/2111290186","heartbeat_back_addr":"172.21.15.159:6807/2111290186","heartbeat_front_addr":"172.21.15.159:6805/2111290186","state":["exists","up"]},{"osd":2,"uuid":"d92cd431-0ba7-4171-82b8-60fa3d63a64b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6801","nonce":299915717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6803","nonce":299915717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6807","nonce":299915717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6805","nonce":299915717}]},"public_addr":"172.21.15.172:6801/299915717","cluster_addr":"172.21.15.172:6803/299915717","heartbeat_back_addr":"172.21.15.172:6807/299915717","heartbeat_front_addr":"172.21.15.172:6805/299915717","state":["exists","up"]},{"osd":3,"uuid":"0521043b-559c-4671-b11e-9117871cff49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6811","nonce":2080498921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6813","nonce":2080498921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6817","nonce":2080498921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6815","nonce":2080498921}]},"public_addr":"172.21.15.5:6811/2080498921","cluster_addr":"172.21.15.5:6813/2080498921","heartbeat_back_addr":"172.21.15.5:6817/2080498921","heartbeat_front_addr":"172.21.15.5:6815/2080498921","state":["exists","up"]},{"osd":4,"uuid":"b968d762-a46e-4ae2-b19d-8225f82de613","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6809","nonce":4185908786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6811","nonce":4185908786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6815","nonce":4185908786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6813","nonce":4185908786}]},"public_addr":"172.21.15.159:6809/4185908786","cluster_addr":"172.21.15.159:6811/4185908786","heartbeat_back_addr":"172.21.15.159:6815/4185908786","heartbeat_front_addr":"172.21.15.159:6813/4185908786","state":["exists","up"]},{"osd":5,"uuid":"1b0a518a-3d17-4635-81da-52f9ef83a574","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6809","nonce":3742759000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6811","nonce":3742759000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6815","nonce":3742759000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6813","nonce":3742759000}]},"public_addr":"172.21.15.172:6809/3742759000","cluster_addr":"172.21.15.172:6811/3742759000","heartbeat_back_addr":"172.21.15.172:6815/3742759000","heartbeat_front_addr":"172.21.15.172:6813/3742759000","state":["exists","up"]},{"osd":6,"uuid":"c3a2db6c-9189-4e42-aa1e-52189a9c4291","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6819","nonce":4156823423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6821","nonce":4156823423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6825","nonce":4156823423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6823","nonce":4156823423}]},"public_addr":"172.21.15.5:6819/4156823423","cluster_addr":"172.21.15.5:6821/4156823423","heartbeat_back_addr":"172.21.15.5:6825/4156823423","heartbeat_front_addr":"172.21.15.5:6823/4156823423","state":["exists","up"]},{"osd":7,"uuid":"dfaadf28-74ab-4cda-8647-dcb58beb7cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6817","nonce":4222571927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6819","nonce":4222571927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6823","nonce":4222571927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6821","nonce":4222571927}]},"public_addr":"172.21.15.159:6817/4222571927","cluster_addr":"172.21.15.159:6819/4222571927","heartbeat_back_addr":"172.21.15.159:6823/4222571927","heartbeat_front_addr":"172.21.15.159:6821/4222571927","state":["exists","up"]},{"osd":8,"uuid":"47f66651-614c-4613-9793-69c140dbf705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6817","nonce":3661505951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6819","nonce":3661505951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6823","nonce":3661505951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6821","nonce":3661505951}]},"public_addr":"172.21.15.172:6817/3661505951","cluster_addr":"172.21.15.172:6819/3661505951","heartbeat_back_addr":"172.21.15.172:6823/3661505951","heartbeat_front_addr":"172.21.15.172:6821/3661505951","state":["exists","up"]},{"osd":9,"uuid":"c97b8221-8cf9-4fab-9e27-ff7f3bd98152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6827","nonce":72036667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6829","nonce":72036667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6833","nonce":72036667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6831","nonce":72036667}]},"public_addr":"172.21.15.5:6827/72036667","cluster_addr":"172.21.15.5:6829/72036667","heartbeat_back_addr":"172.21.15.5:6833/72036667","heartbeat_front_addr":"172.21.15.5:6831/72036667","state":["exists","up"]},{"osd":10,"uuid":"143376c1-f3f1-4df4-bcd3-a9b46fad8c1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6825","nonce":3334483164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6827","nonce":3334483164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6831","nonce":3334483164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6829","nonce":3334483164}]},"public_addr":"172.21.15.159:6825/3334483164","cluster_addr":"172.21.15.159:6827/3334483164","heartbeat_back_addr":"172.21.15.159:6831/3334483164","heartbeat_front_addr":"172.21.15.159:6829/3334483164","state":["exists","up"]},{"osd":11,"uuid":"5cc91ff9-fc0f-4e7a-8e4d-87df0e7efbeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6825","nonce":1965415663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6827","nonce":1965415663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6831","nonce":1965415663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6829","nonce":1965415663}]},"public_addr":"172.21.15.172:6825/1965415663","cluster_addr":"172.21.15.172:6827/1965415663","heartbeat_back_addr":"172.21.15.172:6831/1965415663","heartbeat_front_addr":"172.21.15.172:6829/1965415663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:21:13.024707+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:21:38.063741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:22:02.221583+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:22:27.919711+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:22:53.870543+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:23:18.539905+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:23:43.694229+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:24:08.984704+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:24:34.378582+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:25:00.102231+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:25:25.367178+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:25:51.439033+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/2713701762":"2024-09-12T23:19:50.031855+0000","172.21.15.5:0/3135835713":"2024-09-12T23:19:50.031855+0000","172.21.15.5:0/3935034940":"2024-09-12T23:19:50.031855+0000","172.21.15.5:6801/1790126649":"2024-09-12T23:19:50.031855+0000","172.21.15.5:6801/1358356358":"2024-09-12T23:19:26.149011+0000","172.21.15.5:6800/1790126649":"2024-09-12T23:19:50.031855+0000","172.21.15.5:6800/1358356358":"2024-09-12T23:19:26.149011+0000","172.21.15.5:0/2243688290":"2024-09-12T23:19:26.149011+0000","172.21.15.5:0/1493331899":"2024-09-12T23:19:26.149011+0000","172.21.15.5:0/2329812802":"2024-09-12T23:19:26.149011+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:27:46.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.432+0000 7f5067357640 1 -- 172.21.15.5:0/951822161 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f504c0a2c10 msgr2=0x7f504c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:46.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.432+0000 7f5067357640 1 --2- 172.21.15.5:0/951822161 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f504c0a2c10 0x7f504c0a50d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f50601024e0 tx=0x7f5050008040 comp rx=0 tx=0).stop 2024-09-11T23:27:46.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.432+0000 7f5067357640 1 -- 172.21.15.5:0/951822161 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5060102df0 msgr2=0x7f5060100a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:46.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.432+0000 7f5067357640 1 --2- 172.21.15.5:0/951822161 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5060102df0 0x7f5060100a50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f505c005940 tx=0x7f505c004270 comp rx=0 tx=0).stop 2024-09-11T23:27:46.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.432+0000 7f5067357640 1 -- 172.21.15.5:0/951822161 shutdown_connections 2024-09-11T23:27:46.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.432+0000 7f5067357640 1 --2- 172.21.15.5:0/951822161 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f504c0a2c10 0x7f504c0a50d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:46.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.432+0000 7f5067357640 1 --2- 172.21.15.5:0/951822161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f506010c2f0 0x7f50601014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:46.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.432+0000 7f5067357640 1 --2- 172.21.15.5:0/951822161 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50601037a0 0x7f5060100f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:46.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.432+0000 7f5067357640 1 --2- 172.21.15.5:0/951822161 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5060102df0 0x7f5060100a50 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:46.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.432+0000 7f5067357640 1 -- 172.21.15.5:0/951822161 >> 172.21.15.5:0/951822161 conn(0x7f50600fc7d0 msgr2=0x7f50600fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:46.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.432+0000 7f5067357640 1 -- 172.21.15.5:0/951822161 shutdown_connections 2024-09-11T23:27:46.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:46.432+0000 7f5067357640 1 -- 172.21.15.5:0/951822161 wait complete. 2024-09-11T23:27:47.116 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-11T23:27:47.116 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-11T23:27:47.117 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-11T23:27:47.117 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-11T23:27:47.117 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-11T23:27:47.118 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-11T23:27:47.118 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-11T23:27:47.119 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-11T23:27:47.120 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-11T23:27:47.120 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-11T23:27:47.120 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-11T23:27:47.121 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-11T23:27:47.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:47 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/951822161' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:27:47.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:47 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/951822161' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:27:47.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:47 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/951822161' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:27:47.962 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:27:47.976 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:27:47.976 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:27:47.979 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:27:47.979 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:27:47.982 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:27:47.982 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:27:47.986 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:27:47.987 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:27:47.993 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:27:47.999 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:27:48.004 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:27:48.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:48 smithi159 ceph-mon[34394]: pgmap v314: 129 pgs: 129 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-09-11T23:27:48.383 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:48 smithi005 ceph-mon[31201]: pgmap v314: 129 pgs: 129 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-09-11T23:27:48.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:48 smithi172 ceph-mon[34855]: pgmap v314: 129 pgs: 129 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-09-11T23:27:49.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.190+0000 7f57f5d3f640 1 -- 172.21.15.5:0/3625603358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57f0106f10 msgr2=0x7f57f010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:49.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.190+0000 7f57f5d3f640 1 --2- 172.21.15.5:0/3625603358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57f0106f10 0x7f57f010ea90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f57e8009ca0 tx=0x7f57e802a8c0 comp rx=0 tx=0).stop 2024-09-11T23:27:49.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.190+0000 7f57f5d3f640 1 -- 172.21.15.5:0/3625603358 shutdown_connections 2024-09-11T23:27:49.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.190+0000 7f57f5d3f640 1 --2- 172.21.15.5:0/3625603358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57f0106f10 0x7f57f010ea90 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:49.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.190+0000 7f57f5d3f640 1 --2- 172.21.15.5:0/3625603358 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57f0102790 0x7f57f01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:49.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.190+0000 7f57f5d3f640 1 --2- 172.21.15.5:0/3625603358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57f0101de0 0x7f57f01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:49.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.190+0000 7f57f5d3f640 1 -- 172.21.15.5:0/3625603358 >> 172.21.15.5:0/3625603358 conn(0x7f57f00fd8c0 msgr2=0x7f57f00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:49.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.190+0000 7f57f5d3f640 1 -- 172.21.15.5:0/3625603358 shutdown_connections 2024-09-11T23:27:49.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.191+0000 7f57f5d3f640 1 -- 172.21.15.5:0/3625603358 wait complete. 2024-09-11T23:27:49.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.191+0000 7f57f5d3f640 1 Processor -- start 2024-09-11T23:27:49.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.191+0000 7f57f5d3f640 1 -- start start 2024-09-11T23:27:49.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.191+0000 7f57f5d3f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57f0101de0 0x7f57f01983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:49.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.191+0000 7f57f5d3f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57f0102790 0x7f57f01988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:49.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.191+0000 7f57f5d3f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57f0106f10 0x7f57f019cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:49.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.192+0000 7f57f5d3f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f57f0111e20 con 0x7f57f0102790 2024-09-11T23:27:49.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.192+0000 7f57f5d3f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f57f0111ca0 con 0x7f57f0106f10 2024-09-11T23:27:49.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.192+0000 7f57f5d3f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f57f0111fa0 con 0x7f57f0101de0 2024-09-11T23:27:49.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.192+0000 7f57eeffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57f0102790 0x7f57f01988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:49.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.192+0000 7f57eeffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57f0102790 0x7f57f01988e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42642/0 (socket says 172.21.15.5:42642) 2024-09-11T23:27:49.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.192+0000 7f57eeffd640 1 -- 172.21.15.5:0/3801794008 learned_addr learned my addr 172.21.15.5:0/3801794008 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:27:49.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.192+0000 7f57ef7fe640 1 --2- 172.21.15.5:0/3801794008 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57f0101de0 0x7f57f01983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:49.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.192+0000 7f57effff640 1 --2- 172.21.15.5:0/3801794008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57f0106f10 0x7f57f019cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:49.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.192+0000 7f57eeffd640 1 -- 172.21.15.5:0/3801794008 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57f0101de0 msgr2=0x7f57f01983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:49.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.192+0000 7f57eeffd640 1 --2- 172.21.15.5:0/3801794008 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57f0101de0 0x7f57f01983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:49.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.192+0000 7f57eeffd640 1 -- 172.21.15.5:0/3801794008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57f0106f10 msgr2=0x7f57f019cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:49.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.192+0000 7f57eeffd640 1 --2- 172.21.15.5:0/3801794008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57f0106f10 0x7f57f019cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:49.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.192+0000 7f57eeffd640 1 -- 172.21.15.5:0/3801794008 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57f019d350 con 0x7f57f0102790 2024-09-11T23:27:49.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.192+0000 7f57eeffd640 1 --2- 172.21.15.5:0/3801794008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57f0102790 0x7f57f01988e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f57e400d950 tx=0x7f57e400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:49.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.192+0000 7f57ecff9640 1 -- 172.21.15.5:0/3801794008 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e4017030 con 0x7f57f0102790 2024-09-11T23:27:49.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.192+0000 7f57ecff9640 1 -- 172.21.15.5:0/3801794008 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f57e4004020 con 0x7f57f0102790 2024-09-11T23:27:49.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.192+0000 7f57f5d3f640 1 -- 172.21.15.5:0/3801794008 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57f019d640 con 0x7f57f0102790 2024-09-11T23:27:49.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.192+0000 7f57ecff9640 1 -- 172.21.15.5:0/3801794008 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e40047a0 con 0x7f57f0102790 2024-09-11T23:27:49.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.192+0000 7f57f5d3f640 1 -- 172.21.15.5:0/3801794008 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57f01a4f20 con 0x7f57f0102790 2024-09-11T23:27:49.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.193+0000 7f57f5d3f640 1 -- 172.21.15.5:0/3801794008 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f57f0062900 con 0x7f57f0102790 2024-09-11T23:27:49.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.195+0000 7f57ecff9640 1 -- 172.21.15.5:0/3801794008 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f57e40041d0 con 0x7f57f0102790 2024-09-11T23:27:49.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.195+0000 7f57ecff9640 1 --2- 172.21.15.5:0/3801794008 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f57d80a2c90 0x7f57d80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:49.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.195+0000 7f57ecff9640 1 -- 172.21.15.5:0/3801794008 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9071+0+0 (secure 0 0 0) 0x7f57e40cf510 con 0x7f57f0102790 2024-09-11T23:27:49.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.195+0000 7f57ef7fe640 1 --2- 172.21.15.5:0/3801794008 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f57d80a2c90 0x7f57d80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:49.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.195+0000 7f57ecff9640 1 --2- 172.21.15.5:0/3801794008 >> [v2:172.21.15.172:6800/299915717,v1:172.21.15.172:6801/299915717] conn(0x7f57d80adde0 0x7f57d80b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:49.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.195+0000 7f57ecff9640 1 -- 172.21.15.5:0/3801794008 --> [v2:172.21.15.172:6800/299915717,v1:172.21.15.172:6801/299915717] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f57e40056a0 con 0x7f57d80adde0 2024-09-11T23:27:49.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.195+0000 7f57ecff9640 1 -- 172.21.15.5:0/3801794008 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f57e40cf8c0 con 0x7f57f0102790 2024-09-11T23:27:49.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.196+0000 7f57ef7fe640 1 --2- 172.21.15.5:0/3801794008 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f57d80a2c90 0x7f57d80a5150 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f57e0005fd0 tx=0x7f57e000b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:49.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.196+0000 7f57effff640 1 --2- 172.21.15.5:0/3801794008 >> [v2:172.21.15.172:6800/299915717,v1:172.21.15.172:6801/299915717] conn(0x7f57d80adde0 0x7f57d80b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:49.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.196+0000 7f57effff640 1 --2- 172.21.15.5:0/3801794008 >> [v2:172.21.15.172:6800/299915717,v1:172.21.15.172:6801/299915717] conn(0x7f57d80adde0 0x7f57d80b0280 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:49.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.197+0000 7f57ecff9640 1 -- 172.21.15.5:0/3801794008 <== osd.2 v2:172.21.15.172:6800/299915717 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f57e40056a0 con 0x7f57d80adde0 2024-09-11T23:27:49.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.211+0000 7f57f5d3f640 1 -- 172.21.15.5:0/3801794008 --> [v2:172.21.15.172:6800/299915717,v1:172.21.15.172:6801/299915717] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f57f0062d00 con 0x7f57d80adde0 2024-09-11T23:27:49.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.211+0000 7f57ecff9640 1 -- 172.21.15.5:0/3801794008 <== osd.2 v2:172.21.15.172:6800/299915717 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f57f0062d00 con 0x7f57d80adde0 2024-09-11T23:27:49.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.212+0000 7f57f5d3f640 1 -- 172.21.15.5:0/3801794008 >> [v2:172.21.15.172:6800/299915717,v1:172.21.15.172:6801/299915717] conn(0x7f57d80adde0 msgr2=0x7f57d80b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:49.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.212+0000 7f57f5d3f640 1 --2- 172.21.15.5:0/3801794008 >> [v2:172.21.15.172:6800/299915717,v1:172.21.15.172:6801/299915717] conn(0x7f57d80adde0 0x7f57d80b0280 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:49.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.212+0000 7f57f5d3f640 1 -- 172.21.15.5:0/3801794008 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f57d80a2c90 msgr2=0x7f57d80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:49.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.212+0000 7f57f5d3f640 1 --2- 172.21.15.5:0/3801794008 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f57d80a2c90 0x7f57d80a5150 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f57e0005fd0 tx=0x7f57e000b390 comp rx=0 tx=0).stop 2024-09-11T23:27:49.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.212+0000 7f57f5d3f640 1 -- 172.21.15.5:0/3801794008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57f0102790 msgr2=0x7f57f01988e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:49.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.212+0000 7f57f5d3f640 1 --2- 172.21.15.5:0/3801794008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57f0102790 0x7f57f01988e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f57e400d950 tx=0x7f57e400de10 comp rx=0 tx=0).stop 2024-09-11T23:27:49.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.212+0000 7f57effff640 1 -- 172.21.15.5:0/3801794008 reap_dead start 2024-09-11T23:27:49.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.212+0000 7f57f5d3f640 1 -- 172.21.15.5:0/3801794008 shutdown_connections 2024-09-11T23:27:49.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.212+0000 7f57f5d3f640 1 -- 172.21.15.5:0/3801794008 >> 172.21.15.5:0/3801794008 conn(0x7f57f00fd8c0 msgr2=0x7f57f00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:49.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.212+0000 7f57f5d3f640 1 -- 172.21.15.5:0/3801794008 shutdown_connections 2024-09-11T23:27:49.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.212+0000 7f57f5d3f640 1 -- 172.21.15.5:0/3801794008 wait complete. 2024-09-11T23:27:49.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.473+0000 7fe4b1834640 1 -- 172.21.15.5:0/3467686796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4ac106f10 msgr2=0x7fe4ac10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:49.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.473+0000 7fe4b1834640 1 --2- 172.21.15.5:0/3467686796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4ac106f10 0x7fe4ac10ea90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe4a4009ca0 tx=0x7fe4a402a8c0 comp rx=0 tx=0).stop 2024-09-11T23:27:49.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.473+0000 7fe4b1834640 1 -- 172.21.15.5:0/3467686796 shutdown_connections 2024-09-11T23:27:49.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.473+0000 7fe4b1834640 1 --2- 172.21.15.5:0/3467686796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4ac106f10 0x7fe4ac10ea90 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:49.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.473+0000 7fe4b1834640 1 --2- 172.21.15.5:0/3467686796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4ac102790 0x7fe4ac1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:49.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.473+0000 7fe4b1834640 1 --2- 172.21.15.5:0/3467686796 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4ac101de0 0x7fe4ac1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:49.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.473+0000 7fe4b1834640 1 -- 172.21.15.5:0/3467686796 >> 172.21.15.5:0/3467686796 conn(0x7fe4ac0fd8c0 msgr2=0x7fe4ac0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:49.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.473+0000 7fe4b1834640 1 -- 172.21.15.5:0/3467686796 shutdown_connections 2024-09-11T23:27:49.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.473+0000 7fe4b1834640 1 -- 172.21.15.5:0/3467686796 wait complete. 2024-09-11T23:27:49.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.474+0000 7fe4b1834640 1 Processor -- start 2024-09-11T23:27:49.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.474+0000 7fe4b1834640 1 -- start start 2024-09-11T23:27:49.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.474+0000 7fe4b1834640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4ac101de0 0x7fe4ac198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:49.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.474+0000 7fe4b1834640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4ac102790 0x7fe4ac198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:49.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.474+0000 7fe4b1834640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4ac106f10 0x7fe4ac19cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:49.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.474+0000 7fe4b1834640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe4ac111e70 con 0x7fe4ac102790 2024-09-11T23:27:49.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.474+0000 7fe4b1834640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe4ac111cf0 con 0x7fe4ac101de0 2024-09-11T23:27:49.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.474+0000 7fe4b1834640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe4ac111ff0 con 0x7fe4ac106f10 2024-09-11T23:27:49.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.474+0000 7fe4a3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4ac102790 0x7fe4ac198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:49.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.474+0000 7fe4a3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4ac102790 0x7fe4ac198850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42668/0 (socket says 172.21.15.5:42668) 2024-09-11T23:27:49.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.474+0000 7fe4a3fff640 1 -- 172.21.15.5:0/2591989651 learned_addr learned my addr 172.21.15.5:0/2591989651 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:27:49.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.474+0000 7fe4aaffd640 1 --2- 172.21.15.5:0/2591989651 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4ac101de0 0x7fe4ac198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:49.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.474+0000 7fe4ab7fe640 1 --2- 172.21.15.5:0/2591989651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4ac106f10 0x7fe4ac19cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:49.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.475+0000 7fe4a3fff640 1 -- 172.21.15.5:0/2591989651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4ac106f10 msgr2=0x7fe4ac19cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:49.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.475+0000 7fe4a3fff640 1 --2- 172.21.15.5:0/2591989651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4ac106f10 0x7fe4ac19cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:49.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.475+0000 7fe4a3fff640 1 -- 172.21.15.5:0/2591989651 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4ac101de0 msgr2=0x7fe4ac198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:49.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.475+0000 7fe4a3fff640 1 --2- 172.21.15.5:0/2591989651 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4ac101de0 0x7fe4ac198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:49.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.475+0000 7fe4a3fff640 1 -- 172.21.15.5:0/2591989651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4ac19d2c0 con 0x7fe4ac102790 2024-09-11T23:27:49.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.475+0000 7fe4a3fff640 1 --2- 172.21.15.5:0/2591989651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4ac102790 0x7fe4ac198850 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe49400d770 tx=0x7fe49400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:49.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.475+0000 7fe4b0832640 1 -- 172.21.15.5:0/2591989651 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe494017070 con 0x7fe4ac102790 2024-09-11T23:27:49.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.475+0000 7fe4b1834640 1 -- 172.21.15.5:0/2591989651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4ac19d5b0 con 0x7fe4ac102790 2024-09-11T23:27:49.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.475+0000 7fe4b0832640 1 -- 172.21.15.5:0/2591989651 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe4940054d0 con 0x7fe4ac102790 2024-09-11T23:27:49.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.475+0000 7fe4b0832640 1 -- 172.21.15.5:0/2591989651 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe494004cf0 con 0x7fe4ac102790 2024-09-11T23:27:49.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.475+0000 7fe4b1834640 1 -- 172.21.15.5:0/2591989651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4ac1a4e90 con 0x7fe4ac102790 2024-09-11T23:27:49.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.476+0000 7fe4b1834640 1 -- 172.21.15.5:0/2591989651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe4ac062900 con 0x7fe4ac102790 2024-09-11T23:27:49.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.477+0000 7fe4b0832640 1 -- 172.21.15.5:0/2591989651 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fe494004e90 con 0x7fe4ac102790 2024-09-11T23:27:49.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.478+0000 7fe4b0832640 1 --2- 172.21.15.5:0/2591989651 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe4980a2c10 0x7fe4980a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:49.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.478+0000 7fe4aaffd640 1 --2- 172.21.15.5:0/2591989651 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe4980a2c10 0x7fe4980a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:49.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.478+0000 7fe4b0832640 1 -- 172.21.15.5:0/2591989651 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9071+0+0 (secure 0 0 0) 0x7fe4940cf320 con 0x7fe4ac102790 2024-09-11T23:27:49.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.478+0000 7fe4b0832640 1 --2- 172.21.15.5:0/2591989651 >> [v2:172.21.15.5:6826/72036667,v1:172.21.15.5:6827/72036667] conn(0x7fe4980add60 0x7fe4980b0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:49.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.478+0000 7fe4b0832640 1 -- 172.21.15.5:0/2591989651 --> [v2:172.21.15.5:6826/72036667,v1:172.21.15.5:6827/72036667] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe494005320 con 0x7fe4980add60 2024-09-11T23:27:49.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.478+0000 7fe4b0832640 1 -- 172.21.15.5:0/2591989651 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7fe4940cf770 con 0x7fe4ac102790 2024-09-11T23:27:49.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.478+0000 7fe4ab7fe640 1 --2- 172.21.15.5:0/2591989651 >> [v2:172.21.15.5:6826/72036667,v1:172.21.15.5:6827/72036667] conn(0x7fe4980add60 0x7fe4980b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:49.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.479+0000 7fe4aaffd640 1 --2- 172.21.15.5:0/2591989651 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe4980a2c10 0x7fe4980a50d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe49c0058c0 tx=0x7fe49c00a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:49.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.479+0000 7fe4ab7fe640 1 --2- 172.21.15.5:0/2591989651 >> [v2:172.21.15.5:6826/72036667,v1:172.21.15.5:6827/72036667] conn(0x7fe4980add60 0x7fe4980b0200 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:49.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.480+0000 7fe4b0832640 1 -- 172.21.15.5:0/2591989651 <== osd.9 v2:172.21.15.5:6826/72036667 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe494005320 con 0x7fe4980add60 2024-09-11T23:27:49.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.493+0000 7fe4b1834640 1 -- 172.21.15.5:0/2591989651 --> [v2:172.21.15.5:6826/72036667,v1:172.21.15.5:6827/72036667] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe4ac062d80 con 0x7fe4980add60 2024-09-11T23:27:49.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.494+0000 7fe4b0832640 1 -- 172.21.15.5:0/2591989651 <== osd.9 v2:172.21.15.5:6826/72036667 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe4ac062d80 con 0x7fe4980add60 2024-09-11T23:27:49.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.494+0000 7fe4b1834640 1 -- 172.21.15.5:0/2591989651 >> [v2:172.21.15.5:6826/72036667,v1:172.21.15.5:6827/72036667] conn(0x7fe4980add60 msgr2=0x7fe4980b0200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:49.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.494+0000 7fe4b1834640 1 --2- 172.21.15.5:0/2591989651 >> [v2:172.21.15.5:6826/72036667,v1:172.21.15.5:6827/72036667] conn(0x7fe4980add60 0x7fe4980b0200 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:49.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.494+0000 7fe4b1834640 1 -- 172.21.15.5:0/2591989651 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe4980a2c10 msgr2=0x7fe4980a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:49.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.494+0000 7fe4b1834640 1 --2- 172.21.15.5:0/2591989651 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe4980a2c10 0x7fe4980a50d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe49c0058c0 tx=0x7fe49c00a2d0 comp rx=0 tx=0).stop 2024-09-11T23:27:49.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.494+0000 7fe4b1834640 1 -- 172.21.15.5:0/2591989651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4ac102790 msgr2=0x7fe4ac198850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:49.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.494+0000 7fe4b1834640 1 --2- 172.21.15.5:0/2591989651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4ac102790 0x7fe4ac198850 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe49400d770 tx=0x7fe49400dc30 comp rx=0 tx=0).stop 2024-09-11T23:27:49.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.494+0000 7fe4ab7fe640 1 -- 172.21.15.5:0/2591989651 reap_dead start 2024-09-11T23:27:49.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.494+0000 7fe4b1834640 1 -- 172.21.15.5:0/2591989651 shutdown_connections 2024-09-11T23:27:49.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.494+0000 7fe4b1834640 1 -- 172.21.15.5:0/2591989651 >> 172.21.15.5:0/2591989651 conn(0x7fe4ac0fd8c0 msgr2=0x7fe4ac0fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:49.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.494+0000 7fe4b1834640 1 -- 172.21.15.5:0/2591989651 shutdown_connections 2024-09-11T23:27:49.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:49.494+0000 7fe4b1834640 1 -- 172.21.15.5:0/2591989651 wait complete. 2024-09-11T23:27:50.198 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:50 smithi005 ceph-mon[31201]: pgmap v315: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.1 KiB/s wr, 7 op/s 2024-09-11T23:27:50.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.284+0000 7f3e17da8640 1 -- 172.21.15.5:0/2472491826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e10102da0 msgr2=0x7f3e10103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:50.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.284+0000 7f3e17da8640 1 --2- 172.21.15.5:0/2472491826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e10102da0 0x7f3e10103180 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c009900 tx=0x7f3e0c02a480 comp rx=0 tx=0).stop 2024-09-11T23:27:50.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.284+0000 7f3e17da8640 1 -- 172.21.15.5:0/2472491826 shutdown_connections 2024-09-11T23:27:50.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.284+0000 7f3e17da8640 1 --2- 172.21.15.5:0/2472491826 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e1010c180 0x7f3e1010e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:50.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.284+0000 7f3e17da8640 1 --2- 172.21.15.5:0/2472491826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e101036c0 0x7f3e1010bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:50.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.284+0000 7f3e17da8640 1 --2- 172.21.15.5:0/2472491826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e10102da0 0x7f3e10103180 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:50.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.284+0000 7f3e17da8640 1 -- 172.21.15.5:0/2472491826 >> 172.21.15.5:0/2472491826 conn(0x7f3e100fc7a0 msgr2=0x7f3e100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:50.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.284+0000 7f3e17da8640 1 -- 172.21.15.5:0/2472491826 shutdown_connections 2024-09-11T23:27:50.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.284+0000 7f3e17da8640 1 -- 172.21.15.5:0/2472491826 wait complete. 2024-09-11T23:27:50.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.285+0000 7f3e17da8640 1 Processor -- start 2024-09-11T23:27:50.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.285+0000 7f3e17da8640 1 -- start start 2024-09-11T23:27:50.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.285+0000 7f3e17da8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e10102da0 0x7f3e10198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:50.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.285+0000 7f3e17da8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e101036c0 0x7f3e101988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:50.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.285+0000 7f3e17da8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e1010c180 0x7f3e1019cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:50.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.285+0000 7f3e17da8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3e10111e10 con 0x7f3e1010c180 2024-09-11T23:27:50.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.285+0000 7f3e17da8640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3e10111c90 con 0x7f3e10102da0 2024-09-11T23:27:50.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.285+0000 7f3e17da8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3e10111f90 con 0x7f3e101036c0 2024-09-11T23:27:50.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.285+0000 7f3e16345640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e1010c180 0x7f3e1019cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:50.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.285+0000 7f3e16345640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e1010c180 0x7f3e1019cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42694/0 (socket says 172.21.15.5:42694) 2024-09-11T23:27:50.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.285+0000 7f3e16345640 1 -- 172.21.15.5:0/2691361401 learned_addr learned my addr 172.21.15.5:0/2691361401 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:27:50.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.285+0000 7f3e15b44640 1 --2- 172.21.15.5:0/2691361401 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e10102da0 0x7f3e10198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:50.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.285+0000 7f3e15343640 1 --2- 172.21.15.5:0/2691361401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e101036c0 0x7f3e101988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:50.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.286+0000 7f3e16345640 1 -- 172.21.15.5:0/2691361401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e101036c0 msgr2=0x7f3e101988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:50.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.286+0000 7f3e16345640 1 --2- 172.21.15.5:0/2691361401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e101036c0 0x7f3e101988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:50.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.286+0000 7f3e16345640 1 -- 172.21.15.5:0/2691361401 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e10102da0 msgr2=0x7f3e10198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:50.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.286+0000 7f3e16345640 1 --2- 172.21.15.5:0/2691361401 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e10102da0 0x7f3e10198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:50.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.286+0000 7f3e16345640 1 -- 172.21.15.5:0/2691361401 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e1019d340 con 0x7f3e1010c180 2024-09-11T23:27:50.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.286+0000 7f3e16345640 1 --2- 172.21.15.5:0/2691361401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e1010c180 0x7f3e1019cc60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3e0800cad0 tx=0x7f3e0800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:50.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.286+0000 7f3e06ffd640 1 -- 172.21.15.5:0/2691361401 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0800ae20 con 0x7f3e1010c180 2024-09-11T23:27:50.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.286+0000 7f3e06ffd640 1 -- 172.21.15.5:0/2691361401 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3e08005020 con 0x7f3e1010c180 2024-09-11T23:27:50.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.286+0000 7f3e17da8640 1 -- 172.21.15.5:0/2691361401 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e1019d630 con 0x7f3e1010c180 2024-09-11T23:27:50.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.286+0000 7f3e06ffd640 1 -- 172.21.15.5:0/2691361401 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0800f6b0 con 0x7f3e1010c180 2024-09-11T23:27:50.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.286+0000 7f3e17da8640 1 -- 172.21.15.5:0/2691361401 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e101a4f10 con 0x7f3e1010c180 2024-09-11T23:27:50.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.287+0000 7f3e17da8640 1 -- 172.21.15.5:0/2691361401 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3e10062980 con 0x7f3e1010c180 2024-09-11T23:27:50.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.288+0000 7f3e06ffd640 1 -- 172.21.15.5:0/2691361401 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f3e080051d0 con 0x7f3e1010c180 2024-09-11T23:27:50.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.289+0000 7f3e06ffd640 1 --2- 172.21.15.5:0/2691361401 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f3dfc0a2c10 0x7f3dfc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:50.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.289+0000 7f3e15b44640 1 --2- 172.21.15.5:0/2691361401 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f3dfc0a2c10 0x7f3dfc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:50.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.289+0000 7f3e06ffd640 1 -- 172.21.15.5:0/2691361401 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9071+0+0 (secure 0 0 0) 0x7f3e080cf940 con 0x7f3e1010c180 2024-09-11T23:27:50.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.289+0000 7f3e06ffd640 1 --2- 172.21.15.5:0/2691361401 >> [v2:172.21.15.172:6824/1965415663,v1:172.21.15.172:6825/1965415663] conn(0x7f3dfc0add60 0x7f3dfc0b0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:50.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.289+0000 7f3e06ffd640 1 -- 172.21.15.5:0/2691361401 --> [v2:172.21.15.172:6824/1965415663,v1:172.21.15.172:6825/1965415663] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3e08012ec0 con 0x7f3dfc0add60 2024-09-11T23:27:50.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.289+0000 7f3e06ffd640 1 -- 172.21.15.5:0/2691361401 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f3e080cfcf0 con 0x7f3e1010c180 2024-09-11T23:27:50.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.290+0000 7f3e15b44640 1 --2- 172.21.15.5:0/2691361401 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f3dfc0a2c10 0x7f3dfc0a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c031440 tx=0x7f3e0c005b50 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:50.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.290+0000 7f3e15343640 1 --2- 172.21.15.5:0/2691361401 >> [v2:172.21.15.172:6824/1965415663,v1:172.21.15.172:6825/1965415663] conn(0x7f3dfc0add60 0x7f3dfc0b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:50.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.290+0000 7f3e15343640 1 --2- 172.21.15.5:0/2691361401 >> [v2:172.21.15.172:6824/1965415663,v1:172.21.15.172:6825/1965415663] conn(0x7f3dfc0add60 0x7f3dfc0b0200 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:50.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.291+0000 7f3e06ffd640 1 -- 172.21.15.5:0/2691361401 <== osd.11 v2:172.21.15.172:6824/1965415663 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3e08012ec0 con 0x7f3dfc0add60 2024-09-11T23:27:50.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.305+0000 7f3e17da8640 1 -- 172.21.15.5:0/2691361401 --> [v2:172.21.15.172:6824/1965415663,v1:172.21.15.172:6825/1965415663] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3e10062e00 con 0x7f3dfc0add60 2024-09-11T23:27:50.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.305+0000 7f3e06ffd640 1 -- 172.21.15.5:0/2691361401 <== osd.11 v2:172.21.15.172:6824/1965415663 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3e10062e00 con 0x7f3dfc0add60 2024-09-11T23:27:50.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.305+0000 7f3e17da8640 1 -- 172.21.15.5:0/2691361401 >> [v2:172.21.15.172:6824/1965415663,v1:172.21.15.172:6825/1965415663] conn(0x7f3dfc0add60 msgr2=0x7f3dfc0b0200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:50.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.305+0000 7f3e17da8640 1 --2- 172.21.15.5:0/2691361401 >> [v2:172.21.15.172:6824/1965415663,v1:172.21.15.172:6825/1965415663] conn(0x7f3dfc0add60 0x7f3dfc0b0200 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:50.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.306+0000 7f3e17da8640 1 -- 172.21.15.5:0/2691361401 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f3dfc0a2c10 msgr2=0x7f3dfc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:50.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.306+0000 7f3e17da8640 1 --2- 172.21.15.5:0/2691361401 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f3dfc0a2c10 0x7f3dfc0a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c031440 tx=0x7f3e0c005b50 comp rx=0 tx=0).stop 2024-09-11T23:27:50.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.306+0000 7f3e17da8640 1 -- 172.21.15.5:0/2691361401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e1010c180 msgr2=0x7f3e1019cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:50.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.306+0000 7f3e17da8640 1 --2- 172.21.15.5:0/2691361401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e1010c180 0x7f3e1019cc60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3e0800cad0 tx=0x7f3e0800cf90 comp rx=0 tx=0).stop 2024-09-11T23:27:50.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.306+0000 7f3e16345640 1 -- 172.21.15.5:0/2691361401 reap_dead start 2024-09-11T23:27:50.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.306+0000 7f3e17da8640 1 -- 172.21.15.5:0/2691361401 shutdown_connections 2024-09-11T23:27:50.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.306+0000 7f3e17da8640 1 -- 172.21.15.5:0/2691361401 >> 172.21.15.5:0/2691361401 conn(0x7f3e100fc7a0 msgr2=0x7f3e100fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:50.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.306+0000 7f3e17da8640 1 -- 172.21.15.5:0/2691361401 shutdown_connections 2024-09-11T23:27:50.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:50.306+0000 7f3e17da8640 1 -- 172.21.15.5:0/2691361401 wait complete. 2024-09-11T23:27:50.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:50 smithi159 ceph-mon[34394]: pgmap v315: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.1 KiB/s wr, 7 op/s 2024-09-11T23:27:50.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:50 smithi172 ceph-mon[34855]: pgmap v315: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.1 KiB/s wr, 7 op/s 2024-09-11T23:27:51.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.045+0000 7f23abe54640 1 -- 172.21.15.5:0/1250557636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23a4100a80 msgr2=0x7f23a4100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:51.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.045+0000 7f23abe54640 1 --2- 172.21.15.5:0/1250557636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23a4100a80 0x7f23a4100ee0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2394009930 tx=0x7f239402a420 comp rx=0 tx=0).stop 2024-09-11T23:27:51.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.045+0000 7f23abe54640 1 -- 172.21.15.5:0/1250557636 shutdown_connections 2024-09-11T23:27:51.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.045+0000 7f23abe54640 1 --2- 172.21.15.5:0/1250557636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23a4101420 0x7f23a410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:51.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.045+0000 7f23abe54640 1 --2- 172.21.15.5:0/1250557636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23a4100a80 0x7f23a4100ee0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:51.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.045+0000 7f23abe54640 1 --2- 172.21.15.5:0/1250557636 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23a4106a80 0x7f23a4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:51.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.045+0000 7f23abe54640 1 -- 172.21.15.5:0/1250557636 >> 172.21.15.5:0/1250557636 conn(0x7f23a40fc7a0 msgr2=0x7f23a40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:51.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.045+0000 7f23abe54640 1 -- 172.21.15.5:0/1250557636 shutdown_connections 2024-09-11T23:27:51.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.045+0000 7f23abe54640 1 -- 172.21.15.5:0/1250557636 wait complete. 2024-09-11T23:27:51.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.046+0000 7f23abe54640 1 Processor -- start 2024-09-11T23:27:51.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.046+0000 7f23abe54640 1 -- start start 2024-09-11T23:27:51.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.046+0000 7f23abe54640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23a4100a80 0x7f23a41991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:51.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.046+0000 7f23abe54640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23a4101420 0x7f23a4199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:51.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.046+0000 7f23abe54640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23a4106a80 0x7f23a41a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:51.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.046+0000 7f23abe54640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f23a4110cf0 con 0x7f23a4106a80 2024-09-11T23:27:51.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.046+0000 7f23abe54640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f23a4110b70 con 0x7f23a4100a80 2024-09-11T23:27:51.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.046+0000 7f23abe54640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f23a4110e70 con 0x7f23a4101420 2024-09-11T23:27:51.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.046+0000 7f23aa3f1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23a4106a80 0x7f23a41a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:51.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.047+0000 7f23aa3f1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23a4106a80 0x7f23a41a4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42716/0 (socket says 172.21.15.5:42716) 2024-09-11T23:27:51.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.047+0000 7f23aa3f1640 1 -- 172.21.15.5:0/298842230 learned_addr learned my addr 172.21.15.5:0/298842230 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:27:51.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.047+0000 7f23a9bf0640 1 --2- 172.21.15.5:0/298842230 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23a4100a80 0x7f23a41991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:51.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.047+0000 7f23a93ef640 1 --2- 172.21.15.5:0/298842230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23a4101420 0x7f23a4199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:51.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.047+0000 7f23aa3f1640 1 -- 172.21.15.5:0/298842230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23a4101420 msgr2=0x7f23a4199700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:51.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.047+0000 7f23aa3f1640 1 --2- 172.21.15.5:0/298842230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23a4101420 0x7f23a4199700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:51.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.047+0000 7f23aa3f1640 1 -- 172.21.15.5:0/298842230 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23a4100a80 msgr2=0x7f23a41991c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:51.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.047+0000 7f23aa3f1640 1 --2- 172.21.15.5:0/298842230 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23a4100a80 0x7f23a41991c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:51.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.047+0000 7f23aa3f1640 1 -- 172.21.15.5:0/298842230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23a41a4780 con 0x7f23a4106a80 2024-09-11T23:27:51.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.047+0000 7f23aa3f1640 1 --2- 172.21.15.5:0/298842230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23a4106a80 0x7f23a41a4240 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f239c00eb10 tx=0x7f239c00ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:51.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.047+0000 7f239affd640 1 -- 172.21.15.5:0/298842230 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239c00ce20 con 0x7f23a4106a80 2024-09-11T23:27:51.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.047+0000 7f239affd640 1 -- 172.21.15.5:0/298842230 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f239c005020 con 0x7f23a4106a80 2024-09-11T23:27:51.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.047+0000 7f23abe54640 1 -- 172.21.15.5:0/298842230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23a41a4950 con 0x7f23a4106a80 2024-09-11T23:27:51.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.047+0000 7f239affd640 1 -- 172.21.15.5:0/298842230 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239c010690 con 0x7f23a4106a80 2024-09-11T23:27:51.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.047+0000 7f23abe54640 1 -- 172.21.15.5:0/298842230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23a41a4e10 con 0x7f23a4106a80 2024-09-11T23:27:51.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.048+0000 7f23abe54640 1 -- 172.21.15.5:0/298842230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f23a40628c0 con 0x7f23a4106a80 2024-09-11T23:27:51.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.049+0000 7f239affd640 1 -- 172.21.15.5:0/298842230 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f239c0051d0 con 0x7f23a4106a80 2024-09-11T23:27:51.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.050+0000 7f239affd640 1 --2- 172.21.15.5:0/298842230 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f23900a2c10 0x7f23900a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:51.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.050+0000 7f23a9bf0640 1 --2- 172.21.15.5:0/298842230 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f23900a2c10 0x7f23900a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:51.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.050+0000 7f239affd640 1 -- 172.21.15.5:0/298842230 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9071+0+0 (secure 0 0 0) 0x7f239c0cff80 con 0x7f23a4106a80 2024-09-11T23:27:51.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.050+0000 7f239affd640 1 --2- 172.21.15.5:0/298842230 >> [v2:172.21.15.159:6816/4222571927,v1:172.21.15.159:6817/4222571927] conn(0x7f23900add60 0x7f23900b0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:51.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.050+0000 7f239affd640 1 -- 172.21.15.5:0/298842230 --> [v2:172.21.15.159:6816/4222571927,v1:172.21.15.159:6817/4222571927] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f23900b08d0 con 0x7f23900add60 2024-09-11T23:27:51.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.050+0000 7f239affd640 1 -- 172.21.15.5:0/298842230 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f239c0d03d0 con 0x7f23a4106a80 2024-09-11T23:27:51.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.051+0000 7f23a9bf0640 1 --2- 172.21.15.5:0/298842230 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f23900a2c10 0x7f23900a50d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f23a000ab60 tx=0x7f23a000a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:51.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.051+0000 7f23a93ef640 1 --2- 172.21.15.5:0/298842230 >> [v2:172.21.15.159:6816/4222571927,v1:172.21.15.159:6817/4222571927] conn(0x7f23900add60 0x7f23900b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:51.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.051+0000 7f23a93ef640 1 --2- 172.21.15.5:0/298842230 >> [v2:172.21.15.159:6816/4222571927,v1:172.21.15.159:6817/4222571927] conn(0x7f23900add60 0x7f23900b0200 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:51.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.052+0000 7f239affd640 1 -- 172.21.15.5:0/298842230 <== osd.7 v2:172.21.15.159:6816/4222571927 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f23900b08d0 con 0x7f23900add60 2024-09-11T23:27:51.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.066+0000 7f23abe54640 1 -- 172.21.15.5:0/298842230 --> [v2:172.21.15.159:6816/4222571927,v1:172.21.15.159:6817/4222571927] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f23a4062d40 con 0x7f23900add60 2024-09-11T23:27:51.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.067+0000 7f239affd640 1 -- 172.21.15.5:0/298842230 <== osd.7 v2:172.21.15.159:6816/4222571927 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f23a4062d40 con 0x7f23900add60 2024-09-11T23:27:51.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.067+0000 7f23abe54640 1 -- 172.21.15.5:0/298842230 >> [v2:172.21.15.159:6816/4222571927,v1:172.21.15.159:6817/4222571927] conn(0x7f23900add60 msgr2=0x7f23900b0200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:51.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.067+0000 7f23abe54640 1 --2- 172.21.15.5:0/298842230 >> [v2:172.21.15.159:6816/4222571927,v1:172.21.15.159:6817/4222571927] conn(0x7f23900add60 0x7f23900b0200 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:51.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.067+0000 7f23abe54640 1 -- 172.21.15.5:0/298842230 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f23900a2c10 msgr2=0x7f23900a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:51.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.067+0000 7f23abe54640 1 --2- 172.21.15.5:0/298842230 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f23900a2c10 0x7f23900a50d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f23a000ab60 tx=0x7f23a000a2d0 comp rx=0 tx=0).stop 2024-09-11T23:27:51.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.067+0000 7f23abe54640 1 -- 172.21.15.5:0/298842230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23a4106a80 msgr2=0x7f23a41a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:51.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.067+0000 7f23abe54640 1 --2- 172.21.15.5:0/298842230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23a4106a80 0x7f23a41a4240 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f239c00eb10 tx=0x7f239c00ef10 comp rx=0 tx=0).stop 2024-09-11T23:27:51.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.067+0000 7f23aa3f1640 1 -- 172.21.15.5:0/298842230 reap_dead start 2024-09-11T23:27:51.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.067+0000 7f23abe54640 1 -- 172.21.15.5:0/298842230 shutdown_connections 2024-09-11T23:27:51.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.067+0000 7f23abe54640 1 -- 172.21.15.5:0/298842230 >> 172.21.15.5:0/298842230 conn(0x7f23a40fc7a0 msgr2=0x7f23a40fd060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:51.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.067+0000 7f23abe54640 1 -- 172.21.15.5:0/298842230 shutdown_connections 2024-09-11T23:27:51.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.067+0000 7f23abe54640 1 -- 172.21.15.5:0/298842230 wait complete. 2024-09-11T23:27:51.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:51 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]: dispatch 2024-09-11T23:27:51.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:51 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 10]}]: dispatch 2024-09-11T23:27:51.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:51 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]: dispatch 2024-09-11T23:27:51.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:51 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]: dispatch 2024-09-11T23:27:51.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:51 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]: dispatch 2024-09-11T23:27:51.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:51 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 10]}]: dispatch 2024-09-11T23:27:51.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:51 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]: dispatch 2024-09-11T23:27:51.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:51 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]: dispatch 2024-09-11T23:27:51.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:51 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]: dispatch 2024-09-11T23:27:51.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:51 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 10]}]: dispatch 2024-09-11T23:27:51.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:51 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]: dispatch 2024-09-11T23:27:51.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:51 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]: dispatch 2024-09-11T23:27:51.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.936+0000 7fc05c5a5640 1 -- 172.21.15.5:0/4131588666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc054106f10 msgr2=0x7fc05410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:51.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.936+0000 7fc05c5a5640 1 --2- 172.21.15.5:0/4131588666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc054106f10 0x7fc05410ea90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc044009ca0 tx=0x7fc04402a8c0 comp rx=0 tx=0).stop 2024-09-11T23:27:51.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.936+0000 7fc05c5a5640 1 -- 172.21.15.5:0/4131588666 shutdown_connections 2024-09-11T23:27:51.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.936+0000 7fc05c5a5640 1 --2- 172.21.15.5:0/4131588666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc054106f10 0x7fc05410ea90 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:51.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.936+0000 7fc05c5a5640 1 --2- 172.21.15.5:0/4131588666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc054102790 0x7fc0541067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:51.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.936+0000 7fc05c5a5640 1 --2- 172.21.15.5:0/4131588666 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc054101de0 0x7fc0541021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:51.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.936+0000 7fc05c5a5640 1 -- 172.21.15.5:0/4131588666 >> 172.21.15.5:0/4131588666 conn(0x7fc0540fd8c0 msgr2=0x7fc0540ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:51.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.936+0000 7fc05c5a5640 1 -- 172.21.15.5:0/4131588666 shutdown_connections 2024-09-11T23:27:51.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.936+0000 7fc05c5a5640 1 -- 172.21.15.5:0/4131588666 wait complete. 2024-09-11T23:27:51.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.937+0000 7fc05c5a5640 1 Processor -- start 2024-09-11T23:27:51.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.937+0000 7fc05c5a5640 1 -- start start 2024-09-11T23:27:51.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.937+0000 7fc05c5a5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc054101de0 0x7fc054198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:51.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.937+0000 7fc05c5a5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc054102790 0x7fc0541987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:51.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.937+0000 7fc05c5a5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc054106f10 0x7fc05419cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:51.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.937+0000 7fc05c5a5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc054111e20 con 0x7fc054102790 2024-09-11T23:27:51.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.937+0000 7fc05c5a5640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc054111ca0 con 0x7fc054101de0 2024-09-11T23:27:51.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.937+0000 7fc05c5a5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc054111fa0 con 0x7fc054106f10 2024-09-11T23:27:51.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.937+0000 7fc059b40640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc054102790 0x7fc0541987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:51.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.937+0000 7fc059b40640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc054102790 0x7fc0541987a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42744/0 (socket says 172.21.15.5:42744) 2024-09-11T23:27:51.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.937+0000 7fc059b40640 1 -- 172.21.15.5:0/2325754124 learned_addr learned my addr 172.21.15.5:0/2325754124 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:27:51.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.937+0000 7fc05a341640 1 --2- 172.21.15.5:0/2325754124 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc054101de0 0x7fc054198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:51.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.937+0000 7fc05ab42640 1 --2- 172.21.15.5:0/2325754124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc054106f10 0x7fc05419cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:51.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.937+0000 7fc059b40640 1 -- 172.21.15.5:0/2325754124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc054106f10 msgr2=0x7fc05419cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:51.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.937+0000 7fc059b40640 1 --2- 172.21.15.5:0/2325754124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc054106f10 0x7fc05419cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:51.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.937+0000 7fc059b40640 1 -- 172.21.15.5:0/2325754124 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc054101de0 msgr2=0x7fc054198260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:51.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.937+0000 7fc059b40640 1 --2- 172.21.15.5:0/2325754124 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc054101de0 0x7fc054198260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:51.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.938+0000 7fc059b40640 1 -- 172.21.15.5:0/2325754124 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc05419d210 con 0x7fc054102790 2024-09-11T23:27:51.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.938+0000 7fc059b40640 1 --2- 172.21.15.5:0/2325754124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc054102790 0x7fc0541987a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc04800d770 tx=0x7fc04800db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:51.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.938+0000 7fc0537fe640 1 -- 172.21.15.5:0/2325754124 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc048017070 con 0x7fc054102790 2024-09-11T23:27:51.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.938+0000 7fc0537fe640 1 -- 172.21.15.5:0/2325754124 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc048009820 con 0x7fc054102790 2024-09-11T23:27:51.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.938+0000 7fc0537fe640 1 -- 172.21.15.5:0/2325754124 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc048004ba0 con 0x7fc054102790 2024-09-11T23:27:51.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.938+0000 7fc05c5a5640 1 -- 172.21.15.5:0/2325754124 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc05419d500 con 0x7fc054102790 2024-09-11T23:27:51.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.938+0000 7fc05c5a5640 1 -- 172.21.15.5:0/2325754124 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0541a4de0 con 0x7fc054102790 2024-09-11T23:27:51.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.939+0000 7fc05c5a5640 1 -- 172.21.15.5:0/2325754124 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc054062980 con 0x7fc054102790 2024-09-11T23:27:51.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.941+0000 7fc0537fe640 1 -- 172.21.15.5:0/2325754124 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fc0480099d0 con 0x7fc054102790 2024-09-11T23:27:51.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.941+0000 7fc0537fe640 1 --2- 172.21.15.5:0/2325754124 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fc03c0a2c10 0x7fc03c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:51.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.942+0000 7fc0537fe640 1 -- 172.21.15.5:0/2325754124 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9187+0+0 (secure 0 0 0) 0x7fc0480cf330 con 0x7fc054102790 2024-09-11T23:27:51.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.942+0000 7fc05a341640 1 --2- 172.21.15.5:0/2325754124 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fc03c0a2c10 0x7fc03c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:51.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.942+0000 7fc0537fe640 1 --2- 172.21.15.5:0/2325754124 >> [v2:172.21.15.159:6824/3334483164,v1:172.21.15.159:6825/3334483164] conn(0x7fc03c0adf60 0x7fc03c0b0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:51.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.942+0000 7fc0537fe640 1 -- 172.21.15.5:0/2325754124 --> [v2:172.21.15.159:6824/3334483164,v1:172.21.15.159:6825/3334483164] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc048001d30 con 0x7fc03c0adf60 2024-09-11T23:27:51.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.942+0000 7fc0537fe640 1 -- 172.21.15.5:0/2325754124 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7fc0480cf6e0 con 0x7fc054102790 2024-09-11T23:27:51.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.942+0000 7fc05a341640 1 --2- 172.21.15.5:0/2325754124 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fc03c0a2c10 0x7fc03c0a50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc04c00abe0 tx=0x7fc04c00a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:51.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.942+0000 7fc05ab42640 1 --2- 172.21.15.5:0/2325754124 >> [v2:172.21.15.159:6824/3334483164,v1:172.21.15.159:6825/3334483164] conn(0x7fc03c0adf60 0x7fc03c0b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:51.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.943+0000 7fc05ab42640 1 --2- 172.21.15.5:0/2325754124 >> [v2:172.21.15.159:6824/3334483164,v1:172.21.15.159:6825/3334483164] conn(0x7fc03c0adf60 0x7fc03c0b0400 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:51.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.944+0000 7fc0537fe640 1 -- 172.21.15.5:0/2325754124 <== osd.10 v2:172.21.15.159:6824/3334483164 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc048001d30 con 0x7fc03c0adf60 2024-09-11T23:27:51.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.957+0000 7fc05c5a5640 1 -- 172.21.15.5:0/2325754124 --> [v2:172.21.15.159:6824/3334483164,v1:172.21.15.159:6825/3334483164] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc054062e00 con 0x7fc03c0adf60 2024-09-11T23:27:51.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.958+0000 7fc0537fe640 1 -- 172.21.15.5:0/2325754124 <== osd.10 v2:172.21.15.159:6824/3334483164 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc054062e00 con 0x7fc03c0adf60 2024-09-11T23:27:51.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.958+0000 7fc05c5a5640 1 -- 172.21.15.5:0/2325754124 >> [v2:172.21.15.159:6824/3334483164,v1:172.21.15.159:6825/3334483164] conn(0x7fc03c0adf60 msgr2=0x7fc03c0b0400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:51.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.958+0000 7fc05c5a5640 1 --2- 172.21.15.5:0/2325754124 >> [v2:172.21.15.159:6824/3334483164,v1:172.21.15.159:6825/3334483164] conn(0x7fc03c0adf60 0x7fc03c0b0400 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:51.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.958+0000 7fc05c5a5640 1 -- 172.21.15.5:0/2325754124 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fc03c0a2c10 msgr2=0x7fc03c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:51.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.958+0000 7fc05c5a5640 1 --2- 172.21.15.5:0/2325754124 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fc03c0a2c10 0x7fc03c0a50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc04c00abe0 tx=0x7fc04c00a2d0 comp rx=0 tx=0).stop 2024-09-11T23:27:51.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.958+0000 7fc05c5a5640 1 -- 172.21.15.5:0/2325754124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc054102790 msgr2=0x7fc0541987a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:51.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.958+0000 7fc05c5a5640 1 --2- 172.21.15.5:0/2325754124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc054102790 0x7fc0541987a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc04800d770 tx=0x7fc04800db70 comp rx=0 tx=0).stop 2024-09-11T23:27:51.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.958+0000 7fc05ab42640 1 -- 172.21.15.5:0/2325754124 reap_dead start 2024-09-11T23:27:51.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.958+0000 7fc05c5a5640 1 -- 172.21.15.5:0/2325754124 shutdown_connections 2024-09-11T23:27:51.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.958+0000 7fc05c5a5640 1 -- 172.21.15.5:0/2325754124 >> 172.21.15.5:0/2325754124 conn(0x7fc0540fd8c0 msgr2=0x7fc0540fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:51.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.958+0000 7fc05c5a5640 1 -- 172.21.15.5:0/2325754124 shutdown_connections 2024-09-11T23:27:51.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:51.958+0000 7fc05c5a5640 1 -- 172.21.15.5:0/2325754124 wait complete. 2024-09-11T23:27:52.365 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:52 smithi005 ceph-mon[31201]: pgmap v316: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-11T23:27:52.365 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:52 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]': finished 2024-09-11T23:27:52.365 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:52 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 10]}]': finished 2024-09-11T23:27:52.366 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:52 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]': finished 2024-09-11T23:27:52.366 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:52 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]': finished 2024-09-11T23:27:52.366 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:52 smithi005 ceph-mon[31201]: osdmap e87: 12 total, 12 up, 12 in 2024-09-11T23:27:52.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:52 smithi159 ceph-mon[34394]: pgmap v316: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-11T23:27:52.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:52 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]': finished 2024-09-11T23:27:52.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:52 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 10]}]': finished 2024-09-11T23:27:52.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:52 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]': finished 2024-09-11T23:27:52.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:52 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]': finished 2024-09-11T23:27:52.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:52 smithi159 ceph-mon[34394]: osdmap e87: 12 total, 12 up, 12 in 2024-09-11T23:27:52.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:52 smithi172 ceph-mon[34855]: pgmap v316: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-11T23:27:52.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:52 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]': finished 2024-09-11T23:27:52.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:52 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 10]}]': finished 2024-09-11T23:27:52.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:52 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]': finished 2024-09-11T23:27:52.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:52 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]': finished 2024-09-11T23:27:52.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:52 smithi172 ceph-mon[34855]: osdmap e87: 12 total, 12 up, 12 in 2024-09-11T23:27:52.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.658+0000 7f70974cc640 1 -- 172.21.15.5:0/3124182350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70901036c0 msgr2=0x7f709010bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:52.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.658+0000 7f70974cc640 1 --2- 172.21.15.5:0/3124182350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70901036c0 0x7f709010bbb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f708c009900 tx=0x7f708c02a480 comp rx=0 tx=0).stop 2024-09-11T23:27:52.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.658+0000 7f70974cc640 1 -- 172.21.15.5:0/3124182350 shutdown_connections 2024-09-11T23:27:52.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.658+0000 7f70974cc640 1 --2- 172.21.15.5:0/3124182350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f709010c180 0x7f709010e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:52.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.658+0000 7f70974cc640 1 --2- 172.21.15.5:0/3124182350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70901036c0 0x7f709010bbb0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:52.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.658+0000 7f70974cc640 1 --2- 172.21.15.5:0/3124182350 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7090102da0 0x7f7090103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:52.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.658+0000 7f70974cc640 1 -- 172.21.15.5:0/3124182350 >> 172.21.15.5:0/3124182350 conn(0x7f70900fc7a0 msgr2=0x7f70900febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:52.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.659+0000 7f70974cc640 1 -- 172.21.15.5:0/3124182350 shutdown_connections 2024-09-11T23:27:52.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.659+0000 7f70974cc640 1 -- 172.21.15.5:0/3124182350 wait complete. 2024-09-11T23:27:52.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.659+0000 7f70974cc640 1 Processor -- start 2024-09-11T23:27:52.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.659+0000 7f70974cc640 1 -- start start 2024-09-11T23:27:52.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.659+0000 7f70974cc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7090102da0 0x7f7090198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:52.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.660+0000 7f70974cc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70901036c0 0x7f7090198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:52.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.660+0000 7f70974cc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f709010c180 0x7f709019cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:52.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.660+0000 7f70974cc640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7090111e50 con 0x7f7090102da0 2024-09-11T23:27:52.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.660+0000 7f70974cc640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7090111cd0 con 0x7f709010c180 2024-09-11T23:27:52.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.660+0000 7f70974cc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7090111fd0 con 0x7f70901036c0 2024-09-11T23:27:52.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.660+0000 7f7095268640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7090102da0 0x7f7090198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:52.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.660+0000 7f7095268640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7090102da0 0x7f7090198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42764/0 (socket says 172.21.15.5:42764) 2024-09-11T23:27:52.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.660+0000 7f7095268640 1 -- 172.21.15.5:0/1265536943 learned_addr learned my addr 172.21.15.5:0/1265536943 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:27:52.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.660+0000 7f7094a67640 1 --2- 172.21.15.5:0/1265536943 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70901036c0 0x7f7090198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:52.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.660+0000 7f7095a69640 1 --2- 172.21.15.5:0/1265536943 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f709010c180 0x7f709019cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:52.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.660+0000 7f7095268640 1 -- 172.21.15.5:0/1265536943 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70901036c0 msgr2=0x7f7090198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:52.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.660+0000 7f7095268640 1 --2- 172.21.15.5:0/1265536943 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70901036c0 0x7f7090198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:52.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.660+0000 7f7095268640 1 -- 172.21.15.5:0/1265536943 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f709010c180 msgr2=0x7f709019cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:52.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.660+0000 7f7095268640 1 --2- 172.21.15.5:0/1265536943 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f709010c180 0x7f709019cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:52.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.660+0000 7f7095268640 1 -- 172.21.15.5:0/1265536943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f709019d2f0 con 0x7f7090102da0 2024-09-11T23:27:52.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.660+0000 7f7095a69640 1 --2- 172.21.15.5:0/1265536943 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f709010c180 0x7f709019cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:27:52.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.660+0000 7f7094a67640 1 --2- 172.21.15.5:0/1265536943 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70901036c0 0x7f7090198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:27:52.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.660+0000 7f7095268640 1 --2- 172.21.15.5:0/1265536943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7090102da0 0x7f7090198340 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f708400c920 tx=0x7f708400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:52.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.660+0000 7f70827fc640 1 -- 172.21.15.5:0/1265536943 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7084007c70 con 0x7f7090102da0 2024-09-11T23:27:52.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.660+0000 7f70827fc640 1 -- 172.21.15.5:0/1265536943 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7084007e10 con 0x7f7090102da0 2024-09-11T23:27:52.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.660+0000 7f70974cc640 1 -- 172.21.15.5:0/1265536943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f709019d5e0 con 0x7f7090102da0 2024-09-11T23:27:52.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.660+0000 7f70827fc640 1 -- 172.21.15.5:0/1265536943 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7084018820 con 0x7f7090102da0 2024-09-11T23:27:52.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.661+0000 7f70974cc640 1 -- 172.21.15.5:0/1265536943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70901a4ec0 con 0x7f7090102da0 2024-09-11T23:27:52.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.661+0000 7f70974cc640 1 -- 172.21.15.5:0/1265536943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7090062940 con 0x7f7090102da0 2024-09-11T23:27:52.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.663+0000 7f70827fc640 1 -- 172.21.15.5:0/1265536943 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f70840189c0 con 0x7f7090102da0 2024-09-11T23:27:52.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.663+0000 7f70827fc640 1 --2- 172.21.15.5:0/1265536943 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f707c0a2c10 0x7f707c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:52.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.664+0000 7f70827fc640 1 -- 172.21.15.5:0/1265536943 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7f70840cfbe0 con 0x7f7090102da0 2024-09-11T23:27:52.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.664+0000 7f7094a67640 1 --2- 172.21.15.5:0/1265536943 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f707c0a2c10 0x7f707c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:52.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.664+0000 7f70827fc640 1 --2- 172.21.15.5:0/1265536943 >> [v2:172.21.15.5:6810/2080498921,v1:172.21.15.5:6811/2080498921] conn(0x7f707c0adf60 0x7f707c0b0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:52.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.664+0000 7f70827fc640 1 -- 172.21.15.5:0/1265536943 --> [v2:172.21.15.5:6810/2080498921,v1:172.21.15.5:6811/2080498921] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7084015e70 con 0x7f707c0adf60 2024-09-11T23:27:52.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.664+0000 7f70827fc640 1 -- 172.21.15.5:0/1265536943 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7f70840d0030 con 0x7f7090102da0 2024-09-11T23:27:52.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.664+0000 7f7095a69640 1 --2- 172.21.15.5:0/1265536943 >> [v2:172.21.15.5:6810/2080498921,v1:172.21.15.5:6811/2080498921] conn(0x7f707c0adf60 0x7f707c0b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:52.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.664+0000 7f7094a67640 1 --2- 172.21.15.5:0/1265536943 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f707c0a2c10 0x7f707c0a50d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f708c031440 tx=0x7f708c0095f0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:52.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.664+0000 7f7095a69640 1 --2- 172.21.15.5:0/1265536943 >> [v2:172.21.15.5:6810/2080498921,v1:172.21.15.5:6811/2080498921] conn(0x7f707c0adf60 0x7f707c0b0400 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:52.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.665+0000 7f70827fc640 1 -- 172.21.15.5:0/1265536943 <== osd.3 v2:172.21.15.5:6810/2080498921 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7084015e70 con 0x7f707c0adf60 2024-09-11T23:27:52.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.679+0000 7f70974cc640 1 -- 172.21.15.5:0/1265536943 --> [v2:172.21.15.5:6810/2080498921,v1:172.21.15.5:6811/2080498921] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7090062dc0 con 0x7f707c0adf60 2024-09-11T23:27:52.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.679+0000 7f70827fc640 1 -- 172.21.15.5:0/1265536943 <== osd.3 v2:172.21.15.5:6810/2080498921 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7090062dc0 con 0x7f707c0adf60 2024-09-11T23:27:52.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.679+0000 7f70974cc640 1 -- 172.21.15.5:0/1265536943 >> [v2:172.21.15.5:6810/2080498921,v1:172.21.15.5:6811/2080498921] conn(0x7f707c0adf60 msgr2=0x7f707c0b0400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:52.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.679+0000 7f70974cc640 1 --2- 172.21.15.5:0/1265536943 >> [v2:172.21.15.5:6810/2080498921,v1:172.21.15.5:6811/2080498921] conn(0x7f707c0adf60 0x7f707c0b0400 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:52.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.679+0000 7f70974cc640 1 -- 172.21.15.5:0/1265536943 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f707c0a2c10 msgr2=0x7f707c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:52.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.679+0000 7f70974cc640 1 --2- 172.21.15.5:0/1265536943 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f707c0a2c10 0x7f707c0a50d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f708c031440 tx=0x7f708c0095f0 comp rx=0 tx=0).stop 2024-09-11T23:27:52.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.679+0000 7f70974cc640 1 -- 172.21.15.5:0/1265536943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7090102da0 msgr2=0x7f7090198340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:52.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.679+0000 7f70974cc640 1 --2- 172.21.15.5:0/1265536943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7090102da0 0x7f7090198340 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f708400c920 tx=0x7f708400cde0 comp rx=0 tx=0).stop 2024-09-11T23:27:52.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.679+0000 7f7095a69640 1 -- 172.21.15.5:0/1265536943 reap_dead start 2024-09-11T23:27:52.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.679+0000 7f70974cc640 1 -- 172.21.15.5:0/1265536943 shutdown_connections 2024-09-11T23:27:52.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.679+0000 7f70974cc640 1 -- 172.21.15.5:0/1265536943 >> 172.21.15.5:0/1265536943 conn(0x7f70900fc7a0 msgr2=0x7f70900fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:52.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.680+0000 7f70974cc640 1 -- 172.21.15.5:0/1265536943 shutdown_connections 2024-09-11T23:27:52.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.680+0000 7f70974cc640 1 -- 172.21.15.5:0/1265536943 wait complete. 2024-09-11T23:27:53.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:53 smithi159 ceph-mon[34394]: osdmap e88: 12 total, 12 up, 12 in 2024-09-11T23:27:53.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:53 smithi159 ceph-mon[34394]: pgmap v319: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 383 B/s wr, 7 op/s 2024-09-11T23:27:53.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:53 smithi172 ceph-mon[34855]: osdmap e88: 12 total, 12 up, 12 in 2024-09-11T23:27:53.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:53 smithi172 ceph-mon[34855]: pgmap v319: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 383 B/s wr, 7 op/s 2024-09-11T23:27:53.455 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:53 smithi005 ceph-mon[31201]: osdmap e88: 12 total, 12 up, 12 in 2024-09-11T23:27:53.456 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:53 smithi005 ceph-mon[31201]: pgmap v319: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 383 B/s wr, 7 op/s 2024-09-11T23:27:53.909 INFO:teuthology.orchestra.run.smithi005.stdout:317827579931 2024-09-11T23:27:53.910 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-11T23:27:54.901 INFO:teuthology.orchestra.run.smithi005.stdout:73014444104 2024-09-11T23:27:54.901 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-11T23:27:55.328 INFO:teuthology.orchestra.run.smithi005.stdout:98784247875 2024-09-11T23:27:55.328 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-11T23:27:55.442 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:55 smithi005 ceph-mon[31201]: pgmap v320: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 383 B/s wr, 6 op/s 2024-09-11T23:27:55.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:55 smithi159 ceph-mon[34394]: pgmap v320: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 383 B/s wr, 6 op/s 2024-09-11T23:27:55.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:55 smithi172 ceph-mon[34855]: pgmap v320: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 383 B/s wr, 6 op/s 2024-09-11T23:27:55.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.197+0000 7f1166afe640 1 -- 172.21.15.5:0/533122711 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1160106a80 msgr2=0x7f1160106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:55.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.197+0000 7f1166afe640 1 --2- 172.21.15.5:0/533122711 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1160106a80 0x7f1160106e60 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1154009930 tx=0x7f115402a420 comp rx=0 tx=0).stop 2024-09-11T23:27:55.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.197+0000 7f1166afe640 1 -- 172.21.15.5:0/533122711 shutdown_connections 2024-09-11T23:27:55.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.197+0000 7f1166afe640 1 --2- 172.21.15.5:0/533122711 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1160101420 0x7f116010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:55.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.197+0000 7f1166afe640 1 --2- 172.21.15.5:0/533122711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1160100a80 0x7f1160100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:55.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.197+0000 7f1166afe640 1 --2- 172.21.15.5:0/533122711 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1160106a80 0x7f1160106e60 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:55.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.197+0000 7f1166afe640 1 -- 172.21.15.5:0/533122711 >> 172.21.15.5:0/533122711 conn(0x7f11600fc7a0 msgr2=0x7f11600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:55.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.197+0000 7f1166afe640 1 -- 172.21.15.5:0/533122711 shutdown_connections 2024-09-11T23:27:55.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.197+0000 7f1166afe640 1 -- 172.21.15.5:0/533122711 wait complete. 2024-09-11T23:27:55.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.198+0000 7f1166afe640 1 Processor -- start 2024-09-11T23:27:55.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.198+0000 7f1166afe640 1 -- start start 2024-09-11T23:27:55.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.198+0000 7f1166afe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1160100a80 0x7f1160197250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:55.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.198+0000 7f1166afe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1160101420 0x7f1160197790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:55.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.198+0000 7f1166afe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1160106a80 0x7f116019bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:55.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.198+0000 7f1166afe640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1160110cf0 con 0x7f1160101420 2024-09-11T23:27:55.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.198+0000 7f1166afe640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1160110b70 con 0x7f1160106a80 2024-09-11T23:27:55.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.198+0000 7f1166afe640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1160110e70 con 0x7f1160100a80 2024-09-11T23:27:55.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.198+0000 7f115ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1160101420 0x7f1160197790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:55.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.198+0000 7f115ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1160101420 0x7f1160197790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43756/0 (socket says 172.21.15.5:43756) 2024-09-11T23:27:55.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.198+0000 7f115ffff640 1 -- 172.21.15.5:0/3807219013 learned_addr learned my addr 172.21.15.5:0/3807219013 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:27:55.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.198+0000 7f116509b640 1 --2- 172.21.15.5:0/3807219013 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1160106a80 0x7f116019bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:55.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.198+0000 7f116489a640 1 --2- 172.21.15.5:0/3807219013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1160100a80 0x7f1160197250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:55.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.198+0000 7f115ffff640 1 -- 172.21.15.5:0/3807219013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1160100a80 msgr2=0x7f1160197250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:55.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.198+0000 7f115ffff640 1 --2- 172.21.15.5:0/3807219013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1160100a80 0x7f1160197250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:55.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.198+0000 7f115ffff640 1 -- 172.21.15.5:0/3807219013 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1160106a80 msgr2=0x7f116019bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:55.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.198+0000 7f115ffff640 1 --2- 172.21.15.5:0/3807219013 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1160106a80 0x7f116019bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:55.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.198+0000 7f115ffff640 1 -- 172.21.15.5:0/3807219013 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f116019c200 con 0x7f1160101420 2024-09-11T23:27:55.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.198+0000 7f116509b640 1 --2- 172.21.15.5:0/3807219013 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1160106a80 0x7f116019bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:27:55.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.199+0000 7f115ffff640 1 --2- 172.21.15.5:0/3807219013 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1160101420 0x7f1160197790 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f114c00c920 tx=0x7f114c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:55.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.199+0000 7f115dffb640 1 -- 172.21.15.5:0/3807219013 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f114c007c70 con 0x7f1160101420 2024-09-11T23:27:55.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.199+0000 7f115dffb640 1 -- 172.21.15.5:0/3807219013 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f114c007e10 con 0x7f1160101420 2024-09-11T23:27:55.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.199+0000 7f1166afe640 1 -- 172.21.15.5:0/3807219013 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f116019c4f0 con 0x7f1160101420 2024-09-11T23:27:55.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.199+0000 7f115dffb640 1 -- 172.21.15.5:0/3807219013 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f114c018820 con 0x7f1160101420 2024-09-11T23:27:55.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.199+0000 7f1166afe640 1 -- 172.21.15.5:0/3807219013 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f116006a790 con 0x7f1160101420 2024-09-11T23:27:55.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.200+0000 7f1166afe640 1 -- 172.21.15.5:0/3807219013 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f116006ada0 con 0x7f1160101420 2024-09-11T23:27:55.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.201+0000 7f115dffb640 1 -- 172.21.15.5:0/3807219013 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f114c0189c0 con 0x7f1160101420 2024-09-11T23:27:55.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.202+0000 7f115dffb640 1 --2- 172.21.15.5:0/3807219013 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f11500a2c90 0x7f11500a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:55.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.202+0000 7f116489a640 1 --2- 172.21.15.5:0/3807219013 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f11500a2c90 0x7f11500a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:55.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.202+0000 7f115dffb640 1 -- 172.21.15.5:0/3807219013 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7f114c0cf730 con 0x7f1160101420 2024-09-11T23:27:55.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.202+0000 7f115dffb640 1 --2- 172.21.15.5:0/3807219013 >> [v2:172.21.15.5:6802/624761084,v1:172.21.15.5:6803/624761084] conn(0x7f11500adfe0 0x7f11500b0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:55.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.202+0000 7f115dffb640 1 -- 172.21.15.5:0/3807219013 --> [v2:172.21.15.5:6802/624761084,v1:172.21.15.5:6803/624761084] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f114c012ec0 con 0x7f11500adfe0 2024-09-11T23:27:55.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.202+0000 7f115dffb640 1 -- 172.21.15.5:0/3807219013 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7f114c0d6050 con 0x7f1160101420 2024-09-11T23:27:55.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.202+0000 7f116509b640 1 --2- 172.21.15.5:0/3807219013 >> [v2:172.21.15.5:6802/624761084,v1:172.21.15.5:6803/624761084] conn(0x7f11500adfe0 0x7f11500b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:55.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.202+0000 7f116489a640 1 --2- 172.21.15.5:0/3807219013 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f11500a2c90 0x7f11500a5150 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1154000c00 tx=0x7f1154032c80 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:55.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.202+0000 7f116509b640 1 --2- 172.21.15.5:0/3807219013 >> [v2:172.21.15.5:6802/624761084,v1:172.21.15.5:6803/624761084] conn(0x7f11500adfe0 0x7f11500b0480 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:55.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.203+0000 7f115dffb640 1 -- 172.21.15.5:0/3807219013 <== osd.0 v2:172.21.15.5:6802/624761084 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f114c012ec0 con 0x7f11500adfe0 2024-09-11T23:27:55.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.217+0000 7f1166afe640 1 -- 172.21.15.5:0/3807219013 --> [v2:172.21.15.5:6802/624761084,v1:172.21.15.5:6803/624761084] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f116006b1a0 con 0x7f11500adfe0 2024-09-11T23:27:55.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.217+0000 7f115dffb640 1 -- 172.21.15.5:0/3807219013 <== osd.0 v2:172.21.15.5:6802/624761084 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f116006b1a0 con 0x7f11500adfe0 2024-09-11T23:27:55.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.217+0000 7f1166afe640 1 -- 172.21.15.5:0/3807219013 >> [v2:172.21.15.5:6802/624761084,v1:172.21.15.5:6803/624761084] conn(0x7f11500adfe0 msgr2=0x7f11500b0480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:55.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.217+0000 7f1166afe640 1 --2- 172.21.15.5:0/3807219013 >> [v2:172.21.15.5:6802/624761084,v1:172.21.15.5:6803/624761084] conn(0x7f11500adfe0 0x7f11500b0480 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:55.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.218+0000 7f1166afe640 1 -- 172.21.15.5:0/3807219013 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f11500a2c90 msgr2=0x7f11500a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:55.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.218+0000 7f1166afe640 1 --2- 172.21.15.5:0/3807219013 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f11500a2c90 0x7f11500a5150 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1154000c00 tx=0x7f1154032c80 comp rx=0 tx=0).stop 2024-09-11T23:27:55.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.218+0000 7f1166afe640 1 -- 172.21.15.5:0/3807219013 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1160101420 msgr2=0x7f1160197790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:55.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.218+0000 7f1166afe640 1 --2- 172.21.15.5:0/3807219013 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1160101420 0x7f1160197790 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f114c00c920 tx=0x7f114c00cde0 comp rx=0 tx=0).stop 2024-09-11T23:27:55.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.218+0000 7f116509b640 1 -- 172.21.15.5:0/3807219013 reap_dead start 2024-09-11T23:27:55.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.218+0000 7f1166afe640 1 -- 172.21.15.5:0/3807219013 shutdown_connections 2024-09-11T23:27:55.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.218+0000 7f1166afe640 1 -- 172.21.15.5:0/3807219013 >> 172.21.15.5:0/3807219013 conn(0x7f11600fc7a0 msgr2=0x7f11600fd100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:55.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.218+0000 7f1166afe640 1 -- 172.21.15.5:0/3807219013 shutdown_connections 2024-09-11T23:27:55.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.218+0000 7f1166afe640 1 -- 172.21.15.5:0/3807219013 wait complete. 2024-09-11T23:27:56.269 INFO:teuthology.orchestra.run.smithi005.stdout:34359738451 2024-09-11T23:27:56.269 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-11T23:27:56.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.398+0000 7f6e03c15640 1 -- 172.21.15.5:0/3805812783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6dfc102570 msgr2=0x7f6dfc1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:56.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.398+0000 7f6e03c15640 1 --2- 172.21.15.5:0/3805812783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6dfc102570 0x7f6dfc1029b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6dec009900 tx=0x7f6dec02a480 comp rx=0 tx=0).stop 2024-09-11T23:27:56.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.398+0000 7f6e03c15640 1 -- 172.21.15.5:0/3805812783 shutdown_connections 2024-09-11T23:27:56.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.398+0000 7f6e03c15640 1 --2- 172.21.15.5:0/3805812783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6dfc102ef0 0x7f6dfc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:56.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.398+0000 7f6e03c15640 1 --2- 172.21.15.5:0/3805812783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6dfc102570 0x7f6dfc1029b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:56.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.398+0000 7f6e03c15640 1 --2- 172.21.15.5:0/3805812783 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6dfc100e20 0x7f6dfc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:56.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.398+0000 7f6e03c15640 1 -- 172.21.15.5:0/3805812783 >> 172.21.15.5:0/3805812783 conn(0x7f6dfc0fc7d0 msgr2=0x7f6dfc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:56.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.398+0000 7f6e03c15640 1 -- 172.21.15.5:0/3805812783 shutdown_connections 2024-09-11T23:27:56.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.398+0000 7f6e03c15640 1 -- 172.21.15.5:0/3805812783 wait complete. 2024-09-11T23:27:56.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.399+0000 7f6e03c15640 1 Processor -- start 2024-09-11T23:27:56.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.399+0000 7f6e03c15640 1 -- start start 2024-09-11T23:27:56.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.399+0000 7f6e03c15640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6dfc100e20 0x7f6dfc199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:56.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.399+0000 7f6e03c15640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6dfc102570 0x7f6dfc1997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:56.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.399+0000 7f6e03c15640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6dfc102ef0 0x7f6dfc1a4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:56.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.399+0000 7f6e03c15640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6dfc110e30 con 0x7f6dfc102570 2024-09-11T23:27:56.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.399+0000 7f6e03c15640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6dfc110cb0 con 0x7f6dfc100e20 2024-09-11T23:27:56.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.399+0000 7f6e03c15640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6dfc110fb0 con 0x7f6dfc102ef0 2024-09-11T23:27:56.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.399+0000 7f6e011b0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6dfc102570 0x7f6dfc1997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:56.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.400+0000 7f6e011b0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6dfc102570 0x7f6dfc1997c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43772/0 (socket says 172.21.15.5:43772) 2024-09-11T23:27:56.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.400+0000 7f6e011b0640 1 -- 172.21.15.5:0/1243520051 learned_addr learned my addr 172.21.15.5:0/1243520051 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:27:56.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.400+0000 7f6e019b1640 1 --2- 172.21.15.5:0/1243520051 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6dfc100e20 0x7f6dfc199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:56.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.400+0000 7f6e021b2640 1 --2- 172.21.15.5:0/1243520051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6dfc102ef0 0x7f6dfc1a4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:56.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.400+0000 7f6e011b0640 1 -- 172.21.15.5:0/1243520051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6dfc102ef0 msgr2=0x7f6dfc1a4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:56.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.400+0000 7f6e011b0640 1 --2- 172.21.15.5:0/1243520051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6dfc102ef0 0x7f6dfc1a4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:56.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.400+0000 7f6e011b0640 1 -- 172.21.15.5:0/1243520051 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6dfc100e20 msgr2=0x7f6dfc199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:56.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.400+0000 7f6e011b0640 1 --2- 172.21.15.5:0/1243520051 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6dfc100e20 0x7f6dfc199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:56.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.400+0000 7f6e011b0640 1 -- 172.21.15.5:0/1243520051 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dfc1a4840 con 0x7f6dfc102570 2024-09-11T23:27:56.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.400+0000 7f6e021b2640 1 --2- 172.21.15.5:0/1243520051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6dfc102ef0 0x7f6dfc1a4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:27:56.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.400+0000 7f6e011b0640 1 --2- 172.21.15.5:0/1243520051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6dfc102570 0x7f6dfc1997c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6dec006010 tx=0x7f6dec0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:56.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.400+0000 7f6df2ffd640 1 -- 172.21.15.5:0/1243520051 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dec03f030 con 0x7f6dfc102570 2024-09-11T23:27:56.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.400+0000 7f6e03c15640 1 -- 172.21.15.5:0/1243520051 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dfc1a4a10 con 0x7f6dfc102570 2024-09-11T23:27:56.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.400+0000 7f6df2ffd640 1 -- 172.21.15.5:0/1243520051 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6dec003cb0 con 0x7f6dfc102570 2024-09-11T23:27:56.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.400+0000 7f6df2ffd640 1 -- 172.21.15.5:0/1243520051 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dec035070 con 0x7f6dfc102570 2024-09-11T23:27:56.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.400+0000 7f6e03c15640 1 -- 172.21.15.5:0/1243520051 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dfc1a4ec0 con 0x7f6dfc102570 2024-09-11T23:27:56.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.401+0000 7f6e03c15640 1 -- 172.21.15.5:0/1243520051 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6dfc062980 con 0x7f6dfc102570 2024-09-11T23:27:56.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.403+0000 7f6df2ffd640 1 -- 172.21.15.5:0/1243520051 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f6dec042030 con 0x7f6dfc102570 2024-09-11T23:27:56.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.403+0000 7f6df2ffd640 1 --2- 172.21.15.5:0/1243520051 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f6de80a2c10 0x7f6de80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:56.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.404+0000 7f6e019b1640 1 --2- 172.21.15.5:0/1243520051 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f6de80a2c10 0x7f6de80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:56.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.404+0000 7f6df2ffd640 1 -- 172.21.15.5:0/1243520051 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7f6dec0f0160 con 0x7f6dfc102570 2024-09-11T23:27:56.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.404+0000 7f6df2ffd640 1 --2- 172.21.15.5:0/1243520051 >> [v2:172.21.15.172:6808/3742759000,v1:172.21.15.172:6809/3742759000] conn(0x7f6de80adf60 0x7f6de80b0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:56.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.404+0000 7f6df2ffd640 1 -- 172.21.15.5:0/1243520051 --> [v2:172.21.15.172:6808/3742759000,v1:172.21.15.172:6809/3742759000] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6de80b0ad0 con 0x7f6de80adf60 2024-09-11T23:27:56.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.404+0000 7f6df2ffd640 1 -- 172.21.15.5:0/1243520051 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7f6dec0f05b0 con 0x7f6dfc102570 2024-09-11T23:27:56.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.404+0000 7f6e019b1640 1 --2- 172.21.15.5:0/1243520051 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f6de80a2c10 0x7f6de80a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6df800bbe0 tx=0x7f6df800b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:56.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.404+0000 7f6e021b2640 1 --2- 172.21.15.5:0/1243520051 >> [v2:172.21.15.172:6808/3742759000,v1:172.21.15.172:6809/3742759000] conn(0x7f6de80adf60 0x7f6de80b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:56.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.405+0000 7f6e021b2640 1 --2- 172.21.15.5:0/1243520051 >> [v2:172.21.15.172:6808/3742759000,v1:172.21.15.172:6809/3742759000] conn(0x7f6de80adf60 0x7f6de80b0400 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:56.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.405+0000 7f6df2ffd640 1 -- 172.21.15.5:0/1243520051 <== osd.5 v2:172.21.15.172:6808/3742759000 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6de80b0ad0 con 0x7f6de80adf60 2024-09-11T23:27:56.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.419+0000 7f6e03c15640 1 -- 172.21.15.5:0/1243520051 --> [v2:172.21.15.172:6808/3742759000,v1:172.21.15.172:6809/3742759000] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6dfc062e00 con 0x7f6de80adf60 2024-09-11T23:27:56.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.420+0000 7f6df2ffd640 1 -- 172.21.15.5:0/1243520051 <== osd.5 v2:172.21.15.172:6808/3742759000 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6dfc062e00 con 0x7f6de80adf60 2024-09-11T23:27:56.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.420+0000 7f6e03c15640 1 -- 172.21.15.5:0/1243520051 >> [v2:172.21.15.172:6808/3742759000,v1:172.21.15.172:6809/3742759000] conn(0x7f6de80adf60 msgr2=0x7f6de80b0400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:56.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.420+0000 7f6e03c15640 1 --2- 172.21.15.5:0/1243520051 >> [v2:172.21.15.172:6808/3742759000,v1:172.21.15.172:6809/3742759000] conn(0x7f6de80adf60 0x7f6de80b0400 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:56.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.420+0000 7f6e03c15640 1 -- 172.21.15.5:0/1243520051 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f6de80a2c10 msgr2=0x7f6de80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:56.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.420+0000 7f6e03c15640 1 --2- 172.21.15.5:0/1243520051 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f6de80a2c10 0x7f6de80a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6df800bbe0 tx=0x7f6df800b390 comp rx=0 tx=0).stop 2024-09-11T23:27:56.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.420+0000 7f6e03c15640 1 -- 172.21.15.5:0/1243520051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6dfc102570 msgr2=0x7f6dfc1997c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:56.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.420+0000 7f6e03c15640 1 --2- 172.21.15.5:0/1243520051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6dfc102570 0x7f6dfc1997c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6dec006010 tx=0x7f6dec0042f0 comp rx=0 tx=0).stop 2024-09-11T23:27:56.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.420+0000 7f6e021b2640 1 -- 172.21.15.5:0/1243520051 reap_dead start 2024-09-11T23:27:56.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.420+0000 7f6e03c15640 1 -- 172.21.15.5:0/1243520051 shutdown_connections 2024-09-11T23:27:56.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.420+0000 7f6e03c15640 1 -- 172.21.15.5:0/1243520051 >> 172.21.15.5:0/1243520051 conn(0x7f6dfc0fc7d0 msgr2=0x7f6dfc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:56.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.420+0000 7f6e03c15640 1 -- 172.21.15.5:0/1243520051 shutdown_connections 2024-09-11T23:27:56.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:54.420+0000 7f6e03c15640 1 -- 172.21.15.5:0/1243520051 wait complete. 2024-09-11T23:27:57.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.877+0000 7effb83c8640 1 -- 172.21.15.5:0/780787688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effb010e4f0 msgr2=0x7effb0110900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:57.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.877+0000 7effb83c8640 1 --2- 172.21.15.5:0/780787688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effb010e4f0 0x7effb0110900 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7effa0009ca0 tx=0x7effa002a8c0 comp rx=0 tx=0).stop 2024-09-11T23:27:57.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.878+0000 7effb83c8640 1 -- 172.21.15.5:0/780787688 shutdown_connections 2024-09-11T23:27:57.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.878+0000 7effb83c8640 1 --2- 172.21.15.5:0/780787688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effb010e4f0 0x7effb0110900 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:57.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.878+0000 7effb83c8640 1 --2- 172.21.15.5:0/780787688 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effb0101380 0x7effb010dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:57.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.878+0000 7effb83c8640 1 --2- 172.21.15.5:0/780787688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effb01009d0 0x7effb0100db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:57.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.878+0000 7effb83c8640 1 -- 172.21.15.5:0/780787688 >> 172.21.15.5:0/780787688 conn(0x7effb00fc7d0 msgr2=0x7effb00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:57.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.878+0000 7effb83c8640 1 -- 172.21.15.5:0/780787688 shutdown_connections 2024-09-11T23:27:57.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.878+0000 7effb83c8640 1 -- 172.21.15.5:0/780787688 wait complete. 2024-09-11T23:27:57.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.878+0000 7effb83c8640 1 Processor -- start 2024-09-11T23:27:57.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.878+0000 7effb83c8640 1 -- start start 2024-09-11T23:27:57.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.879+0000 7effb83c8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effb01009d0 0x7effb019a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:57.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.879+0000 7effb83c8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effb0101380 0x7effb019ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:57.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.879+0000 7effb83c8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effb010e4f0 0x7effb019efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:57.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.879+0000 7effb83c8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7effb0114180 con 0x7effb01009d0 2024-09-11T23:27:57.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.879+0000 7effb83c8640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7effb0114000 con 0x7effb010e4f0 2024-09-11T23:27:57.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.879+0000 7effb83c8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7effb0114300 con 0x7effb0101380 2024-09-11T23:27:57.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.879+0000 7effb6164640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effb01009d0 0x7effb019a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:57.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.879+0000 7effb6164640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effb01009d0 0x7effb019a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42786/0 (socket says 172.21.15.5:42786) 2024-09-11T23:27:57.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.879+0000 7effb6164640 1 -- 172.21.15.5:0/98664935 learned_addr learned my addr 172.21.15.5:0/98664935 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:27:57.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.879+0000 7effb5963640 1 --2- 172.21.15.5:0/98664935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effb0101380 0x7effb019ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:57.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.879+0000 7effb6965640 1 --2- 172.21.15.5:0/98664935 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effb010e4f0 0x7effb019efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:57.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.879+0000 7effb6164640 1 -- 172.21.15.5:0/98664935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effb0101380 msgr2=0x7effb019ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:57.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.879+0000 7effb6164640 1 --2- 172.21.15.5:0/98664935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effb0101380 0x7effb019ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:57.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.879+0000 7effb6164640 1 -- 172.21.15.5:0/98664935 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effb010e4f0 msgr2=0x7effb019efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:57.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.879+0000 7effb6164640 1 --2- 172.21.15.5:0/98664935 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effb010e4f0 0x7effb019efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:57.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.879+0000 7effb6164640 1 -- 172.21.15.5:0/98664935 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb019f680 con 0x7effb01009d0 2024-09-11T23:27:57.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.880+0000 7effb6164640 1 --2- 172.21.15.5:0/98664935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effb01009d0 0x7effb019a6d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7effa800b4a0 tx=0x7effa800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:57.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.880+0000 7effaf7fe640 1 -- 172.21.15.5:0/98664935 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa8014070 con 0x7effb01009d0 2024-09-11T23:27:57.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.880+0000 7effaf7fe640 1 -- 172.21.15.5:0/98664935 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7effa8010ac0 con 0x7effb01009d0 2024-09-11T23:27:57.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.880+0000 7effaf7fe640 1 -- 172.21.15.5:0/98664935 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa8017c30 con 0x7effb01009d0 2024-09-11T23:27:57.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.880+0000 7effb83c8640 1 -- 172.21.15.5:0/98664935 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effb019f970 con 0x7effb01009d0 2024-09-11T23:27:57.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.880+0000 7effb83c8640 1 -- 172.21.15.5:0/98664935 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effb01a7250 con 0x7effb01009d0 2024-09-11T23:27:57.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.881+0000 7effb83c8640 1 -- 172.21.15.5:0/98664935 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7effb0062980 con 0x7effb01009d0 2024-09-11T23:27:57.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.882+0000 7effaf7fe640 1 -- 172.21.15.5:0/98664935 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7effa8017070 con 0x7effb01009d0 2024-09-11T23:27:57.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.883+0000 7effaf7fe640 1 --2- 172.21.15.5:0/98664935 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7eff980a2c90 0x7eff980a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:57.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.883+0000 7effb5963640 1 --2- 172.21.15.5:0/98664935 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7eff980a2c90 0x7eff980a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:57.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.883+0000 7effaf7fe640 1 -- 172.21.15.5:0/98664935 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7effa80ceae0 con 0x7effb01009d0 2024-09-11T23:27:57.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.883+0000 7effaf7fe640 1 --2- 172.21.15.5:0/98664935 >> [v2:172.21.15.159:6808/4185908786,v1:172.21.15.159:6809/4185908786] conn(0x7eff980adfe0 0x7eff980b0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:57.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.883+0000 7effaf7fe640 1 -- 172.21.15.5:0/98664935 --> [v2:172.21.15.159:6808/4185908786,v1:172.21.15.159:6809/4185908786] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7eff980b0b50 con 0x7eff980adfe0 2024-09-11T23:27:57.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.883+0000 7effaf7fe640 1 -- 172.21.15.5:0/98664935 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7effa80cef30 con 0x7effb01009d0 2024-09-11T23:27:57.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.883+0000 7effb5963640 1 --2- 172.21.15.5:0/98664935 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7eff980a2c90 0x7eff980a5150 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7effb010e980 tx=0x7effa400b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:57.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.883+0000 7effb6965640 1 --2- 172.21.15.5:0/98664935 >> [v2:172.21.15.159:6808/4185908786,v1:172.21.15.159:6809/4185908786] conn(0x7eff980adfe0 0x7eff980b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:57.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.884+0000 7effb6965640 1 --2- 172.21.15.5:0/98664935 >> [v2:172.21.15.159:6808/4185908786,v1:172.21.15.159:6809/4185908786] conn(0x7eff980adfe0 0x7eff980b0480 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:57.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.885+0000 7effaf7fe640 1 -- 172.21.15.5:0/98664935 <== osd.4 v2:172.21.15.159:6808/4185908786 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7eff980b0b50 con 0x7eff980adfe0 2024-09-11T23:27:57.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.898+0000 7effb83c8640 1 -- 172.21.15.5:0/98664935 --> [v2:172.21.15.159:6808/4185908786,v1:172.21.15.159:6809/4185908786] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7effb0062d80 con 0x7eff980adfe0 2024-09-11T23:27:57.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.899+0000 7effaf7fe640 1 -- 172.21.15.5:0/98664935 <== osd.4 v2:172.21.15.159:6808/4185908786 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7effb0062d80 con 0x7eff980adfe0 2024-09-11T23:27:57.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.899+0000 7effb83c8640 1 -- 172.21.15.5:0/98664935 >> [v2:172.21.15.159:6808/4185908786,v1:172.21.15.159:6809/4185908786] conn(0x7eff980adfe0 msgr2=0x7eff980b0480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:57.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.899+0000 7effb83c8640 1 --2- 172.21.15.5:0/98664935 >> [v2:172.21.15.159:6808/4185908786,v1:172.21.15.159:6809/4185908786] conn(0x7eff980adfe0 0x7eff980b0480 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:57.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.899+0000 7effb83c8640 1 -- 172.21.15.5:0/98664935 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7eff980a2c90 msgr2=0x7eff980a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:57.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.899+0000 7effb83c8640 1 --2- 172.21.15.5:0/98664935 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7eff980a2c90 0x7eff980a5150 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7effb010e980 tx=0x7effa400b390 comp rx=0 tx=0).stop 2024-09-11T23:27:57.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.899+0000 7effb83c8640 1 -- 172.21.15.5:0/98664935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effb01009d0 msgr2=0x7effb019a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:57.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.899+0000 7effb83c8640 1 --2- 172.21.15.5:0/98664935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effb01009d0 0x7effb019a6d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7effa800b4a0 tx=0x7effa800b960 comp rx=0 tx=0).stop 2024-09-11T23:27:57.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.899+0000 7effb6965640 1 -- 172.21.15.5:0/98664935 reap_dead start 2024-09-11T23:27:57.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.899+0000 7effb83c8640 1 -- 172.21.15.5:0/98664935 shutdown_connections 2024-09-11T23:27:57.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.899+0000 7effb83c8640 1 -- 172.21.15.5:0/98664935 >> 172.21.15.5:0/98664935 conn(0x7effb00fc7d0 msgr2=0x7effb00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:57.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.900+0000 7effb83c8640 1 -- 172.21.15.5:0/98664935 shutdown_connections 2024-09-11T23:27:57.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:52.900+0000 7effb83c8640 1 -- 172.21.15.5:0/98664935 wait complete. 2024-09-11T23:27:57.324 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:57 smithi005 ceph-mon[31201]: pgmap v321: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T23:27:57.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:57 smithi159 ceph-mon[34394]: pgmap v321: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T23:27:57.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:57 smithi172 ceph-mon[34855]: pgmap v321: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T23:27:57.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.621+0000 7f49c363e640 1 -- 172.21.15.5:0/3372018859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49bc101440 msgr2=0x7f49bc10df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:57.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.621+0000 7f49c363e640 1 --2- 172.21.15.5:0/3372018859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49bc101440 0x7f49bc10df30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f49ac009900 tx=0x7f49ac02a410 comp rx=0 tx=0).stop 2024-09-11T23:27:57.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.621+0000 7f49c363e640 1 -- 172.21.15.5:0/3372018859 shutdown_connections 2024-09-11T23:27:57.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.621+0000 7f49c363e640 1 --2- 172.21.15.5:0/3372018859 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49bc10e500 0x7f49bc110910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:57.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.621+0000 7f49c363e640 1 --2- 172.21.15.5:0/3372018859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49bc101440 0x7f49bc10df30 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:57.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.621+0000 7f49c363e640 1 --2- 172.21.15.5:0/3372018859 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49bc100b20 0x7f49bc100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:57.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.621+0000 7f49c363e640 1 -- 172.21.15.5:0/3372018859 >> 172.21.15.5:0/3372018859 conn(0x7f49bc0fc7d0 msgr2=0x7f49bc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:57.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.621+0000 7f49c363e640 1 -- 172.21.15.5:0/3372018859 shutdown_connections 2024-09-11T23:27:57.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.621+0000 7f49c363e640 1 -- 172.21.15.5:0/3372018859 wait complete. 2024-09-11T23:27:57.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.622+0000 7f49c363e640 1 Processor -- start 2024-09-11T23:27:57.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.622+0000 7f49c363e640 1 -- start start 2024-09-11T23:27:57.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.622+0000 7f49c363e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49bc100b20 0x7f49bc19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:57.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.622+0000 7f49c363e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49bc101440 0x7f49bc19ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:57.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.622+0000 7f49c363e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49bc10e500 0x7f49bc19eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:57.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.622+0000 7f49c363e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f49bc114100 con 0x7f49bc101440 2024-09-11T23:27:57.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.622+0000 7f49c363e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f49bc113f80 con 0x7f49bc10e500 2024-09-11T23:27:57.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.622+0000 7f49c363e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f49bc114280 con 0x7f49bc100b20 2024-09-11T23:27:57.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.622+0000 7f49c0bd9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49bc101440 0x7f49bc19ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:57.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.622+0000 7f49c0bd9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49bc101440 0x7f49bc19ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43806/0 (socket says 172.21.15.5:43806) 2024-09-11T23:27:57.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.622+0000 7f49c0bd9640 1 -- 172.21.15.5:0/4061348293 learned_addr learned my addr 172.21.15.5:0/4061348293 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:27:57.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.623+0000 7f49c1bdb640 1 --2- 172.21.15.5:0/4061348293 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49bc10e500 0x7f49bc19eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:57.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.623+0000 7f49c13da640 1 --2- 172.21.15.5:0/4061348293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49bc100b20 0x7f49bc19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:57.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.623+0000 7f49c0bd9640 1 -- 172.21.15.5:0/4061348293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49bc100b20 msgr2=0x7f49bc19a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:57.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.623+0000 7f49c0bd9640 1 --2- 172.21.15.5:0/4061348293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49bc100b20 0x7f49bc19a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:57.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.623+0000 7f49c0bd9640 1 -- 172.21.15.5:0/4061348293 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49bc10e500 msgr2=0x7f49bc19eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:57.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.623+0000 7f49c0bd9640 1 --2- 172.21.15.5:0/4061348293 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49bc10e500 0x7f49bc19eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:57.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.623+0000 7f49c0bd9640 1 -- 172.21.15.5:0/4061348293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49bc19f5b0 con 0x7f49bc101440 2024-09-11T23:27:57.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.623+0000 7f49c0bd9640 1 --2- 172.21.15.5:0/4061348293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49bc101440 0x7f49bc19ab40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f49ac004270 tx=0x7f49ac0042a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:57.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.623+0000 7f49b27fc640 1 -- 172.21.15.5:0/4061348293 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49ac03f030 con 0x7f49bc101440 2024-09-11T23:27:57.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.623+0000 7f49b27fc640 1 -- 172.21.15.5:0/4061348293 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f49ac0044c0 con 0x7f49bc101440 2024-09-11T23:27:57.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.623+0000 7f49b27fc640 1 -- 172.21.15.5:0/4061348293 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49ac035070 con 0x7f49bc101440 2024-09-11T23:27:57.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.623+0000 7f49c363e640 1 -- 172.21.15.5:0/4061348293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49bc19f840 con 0x7f49bc101440 2024-09-11T23:27:57.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.623+0000 7f49c363e640 1 -- 172.21.15.5:0/4061348293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49bc19fcd0 con 0x7f49bc101440 2024-09-11T23:27:57.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.624+0000 7f49c363e640 1 -- 172.21.15.5:0/4061348293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f49bc062980 con 0x7f49bc101440 2024-09-11T23:27:57.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.626+0000 7f49b27fc640 1 -- 172.21.15.5:0/4061348293 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f49ac042030 con 0x7f49bc101440 2024-09-11T23:27:57.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.626+0000 7f49b27fc640 1 --2- 172.21.15.5:0/4061348293 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f49a80a2c10 0x7f49a80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:57.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.626+0000 7f49c13da640 1 --2- 172.21.15.5:0/4061348293 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f49a80a2c10 0x7f49a80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:57.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.626+0000 7f49b27fc640 1 -- 172.21.15.5:0/4061348293 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7f49ac0efea0 con 0x7f49bc101440 2024-09-11T23:27:57.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.627+0000 7f49b27fc640 1 --2- 172.21.15.5:0/4061348293 >> [v2:172.21.15.172:6816/3661505951,v1:172.21.15.172:6817/3661505951] conn(0x7f49a80ade30 0x7f49a80b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:57.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.627+0000 7f49b27fc640 1 -- 172.21.15.5:0/4061348293 --> [v2:172.21.15.172:6816/3661505951,v1:172.21.15.172:6817/3661505951] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f49ac005640 con 0x7f49a80ade30 2024-09-11T23:27:57.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.627+0000 7f49b27fc640 1 -- 172.21.15.5:0/4061348293 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7f49ac0f02f0 con 0x7f49bc101440 2024-09-11T23:27:57.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.627+0000 7f49c13da640 1 --2- 172.21.15.5:0/4061348293 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f49a80a2c10 0x7f49a80a50d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f49b8005e10 tx=0x7f49b8005da0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:57.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.627+0000 7f49c1bdb640 1 --2- 172.21.15.5:0/4061348293 >> [v2:172.21.15.172:6816/3661505951,v1:172.21.15.172:6817/3661505951] conn(0x7f49a80ade30 0x7f49a80b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:57.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.627+0000 7f49c1bdb640 1 --2- 172.21.15.5:0/4061348293 >> [v2:172.21.15.172:6816/3661505951,v1:172.21.15.172:6817/3661505951] conn(0x7f49a80ade30 0x7f49a80b02d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:57.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.629+0000 7f49b27fc640 1 -- 172.21.15.5:0/4061348293 <== osd.8 v2:172.21.15.172:6816/3661505951 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f49ac005640 con 0x7f49a80ade30 2024-09-11T23:27:57.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.642+0000 7f49c363e640 1 -- 172.21.15.5:0/4061348293 --> [v2:172.21.15.172:6816/3661505951,v1:172.21.15.172:6817/3661505951] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f49bc062e00 con 0x7f49a80ade30 2024-09-11T23:27:57.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.643+0000 7f49b27fc640 1 -- 172.21.15.5:0/4061348293 <== osd.8 v2:172.21.15.172:6816/3661505951 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f49bc062e00 con 0x7f49a80ade30 2024-09-11T23:27:57.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.643+0000 7f49c363e640 1 -- 172.21.15.5:0/4061348293 >> [v2:172.21.15.172:6816/3661505951,v1:172.21.15.172:6817/3661505951] conn(0x7f49a80ade30 msgr2=0x7f49a80b02d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:57.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.643+0000 7f49c363e640 1 --2- 172.21.15.5:0/4061348293 >> [v2:172.21.15.172:6816/3661505951,v1:172.21.15.172:6817/3661505951] conn(0x7f49a80ade30 0x7f49a80b02d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:57.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.643+0000 7f49c363e640 1 -- 172.21.15.5:0/4061348293 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f49a80a2c10 msgr2=0x7f49a80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:57.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.643+0000 7f49c363e640 1 --2- 172.21.15.5:0/4061348293 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f49a80a2c10 0x7f49a80a50d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f49b8005e10 tx=0x7f49b8005da0 comp rx=0 tx=0).stop 2024-09-11T23:27:57.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.643+0000 7f49c363e640 1 -- 172.21.15.5:0/4061348293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49bc101440 msgr2=0x7f49bc19ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:57.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.643+0000 7f49c363e640 1 --2- 172.21.15.5:0/4061348293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49bc101440 0x7f49bc19ab40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f49ac004270 tx=0x7f49ac0042a0 comp rx=0 tx=0).stop 2024-09-11T23:27:57.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.643+0000 7f49c1bdb640 1 -- 172.21.15.5:0/4061348293 reap_dead start 2024-09-11T23:27:57.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.643+0000 7f49c363e640 1 -- 172.21.15.5:0/4061348293 shutdown_connections 2024-09-11T23:27:57.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.643+0000 7f49c363e640 1 -- 172.21.15.5:0/4061348293 >> 172.21.15.5:0/4061348293 conn(0x7f49bc0fc7d0 msgr2=0x7f49bc10f950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:57.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.643+0000 7f49c363e640 1 -- 172.21.15.5:0/4061348293 shutdown_connections 2024-09-11T23:27:57.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.643+0000 7f49c363e640 1 -- 172.21.15.5:0/4061348293 wait complete. 2024-09-11T23:27:57.797 INFO:teuthology.orchestra.run.smithi005.stdout:150323855418 2024-09-11T23:27:57.798 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-11T23:27:58.452 INFO:teuthology.orchestra.run.smithi005.stdout:236223201323 2024-09-11T23:27:58.452 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-11T23:27:58.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.516+0000 7f86ead8f640 1 -- 172.21.15.5:0/13968376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86e4102ef0 msgr2=0x7f86e410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:58.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.516+0000 7f86ead8f640 1 --2- 172.21.15.5:0/13968376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86e4102ef0 0x7f86e410da40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f86dc009ca0 tx=0x7f86dc02a950 comp rx=0 tx=0).stop 2024-09-11T23:27:58.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.516+0000 7f86ead8f640 1 -- 172.21.15.5:0/13968376 shutdown_connections 2024-09-11T23:27:58.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.516+0000 7f86ead8f640 1 --2- 172.21.15.5:0/13968376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86e4102ef0 0x7f86e410da40 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:58.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.516+0000 7f86ead8f640 1 --2- 172.21.15.5:0/13968376 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86e4102570 0x7f86e41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:58.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.516+0000 7f86ead8f640 1 --2- 172.21.15.5:0/13968376 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86e4100e20 0x7f86e4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:58.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.516+0000 7f86ead8f640 1 -- 172.21.15.5:0/13968376 >> 172.21.15.5:0/13968376 conn(0x7f86e40fc7d0 msgr2=0x7f86e40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:58.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.516+0000 7f86ead8f640 1 -- 172.21.15.5:0/13968376 shutdown_connections 2024-09-11T23:27:58.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.516+0000 7f86ead8f640 1 -- 172.21.15.5:0/13968376 wait complete. 2024-09-11T23:27:58.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.517+0000 7f86ead8f640 1 Processor -- start 2024-09-11T23:27:58.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.517+0000 7f86ead8f640 1 -- start start 2024-09-11T23:27:58.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.517+0000 7f86ead8f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86e4100e20 0x7f86e41983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:58.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.517+0000 7f86ead8f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86e4102570 0x7f86e4198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:58.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.517+0000 7f86ead8f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86e4102ef0 0x7f86e419ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:58.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.517+0000 7f86ead8f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f86e4110e50 con 0x7f86e4100e20 2024-09-11T23:27:58.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.517+0000 7f86ead8f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f86e4110cd0 con 0x7f86e4102ef0 2024-09-11T23:27:58.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.517+0000 7f86ead8f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f86e4110fd0 con 0x7f86e4102570 2024-09-11T23:27:58.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.517+0000 7f86e8b2b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86e4100e20 0x7f86e41983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:58.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.517+0000 7f86e8b2b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86e4100e20 0x7f86e41983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43794/0 (socket says 172.21.15.5:43794) 2024-09-11T23:27:58.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.517+0000 7f86e8b2b640 1 -- 172.21.15.5:0/1009306064 learned_addr learned my addr 172.21.15.5:0/1009306064 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:27:58.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.517+0000 7f86e932c640 1 --2- 172.21.15.5:0/1009306064 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86e4102ef0 0x7f86e419ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:58.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.517+0000 7f86e8b2b640 1 -- 172.21.15.5:0/1009306064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86e4102570 msgr2=0x7f86e4198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:58.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.517+0000 7f86e8b2b640 1 --2- 172.21.15.5:0/1009306064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86e4102570 0x7f86e4198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:58.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.517+0000 7f86e8b2b640 1 -- 172.21.15.5:0/1009306064 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86e4102ef0 msgr2=0x7f86e419ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:58.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.517+0000 7f86e8b2b640 1 --2- 172.21.15.5:0/1009306064 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86e4102ef0 0x7f86e419ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:58.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.517+0000 7f86e8b2b640 1 -- 172.21.15.5:0/1009306064 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86e419d3a0 con 0x7f86e4100e20 2024-09-11T23:27:58.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.517+0000 7f86e932c640 1 --2- 172.21.15.5:0/1009306064 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86e4102ef0 0x7f86e419ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:27:58.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.518+0000 7f86e8b2b640 1 --2- 172.21.15.5:0/1009306064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86e4100e20 0x7f86e41983f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f86d400c890 tx=0x7f86d400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:58.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.518+0000 7f86e1ffb640 1 -- 172.21.15.5:0/1009306064 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d4004220 con 0x7f86e4100e20 2024-09-11T23:27:58.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.518+0000 7f86e1ffb640 1 -- 172.21.15.5:0/1009306064 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f86d40043c0 con 0x7f86e4100e20 2024-09-11T23:27:58.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.518+0000 7f86ead8f640 1 -- 172.21.15.5:0/1009306064 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86e419d690 con 0x7f86e4100e20 2024-09-11T23:27:58.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.518+0000 7f86e1ffb640 1 -- 172.21.15.5:0/1009306064 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d4004a00 con 0x7f86e4100e20 2024-09-11T23:27:58.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.518+0000 7f86ead8f640 1 -- 172.21.15.5:0/1009306064 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86e41a4f70 con 0x7f86e4100e20 2024-09-11T23:27:58.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.519+0000 7f86ead8f640 1 -- 172.21.15.5:0/1009306064 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f86e4062980 con 0x7f86e4100e20 2024-09-11T23:27:58.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.520+0000 7f86e1ffb640 1 -- 172.21.15.5:0/1009306064 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f86d4004ba0 con 0x7f86e4100e20 2024-09-11T23:27:58.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.521+0000 7f86e1ffb640 1 --2- 172.21.15.5:0/1009306064 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f86d00a2c90 0x7f86d00a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:58.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.521+0000 7f86e3fff640 1 --2- 172.21.15.5:0/1009306064 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f86d00a2c90 0x7f86d00a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:58.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.521+0000 7f86e1ffb640 1 -- 172.21.15.5:0/1009306064 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7f86d40cf6f0 con 0x7f86e4100e20 2024-09-11T23:27:58.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.521+0000 7f86e1ffb640 1 --2- 172.21.15.5:0/1009306064 >> [v2:172.21.15.159:6800/2111290186,v1:172.21.15.159:6801/2111290186] conn(0x7f86d00adfe0 0x7f86d00b0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:58.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.521+0000 7f86e1ffb640 1 -- 172.21.15.5:0/1009306064 --> [v2:172.21.15.159:6800/2111290186,v1:172.21.15.159:6801/2111290186] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f86d4012ec0 con 0x7f86d00adfe0 2024-09-11T23:27:58.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.521+0000 7f86e1ffb640 1 -- 172.21.15.5:0/1009306064 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7f86d40cfb40 con 0x7f86e4100e20 2024-09-11T23:27:58.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.521+0000 7f86e932c640 1 --2- 172.21.15.5:0/1009306064 >> [v2:172.21.15.159:6800/2111290186,v1:172.21.15.159:6801/2111290186] conn(0x7f86d00adfe0 0x7f86d00b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:58.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.521+0000 7f86e3fff640 1 --2- 172.21.15.5:0/1009306064 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f86d00a2c90 0x7f86d00a5150 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f86e4100010 tx=0x7f86cc006c90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:58.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.522+0000 7f86e932c640 1 --2- 172.21.15.5:0/1009306064 >> [v2:172.21.15.159:6800/2111290186,v1:172.21.15.159:6801/2111290186] conn(0x7f86d00adfe0 0x7f86d00b0480 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:58.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.523+0000 7f86e1ffb640 1 -- 172.21.15.5:0/1009306064 <== osd.1 v2:172.21.15.159:6800/2111290186 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f86d4012ec0 con 0x7f86d00adfe0 2024-09-11T23:27:58.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.537+0000 7f86ead8f640 1 -- 172.21.15.5:0/1009306064 --> [v2:172.21.15.159:6800/2111290186,v1:172.21.15.159:6801/2111290186] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f86e4062d80 con 0x7f86d00adfe0 2024-09-11T23:27:58.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.538+0000 7f86e1ffb640 1 -- 172.21.15.5:0/1009306064 <== osd.1 v2:172.21.15.159:6800/2111290186 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f86e4062d80 con 0x7f86d00adfe0 2024-09-11T23:27:58.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.538+0000 7f86ead8f640 1 -- 172.21.15.5:0/1009306064 >> [v2:172.21.15.159:6800/2111290186,v1:172.21.15.159:6801/2111290186] conn(0x7f86d00adfe0 msgr2=0x7f86d00b0480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:58.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.538+0000 7f86ead8f640 1 --2- 172.21.15.5:0/1009306064 >> [v2:172.21.15.159:6800/2111290186,v1:172.21.15.159:6801/2111290186] conn(0x7f86d00adfe0 0x7f86d00b0480 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:58.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.539+0000 7f86ead8f640 1 -- 172.21.15.5:0/1009306064 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f86d00a2c90 msgr2=0x7f86d00a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:58.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.539+0000 7f86ead8f640 1 --2- 172.21.15.5:0/1009306064 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f86d00a2c90 0x7f86d00a5150 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f86e4100010 tx=0x7f86cc006c90 comp rx=0 tx=0).stop 2024-09-11T23:27:58.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.539+0000 7f86ead8f640 1 -- 172.21.15.5:0/1009306064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86e4100e20 msgr2=0x7f86e41983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:58.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.539+0000 7f86ead8f640 1 --2- 172.21.15.5:0/1009306064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86e4100e20 0x7f86e41983f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f86d400c890 tx=0x7f86d400cd50 comp rx=0 tx=0).stop 2024-09-11T23:27:58.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.539+0000 7f86e932c640 1 -- 172.21.15.5:0/1009306064 reap_dead start 2024-09-11T23:27:58.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.539+0000 7f86ead8f640 1 -- 172.21.15.5:0/1009306064 shutdown_connections 2024-09-11T23:27:58.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.539+0000 7f86ead8f640 1 -- 172.21.15.5:0/1009306064 >> 172.21.15.5:0/1009306064 conn(0x7f86e40fc7d0 msgr2=0x7f86e406a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:58.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.539+0000 7f86ead8f640 1 -- 172.21.15.5:0/1009306064 shutdown_connections 2024-09-11T23:27:58.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.539+0000 7f86ead8f640 1 -- 172.21.15.5:0/1009306064 wait complete. 2024-09-11T23:27:59.181 INFO:teuthology.orchestra.run.smithi005.stdout:287762808864 2024-09-11T23:27:59.182 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-11T23:27:59.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.410+0000 7f6c5561c640 1 -- 172.21.15.5:0/639235001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c50106f10 msgr2=0x7f6c5010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:59.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.410+0000 7f6c5561c640 1 --2- 172.21.15.5:0/639235001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c50106f10 0x7f6c5010ea90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6c48009ca0 tx=0x7f6c4802a8c0 comp rx=0 tx=0).stop 2024-09-11T23:27:59.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.411+0000 7f6c5561c640 1 -- 172.21.15.5:0/639235001 shutdown_connections 2024-09-11T23:27:59.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.411+0000 7f6c5561c640 1 --2- 172.21.15.5:0/639235001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c50106f10 0x7f6c5010ea90 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:59.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.411+0000 7f6c5561c640 1 --2- 172.21.15.5:0/639235001 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c50102790 0x7f6c501067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:59.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.411+0000 7f6c5561c640 1 --2- 172.21.15.5:0/639235001 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c50101de0 0x7f6c501021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:59.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.411+0000 7f6c5561c640 1 -- 172.21.15.5:0/639235001 >> 172.21.15.5:0/639235001 conn(0x7f6c500fd8c0 msgr2=0x7f6c500ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:59.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.411+0000 7f6c5561c640 1 -- 172.21.15.5:0/639235001 shutdown_connections 2024-09-11T23:27:59.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.411+0000 7f6c5561c640 1 -- 172.21.15.5:0/639235001 wait complete. 2024-09-11T23:27:59.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.411+0000 7f6c5561c640 1 Processor -- start 2024-09-11T23:27:59.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.411+0000 7f6c5561c640 1 -- start start 2024-09-11T23:27:59.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.412+0000 7f6c5561c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c50101de0 0x7f6c501983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:59.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.412+0000 7f6c5561c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c50102790 0x7f6c50198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:59.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.412+0000 7f6c5561c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c50106f10 0x7f6c5019ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:59.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.412+0000 7f6c5561c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6c50111e40 con 0x7f6c50106f10 2024-09-11T23:27:59.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.412+0000 7f6c5561c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6c50111cc0 con 0x7f6c50101de0 2024-09-11T23:27:59.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.412+0000 7f6c5561c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6c50111fc0 con 0x7f6c50102790 2024-09-11T23:27:59.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.412+0000 7f6c4f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c50106f10 0x7f6c5019ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:59.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.412+0000 7f6c4f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c50106f10 0x7f6c5019ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43776/0 (socket says 172.21.15.5:43776) 2024-09-11T23:27:59.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.412+0000 7f6c4f7fe640 1 -- 172.21.15.5:0/1191569001 learned_addr learned my addr 172.21.15.5:0/1191569001 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:27:59.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.412+0000 7f6c4e7fc640 1 --2- 172.21.15.5:0/1191569001 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c50102790 0x7f6c50198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:59.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.412+0000 7f6c4effd640 1 --2- 172.21.15.5:0/1191569001 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c50101de0 0x7f6c501983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:59.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.412+0000 7f6c4f7fe640 1 -- 172.21.15.5:0/1191569001 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c50102790 msgr2=0x7f6c50198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:59.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.412+0000 7f6c4f7fe640 1 --2- 172.21.15.5:0/1191569001 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c50102790 0x7f6c50198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:59.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.412+0000 7f6c4f7fe640 1 -- 172.21.15.5:0/1191569001 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c50101de0 msgr2=0x7f6c501983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:59.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.412+0000 7f6c4f7fe640 1 --2- 172.21.15.5:0/1191569001 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c50101de0 0x7f6c501983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:59.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.412+0000 7f6c4f7fe640 1 -- 172.21.15.5:0/1191569001 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c5019d390 con 0x7f6c50106f10 2024-09-11T23:27:59.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.412+0000 7f6c4f7fe640 1 --2- 172.21.15.5:0/1191569001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c50106f10 0x7f6c5019ccb0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6c48009dc0 tx=0x7f6c48003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:59.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.412+0000 7f6c37fff640 1 -- 172.21.15.5:0/1191569001 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c48004040 con 0x7f6c50106f10 2024-09-11T23:27:59.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.412+0000 7f6c5561c640 1 -- 172.21.15.5:0/1191569001 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c5019d620 con 0x7f6c50106f10 2024-09-11T23:27:59.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.412+0000 7f6c37fff640 1 -- 172.21.15.5:0/1191569001 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6c48004690 con 0x7f6c50106f10 2024-09-11T23:27:59.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.412+0000 7f6c37fff640 1 -- 172.21.15.5:0/1191569001 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c48030d90 con 0x7f6c50106f10 2024-09-11T23:27:59.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.413+0000 7f6c5561c640 1 -- 172.21.15.5:0/1191569001 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c501a4f60 con 0x7f6c50106f10 2024-09-11T23:27:59.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.413+0000 7f6c5561c640 1 -- 172.21.15.5:0/1191569001 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6c50062980 con 0x7f6c50106f10 2024-09-11T23:27:59.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.415+0000 7f6c37fff640 1 -- 172.21.15.5:0/1191569001 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f6c480305c0 con 0x7f6c50106f10 2024-09-11T23:27:59.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.415+0000 7f6c37fff640 1 --2- 172.21.15.5:0/1191569001 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f6c380a2c10 0x7f6c380a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:59.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.415+0000 7f6c4effd640 1 --2- 172.21.15.5:0/1191569001 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f6c380a2c10 0x7f6c380a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:59.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.415+0000 7f6c37fff640 1 -- 172.21.15.5:0/1191569001 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7f6c480f0ff0 con 0x7f6c50106f10 2024-09-11T23:27:59.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.416+0000 7f6c37fff640 1 --2- 172.21.15.5:0/1191569001 >> [v2:172.21.15.5:6818/4156823423,v1:172.21.15.5:6819/4156823423] conn(0x7f6c380ade30 0x7f6c380b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:59.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.416+0000 7f6c37fff640 1 -- 172.21.15.5:0/1191569001 --> [v2:172.21.15.5:6818/4156823423,v1:172.21.15.5:6819/4156823423] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6c480020b0 con 0x7f6c380ade30 2024-09-11T23:27:59.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.416+0000 7f6c37fff640 1 -- 172.21.15.5:0/1191569001 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7f6c480f1440 con 0x7f6c50106f10 2024-09-11T23:27:59.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.416+0000 7f6c4e7fc640 1 --2- 172.21.15.5:0/1191569001 >> [v2:172.21.15.5:6818/4156823423,v1:172.21.15.5:6819/4156823423] conn(0x7f6c380ade30 0x7f6c380b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:59.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.416+0000 7f6c4effd640 1 --2- 172.21.15.5:0/1191569001 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f6c380a2c10 0x7f6c380a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6c400058c0 tx=0x7f6c40005c60 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:59.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.416+0000 7f6c4e7fc640 1 --2- 172.21.15.5:0/1191569001 >> [v2:172.21.15.5:6818/4156823423,v1:172.21.15.5:6819/4156823423] conn(0x7f6c380ade30 0x7f6c380b02d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:59.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.417+0000 7f6c37fff640 1 -- 172.21.15.5:0/1191569001 <== osd.6 v2:172.21.15.5:6818/4156823423 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6c480020b0 con 0x7f6c380ade30 2024-09-11T23:27:59.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.431+0000 7f6c5561c640 1 -- 172.21.15.5:0/1191569001 --> [v2:172.21.15.5:6818/4156823423,v1:172.21.15.5:6819/4156823423] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6c50062d80 con 0x7f6c380ade30 2024-09-11T23:27:59.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.431+0000 7f6c37fff640 1 -- 172.21.15.5:0/1191569001 <== osd.6 v2:172.21.15.5:6818/4156823423 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6c50062d80 con 0x7f6c380ade30 2024-09-11T23:27:59.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.431+0000 7f6c5561c640 1 -- 172.21.15.5:0/1191569001 >> [v2:172.21.15.5:6818/4156823423,v1:172.21.15.5:6819/4156823423] conn(0x7f6c380ade30 msgr2=0x7f6c380b02d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:59.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.431+0000 7f6c5561c640 1 --2- 172.21.15.5:0/1191569001 >> [v2:172.21.15.5:6818/4156823423,v1:172.21.15.5:6819/4156823423] conn(0x7f6c380ade30 0x7f6c380b02d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:59.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.432+0000 7f6c5561c640 1 -- 172.21.15.5:0/1191569001 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f6c380a2c10 msgr2=0x7f6c380a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:59.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.432+0000 7f6c5561c640 1 --2- 172.21.15.5:0/1191569001 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f6c380a2c10 0x7f6c380a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6c400058c0 tx=0x7f6c40005c60 comp rx=0 tx=0).stop 2024-09-11T23:27:59.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.432+0000 7f6c5561c640 1 -- 172.21.15.5:0/1191569001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c50106f10 msgr2=0x7f6c5019ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:59.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.432+0000 7f6c5561c640 1 --2- 172.21.15.5:0/1191569001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c50106f10 0x7f6c5019ccb0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6c48009dc0 tx=0x7f6c48003ba0 comp rx=0 tx=0).stop 2024-09-11T23:27:59.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.432+0000 7f6c4f7fe640 1 -- 172.21.15.5:0/1191569001 reap_dead start 2024-09-11T23:27:59.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.432+0000 7f6c5561c640 1 -- 172.21.15.5:0/1191569001 shutdown_connections 2024-09-11T23:27:59.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.432+0000 7f6c5561c640 1 -- 172.21.15.5:0/1191569001 >> 172.21.15.5:0/1191569001 conn(0x7f6c500fd8c0 msgr2=0x7f6c500fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:59.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.432+0000 7f6c5561c640 1 -- 172.21.15.5:0/1191569001 shutdown_connections 2024-09-11T23:27:59.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:27:57.432+0000 7f6c5561c640 1 -- 172.21.15.5:0/1191569001 wait complete. 2024-09-11T23:27:59.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:27:59 smithi005 ceph-mon[31201]: pgmap v322: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-11T23:27:59.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:27:59 smithi159 ceph-mon[34394]: pgmap v322: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-11T23:27:59.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:27:59 smithi172 ceph-mon[34855]: pgmap v322: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-11T23:27:59.881 INFO:teuthology.orchestra.run.smithi005.stdout:180388626485 2024-09-11T23:27:59.881 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-11T23:28:00.287 INFO:teuthology.orchestra.run.smithi005.stdout:266287972389 2024-09-11T23:28:00.287 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-11T23:28:00.778 INFO:teuthology.orchestra.run.smithi005.stdout:55834574926 2024-09-11T23:28:00.778 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-11T23:28:01.338 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:01 smithi005 ceph-mon[31201]: pgmap v323: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-11T23:28:01.367 INFO:teuthology.orchestra.run.smithi005.stdout:206158430255 2024-09-11T23:28:01.368 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-11T23:28:01.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:01 smithi159 ceph-mon[34394]: pgmap v323: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-11T23:28:01.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:01 smithi172 ceph-mon[34855]: pgmap v323: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-11T23:28:01.689 INFO:teuthology.orchestra.run.smithi005.stdout:128849018943 2024-09-11T23:28:01.690 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-11T23:28:01.722 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:28:01.723 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:28:01.727 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:28:01.750 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:28:01.751 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:28:01.817 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:28:01.817 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:28:02.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.526+0000 7f13af5c1640 1 -- 172.21.15.5:0/4066192341 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13a81082a0 msgr2=0x7f13a810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:02.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.526+0000 7f13af5c1640 1 --2- 172.21.15.5:0/4066192341 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13a81082a0 0x7f13a810ec40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1398009cd0 tx=0x7f139802a8e0 comp rx=0 tx=0).stop 2024-09-11T23:28:02.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.526+0000 7f13af5c1640 1 -- 172.21.15.5:0/4066192341 shutdown_connections 2024-09-11T23:28:02.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.526+0000 7f13af5c1640 1 --2- 172.21.15.5:0/4066192341 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13a81082a0 0x7f13a810ec40 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:02.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.526+0000 7f13af5c1640 1 --2- 172.21.15.5:0/4066192341 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13a81036e0 0x7f13a8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:02.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.526+0000 7f13af5c1640 1 --2- 172.21.15.5:0/4066192341 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13a8102d30 0x7f13a8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:02.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.526+0000 7f13af5c1640 1 -- 172.21.15.5:0/4066192341 >> 172.21.15.5:0/4066192341 conn(0x7f13a80fc7d0 msgr2=0x7f13a80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:02.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.526+0000 7f13af5c1640 1 -- 172.21.15.5:0/4066192341 shutdown_connections 2024-09-11T23:28:02.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.526+0000 7f13af5c1640 1 -- 172.21.15.5:0/4066192341 wait complete. 2024-09-11T23:28:02.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.526+0000 7f13af5c1640 1 Processor -- start 2024-09-11T23:28:02.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.526+0000 7f13af5c1640 1 -- start start 2024-09-11T23:28:02.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.527+0000 7f13af5c1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13a8102d30 0x7f13a8100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:02.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.527+0000 7f13af5c1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13a81036e0 0x7f13a8100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:02.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.527+0000 7f13af5c1640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13a81082a0 0x7f13a8101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:02.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.527+0000 7f13af5c1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f13a8111f50 con 0x7f13a8102d30 2024-09-11T23:28:02.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.527+0000 7f13af5c1640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f13a8111dd0 con 0x7f13a81082a0 2024-09-11T23:28:02.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.527+0000 7f13af5c1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f13a81120d0 con 0x7f13a81036e0 2024-09-11T23:28:02.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.527+0000 7f13ad35d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13a8102d30 0x7f13a8100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:02.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.527+0000 7f13ad35d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13a8102d30 0x7f13a8100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43822/0 (socket says 172.21.15.5:43822) 2024-09-11T23:28:02.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.527+0000 7f13ad35d640 1 -- 172.21.15.5:0/3471671198 learned_addr learned my addr 172.21.15.5:0/3471671198 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:02.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.527+0000 7f13acb5c640 1 --2- 172.21.15.5:0/3471671198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13a81036e0 0x7f13a8100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:02.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.527+0000 7f13adb5e640 1 --2- 172.21.15.5:0/3471671198 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13a81082a0 0x7f13a8101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:02.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.527+0000 7f13ad35d640 1 -- 172.21.15.5:0/3471671198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13a81036e0 msgr2=0x7f13a8100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:02.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.527+0000 7f13ad35d640 1 --2- 172.21.15.5:0/3471671198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13a81036e0 0x7f13a8100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:02.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.527+0000 7f13ad35d640 1 -- 172.21.15.5:0/3471671198 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13a81082a0 msgr2=0x7f13a8101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:02.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.527+0000 7f13ad35d640 1 --2- 172.21.15.5:0/3471671198 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13a81082a0 0x7f13a8101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:02.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.527+0000 7f13ad35d640 1 -- 172.21.15.5:0/3471671198 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13a81a6970 con 0x7f13a8102d30 2024-09-11T23:28:02.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.527+0000 7f13acb5c640 1 --2- 172.21.15.5:0/3471671198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13a81036e0 0x7f13a8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:28:02.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.527+0000 7f13ad35d640 1 --2- 172.21.15.5:0/3471671198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13a8102d30 0x7f13a8100990 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f13a000d950 tx=0x7f13a000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:02.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.527+0000 7f13a67fc640 1 -- 172.21.15.5:0/3471671198 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a0017030 con 0x7f13a8102d30 2024-09-11T23:28:02.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.528+0000 7f13a67fc640 1 -- 172.21.15.5:0/3471671198 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f13a0004020 con 0x7f13a8102d30 2024-09-11T23:28:02.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.528+0000 7f13af5c1640 1 -- 172.21.15.5:0/3471671198 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13a81a6c60 con 0x7f13a8102d30 2024-09-11T23:28:02.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.528+0000 7f13a67fc640 1 -- 172.21.15.5:0/3471671198 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a00047a0 con 0x7f13a8102d30 2024-09-11T23:28:02.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.528+0000 7f13af5c1640 1 -- 172.21.15.5:0/3471671198 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13a81a71a0 con 0x7f13a8102d30 2024-09-11T23:28:02.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.529+0000 7f13af5c1640 1 -- 172.21.15.5:0/3471671198 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13a8103110 con 0x7f13a8102d30 2024-09-11T23:28:02.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.530+0000 7f13a67fc640 1 -- 172.21.15.5:0/3471671198 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f13a00041d0 con 0x7f13a8102d30 2024-09-11T23:28:02.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.530+0000 7f13a67fc640 1 --2- 172.21.15.5:0/3471671198 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f13900a2c10 0x7f13900a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:02.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.530+0000 7f13acb5c640 1 --2- 172.21.15.5:0/3471671198 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f13900a2c10 0x7f13900a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:02.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.530+0000 7f13a67fc640 1 -- 172.21.15.5:0/3471671198 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7f13a00cf0c0 con 0x7f13a8102d30 2024-09-11T23:28:02.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.531+0000 7f13acb5c640 1 --2- 172.21.15.5:0/3471671198 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f13900a2c10 0x7f13900a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f139c005d70 tx=0x7f139c005d00 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:02.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.535+0000 7f13a67fc640 1 -- 172.21.15.5:0/3471671198 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f13a009bb00 con 0x7f13a8102d30 2024-09-11T23:28:02.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.715+0000 7f13af5c1640 1 -- 172.21.15.5:0/3471671198 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f13a810a2b0 con 0x7f13a8102d30 2024-09-11T23:28:02.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.716+0000 7f13a67fc640 1 -- 172.21.15.5:0/3471671198 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f13a009b400 con 0x7f13a8102d30 2024-09-11T23:28:02.716 INFO:teuthology.orchestra.run.smithi005.stdout:73014444107 2024-09-11T23:28:02.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.718+0000 7f13af5c1640 1 -- 172.21.15.5:0/3471671198 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f13900a2c10 msgr2=0x7f13900a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:02.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.718+0000 7f13af5c1640 1 --2- 172.21.15.5:0/3471671198 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f13900a2c10 0x7f13900a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f139c005d70 tx=0x7f139c005d00 comp rx=0 tx=0).stop 2024-09-11T23:28:02.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.718+0000 7f13af5c1640 1 -- 172.21.15.5:0/3471671198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13a8102d30 msgr2=0x7f13a8100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:02.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.718+0000 7f13af5c1640 1 --2- 172.21.15.5:0/3471671198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13a8102d30 0x7f13a8100990 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f13a000d950 tx=0x7f13a000de10 comp rx=0 tx=0).stop 2024-09-11T23:28:02.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.718+0000 7f13af5c1640 1 -- 172.21.15.5:0/3471671198 shutdown_connections 2024-09-11T23:28:02.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.718+0000 7f13af5c1640 1 --2- 172.21.15.5:0/3471671198 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f13900a2c10 0x7f13900a50d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:02.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.718+0000 7f13af5c1640 1 --2- 172.21.15.5:0/3471671198 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13a81082a0 0x7f13a8101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:02.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.718+0000 7f13af5c1640 1 --2- 172.21.15.5:0/3471671198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13a81036e0 0x7f13a8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:02.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.718+0000 7f13af5c1640 1 --2- 172.21.15.5:0/3471671198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13a8102d30 0x7f13a8100990 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:02.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.718+0000 7f13af5c1640 1 -- 172.21.15.5:0/3471671198 >> 172.21.15.5:0/3471671198 conn(0x7f13a80fc7d0 msgr2=0x7f13a8105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:02.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.718+0000 7f13af5c1640 1 -- 172.21.15.5:0/3471671198 shutdown_connections 2024-09-11T23:28:02.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:02.718+0000 7f13af5c1640 1 -- 172.21.15.5:0/3471671198 wait complete. 2024-09-11T23:28:03.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.141+0000 7f448bdc9640 1 -- 172.21.15.5:0/1216413092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4484106a80 msgr2=0x7f4484106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:03.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.141+0000 7f448bdc9640 1 --2- 172.21.15.5:0/1216413092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4484106a80 0x7f4484106e60 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4480009930 tx=0x7f448002a440 comp rx=0 tx=0).stop 2024-09-11T23:28:03.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.141+0000 7f448bdc9640 1 -- 172.21.15.5:0/1216413092 shutdown_connections 2024-09-11T23:28:03.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.141+0000 7f448bdc9640 1 --2- 172.21.15.5:0/1216413092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4484101420 0x7f448410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:03.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.141+0000 7f448bdc9640 1 --2- 172.21.15.5:0/1216413092 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4484100a80 0x7f4484100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:03.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.141+0000 7f448bdc9640 1 --2- 172.21.15.5:0/1216413092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4484106a80 0x7f4484106e60 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:03.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.141+0000 7f448bdc9640 1 -- 172.21.15.5:0/1216413092 >> 172.21.15.5:0/1216413092 conn(0x7f44840fc7a0 msgr2=0x7f44840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:03.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.141+0000 7f448bdc9640 1 -- 172.21.15.5:0/1216413092 shutdown_connections 2024-09-11T23:28:03.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.141+0000 7f448bdc9640 1 -- 172.21.15.5:0/1216413092 wait complete. 2024-09-11T23:28:03.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.142+0000 7f448bdc9640 1 Processor -- start 2024-09-11T23:28:03.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.142+0000 7f448bdc9640 1 -- start start 2024-09-11T23:28:03.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.142+0000 7f448bdc9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4484100a80 0x7f44841982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:03.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.142+0000 7f448bdc9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4484101420 0x7f44841987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:03.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.142+0000 7f448bdc9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4484106a80 0x7f448419cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:03.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.142+0000 7f448bdc9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4484110cf0 con 0x7f4484106a80 2024-09-11T23:28:03.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.142+0000 7f448bdc9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f4484110b70 con 0x7f4484101420 2024-09-11T23:28:03.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.142+0000 7f448bdc9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4484110e70 con 0x7f4484100a80 2024-09-11T23:28:03.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.142+0000 7f448a366640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4484106a80 0x7f448419cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:03.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.142+0000 7f448a366640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4484106a80 0x7f448419cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43846/0 (socket says 172.21.15.5:43846) 2024-09-11T23:28:03.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.142+0000 7f448a366640 1 -- 172.21.15.5:0/3178377609 learned_addr learned my addr 172.21.15.5:0/3178377609 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:03.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.142+0000 7f4489364640 1 --2- 172.21.15.5:0/3178377609 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4484101420 0x7f44841987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:03.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.142+0000 7f4489b65640 1 --2- 172.21.15.5:0/3178377609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4484100a80 0x7f44841982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:03.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.142+0000 7f448a366640 1 -- 172.21.15.5:0/3178377609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4484100a80 msgr2=0x7f44841982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:03.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.142+0000 7f448a366640 1 --2- 172.21.15.5:0/3178377609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4484100a80 0x7f44841982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:03.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.142+0000 7f448a366640 1 -- 172.21.15.5:0/3178377609 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4484101420 msgr2=0x7f44841987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:03.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.142+0000 7f448a366640 1 --2- 172.21.15.5:0/3178377609 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4484101420 0x7f44841987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:03.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.142+0000 7f448a366640 1 -- 172.21.15.5:0/3178377609 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f448419d250 con 0x7f4484106a80 2024-09-11T23:28:03.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.142+0000 7f4489364640 1 --2- 172.21.15.5:0/3178377609 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4484101420 0x7f44841987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:28:03.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.143+0000 7f448a366640 1 --2- 172.21.15.5:0/3178377609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4484106a80 0x7f448419cb70 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f447c00cce0 tx=0x7f447c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:03.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.143+0000 7f447affd640 1 -- 172.21.15.5:0/3178377609 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447c00f450 con 0x7f4484106a80 2024-09-11T23:28:03.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.143+0000 7f447affd640 1 -- 172.21.15.5:0/3178377609 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f447c00faa0 con 0x7f4484106a80 2024-09-11T23:28:03.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.143+0000 7f448bdc9640 1 -- 172.21.15.5:0/3178377609 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f448419d540 con 0x7f4484106a80 2024-09-11T23:28:03.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.143+0000 7f447affd640 1 -- 172.21.15.5:0/3178377609 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447c018b70 con 0x7f4484106a80 2024-09-11T23:28:03.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.143+0000 7f448bdc9640 1 -- 172.21.15.5:0/3178377609 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44841a4e20 con 0x7f4484106a80 2024-09-11T23:28:03.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.144+0000 7f448bdc9640 1 -- 172.21.15.5:0/3178377609 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4484100ee0 con 0x7f4484106a80 2024-09-11T23:28:03.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.145+0000 7f447affd640 1 -- 172.21.15.5:0/3178377609 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f447c018d10 con 0x7f4484106a80 2024-09-11T23:28:03.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.146+0000 7f447affd640 1 --2- 172.21.15.5:0/3178377609 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f44700a2c90 0x7f44700a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:03.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.146+0000 7f447affd640 1 -- 172.21.15.5:0/3178377609 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7f447c0cf980 con 0x7f4484106a80 2024-09-11T23:28:03.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.146+0000 7f4489b65640 1 --2- 172.21.15.5:0/3178377609 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f44700a2c90 0x7f44700a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:03.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.146+0000 7f4489b65640 1 --2- 172.21.15.5:0/3178377609 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f44700a2c90 0x7f44700a5150 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4480000c00 tx=0x7f4480031400 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:03.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.150+0000 7f447affd640 1 -- 172.21.15.5:0/3178377609 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f447c014030 con 0x7f4484106a80 2024-09-11T23:28:03.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.330+0000 7f448bdc9640 1 -- 172.21.15.5:0/3178377609 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f4484109a70 con 0x7f4484106a80 2024-09-11T23:28:03.330 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:03 smithi005 ceph-mon[31201]: pgmap v324: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-11T23:28:03.330 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:03 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/3471671198' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-11T23:28:03.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.331+0000 7f447affd640 1 -- 172.21.15.5:0/3178377609 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f447c09c3c0 con 0x7f4484106a80 2024-09-11T23:28:03.331 INFO:teuthology.orchestra.run.smithi005.stdout:180388626486 2024-09-11T23:28:03.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.333+0000 7f448bdc9640 1 -- 172.21.15.5:0/3178377609 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f44700a2c90 msgr2=0x7f44700a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:03.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.333+0000 7f448bdc9640 1 --2- 172.21.15.5:0/3178377609 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f44700a2c90 0x7f44700a5150 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4480000c00 tx=0x7f4480031400 comp rx=0 tx=0).stop 2024-09-11T23:28:03.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.333+0000 7f448bdc9640 1 -- 172.21.15.5:0/3178377609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4484106a80 msgr2=0x7f448419cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:03.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.333+0000 7f448bdc9640 1 --2- 172.21.15.5:0/3178377609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4484106a80 0x7f448419cb70 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f447c00cce0 tx=0x7f447c00a620 comp rx=0 tx=0).stop 2024-09-11T23:28:03.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.333+0000 7f448bdc9640 1 -- 172.21.15.5:0/3178377609 shutdown_connections 2024-09-11T23:28:03.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.333+0000 7f448bdc9640 1 --2- 172.21.15.5:0/3178377609 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f44700a2c90 0x7f44700a5150 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:03.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.333+0000 7f448bdc9640 1 --2- 172.21.15.5:0/3178377609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4484106a80 0x7f448419cb70 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:03.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.333+0000 7f448bdc9640 1 --2- 172.21.15.5:0/3178377609 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4484101420 0x7f44841987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:03.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.333+0000 7f448bdc9640 1 --2- 172.21.15.5:0/3178377609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4484100a80 0x7f44841982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:03.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.333+0000 7f448bdc9640 1 -- 172.21.15.5:0/3178377609 >> 172.21.15.5:0/3178377609 conn(0x7f44840fc7a0 msgr2=0x7f448406aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:03.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.333+0000 7f448bdc9640 1 -- 172.21.15.5:0/3178377609 shutdown_connections 2024-09-11T23:28:03.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.333+0000 7f448bdc9640 1 -- 172.21.15.5:0/3178377609 wait complete. 2024-09-11T23:28:03.450 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:03 smithi159 ceph-mon[34394]: pgmap v324: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-11T23:28:03.450 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:03 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/3471671198' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-11T23:28:03.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:03 smithi172 ceph-mon[34855]: pgmap v324: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-11T23:28:03.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:03 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/3471671198' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-11T23:28:03.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.896+0000 7f8e384f9640 1 -- 172.21.15.5:0/377741568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e30103660 msgr2=0x7f8e3010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:03.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.896+0000 7f8e384f9640 1 --2- 172.21.15.5:0/377741568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e30103660 0x7f8e3010bb50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8e20009900 tx=0x7f8e2002a480 comp rx=0 tx=0).stop 2024-09-11T23:28:03.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.897+0000 7f8e384f9640 1 -- 172.21.15.5:0/377741568 shutdown_connections 2024-09-11T23:28:03.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.897+0000 7f8e384f9640 1 --2- 172.21.15.5:0/377741568 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e3010c170 0x7f8e3010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:03.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.897+0000 7f8e384f9640 1 --2- 172.21.15.5:0/377741568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e30103660 0x7f8e3010bb50 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:03.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.897+0000 7f8e384f9640 1 --2- 172.21.15.5:0/377741568 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e30102d40 0x7f8e30103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:03.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.897+0000 7f8e384f9640 1 -- 172.21.15.5:0/377741568 >> 172.21.15.5:0/377741568 conn(0x7f8e300fc7a0 msgr2=0x7f8e300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:03.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.897+0000 7f8e384f9640 1 -- 172.21.15.5:0/377741568 shutdown_connections 2024-09-11T23:28:03.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.897+0000 7f8e384f9640 1 -- 172.21.15.5:0/377741568 wait complete. 2024-09-11T23:28:03.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.897+0000 7f8e384f9640 1 Processor -- start 2024-09-11T23:28:03.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.897+0000 7f8e384f9640 1 -- start start 2024-09-11T23:28:03.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.898+0000 7f8e384f9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e30102d40 0x7f8e301983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:03.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.898+0000 7f8e384f9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e30103660 0x7f8e301988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:03.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.898+0000 7f8e384f9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e3010c170 0x7f8e3019cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:03.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.898+0000 7f8e384f9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8e30111e20 con 0x7f8e3010c170 2024-09-11T23:28:03.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.898+0000 7f8e384f9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f8e30111ca0 con 0x7f8e30102d40 2024-09-11T23:28:03.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.898+0000 7f8e384f9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8e30111fa0 con 0x7f8e30103660 2024-09-11T23:28:03.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.898+0000 7f8e36a96640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e3010c170 0x7f8e3019cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:03.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.898+0000 7f8e36a96640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e3010c170 0x7f8e3019cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42168/0 (socket says 172.21.15.5:42168) 2024-09-11T23:28:03.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.898+0000 7f8e36a96640 1 -- 172.21.15.5:0/3519819831 learned_addr learned my addr 172.21.15.5:0/3519819831 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:03.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.898+0000 7f8e36295640 1 --2- 172.21.15.5:0/3519819831 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e30102d40 0x7f8e301983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:03.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.898+0000 7f8e35a94640 1 --2- 172.21.15.5:0/3519819831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e30103660 0x7f8e301988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:03.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.898+0000 7f8e36295640 1 -- 172.21.15.5:0/3519819831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e30103660 msgr2=0x7f8e301988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:03.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.898+0000 7f8e36295640 1 --2- 172.21.15.5:0/3519819831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e30103660 0x7f8e301988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:03.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.898+0000 7f8e36295640 1 -- 172.21.15.5:0/3519819831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e3010c170 msgr2=0x7f8e3019cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:03.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.898+0000 7f8e36295640 1 --2- 172.21.15.5:0/3519819831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e3010c170 0x7f8e3019cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:03.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.898+0000 7f8e36295640 1 -- 172.21.15.5:0/3519819831 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e3019d350 con 0x7f8e30102d40 2024-09-11T23:28:03.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.898+0000 7f8e36a96640 1 --2- 172.21.15.5:0/3519819831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e3010c170 0x7f8e3019cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:28:03.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.898+0000 7f8e36295640 1 --2- 172.21.15.5:0/3519819831 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e30102d40 0x7f8e301983a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c00e9f0 tx=0x7f8e2c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:03.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.899+0000 7f8e277fe640 1 -- 172.21.15.5:0/3519819831 <== mon.2 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c00ccc0 con 0x7f8e30102d40 2024-09-11T23:28:03.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.899+0000 7f8e384f9640 1 -- 172.21.15.5:0/3519819831 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e3019d640 con 0x7f8e30102d40 2024-09-11T23:28:03.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.899+0000 7f8e277fe640 1 -- 172.21.15.5:0/3519819831 <== mon.2 v2:172.21.15.159:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8e2c0108e0 con 0x7f8e30102d40 2024-09-11T23:28:03.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.899+0000 7f8e277fe640 1 -- 172.21.15.5:0/3519819831 <== mon.2 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c018880 con 0x7f8e30102d40 2024-09-11T23:28:03.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.899+0000 7f8e384f9640 1 -- 172.21.15.5:0/3519819831 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e301a4f20 con 0x7f8e30102d40 2024-09-11T23:28:03.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.900+0000 7f8e384f9640 1 -- 172.21.15.5:0/3519819831 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e30103120 con 0x7f8e30102d40 2024-09-11T23:28:03.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.901+0000 7f8e277fe640 1 -- 172.21.15.5:0/3519819831 <== mon.2 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f8e2c010a90 con 0x7f8e30102d40 2024-09-11T23:28:03.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.901+0000 7f8e277fe640 1 --2- 172.21.15.5:0/3519819831 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f8e1c0a2c90 0x7f8e1c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:03.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.902+0000 7f8e35a94640 1 --2- 172.21.15.5:0/3519819831 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f8e1c0a2c90 0x7f8e1c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:03.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.902+0000 7f8e277fe640 1 -- 172.21.15.5:0/3519819831 <== mon.2 v2:172.21.15.159:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7f8e2c0cfbc0 con 0x7f8e30102d40 2024-09-11T23:28:03.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.902+0000 7f8e35a94640 1 --2- 172.21.15.5:0/3519819831 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f8e1c0a2c90 0x7f8e1c0a5150 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8e20031440 tx=0x7f8e20005b50 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:03.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:03.905+0000 7f8e277fe640 1 -- 172.21.15.5:0/3519819831 <== mon.2 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8e2c09bf50 con 0x7f8e30102d40 2024-09-11T23:28:04.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.086+0000 7f8e384f9640 1 -- 172.21.15.5:0/3519819831 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f8e30107210 con 0x7f8e30102d40 2024-09-11T23:28:04.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.087+0000 7f8e277fe640 1 -- 172.21.15.5:0/3519819831 <== mon.2 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8e2c0a0250 con 0x7f8e30102d40 2024-09-11T23:28:04.087 INFO:teuthology.orchestra.run.smithi005.stdout:34359738453 2024-09-11T23:28:04.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.089+0000 7f8e384f9640 1 -- 172.21.15.5:0/3519819831 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f8e1c0a2c90 msgr2=0x7f8e1c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:04.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.089+0000 7f8e384f9640 1 --2- 172.21.15.5:0/3519819831 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f8e1c0a2c90 0x7f8e1c0a5150 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8e20031440 tx=0x7f8e20005b50 comp rx=0 tx=0).stop 2024-09-11T23:28:04.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.089+0000 7f8e384f9640 1 -- 172.21.15.5:0/3519819831 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e30102d40 msgr2=0x7f8e301983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:04.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.089+0000 7f8e384f9640 1 --2- 172.21.15.5:0/3519819831 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e30102d40 0x7f8e301983a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c00e9f0 tx=0x7f8e2c00eeb0 comp rx=0 tx=0).stop 2024-09-11T23:28:04.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.089+0000 7f8e384f9640 1 -- 172.21.15.5:0/3519819831 shutdown_connections 2024-09-11T23:28:04.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.089+0000 7f8e384f9640 1 --2- 172.21.15.5:0/3519819831 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f8e1c0a2c90 0x7f8e1c0a5150 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:04.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.089+0000 7f8e384f9640 1 --2- 172.21.15.5:0/3519819831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e3010c170 0x7f8e3019cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:04.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.089+0000 7f8e384f9640 1 --2- 172.21.15.5:0/3519819831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e30103660 0x7f8e301988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:04.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.089+0000 7f8e384f9640 1 --2- 172.21.15.5:0/3519819831 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e30102d40 0x7f8e301983a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:04.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.089+0000 7f8e384f9640 1 -- 172.21.15.5:0/3519819831 >> 172.21.15.5:0/3519819831 conn(0x7f8e300fc7a0 msgr2=0x7f8e300fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:04.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.089+0000 7f8e384f9640 1 -- 172.21.15.5:0/3519819831 shutdown_connections 2024-09-11T23:28:04.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.089+0000 7f8e384f9640 1 -- 172.21.15.5:0/3519819831 wait complete. 2024-09-11T23:28:04.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:04 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/3178377609' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-11T23:28:04.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:04 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/3519819831' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-11T23:28:04.535 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:04 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/3178377609' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-11T23:28:04.535 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:04 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/3519819831' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-11T23:28:04.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:04 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/3178377609' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-11T23:28:04.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:04 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/3519819831' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-11T23:28:04.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.791+0000 7f663aeaf640 1 -- 172.21.15.5:0/1818989350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6634101de0 msgr2=0x7f66341021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:04.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.791+0000 7f663aeaf640 1 --2- 172.21.15.5:0/1818989350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6634101de0 0x7f66341021c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6624009900 tx=0x7f662402a410 comp rx=0 tx=0).stop 2024-09-11T23:28:04.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.791+0000 7f663aeaf640 1 -- 172.21.15.5:0/1818989350 shutdown_connections 2024-09-11T23:28:04.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.791+0000 7f663aeaf640 1 --2- 172.21.15.5:0/1818989350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6634106f10 0x7f663410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:04.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.791+0000 7f663aeaf640 1 --2- 172.21.15.5:0/1818989350 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6634102790 0x7f66341067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:04.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.791+0000 7f663aeaf640 1 --2- 172.21.15.5:0/1818989350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6634101de0 0x7f66341021c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:04.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.791+0000 7f663aeaf640 1 -- 172.21.15.5:0/1818989350 >> 172.21.15.5:0/1818989350 conn(0x7f66340fd8c0 msgr2=0x7f66340ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:04.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.791+0000 7f663aeaf640 1 -- 172.21.15.5:0/1818989350 shutdown_connections 2024-09-11T23:28:04.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.792+0000 7f663aeaf640 1 -- 172.21.15.5:0/1818989350 wait complete. 2024-09-11T23:28:04.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.792+0000 7f663aeaf640 1 Processor -- start 2024-09-11T23:28:04.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.792+0000 7f663aeaf640 1 -- start start 2024-09-11T23:28:04.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.792+0000 7f663aeaf640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6634101de0 0x7f663419a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:04.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.792+0000 7f663aeaf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6634102790 0x7f663419aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:04.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.792+0000 7f663aeaf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6634106f10 0x7f663419ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:04.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.792+0000 7f663aeaf640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6634111e70 con 0x7f6634106f10 2024-09-11T23:28:04.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.792+0000 7f663aeaf640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6634111cf0 con 0x7f6634101de0 2024-09-11T23:28:04.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.792+0000 7f663aeaf640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6634111ff0 con 0x7f6634102790 2024-09-11T23:28:04.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.793+0000 7f663944c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6634106f10 0x7f663419ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:04.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.793+0000 7f6638c4b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6634101de0 0x7f663419a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:04.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.793+0000 7f663944c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6634106f10 0x7f663419ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42176/0 (socket says 172.21.15.5:42176) 2024-09-11T23:28:04.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.793+0000 7f663944c640 1 -- 172.21.15.5:0/1260243929 learned_addr learned my addr 172.21.15.5:0/1260243929 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:04.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.793+0000 7f6633fff640 1 --2- 172.21.15.5:0/1260243929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6634102790 0x7f663419aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:04.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.793+0000 7f663944c640 1 -- 172.21.15.5:0/1260243929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6634102790 msgr2=0x7f663419aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:04.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.793+0000 7f663944c640 1 --2- 172.21.15.5:0/1260243929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6634102790 0x7f663419aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:04.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.793+0000 7f663944c640 1 -- 172.21.15.5:0/1260243929 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6634101de0 msgr2=0x7f663419a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:04.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.793+0000 7f663944c640 1 --2- 172.21.15.5:0/1260243929 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6634101de0 0x7f663419a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:04.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.793+0000 7f663944c640 1 -- 172.21.15.5:0/1260243929 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f663419f530 con 0x7f6634106f10 2024-09-11T23:28:04.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.793+0000 7f663944c640 1 --2- 172.21.15.5:0/1260243929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6634106f10 0x7f663419ee50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f662c00eaa0 tx=0x7f662c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:04.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.793+0000 7f6631ffb640 1 -- 172.21.15.5:0/1260243929 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f662c004d20 con 0x7f6634106f10 2024-09-11T23:28:04.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.793+0000 7f6631ffb640 1 -- 172.21.15.5:0/1260243929 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f662c005020 con 0x7f6634106f10 2024-09-11T23:28:04.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.793+0000 7f663aeaf640 1 -- 172.21.15.5:0/1260243929 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f663419f820 con 0x7f6634106f10 2024-09-11T23:28:04.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.793+0000 7f6631ffb640 1 -- 172.21.15.5:0/1260243929 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f662c0116b0 con 0x7f6634106f10 2024-09-11T23:28:04.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.794+0000 7f663aeaf640 1 -- 172.21.15.5:0/1260243929 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66341a7100 con 0x7f6634106f10 2024-09-11T23:28:04.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.795+0000 7f663aeaf640 1 -- 172.21.15.5:0/1260243929 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66341021c0 con 0x7f6634106f10 2024-09-11T23:28:04.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.795+0000 7f6631ffb640 1 -- 172.21.15.5:0/1260243929 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f662c0051d0 con 0x7f6634106f10 2024-09-11T23:28:04.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.796+0000 7f6631ffb640 1 --2- 172.21.15.5:0/1260243929 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f661c0a2c10 0x7f661c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:04.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.796+0000 7f6631ffb640 1 -- 172.21.15.5:0/1260243929 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7f662c0cf650 con 0x7f6634106f10 2024-09-11T23:28:04.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.796+0000 7f6638c4b640 1 --2- 172.21.15.5:0/1260243929 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f661c0a2c10 0x7f661c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:04.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.797+0000 7f6638c4b640 1 --2- 172.21.15.5:0/1260243929 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f661c0a2c10 0x7f661c0a50d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6624005ab0 tx=0x7f6624005a20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:04.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.801+0000 7f6631ffb640 1 -- 172.21.15.5:0/1260243929 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f662c016030 con 0x7f6634106f10 2024-09-11T23:28:04.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.983+0000 7f663aeaf640 1 -- 172.21.15.5:0/1260243929 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f66341a7330 con 0x7f6634106f10 2024-09-11T23:28:04.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.984+0000 7f6631ffb640 1 -- 172.21.15.5:0/1260243929 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f662c09c090 con 0x7f6634106f10 2024-09-11T23:28:04.990 INFO:teuthology.orchestra.run.smithi005.stdout:206158430258 2024-09-11T23:28:04.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.986+0000 7f663aeaf640 1 -- 172.21.15.5:0/1260243929 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f661c0a2c10 msgr2=0x7f661c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:04.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.986+0000 7f663aeaf640 1 --2- 172.21.15.5:0/1260243929 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f661c0a2c10 0x7f661c0a50d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6624005ab0 tx=0x7f6624005a20 comp rx=0 tx=0).stop 2024-09-11T23:28:04.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.986+0000 7f663aeaf640 1 -- 172.21.15.5:0/1260243929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6634106f10 msgr2=0x7f663419ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:04.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.986+0000 7f663aeaf640 1 --2- 172.21.15.5:0/1260243929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6634106f10 0x7f663419ee50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f662c00eaa0 tx=0x7f662c00eea0 comp rx=0 tx=0).stop 2024-09-11T23:28:04.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.986+0000 7f663aeaf640 1 -- 172.21.15.5:0/1260243929 shutdown_connections 2024-09-11T23:28:04.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.986+0000 7f663aeaf640 1 --2- 172.21.15.5:0/1260243929 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f661c0a2c10 0x7f661c0a50d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:04.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.986+0000 7f663aeaf640 1 --2- 172.21.15.5:0/1260243929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6634106f10 0x7f663419ee50 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:04.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.986+0000 7f663aeaf640 1 --2- 172.21.15.5:0/1260243929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6634102790 0x7f663419aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:04.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.986+0000 7f663aeaf640 1 --2- 172.21.15.5:0/1260243929 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6634101de0 0x7f663419a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:04.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.986+0000 7f663aeaf640 1 -- 172.21.15.5:0/1260243929 >> 172.21.15.5:0/1260243929 conn(0x7f66340fd8c0 msgr2=0x7f66340feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:04.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.986+0000 7f663aeaf640 1 -- 172.21.15.5:0/1260243929 shutdown_connections 2024-09-11T23:28:04.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:04.986+0000 7f663aeaf640 1 -- 172.21.15.5:0/1260243929 wait complete. 2024-09-11T23:28:05.473 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:05 smithi005 ceph-mon[31201]: pgmap v325: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-11T23:28:05.473 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:05 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/1260243929' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-11T23:28:05.506 INFO:tasks.cephadm.ceph_manager.ceph:need seq 180388626485 got 180388626486 for osd.6 2024-09-11T23:28:05.507 DEBUG:teuthology.parallel:result is None 2024-09-11T23:28:05.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:05 smithi159 ceph-mon[34394]: pgmap v325: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-11T23:28:05.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:05 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/1260243929' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-11T23:28:05.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:05 smithi172 ceph-mon[34855]: pgmap v325: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-11T23:28:05.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:05 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/1260243929' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-11T23:28:05.955 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738451 got 34359738453 for osd.0 2024-09-11T23:28:05.955 DEBUG:teuthology.parallel:result is None 2024-09-11T23:28:06.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.308+0000 7f04be826640 1 -- 172.21.15.5:0/2101958123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04b8102ef0 msgr2=0x7f04b810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:06.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.308+0000 7f04be826640 1 --2- 172.21.15.5:0/2101958123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04b8102ef0 0x7f04b810da40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f04b0009ca0 tx=0x7f04b002a950 comp rx=0 tx=0).stop 2024-09-11T23:28:06.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.308+0000 7f04be826640 1 -- 172.21.15.5:0/2101958123 shutdown_connections 2024-09-11T23:28:06.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.308+0000 7f04be826640 1 --2- 172.21.15.5:0/2101958123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04b8102ef0 0x7f04b810da40 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:06.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.308+0000 7f04be826640 1 --2- 172.21.15.5:0/2101958123 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04b8102570 0x7f04b81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:06.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.308+0000 7f04be826640 1 --2- 172.21.15.5:0/2101958123 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04b8100e20 0x7f04b8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:06.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.308+0000 7f04be826640 1 -- 172.21.15.5:0/2101958123 >> 172.21.15.5:0/2101958123 conn(0x7f04b80fc7d0 msgr2=0x7f04b80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:06.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.308+0000 7f04be826640 1 -- 172.21.15.5:0/2101958123 shutdown_connections 2024-09-11T23:28:06.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.308+0000 7f04be826640 1 -- 172.21.15.5:0/2101958123 wait complete. 2024-09-11T23:28:06.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.309+0000 7f04be826640 1 Processor -- start 2024-09-11T23:28:06.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.309+0000 7f04be826640 1 -- start start 2024-09-11T23:28:06.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.309+0000 7f04be826640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04b8100e20 0x7f04b80fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:06.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.309+0000 7f04be826640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04b8102570 0x7f04b80fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:06.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.309+0000 7f04be826640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04b8102ef0 0x7f04b80fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:06.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.309+0000 7f04be826640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f04b8110e30 con 0x7f04b8100e20 2024-09-11T23:28:06.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.309+0000 7f04be826640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f04b8110cb0 con 0x7f04b8102570 2024-09-11T23:28:06.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.309+0000 7f04be826640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f04b8110fb0 con 0x7f04b8102ef0 2024-09-11T23:28:06.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.309+0000 7f04b7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04b8100e20 0x7f04b80fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:06.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.309+0000 7f04b7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04b8100e20 0x7f04b80fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42204/0 (socket says 172.21.15.5:42204) 2024-09-11T23:28:06.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.309+0000 7f04b7fff640 1 -- 172.21.15.5:0/411045066 learned_addr learned my addr 172.21.15.5:0/411045066 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:06.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.310+0000 7f04bcdc3640 1 --2- 172.21.15.5:0/411045066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04b8102ef0 0x7f04b80fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:06.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.310+0000 7f04affff640 1 --2- 172.21.15.5:0/411045066 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04b8102570 0x7f04b80fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:06.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.310+0000 7f04b7fff640 1 -- 172.21.15.5:0/411045066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04b8102ef0 msgr2=0x7f04b80fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:06.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.310+0000 7f04b7fff640 1 --2- 172.21.15.5:0/411045066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04b8102ef0 0x7f04b80fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:06.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.310+0000 7f04b7fff640 1 -- 172.21.15.5:0/411045066 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04b8102570 msgr2=0x7f04b80fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:06.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.310+0000 7f04b7fff640 1 --2- 172.21.15.5:0/411045066 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04b8102570 0x7f04b80fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:06.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.310+0000 7f04b7fff640 1 -- 172.21.15.5:0/411045066 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04b81a68e0 con 0x7f04b8100e20 2024-09-11T23:28:06.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.310+0000 7f04affff640 1 --2- 172.21.15.5:0/411045066 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04b8102570 0x7f04b80fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:28:06.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.310+0000 7f04b7fff640 1 --2- 172.21.15.5:0/411045066 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04b8100e20 0x7f04b80fcc80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f04a800d950 tx=0x7f04a800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:06.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.310+0000 7f04b5ffb640 1 -- 172.21.15.5:0/411045066 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a8017030 con 0x7f04b8100e20 2024-09-11T23:28:06.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.310+0000 7f04b5ffb640 1 -- 172.21.15.5:0/411045066 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f04a8004020 con 0x7f04b8100e20 2024-09-11T23:28:06.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.310+0000 7f04be826640 1 -- 172.21.15.5:0/411045066 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04b81a6bd0 con 0x7f04b8100e20 2024-09-11T23:28:06.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.310+0000 7f04b5ffb640 1 -- 172.21.15.5:0/411045066 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a80047a0 con 0x7f04b8100e20 2024-09-11T23:28:06.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.311+0000 7f04be826640 1 -- 172.21.15.5:0/411045066 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04b81a7110 con 0x7f04b8100e20 2024-09-11T23:28:06.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.312+0000 7f04be826640 1 -- 172.21.15.5:0/411045066 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04b8101200 con 0x7f04b8100e20 2024-09-11T23:28:06.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.313+0000 7f04b5ffb640 1 -- 172.21.15.5:0/411045066 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f04a80041d0 con 0x7f04b8100e20 2024-09-11T23:28:06.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.314+0000 7f04b5ffb640 1 --2- 172.21.15.5:0/411045066 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f04a40a2c10 0x7f04a40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:06.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.314+0000 7f04b5ffb640 1 -- 172.21.15.5:0/411045066 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7f04a80cf020 con 0x7f04b8100e20 2024-09-11T23:28:06.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.314+0000 7f04affff640 1 --2- 172.21.15.5:0/411045066 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f04a40a2c10 0x7f04a40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:06.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.315+0000 7f04affff640 1 --2- 172.21.15.5:0/411045066 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f04a40a2c10 0x7f04a40a50d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f04b80fe710 tx=0x7f04a0005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:06.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.319+0000 7f04b5ffb640 1 -- 172.21.15.5:0/411045066 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f04a809ba60 con 0x7f04b8100e20 2024-09-11T23:28:06.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.501+0000 7f04be826640 1 -- 172.21.15.5:0/411045066 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f04b80fe1b0 con 0x7f04b8100e20 2024-09-11T23:28:06.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.501+0000 7f04b5ffb640 1 -- 172.21.15.5:0/411045066 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f04a809b360 con 0x7f04b8100e20 2024-09-11T23:28:06.501 INFO:teuthology.orchestra.run.smithi005.stdout:98784247878 2024-09-11T23:28:06.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.505+0000 7f04be826640 1 -- 172.21.15.5:0/411045066 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f04a40a2c10 msgr2=0x7f04a40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:06.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.505+0000 7f04be826640 1 --2- 172.21.15.5:0/411045066 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f04a40a2c10 0x7f04a40a50d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f04b80fe710 tx=0x7f04a0005f90 comp rx=0 tx=0).stop 2024-09-11T23:28:06.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.505+0000 7f04be826640 1 -- 172.21.15.5:0/411045066 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04b8100e20 msgr2=0x7f04b80fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:06.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.505+0000 7f04be826640 1 --2- 172.21.15.5:0/411045066 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04b8100e20 0x7f04b80fcc80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f04a800d950 tx=0x7f04a800de10 comp rx=0 tx=0).stop 2024-09-11T23:28:06.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.505+0000 7f04be826640 1 -- 172.21.15.5:0/411045066 shutdown_connections 2024-09-11T23:28:06.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.505+0000 7f04be826640 1 --2- 172.21.15.5:0/411045066 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f04a40a2c10 0x7f04a40a50d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:06.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.505+0000 7f04be826640 1 --2- 172.21.15.5:0/411045066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04b8102ef0 0x7f04b80fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:06.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.505+0000 7f04be826640 1 --2- 172.21.15.5:0/411045066 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04b8102570 0x7f04b80fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:06.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.505+0000 7f04be826640 1 --2- 172.21.15.5:0/411045066 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04b8100e20 0x7f04b80fcc80 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:06.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.505+0000 7f04be826640 1 -- 172.21.15.5:0/411045066 >> 172.21.15.5:0/411045066 conn(0x7f04b80fc7d0 msgr2=0x7f04b806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:06.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.505+0000 7f04be826640 1 -- 172.21.15.5:0/411045066 shutdown_connections 2024-09-11T23:28:06.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.505+0000 7f04be826640 1 -- 172.21.15.5:0/411045066 wait complete. 2024-09-11T23:28:06.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.489+0000 7f1fe0157640 1 -- 172.21.15.5:0/1795921967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fd81082e0 msgr2=0x7f1fd810ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:06.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.489+0000 7f1fe0157640 1 --2- 172.21.15.5:0/1795921967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fd81082e0 0x7f1fd810ec50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0009cd0 tx=0x7f1fd002a8e0 comp rx=0 tx=0).stop 2024-09-11T23:28:06.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.489+0000 7f1fe0157640 1 -- 172.21.15.5:0/1795921967 shutdown_connections 2024-09-11T23:28:06.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.489+0000 7f1fe0157640 1 --2- 172.21.15.5:0/1795921967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fd81082e0 0x7f1fd810ec50 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:06.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.489+0000 7f1fe0157640 1 --2- 172.21.15.5:0/1795921967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1fd8103760 0x7f1fd8107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:06.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.489+0000 7f1fe0157640 1 --2- 172.21.15.5:0/1795921967 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fd8102db0 0x7f1fd8103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:06.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.489+0000 7f1fe0157640 1 -- 172.21.15.5:0/1795921967 >> 172.21.15.5:0/1795921967 conn(0x7f1fd80fc7d0 msgr2=0x7f1fd80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:06.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.489+0000 7f1fe0157640 1 -- 172.21.15.5:0/1795921967 shutdown_connections 2024-09-11T23:28:06.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.489+0000 7f1fe0157640 1 -- 172.21.15.5:0/1795921967 wait complete. 2024-09-11T23:28:06.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.490+0000 7f1fe0157640 1 Processor -- start 2024-09-11T23:28:06.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.490+0000 7f1fe0157640 1 -- start start 2024-09-11T23:28:06.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.490+0000 7f1fe0157640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1fd8102db0 0x7f1fd81985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:06.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.490+0000 7f1fe0157640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fd8103760 0x7f1fd8198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:06.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.490+0000 7f1fe0157640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fd81082e0 0x7f1fd819ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:06.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.490+0000 7f1fe0157640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1fd8111f60 con 0x7f1fd8103760 2024-09-11T23:28:06.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.490+0000 7f1fe0157640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1fd8111de0 con 0x7f1fd81082e0 2024-09-11T23:28:06.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.490+0000 7f1fe0157640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1fd81120e0 con 0x7f1fd8102db0 2024-09-11T23:28:06.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.490+0000 7f1fdd6f2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fd8103760 0x7f1fd8198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:06.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.490+0000 7f1fdd6f2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fd8103760 0x7f1fd8198af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42232/0 (socket says 172.21.15.5:42232) 2024-09-11T23:28:06.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.490+0000 7f1fdd6f2640 1 -- 172.21.15.5:0/2529935451 learned_addr learned my addr 172.21.15.5:0/2529935451 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:06.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.490+0000 7f1fddef3640 1 --2- 172.21.15.5:0/2529935451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1fd8102db0 0x7f1fd81985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:06.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.491+0000 7f1fde6f4640 1 --2- 172.21.15.5:0/2529935451 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fd81082e0 0x7f1fd819ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:06.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.491+0000 7f1fddef3640 1 -- 172.21.15.5:0/2529935451 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fd81082e0 msgr2=0x7f1fd819ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:06.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.491+0000 7f1fddef3640 1 --2- 172.21.15.5:0/2529935451 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fd81082e0 0x7f1fd819ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:06.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.491+0000 7f1fddef3640 1 -- 172.21.15.5:0/2529935451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fd8103760 msgr2=0x7f1fd8198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:06.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.491+0000 7f1fddef3640 1 --2- 172.21.15.5:0/2529935451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fd8103760 0x7f1fd8198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:06.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.491+0000 7f1fddef3640 1 -- 172.21.15.5:0/2529935451 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fd819d560 con 0x7f1fd8102db0 2024-09-11T23:28:06.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.491+0000 7f1fdd6f2640 1 --2- 172.21.15.5:0/2529935451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fd8103760 0x7f1fd8198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:28:06.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.491+0000 7f1fddef3640 1 --2- 172.21.15.5:0/2529935451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1fd8102db0 0x7f1fd81985b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1fd400d6d0 tx=0x7f1fd400db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:06.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.491+0000 7f1fceffd640 1 -- 172.21.15.5:0/2529935451 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd4017070 con 0x7f1fd8102db0 2024-09-11T23:28:06.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.491+0000 7f1fe0157640 1 -- 172.21.15.5:0/2529935451 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fd819d850 con 0x7f1fd8102db0 2024-09-11T23:28:06.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.491+0000 7f1fceffd640 1 -- 172.21.15.5:0/2529935451 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1fd4009820 con 0x7f1fd8102db0 2024-09-11T23:28:06.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.491+0000 7f1fceffd640 1 -- 172.21.15.5:0/2529935451 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd4004c40 con 0x7f1fd8102db0 2024-09-11T23:28:06.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.491+0000 7f1fe0157640 1 -- 172.21.15.5:0/2529935451 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fd81a5130 con 0x7f1fd8102db0 2024-09-11T23:28:06.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.492+0000 7f1fe0157640 1 -- 172.21.15.5:0/2529935451 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fd8103190 con 0x7f1fd8102db0 2024-09-11T23:28:06.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.493+0000 7f1fceffd640 1 -- 172.21.15.5:0/2529935451 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f1fd40099d0 con 0x7f1fd8102db0 2024-09-11T23:28:06.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.494+0000 7f1fceffd640 1 --2- 172.21.15.5:0/2529935451 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f1fc40a2c10 0x7f1fc40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:06.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.494+0000 7f1fceffd640 1 -- 172.21.15.5:0/2529935451 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7f1fd40cf210 con 0x7f1fd8102db0 2024-09-11T23:28:06.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.494+0000 7f1fdd6f2640 1 --2- 172.21.15.5:0/2529935451 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f1fc40a2c10 0x7f1fc40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:06.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.495+0000 7f1fdd6f2640 1 --2- 172.21.15.5:0/2529935451 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f1fc40a2c10 0x7f1fc40a50d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1fd80fee50 tx=0x7f1fc8005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:06.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.497+0000 7f1fceffd640 1 -- 172.21.15.5:0/2529935451 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1fd409bc50 con 0x7f1fd8102db0 2024-09-11T23:28:06.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.682+0000 7f1fe0157640 1 -- 172.21.15.5:0/2529935451 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f1fd810a2c0 con 0x7f1fd8102db0 2024-09-11T23:28:06.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.682+0000 7f1fceffd640 1 -- 172.21.15.5:0/2529935451 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f1fd409b550 con 0x7f1fd8102db0 2024-09-11T23:28:06.682 INFO:teuthology.orchestra.run.smithi005.stdout:287762808867 2024-09-11T23:28:06.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.684+0000 7f1fe0157640 1 -- 172.21.15.5:0/2529935451 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f1fc40a2c10 msgr2=0x7f1fc40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:06.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.684+0000 7f1fe0157640 1 --2- 172.21.15.5:0/2529935451 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f1fc40a2c10 0x7f1fc40a50d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1fd80fee50 tx=0x7f1fc8005f90 comp rx=0 tx=0).stop 2024-09-11T23:28:06.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.684+0000 7f1fe0157640 1 -- 172.21.15.5:0/2529935451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1fd8102db0 msgr2=0x7f1fd81985b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:06.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.684+0000 7f1fe0157640 1 --2- 172.21.15.5:0/2529935451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1fd8102db0 0x7f1fd81985b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1fd400d6d0 tx=0x7f1fd400db90 comp rx=0 tx=0).stop 2024-09-11T23:28:06.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.684+0000 7f1fe0157640 1 -- 172.21.15.5:0/2529935451 shutdown_connections 2024-09-11T23:28:06.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.684+0000 7f1fe0157640 1 --2- 172.21.15.5:0/2529935451 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f1fc40a2c10 0x7f1fc40a50d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:06.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.684+0000 7f1fe0157640 1 --2- 172.21.15.5:0/2529935451 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fd81082e0 0x7f1fd819ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:06.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.684+0000 7f1fe0157640 1 --2- 172.21.15.5:0/2529935451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fd8103760 0x7f1fd8198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:06.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.684+0000 7f1fe0157640 1 --2- 172.21.15.5:0/2529935451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1fd8102db0 0x7f1fd81985b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:06.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.684+0000 7f1fe0157640 1 -- 172.21.15.5:0/2529935451 >> 172.21.15.5:0/2529935451 conn(0x7f1fd80fc7d0 msgr2=0x7f1fd8105d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:06.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.684+0000 7f1fe0157640 1 -- 172.21.15.5:0/2529935451 shutdown_connections 2024-09-11T23:28:06.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:06.684+0000 7f1fe0157640 1 -- 172.21.15.5:0/2529935451 wait complete. 2024-09-11T23:28:07.096 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444104 got 73014444107 for osd.2 2024-09-11T23:28:07.097 DEBUG:teuthology.parallel:result is None 2024-09-11T23:28:07.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.296+0000 7f0b4c46c640 1 -- 172.21.15.5:0/3208192342 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b44102570 msgr2=0x7f0b441029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:07.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.296+0000 7f0b4c46c640 1 --2- 172.21.15.5:0/3208192342 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b44102570 0x7f0b441029b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0b38009900 tx=0x7f0b3802a480 comp rx=0 tx=0).stop 2024-09-11T23:28:07.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.296+0000 7f0b4c46c640 1 -- 172.21.15.5:0/3208192342 shutdown_connections 2024-09-11T23:28:07.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.296+0000 7f0b4c46c640 1 --2- 172.21.15.5:0/3208192342 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b44102ef0 0x7f0b4410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:07.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.296+0000 7f0b4c46c640 1 --2- 172.21.15.5:0/3208192342 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b44102570 0x7f0b441029b0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:07.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.296+0000 7f0b4c46c640 1 --2- 172.21.15.5:0/3208192342 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b44100e20 0x7f0b44101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:07.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.296+0000 7f0b4c46c640 1 -- 172.21.15.5:0/3208192342 >> 172.21.15.5:0/3208192342 conn(0x7f0b440fc7d0 msgr2=0x7f0b440febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:07.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.296+0000 7f0b4c46c640 1 -- 172.21.15.5:0/3208192342 shutdown_connections 2024-09-11T23:28:07.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.296+0000 7f0b4c46c640 1 -- 172.21.15.5:0/3208192342 wait complete. 2024-09-11T23:28:07.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.296+0000 7f0b4c46c640 1 Processor -- start 2024-09-11T23:28:07.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.296+0000 7f0b4c46c640 1 -- start start 2024-09-11T23:28:07.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.297+0000 7f0b4c46c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b44100e20 0x7f0b44198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:07.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.297+0000 7f0b4c46c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b44102570 0x7f0b44198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:07.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.297+0000 7f0b4c46c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b44102ef0 0x7f0b4419cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:07.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.297+0000 7f0b4c46c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0b44110e50 con 0x7f0b44102ef0 2024-09-11T23:28:07.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.297+0000 7f0b4c46c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f0b44110cd0 con 0x7f0b44102570 2024-09-11T23:28:07.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.297+0000 7f0b4c46c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0b44110fd0 con 0x7f0b44100e20 2024-09-11T23:28:07.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.297+0000 7f0b4aa09640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b44102ef0 0x7f0b4419cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:07.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.297+0000 7f0b4aa09640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b44102ef0 0x7f0b4419cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42250/0 (socket says 172.21.15.5:42250) 2024-09-11T23:28:07.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.297+0000 7f0b4aa09640 1 -- 172.21.15.5:0/2091074119 learned_addr learned my addr 172.21.15.5:0/2091074119 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:07.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.297+0000 7f0b4a208640 1 --2- 172.21.15.5:0/2091074119 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b44100e20 0x7f0b44198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:07.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.297+0000 7f0b49a07640 1 --2- 172.21.15.5:0/2091074119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b44102570 0x7f0b44198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:07.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.297+0000 7f0b4aa09640 1 -- 172.21.15.5:0/2091074119 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b44100e20 msgr2=0x7f0b44198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:07.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.297+0000 7f0b4aa09640 1 --2- 172.21.15.5:0/2091074119 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b44100e20 0x7f0b44198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:07.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.297+0000 7f0b4aa09640 1 -- 172.21.15.5:0/2091074119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b44102570 msgr2=0x7f0b44198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:07.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.297+0000 7f0b4aa09640 1 --2- 172.21.15.5:0/2091074119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b44102570 0x7f0b44198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:07.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.297+0000 7f0b4aa09640 1 -- 172.21.15.5:0/2091074119 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b4419d4d0 con 0x7f0b44102ef0 2024-09-11T23:28:07.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.297+0000 7f0b4aa09640 1 --2- 172.21.15.5:0/2091074119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b44102ef0 0x7f0b4419cdf0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c00d750 tx=0x7f0b3c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:07.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.297+0000 7f0b437fe640 1 -- 172.21.15.5:0/2091074119 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c017070 con 0x7f0b44102ef0 2024-09-11T23:28:07.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.297+0000 7f0b437fe640 1 -- 172.21.15.5:0/2091074119 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0b3c0054d0 con 0x7f0b44102ef0 2024-09-11T23:28:07.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.297+0000 7f0b4c46c640 1 -- 172.21.15.5:0/2091074119 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b4419d7c0 con 0x7f0b44102ef0 2024-09-11T23:28:07.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.298+0000 7f0b437fe640 1 -- 172.21.15.5:0/2091074119 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c004c60 con 0x7f0b44102ef0 2024-09-11T23:28:07.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.298+0000 7f0b4c46c640 1 -- 172.21.15.5:0/2091074119 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b441a50a0 con 0x7f0b44102ef0 2024-09-11T23:28:07.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.299+0000 7f0b4c46c640 1 -- 172.21.15.5:0/2091074119 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b44101200 con 0x7f0b44102ef0 2024-09-11T23:28:07.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.300+0000 7f0b437fe640 1 -- 172.21.15.5:0/2091074119 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f0b3c004e00 con 0x7f0b44102ef0 2024-09-11T23:28:07.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.300+0000 7f0b437fe640 1 --2- 172.21.15.5:0/2091074119 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f0b2c0a2c90 0x7f0b2c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:07.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.300+0000 7f0b4a208640 1 --2- 172.21.15.5:0/2091074119 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f0b2c0a2c90 0x7f0b2c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:07.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.300+0000 7f0b437fe640 1 -- 172.21.15.5:0/2091074119 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7f0b3c0cef20 con 0x7f0b44102ef0 2024-09-11T23:28:07.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.301+0000 7f0b4a208640 1 --2- 172.21.15.5:0/2091074119 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f0b2c0a2c90 0x7f0b2c0a5150 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0b3400a400 tx=0x7f0b3400d040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:07.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.305+0000 7f0b437fe640 1 -- 172.21.15.5:0/2091074119 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0b3c09b960 con 0x7f0b44102ef0 2024-09-11T23:28:07.323 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:07 smithi005 ceph-mon[31201]: pgmap v326: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T23:28:07.323 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:07 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/411045066' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-11T23:28:07.323 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:07 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/2529935451' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-11T23:28:07.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.482+0000 7f0b4c46c640 1 -- 172.21.15.5:0/2091074119 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f0b4410a0a0 con 0x7f0b44102ef0 2024-09-11T23:28:07.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.482+0000 7f0b437fe640 1 -- 172.21.15.5:0/2091074119 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f0b3c09b260 con 0x7f0b44102ef0 2024-09-11T23:28:07.482 INFO:teuthology.orchestra.run.smithi005.stdout:266287972392 2024-09-11T23:28:07.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.485+0000 7f0b4c46c640 1 -- 172.21.15.5:0/2091074119 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f0b2c0a2c90 msgr2=0x7f0b2c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:07.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.485+0000 7f0b4c46c640 1 --2- 172.21.15.5:0/2091074119 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f0b2c0a2c90 0x7f0b2c0a5150 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0b3400a400 tx=0x7f0b3400d040 comp rx=0 tx=0).stop 2024-09-11T23:28:07.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.485+0000 7f0b4c46c640 1 -- 172.21.15.5:0/2091074119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b44102ef0 msgr2=0x7f0b4419cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:07.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.485+0000 7f0b4c46c640 1 --2- 172.21.15.5:0/2091074119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b44102ef0 0x7f0b4419cdf0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c00d750 tx=0x7f0b3c00dc10 comp rx=0 tx=0).stop 2024-09-11T23:28:07.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.485+0000 7f0b4c46c640 1 -- 172.21.15.5:0/2091074119 shutdown_connections 2024-09-11T23:28:07.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.485+0000 7f0b4c46c640 1 --2- 172.21.15.5:0/2091074119 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f0b2c0a2c90 0x7f0b2c0a5150 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:07.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.485+0000 7f0b4c46c640 1 --2- 172.21.15.5:0/2091074119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b44102ef0 0x7f0b4419cdf0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:07.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.485+0000 7f0b4c46c640 1 --2- 172.21.15.5:0/2091074119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b44102570 0x7f0b44198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:07.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.485+0000 7f0b4c46c640 1 --2- 172.21.15.5:0/2091074119 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b44100e20 0x7f0b44198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:07.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.485+0000 7f0b4c46c640 1 -- 172.21.15.5:0/2091074119 >> 172.21.15.5:0/2091074119 conn(0x7f0b440fc7d0 msgr2=0x7f0b4406a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:07.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.485+0000 7f0b4c46c640 1 -- 172.21.15.5:0/2091074119 shutdown_connections 2024-09-11T23:28:07.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:07.485+0000 7f0b4c46c640 1 -- 172.21.15.5:0/2091074119 wait complete. 2024-09-11T23:28:07.539 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:28:07.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:07 smithi159 ceph-mon[34394]: pgmap v326: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T23:28:07.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:07 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/411045066' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-11T23:28:07.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:07 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/2529935451' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-11T23:28:07.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:07 smithi172 ceph-mon[34855]: pgmap v326: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T23:28:07.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:07 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/411045066' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-11T23:28:07.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:07 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/2529935451' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-11T23:28:07.989 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808864 got 287762808867 for osd.10 2024-09-11T23:28:07.989 DEBUG:teuthology.parallel:result is None 2024-09-11T23:28:08.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:08 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/2091074119' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-11T23:28:08.572 INFO:tasks.cephadm.ceph_manager.ceph:need seq 98784247875 got 98784247878 for osd.3 2024-09-11T23:28:08.573 DEBUG:teuthology.parallel:result is None 2024-09-11T23:28:08.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:08 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/2091074119' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-11T23:28:08.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:08 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/2091074119' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-11T23:28:09.140 INFO:tasks.cephadm.ceph_manager.ceph:need seq 206158430255 got 206158430258 for osd.7 2024-09-11T23:28:09.141 DEBUG:teuthology.parallel:result is None 2024-09-11T23:28:09.396 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:09 smithi005 ceph-mon[31201]: pgmap v327: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T23:28:09.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.483+0000 7f486eaaa640 1 -- 172.21.15.5:0/3833453502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4868106f10 msgr2=0x7f486810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:09.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.483+0000 7f486eaaa640 1 --2- 172.21.15.5:0/3833453502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4868106f10 0x7f486810ea90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4860009ca0 tx=0x7f486002a8c0 comp rx=0 tx=0).stop 2024-09-11T23:28:09.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.483+0000 7f486eaaa640 1 -- 172.21.15.5:0/3833453502 shutdown_connections 2024-09-11T23:28:09.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.483+0000 7f486eaaa640 1 --2- 172.21.15.5:0/3833453502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4868106f10 0x7f486810ea90 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:09.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.483+0000 7f486eaaa640 1 --2- 172.21.15.5:0/3833453502 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4868102790 0x7f48681067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:09.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.483+0000 7f486eaaa640 1 --2- 172.21.15.5:0/3833453502 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4868101de0 0x7f48681021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:09.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.483+0000 7f486eaaa640 1 -- 172.21.15.5:0/3833453502 >> 172.21.15.5:0/3833453502 conn(0x7f48680fd8c0 msgr2=0x7f48680ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:09.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.483+0000 7f486eaaa640 1 -- 172.21.15.5:0/3833453502 shutdown_connections 2024-09-11T23:28:09.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.483+0000 7f486eaaa640 1 -- 172.21.15.5:0/3833453502 wait complete. 2024-09-11T23:28:09.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.484+0000 7f486eaaa640 1 Processor -- start 2024-09-11T23:28:09.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.484+0000 7f486eaaa640 1 -- start start 2024-09-11T23:28:09.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.484+0000 7f486eaaa640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4868101de0 0x7f4868198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:09.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.484+0000 7f486eaaa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4868102790 0x7f4868198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:09.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.484+0000 7f486eaaa640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4868106f10 0x7f486819cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:09.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.484+0000 7f486eaaa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4868111e20 con 0x7f4868102790 2024-09-11T23:28:09.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.484+0000 7f486eaaa640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f4868111ca0 con 0x7f4868106f10 2024-09-11T23:28:09.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.484+0000 7f486eaaa640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4868111fa0 con 0x7f4868101de0 2024-09-11T23:28:09.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.484+0000 7f4867fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4868102790 0x7f4868198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:09.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.484+0000 7f4867fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4868102790 0x7f4868198860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42276/0 (socket says 172.21.15.5:42276) 2024-09-11T23:28:09.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.484+0000 7f4867fff640 1 -- 172.21.15.5:0/2302099434 learned_addr learned my addr 172.21.15.5:0/2302099434 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:09.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.484+0000 7f486c846640 1 --2- 172.21.15.5:0/2302099434 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4868101de0 0x7f4868198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:09.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.484+0000 7f486d047640 1 --2- 172.21.15.5:0/2302099434 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4868106f10 0x7f486819cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:09.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.484+0000 7f4867fff640 1 -- 172.21.15.5:0/2302099434 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4868101de0 msgr2=0x7f4868198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:09.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.484+0000 7f4867fff640 1 --2- 172.21.15.5:0/2302099434 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4868101de0 0x7f4868198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:09.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.484+0000 7f4867fff640 1 -- 172.21.15.5:0/2302099434 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4868106f10 msgr2=0x7f486819cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:09.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.484+0000 7f4867fff640 1 --2- 172.21.15.5:0/2302099434 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4868106f10 0x7f486819cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:09.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.484+0000 7f4867fff640 1 -- 172.21.15.5:0/2302099434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f486819d2d0 con 0x7f4868102790 2024-09-11T23:28:09.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.485+0000 7f4867fff640 1 --2- 172.21.15.5:0/2302099434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4868102790 0x7f4868198860 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f485c00c920 tx=0x7f485c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:09.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.485+0000 7f4865ffb640 1 -- 172.21.15.5:0/2302099434 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f485c007c70 con 0x7f4868102790 2024-09-11T23:28:09.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.485+0000 7f4865ffb640 1 -- 172.21.15.5:0/2302099434 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f485c007e10 con 0x7f4868102790 2024-09-11T23:28:09.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.485+0000 7f4865ffb640 1 -- 172.21.15.5:0/2302099434 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f485c018820 con 0x7f4868102790 2024-09-11T23:28:09.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.485+0000 7f486eaaa640 1 -- 172.21.15.5:0/2302099434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f486819d5c0 con 0x7f4868102790 2024-09-11T23:28:09.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.485+0000 7f486eaaa640 1 -- 172.21.15.5:0/2302099434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48681a4ea0 con 0x7f4868102790 2024-09-11T23:28:09.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.486+0000 7f486eaaa640 1 -- 172.21.15.5:0/2302099434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48681021c0 con 0x7f4868102790 2024-09-11T23:28:09.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.487+0000 7f4865ffb640 1 -- 172.21.15.5:0/2302099434 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f485c0189c0 con 0x7f4868102790 2024-09-11T23:28:09.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.488+0000 7f4865ffb640 1 --2- 172.21.15.5:0/2302099434 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f48500a2c10 0x7f48500a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:09.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.488+0000 7f486c846640 1 --2- 172.21.15.5:0/2302099434 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f48500a2c10 0x7f48500a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:09.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.488+0000 7f4865ffb640 1 -- 172.21.15.5:0/2302099434 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7f485c0cf6f0 con 0x7f4868102790 2024-09-11T23:28:09.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.489+0000 7f486c846640 1 --2- 172.21.15.5:0/2302099434 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f48500a2c10 0x7f48500a50d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f485800bbe0 tx=0x7f485800b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:09.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.493+0000 7f4865ffb640 1 -- 172.21.15.5:0/2302099434 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f485c014030 con 0x7f4868102790 2024-09-11T23:28:09.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:09 smithi159 ceph-mon[34394]: pgmap v327: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T23:28:09.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:09 smithi172 ceph-mon[34855]: pgmap v327: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T23:28:09.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.670+0000 7f486eaaa640 1 -- 172.21.15.5:0/2302099434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f486810a150 con 0x7f4868102790 2024-09-11T23:28:09.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.671+0000 7f4865ffb640 1 -- 172.21.15.5:0/2302099434 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f485c09c0d0 con 0x7f4868102790 2024-09-11T23:28:09.670 INFO:teuthology.orchestra.run.smithi005.stdout:150323855421 2024-09-11T23:28:09.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.673+0000 7f486eaaa640 1 -- 172.21.15.5:0/2302099434 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f48500a2c10 msgr2=0x7f48500a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:09.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.673+0000 7f486eaaa640 1 --2- 172.21.15.5:0/2302099434 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f48500a2c10 0x7f48500a50d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f485800bbe0 tx=0x7f485800b390 comp rx=0 tx=0).stop 2024-09-11T23:28:09.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.673+0000 7f486eaaa640 1 -- 172.21.15.5:0/2302099434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4868102790 msgr2=0x7f4868198860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:09.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.673+0000 7f486eaaa640 1 --2- 172.21.15.5:0/2302099434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4868102790 0x7f4868198860 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f485c00c920 tx=0x7f485c00cde0 comp rx=0 tx=0).stop 2024-09-11T23:28:09.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.673+0000 7f486eaaa640 1 -- 172.21.15.5:0/2302099434 shutdown_connections 2024-09-11T23:28:09.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.673+0000 7f486eaaa640 1 --2- 172.21.15.5:0/2302099434 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f48500a2c10 0x7f48500a50d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:09.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.673+0000 7f486eaaa640 1 --2- 172.21.15.5:0/2302099434 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4868106f10 0x7f486819cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:09.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.673+0000 7f486eaaa640 1 --2- 172.21.15.5:0/2302099434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4868102790 0x7f4868198860 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:09.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.673+0000 7f486eaaa640 1 --2- 172.21.15.5:0/2302099434 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4868101de0 0x7f4868198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:09.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.673+0000 7f486eaaa640 1 -- 172.21.15.5:0/2302099434 >> 172.21.15.5:0/2302099434 conn(0x7f48680fd8c0 msgr2=0x7f48680feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:09.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.673+0000 7f486eaaa640 1 -- 172.21.15.5:0/2302099434 shutdown_connections 2024-09-11T23:28:09.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:09.673+0000 7f486eaaa640 1 -- 172.21.15.5:0/2302099434 wait complete. 2024-09-11T23:28:10.155 INFO:tasks.cephadm.ceph_manager.ceph:need seq 266287972389 got 266287972392 for osd.9 2024-09-11T23:28:10.155 DEBUG:teuthology.parallel:result is None 2024-09-11T23:28:10.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:10 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/2302099434' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-11T23:28:10.494 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:28:10.495 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:28:10.495 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:28:10.497 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:28:10.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:10 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/2302099434' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-11T23:28:10.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:10 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/2302099434' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-11T23:28:10.923 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855418 got 150323855421 for osd.5 2024-09-11T23:28:10.923 DEBUG:teuthology.parallel:result is None 2024-09-11T23:28:11.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:11 smithi005 ceph-mon[31201]: pgmap v328: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 5 op/s 2024-09-11T23:28:11.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.611+0000 7f36e526a640 1 -- 172.21.15.5:0/63022369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36e0103760 msgr2=0x7f36e0107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:11.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.611+0000 7f36e526a640 1 --2- 172.21.15.5:0/63022369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36e0103760 0x7f36e0107ba0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f36d4009930 tx=0x7f36d402a420 comp rx=0 tx=0).stop 2024-09-11T23:28:11.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.611+0000 7f36e526a640 1 -- 172.21.15.5:0/63022369 shutdown_connections 2024-09-11T23:28:11.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.611+0000 7f36e526a640 1 --2- 172.21.15.5:0/63022369 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36e01082e0 0x7f36e010ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:11.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.611+0000 7f36e526a640 1 --2- 172.21.15.5:0/63022369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36e0103760 0x7f36e0107ba0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:11.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.611+0000 7f36e526a640 1 --2- 172.21.15.5:0/63022369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36e0102db0 0x7f36e0103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:11.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.611+0000 7f36e526a640 1 -- 172.21.15.5:0/63022369 >> 172.21.15.5:0/63022369 conn(0x7f36e00fc7d0 msgr2=0x7f36e00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:11.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.611+0000 7f36e526a640 1 -- 172.21.15.5:0/63022369 shutdown_connections 2024-09-11T23:28:11.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.611+0000 7f36e526a640 1 -- 172.21.15.5:0/63022369 wait complete. 2024-09-11T23:28:11.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.611+0000 7f36e526a640 1 Processor -- start 2024-09-11T23:28:11.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.612+0000 7f36e526a640 1 -- start start 2024-09-11T23:28:11.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.612+0000 7f36e526a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36e0102db0 0x7f36e0198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:11.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.612+0000 7f36e526a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36e0103760 0x7f36e01989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:11.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.612+0000 7f36e526a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36e01082e0 0x7f36e019cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:11.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.612+0000 7f36e526a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f36e0111f20 con 0x7f36e0102db0 2024-09-11T23:28:11.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.612+0000 7f36e526a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f36e0111da0 con 0x7f36e01082e0 2024-09-11T23:28:11.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.612+0000 7f36e526a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f36e01120a0 con 0x7f36e0103760 2024-09-11T23:28:11.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.612+0000 7f36deffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36e0102db0 0x7f36e0198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:11.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.612+0000 7f36deffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36e0102db0 0x7f36e0198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42292/0 (socket says 172.21.15.5:42292) 2024-09-11T23:28:11.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.612+0000 7f36deffd640 1 -- 172.21.15.5:0/1932965802 learned_addr learned my addr 172.21.15.5:0/1932965802 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:11.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.612+0000 7f36de7fc640 1 --2- 172.21.15.5:0/1932965802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36e0103760 0x7f36e01989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:11.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.612+0000 7f36df7fe640 1 --2- 172.21.15.5:0/1932965802 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36e01082e0 0x7f36e019cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:11.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.612+0000 7f36deffd640 1 -- 172.21.15.5:0/1932965802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36e0103760 msgr2=0x7f36e01989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:11.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.612+0000 7f36deffd640 1 --2- 172.21.15.5:0/1932965802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36e0103760 0x7f36e01989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:11.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.612+0000 7f36deffd640 1 -- 172.21.15.5:0/1932965802 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36e01082e0 msgr2=0x7f36e019cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:11.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.612+0000 7f36deffd640 1 --2- 172.21.15.5:0/1932965802 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36e01082e0 0x7f36e019cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:11.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.612+0000 7f36deffd640 1 -- 172.21.15.5:0/1932965802 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36e019d430 con 0x7f36e0102db0 2024-09-11T23:28:11.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.612+0000 7f36de7fc640 1 --2- 172.21.15.5:0/1932965802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36e0103760 0x7f36e01989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:28:11.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.612+0000 7f36df7fe640 1 --2- 172.21.15.5:0/1932965802 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36e01082e0 0x7f36e019cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:28:11.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.612+0000 7f36deffd640 1 --2- 172.21.15.5:0/1932965802 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36e0102db0 0x7f36e0198480 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f36d000ea80 tx=0x7f36d000ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:11.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.613+0000 7f36c7fff640 1 -- 172.21.15.5:0/1932965802 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d000ce40 con 0x7f36e0102db0 2024-09-11T23:28:11.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.613+0000 7f36c7fff640 1 -- 172.21.15.5:0/1932965802 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f36d0005020 con 0x7f36e0102db0 2024-09-11T23:28:11.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.613+0000 7f36e526a640 1 -- 172.21.15.5:0/1932965802 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36e019d720 con 0x7f36e0102db0 2024-09-11T23:28:11.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.613+0000 7f36c7fff640 1 -- 172.21.15.5:0/1932965802 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d00116d0 con 0x7f36e0102db0 2024-09-11T23:28:11.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.613+0000 7f36e526a640 1 -- 172.21.15.5:0/1932965802 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36e01a5000 con 0x7f36e0102db0 2024-09-11T23:28:11.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.614+0000 7f36e526a640 1 -- 172.21.15.5:0/1932965802 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36e0103190 con 0x7f36e0102db0 2024-09-11T23:28:11.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.615+0000 7f36c7fff640 1 -- 172.21.15.5:0/1932965802 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f36d00051d0 con 0x7f36e0102db0 2024-09-11T23:28:11.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.616+0000 7f36c7fff640 1 --2- 172.21.15.5:0/1932965802 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f36c80a2c10 0x7f36c80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:11.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.616+0000 7f36c7fff640 1 -- 172.21.15.5:0/1932965802 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7f36d00cf5d0 con 0x7f36e0102db0 2024-09-11T23:28:11.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.616+0000 7f36de7fc640 1 --2- 172.21.15.5:0/1932965802 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f36c80a2c10 0x7f36c80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:11.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.617+0000 7f36de7fc640 1 --2- 172.21.15.5:0/1932965802 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f36c80a2c10 0x7f36c80a50d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f36d4009900 tx=0x7f36d4005a20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:11.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.621+0000 7f36c7fff640 1 -- 172.21.15.5:0/1932965802 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f36d0016030 con 0x7f36e0102db0 2024-09-11T23:28:11.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:11 smithi159 ceph-mon[34394]: pgmap v328: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 5 op/s 2024-09-11T23:28:11.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:11 smithi172 ceph-mon[34855]: pgmap v328: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 5 op/s 2024-09-11T23:28:11.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.805+0000 7f36e526a640 1 -- 172.21.15.5:0/1932965802 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f36e01997e0 con 0x7f36e0102db0 2024-09-11T23:28:11.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.805+0000 7f36c7fff640 1 -- 172.21.15.5:0/1932965802 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f36d009c010 con 0x7f36e0102db0 2024-09-11T23:28:11.805 INFO:teuthology.orchestra.run.smithi005.stdout:128849018946 2024-09-11T23:28:11.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.807+0000 7f36e526a640 1 -- 172.21.15.5:0/1932965802 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f36c80a2c10 msgr2=0x7f36c80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:11.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.807+0000 7f36e526a640 1 --2- 172.21.15.5:0/1932965802 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f36c80a2c10 0x7f36c80a50d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f36d4009900 tx=0x7f36d4005a20 comp rx=0 tx=0).stop 2024-09-11T23:28:11.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.807+0000 7f36e526a640 1 -- 172.21.15.5:0/1932965802 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36e0102db0 msgr2=0x7f36e0198480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:11.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.807+0000 7f36e526a640 1 --2- 172.21.15.5:0/1932965802 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36e0102db0 0x7f36e0198480 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f36d000ea80 tx=0x7f36d000ef40 comp rx=0 tx=0).stop 2024-09-11T23:28:11.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.807+0000 7f36e526a640 1 -- 172.21.15.5:0/1932965802 shutdown_connections 2024-09-11T23:28:11.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.807+0000 7f36e526a640 1 --2- 172.21.15.5:0/1932965802 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f36c80a2c10 0x7f36c80a50d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:11.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.807+0000 7f36e526a640 1 --2- 172.21.15.5:0/1932965802 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36e01082e0 0x7f36e019cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:11.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.807+0000 7f36e526a640 1 --2- 172.21.15.5:0/1932965802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36e0103760 0x7f36e01989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:11.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.807+0000 7f36e526a640 1 --2- 172.21.15.5:0/1932965802 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36e0102db0 0x7f36e0198480 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:11.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.807+0000 7f36e526a640 1 -- 172.21.15.5:0/1932965802 >> 172.21.15.5:0/1932965802 conn(0x7f36e00fc7d0 msgr2=0x7f36e0105df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:11.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.808+0000 7f36e526a640 1 -- 172.21.15.5:0/1932965802 shutdown_connections 2024-09-11T23:28:11.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.808+0000 7f36e526a640 1 -- 172.21.15.5:0/1932965802 wait complete. 2024-09-11T23:28:11.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.973+0000 7fc0cb15b640 1 -- 172.21.15.5:0/1016598938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0c4106f10 msgr2=0x7fc0c410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:11.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.973+0000 7fc0cb15b640 1 --2- 172.21.15.5:0/1016598938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0c4106f10 0x7fc0c410ea90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc009ca0 tx=0x7fc0bc02a8c0 comp rx=0 tx=0).stop 2024-09-11T23:28:11.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.973+0000 7fc0cb15b640 1 -- 172.21.15.5:0/1016598938 shutdown_connections 2024-09-11T23:28:11.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.973+0000 7fc0cb15b640 1 --2- 172.21.15.5:0/1016598938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0c4106f10 0x7fc0c410ea90 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:11.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.973+0000 7fc0cb15b640 1 --2- 172.21.15.5:0/1016598938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0c4102790 0x7fc0c41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:11.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.973+0000 7fc0cb15b640 1 --2- 172.21.15.5:0/1016598938 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0c4101de0 0x7fc0c41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:11.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.973+0000 7fc0cb15b640 1 -- 172.21.15.5:0/1016598938 >> 172.21.15.5:0/1016598938 conn(0x7fc0c40fd8c0 msgr2=0x7fc0c40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:11.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.973+0000 7fc0cb15b640 1 -- 172.21.15.5:0/1016598938 shutdown_connections 2024-09-11T23:28:11.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.973+0000 7fc0cb15b640 1 -- 172.21.15.5:0/1016598938 wait complete. 2024-09-11T23:28:11.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.973+0000 7fc0cb15b640 1 Processor -- start 2024-09-11T23:28:11.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.974+0000 7fc0cb15b640 1 -- start start 2024-09-11T23:28:11.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.974+0000 7fc0cb15b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0c4101de0 0x7fc0c41983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:11.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.974+0000 7fc0cb15b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0c4102790 0x7fc0c4198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:11.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.974+0000 7fc0cb15b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0c4106f10 0x7fc0c419ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:11.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.974+0000 7fc0cb15b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c4111e40 con 0x7fc0c4102790 2024-09-11T23:28:11.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.974+0000 7fc0cb15b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c4111cc0 con 0x7fc0c4106f10 2024-09-11T23:28:11.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.974+0000 7fc0cb15b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c4111fc0 con 0x7fc0c4101de0 2024-09-11T23:28:11.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.974+0000 7fc0bbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0c4102790 0x7fc0c4198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:11.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.974+0000 7fc0bbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0c4102790 0x7fc0c4198920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42308/0 (socket says 172.21.15.5:42308) 2024-09-11T23:28:11.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.974+0000 7fc0bbfff640 1 -- 172.21.15.5:0/1244269136 learned_addr learned my addr 172.21.15.5:0/1244269136 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:11.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.974+0000 7fc0c96f8640 1 --2- 172.21.15.5:0/1244269136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0c4106f10 0x7fc0c419ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:11.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.974+0000 7fc0c8ef7640 1 --2- 172.21.15.5:0/1244269136 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0c4101de0 0x7fc0c41983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:11.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.974+0000 7fc0bbfff640 1 -- 172.21.15.5:0/1244269136 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0c4101de0 msgr2=0x7fc0c41983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:11.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.974+0000 7fc0bbfff640 1 --2- 172.21.15.5:0/1244269136 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0c4101de0 0x7fc0c41983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:11.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.974+0000 7fc0bbfff640 1 -- 172.21.15.5:0/1244269136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0c4106f10 msgr2=0x7fc0c419ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:11.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.974+0000 7fc0bbfff640 1 --2- 172.21.15.5:0/1244269136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0c4106f10 0x7fc0c419ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:11.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.974+0000 7fc0bbfff640 1 -- 172.21.15.5:0/1244269136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0c419d390 con 0x7fc0c4102790 2024-09-11T23:28:11.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.974+0000 7fc0c8ef7640 1 --2- 172.21.15.5:0/1244269136 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0c4101de0 0x7fc0c41983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:28:11.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.974+0000 7fc0bbfff640 1 --2- 172.21.15.5:0/1244269136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0c4102790 0x7fc0c4198920 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc0b400b4a0 tx=0x7fc0b400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:11.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.975+0000 7fc0b9ffb640 1 -- 172.21.15.5:0/1244269136 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b4014070 con 0x7fc0c4102790 2024-09-11T23:28:11.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.975+0000 7fc0cb15b640 1 -- 172.21.15.5:0/1244269136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0c419d680 con 0x7fc0c4102790 2024-09-11T23:28:11.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.975+0000 7fc0b9ffb640 1 -- 172.21.15.5:0/1244269136 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc0b4010ac0 con 0x7fc0c4102790 2024-09-11T23:28:11.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.975+0000 7fc0b9ffb640 1 -- 172.21.15.5:0/1244269136 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b4017c30 con 0x7fc0c4102790 2024-09-11T23:28:11.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.975+0000 7fc0cb15b640 1 -- 172.21.15.5:0/1244269136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0c41a4f60 con 0x7fc0c4102790 2024-09-11T23:28:11.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.976+0000 7fc0cb15b640 1 -- 172.21.15.5:0/1244269136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0c41021c0 con 0x7fc0c4102790 2024-09-11T23:28:11.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.977+0000 7fc0b9ffb640 1 -- 172.21.15.5:0/1244269136 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fc0b4017070 con 0x7fc0c4102790 2024-09-11T23:28:11.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.978+0000 7fc0b9ffb640 1 --2- 172.21.15.5:0/1244269136 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fc0ac0a2c10 0x7fc0ac0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:11.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.978+0000 7fc0c8ef7640 1 --2- 172.21.15.5:0/1244269136 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fc0ac0a2c10 0x7fc0ac0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:11.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.978+0000 7fc0b9ffb640 1 -- 172.21.15.5:0/1244269136 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7fc0b40ce920 con 0x7fc0c4102790 2024-09-11T23:28:11.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.978+0000 7fc0c8ef7640 1 --2- 172.21.15.5:0/1244269136 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fc0ac0a2c10 0x7fc0ac0a50d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc0c00058c0 tx=0x7fc0c0005d30 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:11.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:11.982+0000 7fc0b9ffb640 1 -- 172.21.15.5:0/1244269136 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc0b409b470 con 0x7fc0c4102790 2024-09-11T23:28:12.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:12.162+0000 7fc0cb15b640 1 -- 172.21.15.5:0/1244269136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fc0c4109bc0 con 0x7fc0c4102790 2024-09-11T23:28:12.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:12.162+0000 7fc0b9ffb640 1 -- 172.21.15.5:0/1244269136 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc0b409ad70 con 0x7fc0c4102790 2024-09-11T23:28:12.162 INFO:teuthology.orchestra.run.smithi005.stdout:55834574928 2024-09-11T23:28:12.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:12.165+0000 7fc0cb15b640 1 -- 172.21.15.5:0/1244269136 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fc0ac0a2c10 msgr2=0x7fc0ac0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:12.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:12.165+0000 7fc0cb15b640 1 --2- 172.21.15.5:0/1244269136 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fc0ac0a2c10 0x7fc0ac0a50d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc0c00058c0 tx=0x7fc0c0005d30 comp rx=0 tx=0).stop 2024-09-11T23:28:12.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:12.165+0000 7fc0cb15b640 1 -- 172.21.15.5:0/1244269136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0c4102790 msgr2=0x7fc0c4198920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:12.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:12.165+0000 7fc0cb15b640 1 --2- 172.21.15.5:0/1244269136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0c4102790 0x7fc0c4198920 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc0b400b4a0 tx=0x7fc0b400b960 comp rx=0 tx=0).stop 2024-09-11T23:28:12.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:12.165+0000 7fc0cb15b640 1 -- 172.21.15.5:0/1244269136 shutdown_connections 2024-09-11T23:28:12.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:12.165+0000 7fc0cb15b640 1 --2- 172.21.15.5:0/1244269136 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fc0ac0a2c10 0x7fc0ac0a50d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:12.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:12.165+0000 7fc0cb15b640 1 --2- 172.21.15.5:0/1244269136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0c4106f10 0x7fc0c419ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:12.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:12.165+0000 7fc0cb15b640 1 --2- 172.21.15.5:0/1244269136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0c4102790 0x7fc0c4198920 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:12.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:12.165+0000 7fc0cb15b640 1 --2- 172.21.15.5:0/1244269136 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0c4101de0 0x7fc0c41983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:12.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:12.165+0000 7fc0cb15b640 1 -- 172.21.15.5:0/1244269136 >> 172.21.15.5:0/1244269136 conn(0x7fc0c40fd8c0 msgr2=0x7fc0c40fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:12.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:12.165+0000 7fc0cb15b640 1 -- 172.21.15.5:0/1244269136 shutdown_connections 2024-09-11T23:28:12.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:12.165+0000 7fc0cb15b640 1 -- 172.21.15.5:0/1244269136 wait complete. 2024-09-11T23:28:12.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:12 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/1932965802' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-11T23:28:12.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:12 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/1244269136' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-11T23:28:12.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:12 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/1932965802' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-11T23:28:12.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:12 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/1244269136' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-11T23:28:12.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:12 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/1932965802' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-11T23:28:12.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:12 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/1244269136' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-11T23:28:13.071 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574926 got 55834574928 for osd.1 2024-09-11T23:28:13.071 DEBUG:teuthology.parallel:result is None 2024-09-11T23:28:13.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.236+0000 7f46e2e19640 1 -- 172.21.15.5:0/1449237313 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46dc103660 msgr2=0x7f46dc10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:13.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.236+0000 7f46e2e19640 1 --2- 172.21.15.5:0/1449237313 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46dc103660 0x7f46dc10bb50 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f46cc009900 tx=0x7f46cc02a480 comp rx=0 tx=0).stop 2024-09-11T23:28:13.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.236+0000 7f46e2e19640 1 -- 172.21.15.5:0/1449237313 shutdown_connections 2024-09-11T23:28:13.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.236+0000 7f46e2e19640 1 --2- 172.21.15.5:0/1449237313 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46dc10c170 0x7f46dc10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:13.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.236+0000 7f46e2e19640 1 --2- 172.21.15.5:0/1449237313 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46dc103660 0x7f46dc10bb50 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:13.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.236+0000 7f46e2e19640 1 --2- 172.21.15.5:0/1449237313 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46dc102d40 0x7f46dc103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:13.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.236+0000 7f46e2e19640 1 -- 172.21.15.5:0/1449237313 >> 172.21.15.5:0/1449237313 conn(0x7f46dc0fc7a0 msgr2=0x7f46dc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:13.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.236+0000 7f46e2e19640 1 -- 172.21.15.5:0/1449237313 shutdown_connections 2024-09-11T23:28:13.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.236+0000 7f46e2e19640 1 -- 172.21.15.5:0/1449237313 wait complete. 2024-09-11T23:28:13.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.237+0000 7f46e2e19640 1 Processor -- start 2024-09-11T23:28:13.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.237+0000 7f46e2e19640 1 -- start start 2024-09-11T23:28:13.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.237+0000 7f46e2e19640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46dc102d40 0x7f46dc19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:13.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.237+0000 7f46e2e19640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46dc103660 0x7f46dc19ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:13.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.237+0000 7f46e2e19640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46dc10c170 0x7f46dc19eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:13.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.237+0000 7f46e2e19640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f46dc111e20 con 0x7f46dc10c170 2024-09-11T23:28:13.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.237+0000 7f46e2e19640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f46dc111ca0 con 0x7f46dc102d40 2024-09-11T23:28:13.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.237+0000 7f46e2e19640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f46dc111fa0 con 0x7f46dc103660 2024-09-11T23:28:13.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.237+0000 7f46e13b6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46dc10c170 0x7f46dc19eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:13.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.237+0000 7f46e13b6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46dc10c170 0x7f46dc19eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42320/0 (socket says 172.21.15.5:42320) 2024-09-11T23:28:13.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.237+0000 7f46e13b6640 1 -- 172.21.15.5:0/2155128762 learned_addr learned my addr 172.21.15.5:0/2155128762 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:13.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.237+0000 7f46e0bb5640 1 --2- 172.21.15.5:0/2155128762 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46dc102d40 0x7f46dc19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:13.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.237+0000 7f46d3fff640 1 --2- 172.21.15.5:0/2155128762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46dc103660 0x7f46dc19ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:13.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.238+0000 7f46e13b6640 1 -- 172.21.15.5:0/2155128762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46dc103660 msgr2=0x7f46dc19ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:13.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.238+0000 7f46e13b6640 1 --2- 172.21.15.5:0/2155128762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46dc103660 0x7f46dc19ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:13.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.238+0000 7f46e13b6640 1 -- 172.21.15.5:0/2155128762 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46dc102d40 msgr2=0x7f46dc19a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:13.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.238+0000 7f46e13b6640 1 --2- 172.21.15.5:0/2155128762 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46dc102d40 0x7f46dc19a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:13.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.238+0000 7f46e13b6640 1 -- 172.21.15.5:0/2155128762 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46dc19f5b0 con 0x7f46dc10c170 2024-09-11T23:28:13.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.238+0000 7f46e13b6640 1 --2- 172.21.15.5:0/2155128762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46dc10c170 0x7f46dc19eed0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f46d400eaa0 tx=0x7f46d400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:13.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.238+0000 7f46d1ffb640 1 -- 172.21.15.5:0/2155128762 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d400cdb0 con 0x7f46dc10c170 2024-09-11T23:28:13.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.238+0000 7f46d1ffb640 1 -- 172.21.15.5:0/2155128762 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f46d4005020 con 0x7f46dc10c170 2024-09-11T23:28:13.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.238+0000 7f46e2e19640 1 -- 172.21.15.5:0/2155128762 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46dc19f8a0 con 0x7f46dc10c170 2024-09-11T23:28:13.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.238+0000 7f46d1ffb640 1 -- 172.21.15.5:0/2155128762 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d40116d0 con 0x7f46dc10c170 2024-09-11T23:28:13.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.238+0000 7f46e2e19640 1 -- 172.21.15.5:0/2155128762 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46dc1a7180 con 0x7f46dc10c170 2024-09-11T23:28:13.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.239+0000 7f46e2e19640 1 -- 172.21.15.5:0/2155128762 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46dc103120 con 0x7f46dc10c170 2024-09-11T23:28:13.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.240+0000 7f46d1ffb640 1 -- 172.21.15.5:0/2155128762 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f46d40051d0 con 0x7f46dc10c170 2024-09-11T23:28:13.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.241+0000 7f46d1ffb640 1 --2- 172.21.15.5:0/2155128762 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f46c40a2c90 0x7f46c40a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:13.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.241+0000 7f46d1ffb640 1 -- 172.21.15.5:0/2155128762 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7f46d40cf630 con 0x7f46dc10c170 2024-09-11T23:28:13.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.241+0000 7f46e0bb5640 1 --2- 172.21.15.5:0/2155128762 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f46c40a2c90 0x7f46c40a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:13.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.242+0000 7f46e0bb5640 1 --2- 172.21.15.5:0/2155128762 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f46c40a2c90 0x7f46c40a5150 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f46d800bbe0 tx=0x7f46d800b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:13.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.245+0000 7f46d1ffb640 1 -- 172.21.15.5:0/2155128762 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f46d4016030 con 0x7f46dc10c170 2024-09-11T23:28:13.404 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:13 smithi005 ceph-mon[31201]: pgmap v329: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-11T23:28:13.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.426+0000 7f46e2e19640 1 -- 172.21.15.5:0/2155128762 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f46dc1a7480 con 0x7f46dc10c170 2024-09-11T23:28:13.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.427+0000 7f46d1ffb640 1 -- 172.21.15.5:0/2155128762 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f46d409c070 con 0x7f46dc10c170 2024-09-11T23:28:13.426 INFO:teuthology.orchestra.run.smithi005.stdout:236223201326 2024-09-11T23:28:13.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.429+0000 7f46e2e19640 1 -- 172.21.15.5:0/2155128762 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f46c40a2c90 msgr2=0x7f46c40a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:13.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.429+0000 7f46e2e19640 1 --2- 172.21.15.5:0/2155128762 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f46c40a2c90 0x7f46c40a5150 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f46d800bbe0 tx=0x7f46d800b390 comp rx=0 tx=0).stop 2024-09-11T23:28:13.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.429+0000 7f46e2e19640 1 -- 172.21.15.5:0/2155128762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46dc10c170 msgr2=0x7f46dc19eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:13.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.429+0000 7f46e2e19640 1 --2- 172.21.15.5:0/2155128762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46dc10c170 0x7f46dc19eed0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f46d400eaa0 tx=0x7f46d400ef60 comp rx=0 tx=0).stop 2024-09-11T23:28:13.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.429+0000 7f46e2e19640 1 -- 172.21.15.5:0/2155128762 shutdown_connections 2024-09-11T23:28:13.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.429+0000 7f46e2e19640 1 --2- 172.21.15.5:0/2155128762 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f46c40a2c90 0x7f46c40a5150 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:13.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.429+0000 7f46e2e19640 1 --2- 172.21.15.5:0/2155128762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46dc10c170 0x7f46dc19eed0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:13.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.429+0000 7f46e2e19640 1 --2- 172.21.15.5:0/2155128762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46dc103660 0x7f46dc19ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:13.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.429+0000 7f46e2e19640 1 --2- 172.21.15.5:0/2155128762 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46dc102d40 0x7f46dc19a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:13.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.429+0000 7f46e2e19640 1 -- 172.21.15.5:0/2155128762 >> 172.21.15.5:0/2155128762 conn(0x7f46dc0fc7a0 msgr2=0x7f46dc101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:13.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.429+0000 7f46e2e19640 1 -- 172.21.15.5:0/2155128762 shutdown_connections 2024-09-11T23:28:13.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:13.429+0000 7f46e2e19640 1 -- 172.21.15.5:0/2155128762 wait complete. 2024-09-11T23:28:13.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:13 smithi159 ceph-mon[34394]: pgmap v329: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-11T23:28:13.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:13 smithi172 ceph-mon[34855]: pgmap v329: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-11T23:28:14.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.068+0000 7f9e3517c640 1 -- 172.21.15.5:0/1130527811 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e30106f10 msgr2=0x7f9e3010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:14.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.068+0000 7f9e3517c640 1 --2- 172.21.15.5:0/1130527811 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e30106f10 0x7f9e3010ea90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9e28009ca0 tx=0x7f9e2802a8c0 comp rx=0 tx=0).stop 2024-09-11T23:28:14.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.068+0000 7f9e3517c640 1 -- 172.21.15.5:0/1130527811 shutdown_connections 2024-09-11T23:28:14.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.068+0000 7f9e3517c640 1 --2- 172.21.15.5:0/1130527811 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e30106f10 0x7f9e3010ea90 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:14.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.068+0000 7f9e3517c640 1 --2- 172.21.15.5:0/1130527811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e30102790 0x7f9e301067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:14.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.068+0000 7f9e3517c640 1 --2- 172.21.15.5:0/1130527811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e30101de0 0x7f9e301021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:14.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.069+0000 7f9e3517c640 1 -- 172.21.15.5:0/1130527811 >> 172.21.15.5:0/1130527811 conn(0x7f9e300fd8c0 msgr2=0x7f9e300ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:14.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.069+0000 7f9e3517c640 1 -- 172.21.15.5:0/1130527811 shutdown_connections 2024-09-11T23:28:14.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.069+0000 7f9e3517c640 1 -- 172.21.15.5:0/1130527811 wait complete. 2024-09-11T23:28:14.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.069+0000 7f9e3517c640 1 Processor -- start 2024-09-11T23:28:14.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.069+0000 7f9e3517c640 1 -- start start 2024-09-11T23:28:14.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.070+0000 7f9e3517c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e30101de0 0x7f9e30198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:14.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.070+0000 7f9e3517c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e30102790 0x7f9e30198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:14.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.070+0000 7f9e3517c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e30106f10 0x7f9e3019cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:14.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.070+0000 7f9e3517c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9e30111e20 con 0x7f9e30106f10 2024-09-11T23:28:14.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.070+0000 7f9e3517c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9e30111ca0 con 0x7f9e30101de0 2024-09-11T23:28:14.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.070+0000 7f9e3517c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9e30111fa0 con 0x7f9e30102790 2024-09-11T23:28:14.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.070+0000 7f9e2f59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e30106f10 0x7f9e3019cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:14.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.070+0000 7f9e2f59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e30106f10 0x7f9e3019cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54160/0 (socket says 172.21.15.5:54160) 2024-09-11T23:28:14.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.070+0000 7f9e2f59e640 1 -- 172.21.15.5:0/3466649931 learned_addr learned my addr 172.21.15.5:0/3466649931 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:14.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.070+0000 7f9e2e59c640 1 --2- 172.21.15.5:0/3466649931 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e30102790 0x7f9e30198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:14.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.070+0000 7f9e2ed9d640 1 --2- 172.21.15.5:0/3466649931 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e30101de0 0x7f9e30198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:14.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.070+0000 7f9e2f59e640 1 -- 172.21.15.5:0/3466649931 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e30102790 msgr2=0x7f9e30198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:14.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.070+0000 7f9e2f59e640 1 --2- 172.21.15.5:0/3466649931 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e30102790 0x7f9e30198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:14.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.070+0000 7f9e2f59e640 1 -- 172.21.15.5:0/3466649931 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e30101de0 msgr2=0x7f9e30198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:14.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.070+0000 7f9e2f59e640 1 --2- 172.21.15.5:0/3466649931 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e30101de0 0x7f9e30198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:14.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.070+0000 7f9e2f59e640 1 -- 172.21.15.5:0/3466649931 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e3019d2f0 con 0x7f9e30106f10 2024-09-11T23:28:14.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.071+0000 7f9e2f59e640 1 --2- 172.21.15.5:0/3466649931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e30106f10 0x7f9e3019cc10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9e28009dc0 tx=0x7f9e28032ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:14.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.071+0000 7f9e17fff640 1 -- 172.21.15.5:0/3466649931 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e28003cf0 con 0x7f9e30106f10 2024-09-11T23:28:14.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.071+0000 7f9e17fff640 1 -- 172.21.15.5:0/3466649931 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9e280044f0 con 0x7f9e30106f10 2024-09-11T23:28:14.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.071+0000 7f9e3517c640 1 -- 172.21.15.5:0/3466649931 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e3019d580 con 0x7f9e30106f10 2024-09-11T23:28:14.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.071+0000 7f9e17fff640 1 -- 172.21.15.5:0/3466649931 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e28030bf0 con 0x7f9e30106f10 2024-09-11T23:28:14.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.071+0000 7f9e3517c640 1 -- 172.21.15.5:0/3466649931 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e301a4ec0 con 0x7f9e30106f10 2024-09-11T23:28:14.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.072+0000 7f9e3517c640 1 -- 172.21.15.5:0/3466649931 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e301021c0 con 0x7f9e30106f10 2024-09-11T23:28:14.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.073+0000 7f9e17fff640 1 -- 172.21.15.5:0/3466649931 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f9e28004040 con 0x7f9e30106f10 2024-09-11T23:28:14.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.074+0000 7f9e17fff640 1 --2- 172.21.15.5:0/3466649931 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f9e180a2c10 0x7f9e180a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:14.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.074+0000 7f9e17fff640 1 -- 172.21.15.5:0/3466649931 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7f9e280f09f0 con 0x7f9e30106f10 2024-09-11T23:28:14.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.074+0000 7f9e2ed9d640 1 --2- 172.21.15.5:0/3466649931 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f9e180a2c10 0x7f9e180a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:14.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.074+0000 7f9e2ed9d640 1 --2- 172.21.15.5:0/3466649931 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f9e180a2c10 0x7f9e180a50d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9e20005d00 tx=0x7f9e2000b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:14.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.078+0000 7f9e17fff640 1 -- 172.21.15.5:0/3466649931 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9e280bd540 con 0x7f9e30106f10 2024-09-11T23:28:14.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.271+0000 7f9e3517c640 1 -- 172.21.15.5:0/3466649931 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f9e3010a150 con 0x7f9e30106f10 2024-09-11T23:28:14.271 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:14 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/2155128762' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-11T23:28:14.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.272+0000 7f9e17fff640 1 -- 172.21.15.5:0/3466649931 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f9e280bce40 con 0x7f9e30106f10 2024-09-11T23:28:14.272 INFO:teuthology.orchestra.run.smithi005.stdout:317827579936 2024-09-11T23:28:14.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.274+0000 7f9e3517c640 1 -- 172.21.15.5:0/3466649931 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f9e180a2c10 msgr2=0x7f9e180a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:14.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.274+0000 7f9e3517c640 1 --2- 172.21.15.5:0/3466649931 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f9e180a2c10 0x7f9e180a50d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9e20005d00 tx=0x7f9e2000b410 comp rx=0 tx=0).stop 2024-09-11T23:28:14.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.274+0000 7f9e3517c640 1 -- 172.21.15.5:0/3466649931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e30106f10 msgr2=0x7f9e3019cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:14.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.274+0000 7f9e3517c640 1 --2- 172.21.15.5:0/3466649931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e30106f10 0x7f9e3019cc10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9e28009dc0 tx=0x7f9e28032ff0 comp rx=0 tx=0).stop 2024-09-11T23:28:14.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.274+0000 7f9e3517c640 1 -- 172.21.15.5:0/3466649931 shutdown_connections 2024-09-11T23:28:14.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.274+0000 7f9e3517c640 1 --2- 172.21.15.5:0/3466649931 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f9e180a2c10 0x7f9e180a50d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:14.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.274+0000 7f9e3517c640 1 --2- 172.21.15.5:0/3466649931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e30106f10 0x7f9e3019cc10 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:14.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.274+0000 7f9e3517c640 1 --2- 172.21.15.5:0/3466649931 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e30102790 0x7f9e30198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:14.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.274+0000 7f9e3517c640 1 --2- 172.21.15.5:0/3466649931 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e30101de0 0x7f9e30198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:14.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.274+0000 7f9e3517c640 1 -- 172.21.15.5:0/3466649931 >> 172.21.15.5:0/3466649931 conn(0x7f9e300fd8c0 msgr2=0x7f9e300fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:14.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.274+0000 7f9e3517c640 1 -- 172.21.15.5:0/3466649931 shutdown_connections 2024-09-11T23:28:14.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:14.274+0000 7f9e3517c640 1 -- 172.21.15.5:0/3466649931 wait complete. 2024-09-11T23:28:14.557 INFO:tasks.cephadm.ceph_manager.ceph:need seq 236223201323 got 236223201326 for osd.8 2024-09-11T23:28:14.557 DEBUG:teuthology.parallel:result is None 2024-09-11T23:28:14.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:14 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/2155128762' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-11T23:28:14.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:14 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/2155128762' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-11T23:28:14.834 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018943 got 128849018946 for osd.4 2024-09-11T23:28:14.834 DEBUG:teuthology.parallel:result is None 2024-09-11T23:28:15.412 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:15 smithi005 ceph-mon[31201]: pgmap v330: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T23:28:15.412 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:15 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/3466649931' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-11T23:28:15.449 INFO:tasks.cephadm.ceph_manager.ceph:need seq 317827579931 got 317827579936 for osd.11 2024-09-11T23:28:15.450 DEBUG:teuthology.parallel:result is None 2024-09-11T23:28:15.450 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-11T23:28:15.450 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T23:28:15.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:15 smithi159 ceph-mon[34394]: pgmap v330: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T23:28:15.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:15 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/3466649931' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-11T23:28:15.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:15 smithi172 ceph-mon[34855]: pgmap v330: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T23:28:15.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:15 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/3466649931' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-11T23:28:15.717 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:28:16.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.231+0000 7f4537790640 1 -- 172.21.15.5:0/1742065816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f453010e480 msgr2=0x7f4530110870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:16.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.231+0000 7f4537790640 1 --2- 172.21.15.5:0/1742065816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f453010e480 0x7f4530110870 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4528009ca0 tx=0x7f452802a8c0 comp rx=0 tx=0).stop 2024-09-11T23:28:16.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.231+0000 7f4537790640 1 -- 172.21.15.5:0/1742065816 shutdown_connections 2024-09-11T23:28:16.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.231+0000 7f4537790640 1 --2- 172.21.15.5:0/1742065816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f453010e480 0x7f4530110870 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:16.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.231+0000 7f4537790640 1 --2- 172.21.15.5:0/1742065816 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4530101280 0x7f453010df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:16.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.231+0000 7f4537790640 1 --2- 172.21.15.5:0/1742065816 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45301008d0 0x7f4530100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:16.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.231+0000 7f4537790640 1 -- 172.21.15.5:0/1742065816 >> 172.21.15.5:0/1742065816 conn(0x7f45300fc7a0 msgr2=0x7f45300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:16.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.231+0000 7f4537790640 1 -- 172.21.15.5:0/1742065816 shutdown_connections 2024-09-11T23:28:16.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.231+0000 7f4537790640 1 -- 172.21.15.5:0/1742065816 wait complete. 2024-09-11T23:28:16.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.232+0000 7f4537790640 1 Processor -- start 2024-09-11T23:28:16.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.232+0000 7f4537790640 1 -- start start 2024-09-11T23:28:16.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.232+0000 7f4537790640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45301008d0 0x7f453019a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:16.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.232+0000 7f4537790640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4530101280 0x7f453019ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:16.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.232+0000 7f4537790640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f453010e480 0x7f453019eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:16.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.232+0000 7f4537790640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4530114030 con 0x7f453010e480 2024-09-11T23:28:16.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.232+0000 7f4537790640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f4530113eb0 con 0x7f4530101280 2024-09-11T23:28:16.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.232+0000 7f4537790640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f45301141b0 con 0x7f45301008d0 2024-09-11T23:28:16.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.233+0000 7f4535d2d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f453010e480 0x7f453019eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:16.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.233+0000 7f453552c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45301008d0 0x7f453019a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:16.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.233+0000 7f4535d2d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f453010e480 0x7f453019eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54174/0 (socket says 172.21.15.5:54174) 2024-09-11T23:28:16.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.233+0000 7f4535d2d640 1 -- 172.21.15.5:0/3447052627 learned_addr learned my addr 172.21.15.5:0/3447052627 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:16.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.233+0000 7f453552c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45301008d0 0x7f453019a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.5:52748/0 (socket says 172.21.15.5:52748) 2024-09-11T23:28:16.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.233+0000 7f4534d2b640 1 --2- 172.21.15.5:0/3447052627 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4530101280 0x7f453019ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:16.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.233+0000 7f4535d2d640 1 -- 172.21.15.5:0/3447052627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45301008d0 msgr2=0x7f453019a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:16.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.233+0000 7f4535d2d640 1 --2- 172.21.15.5:0/3447052627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45301008d0 0x7f453019a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:16.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.233+0000 7f4535d2d640 1 -- 172.21.15.5:0/3447052627 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4530101280 msgr2=0x7f453019ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:16.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.233+0000 7f4535d2d640 1 --2- 172.21.15.5:0/3447052627 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4530101280 0x7f453019ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:16.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.233+0000 7f4535d2d640 1 -- 172.21.15.5:0/3447052627 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f453019f580 con 0x7f453010e480 2024-09-11T23:28:16.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.233+0000 7f453552c640 1 --2- 172.21.15.5:0/3447052627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45301008d0 0x7f453019a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:28:16.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.233+0000 7f4535d2d640 1 --2- 172.21.15.5:0/3447052627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f453010e480 0x7f453019eea0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4528004af0 tx=0x7f4528032ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:16.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.235+0000 7f45267fc640 1 -- 172.21.15.5:0/3447052627 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4528003d30 con 0x7f453010e480 2024-09-11T23:28:16.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.235+0000 7f45267fc640 1 -- 172.21.15.5:0/3447052627 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f45280044f0 con 0x7f453010e480 2024-09-11T23:28:16.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.235+0000 7f4537790640 1 -- 172.21.15.5:0/3447052627 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f453019f810 con 0x7f453010e480 2024-09-11T23:28:16.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.235+0000 7f45267fc640 1 -- 172.21.15.5:0/3447052627 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4528030c60 con 0x7f453010e480 2024-09-11T23:28:16.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.235+0000 7f4537790640 1 -- 172.21.15.5:0/3447052627 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45301a7150 con 0x7f453010e480 2024-09-11T23:28:16.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.236+0000 7f4537790640 1 -- 172.21.15.5:0/3447052627 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4530100cb0 con 0x7f453010e480 2024-09-11T23:28:16.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.237+0000 7f45267fc640 1 -- 172.21.15.5:0/3447052627 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f45280046a0 con 0x7f453010e480 2024-09-11T23:28:16.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.238+0000 7f45267fc640 1 --2- 172.21.15.5:0/3447052627 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f451c0a2c90 0x7f451c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:16.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.238+0000 7f453552c640 1 --2- 172.21.15.5:0/3447052627 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f451c0a2c90 0x7f451c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:16.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.238+0000 7f45267fc640 1 -- 172.21.15.5:0/3447052627 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7f45280f0ae0 con 0x7f453010e480 2024-09-11T23:28:16.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.238+0000 7f453552c640 1 --2- 172.21.15.5:0/3447052627 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f451c0a2c90 0x7f451c0a5150 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f452c0058c0 tx=0x7f452c00a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:16.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.242+0000 7f45267fc640 1 -- 172.21.15.5:0/3447052627 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f45280bd660 con 0x7f453010e480 2024-09-11T23:28:16.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.414+0000 7f4537790640 1 -- 172.21.15.5:0/3447052627 --> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4530062630 con 0x7f451c0a2c90 2024-09-11T23:28:16.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.423+0000 7f45267fc640 1 -- 172.21.15.5:0/3447052627 <== mgr.14148 v2:172.21.15.5:6800/2285128668 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340575 (secure 0 0 0) 0x7f4530062630 con 0x7f451c0a2c90 2024-09-11T23:28:16.427 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:28:16.429 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-11T23:28:16.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.426+0000 7f4537790640 1 -- 172.21.15.5:0/3447052627 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f451c0a2c90 msgr2=0x7f451c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:16.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.426+0000 7f4537790640 1 --2- 172.21.15.5:0/3447052627 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f451c0a2c90 0x7f451c0a5150 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f452c0058c0 tx=0x7f452c00a2d0 comp rx=0 tx=0).stop 2024-09-11T23:28:16.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.426+0000 7f4537790640 1 -- 172.21.15.5:0/3447052627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f453010e480 msgr2=0x7f453019eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:16.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.426+0000 7f4537790640 1 --2- 172.21.15.5:0/3447052627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f453010e480 0x7f453019eea0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4528004af0 tx=0x7f4528032ff0 comp rx=0 tx=0).stop 2024-09-11T23:28:16.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.426+0000 7f4537790640 1 -- 172.21.15.5:0/3447052627 shutdown_connections 2024-09-11T23:28:16.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.426+0000 7f4537790640 1 --2- 172.21.15.5:0/3447052627 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f451c0a2c90 0x7f451c0a5150 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:16.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.426+0000 7f4537790640 1 --2- 172.21.15.5:0/3447052627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f453010e480 0x7f453019eea0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:16.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.426+0000 7f4537790640 1 --2- 172.21.15.5:0/3447052627 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4530101280 0x7f453019ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:16.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.426+0000 7f4537790640 1 --2- 172.21.15.5:0/3447052627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45301008d0 0x7f453019a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:16.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.426+0000 7f4537790640 1 -- 172.21.15.5:0/3447052627 >> 172.21.15.5:0/3447052627 conn(0x7f45300fc7a0 msgr2=0x7f45300feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:16.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.426+0000 7f4537790640 1 -- 172.21.15.5:0/3447052627 shutdown_connections 2024-09-11T23:28:16.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:16.427+0000 7f4537790640 1 -- 172.21.15.5:0/3447052627 wait complete. 2024-09-11T23:28:17.137 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":331,"stamp":"2024-09-11T23:28:16.142871+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657691,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":466,"num_read_kb":349,"num_write":350,"num_write_kb":3056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":281,"ondisk_log_size":281,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":369516,"kb_used_data":11876,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124572308,"statfs":{"total":1151940427776,"available":1151562043392,"internally_reserved":0,"allocated":12161024,"data_stored":7942919,"data_compressed":393366,"data_compressed_allocated":528384,"data_compressed_original":2555904,"omap_allocated":19142,"internal_metadata":365933882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":35,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003492"},"pg_stats":[{"pgid":"2.1f","version":"86'9","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.101738+0000","last_change":"2024-09-11T23:26:42.617529+0000","last_active":"2024-09-11T23:27:52.101738+0000","last_peered":"2024-09-11T23:27:52.101738+0000","last_clean":"2024-09-11T23:27:52.101738+0000","last_became_active":"2024-09-11T23:26:42.616841+0000","last_became_peered":"2024-09-11T23:26:42.616841+0000","last_unstale":"2024-09-11T23:27:52.101738+0000","last_undegraded":"2024-09-11T23:27:52.101738+0000","last_fullsized":"2024-09-11T23:27:52.101738+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:32.464566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.179696+0000","last_change":"2024-09-11T23:26:44.700282+0000","last_active":"2024-09-11T23:27:52.179696+0000","last_peered":"2024-09-11T23:27:52.179696+0000","last_clean":"2024-09-11T23:27:52.179696+0000","last_became_active":"2024-09-11T23:26:44.700046+0000","last_became_peered":"2024-09-11T23:26:44.700046+0000","last_unstale":"2024-09-11T23:27:52.179696+0000","last_undegraded":"2024-09-11T23:27:52.179696+0000","last_fullsized":"2024-09-11T23:27:52.179696+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:10.211467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.180486+0000","last_change":"2024-09-11T23:27:52.180486+0000","last_active":"2024-09-11T23:27:52.180486+0000","last_peered":"2024-09-11T23:27:52.180486+0000","last_clean":"2024-09-11T23:27:52.180486+0000","last_became_active":"2024-09-11T23:27:52.180057+0000","last_became_peered":"2024-09-11T23:27:52.180057+0000","last_unstale":"2024-09-11T23:27:52.180486+0000","last_undegraded":"2024-09-11T23:27:52.180486+0000","last_fullsized":"2024-09-11T23:27:52.180486+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:08.087489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,10,0],"acting":[2,3,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.179881+0000","last_change":"2024-09-11T23:26:42.645941+0000","last_active":"2024-09-11T23:27:52.179881+0000","last_peered":"2024-09-11T23:27:52.179881+0000","last_clean":"2024-09-11T23:27:52.179881+0000","last_became_active":"2024-09-11T23:26:42.645590+0000","last_became_peered":"2024-09-11T23:26:42.645590+0000","last_unstale":"2024-09-11T23:27:52.179881+0000","last_undegraded":"2024-09-11T23:27:52.179881+0000","last_fullsized":"2024-09-11T23:27:52.179881+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:20.374936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.160516+0000","last_change":"2024-09-11T23:26:44.684678+0000","last_active":"2024-09-11T23:27:52.160516+0000","last_peered":"2024-09-11T23:27:52.160516+0000","last_clean":"2024-09-11T23:27:52.160516+0000","last_became_active":"2024-09-11T23:26:44.684001+0000","last_became_peered":"2024-09-11T23:26:44.684001+0000","last_unstale":"2024-09-11T23:27:52.160516+0000","last_undegraded":"2024-09-11T23:27:52.160516+0000","last_fullsized":"2024-09-11T23:27:52.160516+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:57.773985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.103686+0000","last_change":"2024-09-11T23:26:52.073563+0000","last_active":"2024-09-11T23:27:52.103686+0000","last_peered":"2024-09-11T23:27:52.103686+0000","last_clean":"2024-09-11T23:27:52.103686+0000","last_became_active":"2024-09-11T23:26:52.072851+0000","last_became_peered":"2024-09-11T23:26:52.072851+0000","last_unstale":"2024-09-11T23:27:52.103686+0000","last_undegraded":"2024-09-11T23:27:52.103686+0000","last_fullsized":"2024-09-11T23:27:52.103686+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:25.711274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"86'4","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.103801+0000","last_change":"2024-09-11T23:26:42.618190+0000","last_active":"2024-09-11T23:27:52.103801+0000","last_peered":"2024-09-11T23:27:52.103801+0000","last_clean":"2024-09-11T23:27:52.103801+0000","last_became_active":"2024-09-11T23:26:42.617797+0000","last_became_peered":"2024-09-11T23:26:42.617797+0000","last_unstale":"2024-09-11T23:27:52.103801+0000","last_undegraded":"2024-09-11T23:27:52.103801+0000","last_fullsized":"2024-09-11T23:27:52.103801+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:47.800168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.881543+0000","last_change":"2024-09-11T23:26:44.690899+0000","last_active":"2024-09-11T23:27:52.881543+0000","last_peered":"2024-09-11T23:27:52.881543+0000","last_clean":"2024-09-11T23:27:52.881543+0000","last_became_active":"2024-09-11T23:26:44.690552+0000","last_became_peered":"2024-09-11T23:26:44.690552+0000","last_unstale":"2024-09-11T23:27:52.881543+0000","last_undegraded":"2024-09-11T23:27:52.881543+0000","last_fullsized":"2024-09-11T23:27:52.881543+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:02.148342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.490928+0000","last_change":"2024-09-11T23:27:52.490928+0000","last_active":"2024-09-11T23:27:52.490928+0000","last_peered":"2024-09-11T23:27:52.490928+0000","last_clean":"2024-09-11T23:27:52.490928+0000","last_became_active":"2024-09-11T23:27:52.490568+0000","last_became_peered":"2024-09-11T23:27:52.490568+0000","last_unstale":"2024-09-11T23:27:52.490928+0000","last_undegraded":"2024-09-11T23:27:52.490928+0000","last_fullsized":"2024-09-11T23:27:52.490928+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:31.196463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.756064+0000","last_change":"2024-09-11T23:26:52.072018+0000","last_active":"2024-09-11T23:27:52.756064+0000","last_peered":"2024-09-11T23:27:52.756064+0000","last_clean":"2024-09-11T23:27:52.756064+0000","last_became_active":"2024-09-11T23:26:52.062541+0000","last_became_peered":"2024-09-11T23:26:52.062541+0000","last_unstale":"2024-09-11T23:27:52.756064+0000","last_undegraded":"2024-09-11T23:27:52.756064+0000","last_fullsized":"2024-09-11T23:27:52.756064+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:38.371660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.490251+0000","last_change":"2024-09-11T23:26:52.068090+0000","last_active":"2024-09-11T23:27:52.490251+0000","last_peered":"2024-09-11T23:27:52.490251+0000","last_clean":"2024-09-11T23:27:52.490251+0000","last_became_active":"2024-09-11T23:26:52.067755+0000","last_became_peered":"2024-09-11T23:26:52.067755+0000","last_unstale":"2024-09-11T23:27:52.490251+0000","last_undegraded":"2024-09-11T23:27:52.490251+0000","last_fullsized":"2024-09-11T23:27:52.490251+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:09.250735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.103911+0000","last_change":"2024-09-11T23:26:52.063609+0000","last_active":"2024-09-11T23:27:52.103911+0000","last_peered":"2024-09-11T23:27:52.103911+0000","last_clean":"2024-09-11T23:27:52.103911+0000","last_became_active":"2024-09-11T23:26:52.063212+0000","last_became_peered":"2024-09-11T23:26:52.063212+0000","last_unstale":"2024-09-11T23:27:52.103911+0000","last_undegraded":"2024-09-11T23:27:52.103911+0000","last_fullsized":"2024-09-11T23:27:52.103911+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:51.706288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.756299+0000","last_change":"2024-09-11T23:26:44.700390+0000","last_active":"2024-09-11T23:27:52.756299+0000","last_peered":"2024-09-11T23:27:52.756299+0000","last_clean":"2024-09-11T23:27:52.756299+0000","last_became_active":"2024-09-11T23:26:44.700062+0000","last_became_peered":"2024-09-11T23:26:44.700062+0000","last_unstale":"2024-09-11T23:27:52.756299+0000","last_undegraded":"2024-09-11T23:27:52.756299+0000","last_fullsized":"2024-09-11T23:27:52.756299+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:50.934552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.103862+0000","last_change":"2024-09-11T23:26:42.616879+0000","last_active":"2024-09-11T23:27:52.103862+0000","last_peered":"2024-09-11T23:27:52.103862+0000","last_clean":"2024-09-11T23:27:52.103862+0000","last_became_active":"2024-09-11T23:26:42.616522+0000","last_became_peered":"2024-09-11T23:26:42.616522+0000","last_unstale":"2024-09-11T23:27:52.103862+0000","last_undegraded":"2024-09-11T23:27:52.103862+0000","last_fullsized":"2024-09-11T23:27:52.103862+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:47.903838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.104252+0000","last_change":"2024-09-11T23:26:52.064232+0000","last_active":"2024-09-11T23:27:52.104252+0000","last_peered":"2024-09-11T23:27:52.104252+0000","last_clean":"2024-09-11T23:27:52.104252+0000","last_became_active":"2024-09-11T23:26:52.063559+0000","last_became_peered":"2024-09-11T23:26:52.063559+0000","last_unstale":"2024-09-11T23:27:52.104252+0000","last_undegraded":"2024-09-11T23:27:52.104252+0000","last_fullsized":"2024-09-11T23:27:52.104252+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:48.967531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.179549+0000","last_change":"2024-09-11T23:26:44.691634+0000","last_active":"2024-09-11T23:27:52.179549+0000","last_peered":"2024-09-11T23:27:52.179549+0000","last_clean":"2024-09-11T23:27:52.179549+0000","last_became_active":"2024-09-11T23:26:44.690900+0000","last_became_peered":"2024-09-11T23:26:44.690900+0000","last_unstale":"2024-09-11T23:27:52.179549+0000","last_undegraded":"2024-09-11T23:27:52.179549+0000","last_fullsized":"2024-09-11T23:27:52.179549+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:37.129433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"86'1","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.102793+0000","last_change":"2024-09-11T23:26:42.613452+0000","last_active":"2024-09-11T23:27:52.102793+0000","last_peered":"2024-09-11T23:27:52.102793+0000","last_clean":"2024-09-11T23:27:52.102793+0000","last_became_active":"2024-09-11T23:26:42.612943+0000","last_became_peered":"2024-09-11T23:26:42.612943+0000","last_unstale":"2024-09-11T23:27:52.102793+0000","last_undegraded":"2024-09-11T23:27:52.102793+0000","last_fullsized":"2024-09-11T23:27:52.102793+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:57.337796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"86'1","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.104369+0000","last_change":"2024-09-11T23:26:52.072930+0000","last_active":"2024-09-11T23:27:52.104369+0000","last_peered":"2024-09-11T23:27:52.104369+0000","last_clean":"2024-09-11T23:27:52.104369+0000","last_became_active":"2024-09-11T23:26:52.071512+0000","last_became_peered":"2024-09-11T23:26:52.071512+0000","last_unstale":"2024-09-11T23:27:52.104369+0000","last_undegraded":"2024-09-11T23:27:52.104369+0000","last_fullsized":"2024-09-11T23:27:52.104369+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:48.913194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.755986+0000","last_change":"2024-09-11T23:26:44.705318+0000","last_active":"2024-09-11T23:27:52.755986+0000","last_peered":"2024-09-11T23:27:52.755986+0000","last_clean":"2024-09-11T23:27:52.755986+0000","last_became_active":"2024-09-11T23:26:44.704974+0000","last_became_peered":"2024-09-11T23:26:44.704974+0000","last_unstale":"2024-09-11T23:27:52.755986+0000","last_undegraded":"2024-09-11T23:27:52.755986+0000","last_fullsized":"2024-09-11T23:27:52.755986+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:44.252769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"86'3","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.179463+0000","last_change":"2024-09-11T23:26:42.615528+0000","last_active":"2024-09-11T23:27:52.179463+0000","last_peered":"2024-09-11T23:27:52.179463+0000","last_clean":"2024-09-11T23:27:52.179463+0000","last_became_active":"2024-09-11T23:26:42.615182+0000","last_became_peered":"2024-09-11T23:26:42.615182+0000","last_unstale":"2024-09-11T23:27:52.179463+0000","last_undegraded":"2024-09-11T23:27:52.179463+0000","last_fullsized":"2024-09-11T23:27:52.179463+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:40.491178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.101567+0000","last_change":"2024-09-11T23:26:52.074907+0000","last_active":"2024-09-11T23:27:52.101567+0000","last_peered":"2024-09-11T23:27:52.101567+0000","last_clean":"2024-09-11T23:27:52.101567+0000","last_became_active":"2024-09-11T23:26:52.074645+0000","last_became_peered":"2024-09-11T23:26:52.074645+0000","last_unstale":"2024-09-11T23:27:52.101567+0000","last_undegraded":"2024-09-11T23:27:52.101567+0000","last_fullsized":"2024-09-11T23:27:52.101567+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:37.885656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.103613+0000","last_change":"2024-09-11T23:26:44.700291+0000","last_active":"2024-09-11T23:27:52.103613+0000","last_peered":"2024-09-11T23:27:52.103613+0000","last_clean":"2024-09-11T23:27:52.103613+0000","last_became_active":"2024-09-11T23:26:44.699965+0000","last_became_peered":"2024-09-11T23:26:44.699965+0000","last_unstale":"2024-09-11T23:27:52.103613+0000","last_undegraded":"2024-09-11T23:27:52.103613+0000","last_fullsized":"2024-09-11T23:27:52.103613+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:10.526254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.881347+0000","last_change":"2024-09-11T23:26:42.645574+0000","last_active":"2024-09-11T23:27:52.881347+0000","last_peered":"2024-09-11T23:27:52.881347+0000","last_clean":"2024-09-11T23:27:52.881347+0000","last_became_active":"2024-09-11T23:26:42.645266+0000","last_became_peered":"2024-09-11T23:26:42.645266+0000","last_unstale":"2024-09-11T23:27:52.881347+0000","last_undegraded":"2024-09-11T23:27:52.881347+0000","last_fullsized":"2024-09-11T23:27:52.881347+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:54.343564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.104312+0000","last_change":"2024-09-11T23:26:52.072072+0000","last_active":"2024-09-11T23:27:52.104312+0000","last_peered":"2024-09-11T23:27:52.104312+0000","last_clean":"2024-09-11T23:27:52.104312+0000","last_became_active":"2024-09-11T23:26:52.071488+0000","last_became_peered":"2024-09-11T23:26:52.071488+0000","last_unstale":"2024-09-11T23:27:52.104312+0000","last_undegraded":"2024-09-11T23:27:52.104312+0000","last_fullsized":"2024-09-11T23:27:52.104312+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:22.788819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.160456+0000","last_change":"2024-09-11T23:26:44.692168+0000","last_active":"2024-09-11T23:27:52.160456+0000","last_peered":"2024-09-11T23:27:52.160456+0000","last_clean":"2024-09-11T23:27:52.160456+0000","last_became_active":"2024-09-11T23:26:44.691842+0000","last_became_peered":"2024-09-11T23:26:44.691842+0000","last_unstale":"2024-09-11T23:27:52.160456+0000","last_undegraded":"2024-09-11T23:27:52.160456+0000","last_fullsized":"2024-09-11T23:27:52.160456+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:58.143490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"86'4","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.104484+0000","last_change":"2024-09-11T23:26:42.640164+0000","last_active":"2024-09-11T23:27:52.104484+0000","last_peered":"2024-09-11T23:27:52.104484+0000","last_clean":"2024-09-11T23:27:52.104484+0000","last_became_active":"2024-09-11T23:26:42.639827+0000","last_became_peered":"2024-09-11T23:26:42.639827+0000","last_unstale":"2024-09-11T23:27:52.104484+0000","last_undegraded":"2024-09-11T23:27:52.104484+0000","last_fullsized":"2024-09-11T23:27:52.104484+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:18.250513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.103566+0000","last_change":"2024-09-11T23:26:52.063970+0000","last_active":"2024-09-11T23:27:52.103566+0000","last_peered":"2024-09-11T23:27:52.103566+0000","last_clean":"2024-09-11T23:27:52.103566+0000","last_became_active":"2024-09-11T23:26:52.063575+0000","last_became_peered":"2024-09-11T23:26:52.063575+0000","last_unstale":"2024-09-11T23:27:52.103566+0000","last_undegraded":"2024-09-11T23:27:52.103566+0000","last_fullsized":"2024-09-11T23:27:52.103566+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:59.828888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.179903+0000","last_change":"2024-09-11T23:26:44.696709+0000","last_active":"2024-09-11T23:27:52.179903+0000","last_peered":"2024-09-11T23:27:52.179903+0000","last_clean":"2024-09-11T23:27:52.179903+0000","last_became_active":"2024-09-11T23:26:44.696401+0000","last_became_peered":"2024-09-11T23:26:44.696401+0000","last_unstale":"2024-09-11T23:27:52.179903+0000","last_undegraded":"2024-09-11T23:27:52.179903+0000","last_fullsized":"2024-09-11T23:27:52.179903+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:58:23.823664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"86'11","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.101647+0000","last_change":"2024-09-11T23:26:42.611182+0000","last_active":"2024-09-11T23:27:52.101647+0000","last_peered":"2024-09-11T23:27:52.101647+0000","last_clean":"2024-09-11T23:27:52.101647+0000","last_became_active":"2024-09-11T23:26:42.610843+0000","last_became_peered":"2024-09-11T23:26:42.610843+0000","last_unstale":"2024-09-11T23:27:52.101647+0000","last_undegraded":"2024-09-11T23:27:52.101647+0000","last_fullsized":"2024-09-11T23:27:52.101647+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:14.099591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.179081+0000","last_change":"2024-09-11T23:26:52.061367+0000","last_active":"2024-09-11T23:27:52.179081+0000","last_peered":"2024-09-11T23:27:52.179081+0000","last_clean":"2024-09-11T23:27:52.179081+0000","last_became_active":"2024-09-11T23:26:52.061005+0000","last_became_peered":"2024-09-11T23:26:52.061005+0000","last_unstale":"2024-09-11T23:27:52.179081+0000","last_undegraded":"2024-09-11T23:27:52.179081+0000","last_fullsized":"2024-09-11T23:27:52.179081+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:19.705133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.223722+0000","last_change":"2024-09-11T23:26:44.699122+0000","last_active":"2024-09-11T23:27:52.223722+0000","last_peered":"2024-09-11T23:27:52.223722+0000","last_clean":"2024-09-11T23:27:52.223722+0000","last_became_active":"2024-09-11T23:26:44.698813+0000","last_became_peered":"2024-09-11T23:26:44.698813+0000","last_unstale":"2024-09-11T23:27:52.223722+0000","last_undegraded":"2024-09-11T23:27:52.223722+0000","last_fullsized":"2024-09-11T23:27:52.223722+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:42.286431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"86'1","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.104467+0000","last_change":"2024-09-11T23:26:42.645612+0000","last_active":"2024-09-11T23:27:52.104467+0000","last_peered":"2024-09-11T23:27:52.104467+0000","last_clean":"2024-09-11T23:27:52.104467+0000","last_became_active":"2024-09-11T23:26:42.645228+0000","last_became_peered":"2024-09-11T23:26:42.645228+0000","last_unstale":"2024-09-11T23:27:52.104467+0000","last_undegraded":"2024-09-11T23:27:52.104467+0000","last_fullsized":"2024-09-11T23:27:52.104467+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:12.068952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.755995+0000","last_change":"2024-09-11T23:26:52.062843+0000","last_active":"2024-09-11T23:27:52.755995+0000","last_peered":"2024-09-11T23:27:52.755995+0000","last_clean":"2024-09-11T23:27:52.755995+0000","last_became_active":"2024-09-11T23:26:52.062446+0000","last_became_peered":"2024-09-11T23:26:52.062446+0000","last_unstale":"2024-09-11T23:27:52.755995+0000","last_undegraded":"2024-09-11T23:27:52.755995+0000","last_fullsized":"2024-09-11T23:27:52.755995+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:03.934877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.102293+0000","last_change":"2024-09-11T23:26:44.690179+0000","last_active":"2024-09-11T23:27:52.102293+0000","last_peered":"2024-09-11T23:27:52.102293+0000","last_clean":"2024-09-11T23:27:52.102293+0000","last_became_active":"2024-09-11T23:26:44.689856+0000","last_became_peered":"2024-09-11T23:26:44.689856+0000","last_unstale":"2024-09-11T23:27:52.102293+0000","last_undegraded":"2024-09-11T23:27:52.102293+0000","last_fullsized":"2024-09-11T23:27:52.102293+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:46.546000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.101459+0000","last_change":"2024-09-11T23:26:42.646678+0000","last_active":"2024-09-11T23:27:52.101459+0000","last_peered":"2024-09-11T23:27:52.101459+0000","last_clean":"2024-09-11T23:27:52.101459+0000","last_became_active":"2024-09-11T23:26:42.645748+0000","last_became_peered":"2024-09-11T23:26:42.645748+0000","last_unstale":"2024-09-11T23:27:52.101459+0000","last_undegraded":"2024-09-11T23:27:52.101459+0000","last_fullsized":"2024-09-11T23:27:52.101459+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:41.497025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.104101+0000","last_change":"2024-09-11T23:26:52.065357+0000","last_active":"2024-09-11T23:27:52.104101+0000","last_peered":"2024-09-11T23:27:52.104101+0000","last_clean":"2024-09-11T23:27:52.104101+0000","last_became_active":"2024-09-11T23:26:52.065004+0000","last_became_peered":"2024-09-11T23:26:52.065004+0000","last_unstale":"2024-09-11T23:27:52.104101+0000","last_undegraded":"2024-09-11T23:27:52.104101+0000","last_fullsized":"2024-09-11T23:27:52.104101+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:30.975294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.102312+0000","last_change":"2024-09-11T23:26:44.694358+0000","last_active":"2024-09-11T23:27:52.102312+0000","last_peered":"2024-09-11T23:27:52.102312+0000","last_clean":"2024-09-11T23:27:52.102312+0000","last_became_active":"2024-09-11T23:26:44.693305+0000","last_became_peered":"2024-09-11T23:26:44.693305+0000","last_unstale":"2024-09-11T23:27:52.102312+0000","last_undegraded":"2024-09-11T23:27:52.102312+0000","last_fullsized":"2024-09-11T23:27:52.102312+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:48.107696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'1","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.756706+0000","last_change":"2024-09-11T23:26:42.619221+0000","last_active":"2024-09-11T23:27:52.756706+0000","last_peered":"2024-09-11T23:27:52.756706+0000","last_clean":"2024-09-11T23:27:52.756706+0000","last_became_active":"2024-09-11T23:26:42.618833+0000","last_became_peered":"2024-09-11T23:26:42.618833+0000","last_unstale":"2024-09-11T23:27:52.756706+0000","last_undegraded":"2024-09-11T23:27:52.756706+0000","last_fullsized":"2024-09-11T23:27:52.756706+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:40.584145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.223540+0000","last_change":"2024-09-11T23:26:52.061287+0000","last_active":"2024-09-11T23:27:52.223540+0000","last_peered":"2024-09-11T23:27:52.223540+0000","last_clean":"2024-09-11T23:27:52.223540+0000","last_became_active":"2024-09-11T23:26:52.060904+0000","last_became_peered":"2024-09-11T23:26:52.060904+0000","last_unstale":"2024-09-11T23:27:52.223540+0000","last_undegraded":"2024-09-11T23:27:52.223540+0000","last_fullsized":"2024-09-11T23:27:52.223540+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:49.456325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.489448+0000","last_change":"2024-09-11T23:26:44.696624+0000","last_active":"2024-09-11T23:27:52.489448+0000","last_peered":"2024-09-11T23:27:52.489448+0000","last_clean":"2024-09-11T23:27:52.489448+0000","last_became_active":"2024-09-11T23:26:44.695521+0000","last_became_peered":"2024-09-11T23:26:44.695521+0000","last_unstale":"2024-09-11T23:27:52.489448+0000","last_undegraded":"2024-09-11T23:27:52.489448+0000","last_fullsized":"2024-09-11T23:27:52.489448+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:42.026975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'4","reported_seq":92,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:28:14.119726+0000","last_change":"2024-09-11T23:26:42.645319+0000","last_active":"2024-09-11T23:28:14.119726+0000","last_peered":"2024-09-11T23:28:14.119726+0000","last_clean":"2024-09-11T23:28:14.119726+0000","last_became_active":"2024-09-11T23:26:42.644986+0000","last_became_peered":"2024-09-11T23:26:42.644986+0000","last_unstale":"2024-09-11T23:28:14.119726+0000","last_undegraded":"2024-09-11T23:28:14.119726+0000","last_fullsized":"2024-09-11T23:28:14.119726+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:06.020663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.223751+0000","last_change":"2024-09-11T23:26:52.061235+0000","last_active":"2024-09-11T23:27:52.223751+0000","last_peered":"2024-09-11T23:27:52.223751+0000","last_clean":"2024-09-11T23:27:52.223751+0000","last_became_active":"2024-09-11T23:26:52.060827+0000","last_became_peered":"2024-09-11T23:26:52.060827+0000","last_unstale":"2024-09-11T23:27:52.223751+0000","last_undegraded":"2024-09-11T23:27:52.223751+0000","last_fullsized":"2024-09-11T23:27:52.223751+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:52.354881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.223181+0000","last_change":"2024-09-11T23:26:44.694777+0000","last_active":"2024-09-11T23:27:52.223181+0000","last_peered":"2024-09-11T23:27:52.223181+0000","last_clean":"2024-09-11T23:27:52.223181+0000","last_became_active":"2024-09-11T23:26:44.694485+0000","last_became_peered":"2024-09-11T23:26:44.694485+0000","last_unstale":"2024-09-11T23:27:52.223181+0000","last_undegraded":"2024-09-11T23:27:52.223181+0000","last_fullsized":"2024-09-11T23:27:52.223181+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:58:19.913909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'3","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.756226+0000","last_change":"2024-09-11T23:26:42.619902+0000","last_active":"2024-09-11T23:27:52.756226+0000","last_peered":"2024-09-11T23:27:52.756226+0000","last_clean":"2024-09-11T23:27:52.756226+0000","last_became_active":"2024-09-11T23:26:42.619405+0000","last_became_peered":"2024-09-11T23:26:42.619405+0000","last_unstale":"2024-09-11T23:27:52.756226+0000","last_undegraded":"2024-09-11T23:27:52.756226+0000","last_fullsized":"2024-09-11T23:27:52.756226+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:30.584258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.225250+0000","last_change":"2024-09-11T23:27:52.224858+0000","last_active":"2024-09-11T23:27:52.225250+0000","last_peered":"2024-09-11T23:27:52.225250+0000","last_clean":"2024-09-11T23:27:52.225250+0000","last_became_active":"2024-09-11T23:27:52.224356+0000","last_became_peered":"2024-09-11T23:27:52.224356+0000","last_unstale":"2024-09-11T23:27:52.225250+0000","last_undegraded":"2024-09-11T23:27:52.225250+0000","last_fullsized":"2024-09-11T23:27:52.225250+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:38.924394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6,10],"acting":[8,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.179451+0000","last_change":"2024-09-11T23:26:44.690426+0000","last_active":"2024-09-11T23:27:52.179451+0000","last_peered":"2024-09-11T23:27:52.179451+0000","last_clean":"2024-09-11T23:27:52.179451+0000","last_became_active":"2024-09-11T23:26:44.690127+0000","last_became_peered":"2024-09-11T23:26:44.690127+0000","last_unstale":"2024-09-11T23:27:52.179451+0000","last_undegraded":"2024-09-11T23:27:52.179451+0000","last_fullsized":"2024-09-11T23:27:52.179451+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:42.750965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'3","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.104761+0000","last_change":"2024-09-11T23:26:42.617589+0000","last_active":"2024-09-11T23:27:52.104761+0000","last_peered":"2024-09-11T23:27:52.104761+0000","last_clean":"2024-09-11T23:27:52.104761+0000","last_became_active":"2024-09-11T23:26:42.616853+0000","last_became_peered":"2024-09-11T23:26:42.616853+0000","last_unstale":"2024-09-11T23:27:52.104761+0000","last_undegraded":"2024-09-11T23:27:52.104761+0000","last_fullsized":"2024-09-11T23:27:52.104761+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:57.689231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":349,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.756372+0000","last_change":"2024-09-11T23:25:30.452649+0000","last_active":"2024-09-11T23:27:52.756372+0000","last_peered":"2024-09-11T23:27:52.756372+0000","last_clean":"2024-09-11T23:27:52.756372+0000","last_became_active":"2024-09-11T23:25:30.452234+0000","last_became_peered":"2024-09-11T23:25:30.452234+0000","last_unstale":"2024-09-11T23:27:52.756372+0000","last_undegraded":"2024-09-11T23:27:52.756372+0000","last_fullsized":"2024-09-11T23:27:52.756372+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:04.900818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:04.900818+0000","last_clean_scrub_stamp":"2024-09-11T23:22:04.900818+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:39.029859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"86'1","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.756406+0000","last_change":"2024-09-11T23:26:52.066339+0000","last_active":"2024-09-11T23:27:52.756406+0000","last_peered":"2024-09-11T23:27:52.756406+0000","last_clean":"2024-09-11T23:27:52.756406+0000","last_became_active":"2024-09-11T23:26:52.065945+0000","last_became_peered":"2024-09-11T23:26:52.065945+0000","last_unstale":"2024-09-11T23:27:52.756406+0000","last_undegraded":"2024-09-11T23:27:52.756406+0000","last_fullsized":"2024-09-11T23:27:52.756406+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:49.597372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.756564+0000","last_change":"2024-09-11T23:26:44.700943+0000","last_active":"2024-09-11T23:27:52.756564+0000","last_peered":"2024-09-11T23:27:52.756564+0000","last_clean":"2024-09-11T23:27:52.756564+0000","last_became_active":"2024-09-11T23:26:44.700418+0000","last_became_peered":"2024-09-11T23:26:44.700418+0000","last_unstale":"2024-09-11T23:27:52.756564+0000","last_undegraded":"2024-09-11T23:27:52.756564+0000","last_fullsized":"2024-09-11T23:27:52.756564+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:18.474520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'3","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.103479+0000","last_change":"2024-09-11T23:26:42.645889+0000","last_active":"2024-09-11T23:27:52.103479+0000","last_peered":"2024-09-11T23:27:52.103479+0000","last_clean":"2024-09-11T23:27:52.103479+0000","last_became_active":"2024-09-11T23:26:42.645530+0000","last_became_peered":"2024-09-11T23:26:42.645530+0000","last_unstale":"2024-09-11T23:27:52.103479+0000","last_undegraded":"2024-09-11T23:27:52.103479+0000","last_fullsized":"2024-09-11T23:27:52.103479+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:27.311459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.881348+0000","last_change":"2024-09-11T23:26:52.066911+0000","last_active":"2024-09-11T23:27:52.881348+0000","last_peered":"2024-09-11T23:27:52.881348+0000","last_clean":"2024-09-11T23:27:52.881348+0000","last_became_active":"2024-09-11T23:26:52.065969+0000","last_became_peered":"2024-09-11T23:26:52.065969+0000","last_unstale":"2024-09-11T23:27:52.881348+0000","last_undegraded":"2024-09-11T23:27:52.881348+0000","last_fullsized":"2024-09-11T23:27:52.881348+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:26.406644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.756675+0000","last_change":"2024-09-11T23:26:44.696945+0000","last_active":"2024-09-11T23:27:52.756675+0000","last_peered":"2024-09-11T23:27:52.756675+0000","last_clean":"2024-09-11T23:27:52.756675+0000","last_became_active":"2024-09-11T23:26:44.696546+0000","last_became_peered":"2024-09-11T23:26:44.696546+0000","last_unstale":"2024-09-11T23:27:52.756675+0000","last_undegraded":"2024-09-11T23:27:52.756675+0000","last_fullsized":"2024-09-11T23:27:52.756675+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:52.428610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.490423+0000","last_change":"2024-09-11T23:26:42.616991+0000","last_active":"2024-09-11T23:27:52.490423+0000","last_peered":"2024-09-11T23:27:52.490423+0000","last_clean":"2024-09-11T23:27:52.490423+0000","last_became_active":"2024-09-11T23:26:42.616576+0000","last_became_peered":"2024-09-11T23:26:42.616576+0000","last_unstale":"2024-09-11T23:27:52.490423+0000","last_undegraded":"2024-09-11T23:27:52.490423+0000","last_fullsized":"2024-09-11T23:27:52.490423+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:07.142958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.160127+0000","last_change":"2024-09-11T23:26:52.066240+0000","last_active":"2024-09-11T23:27:52.160127+0000","last_peered":"2024-09-11T23:27:52.160127+0000","last_clean":"2024-09-11T23:27:52.160127+0000","last_became_active":"2024-09-11T23:26:52.065873+0000","last_became_peered":"2024-09-11T23:26:52.065873+0000","last_unstale":"2024-09-11T23:27:52.160127+0000","last_undegraded":"2024-09-11T23:27:52.160127+0000","last_fullsized":"2024-09-11T23:27:52.160127+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:51.175750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.756609+0000","last_change":"2024-09-11T23:26:44.699302+0000","last_active":"2024-09-11T23:27:52.756609+0000","last_peered":"2024-09-11T23:27:52.756609+0000","last_clean":"2024-09-11T23:27:52.756609+0000","last_became_active":"2024-09-11T23:26:44.698948+0000","last_became_peered":"2024-09-11T23:26:44.698948+0000","last_unstale":"2024-09-11T23:27:52.756609+0000","last_undegraded":"2024-09-11T23:27:52.756609+0000","last_fullsized":"2024-09-11T23:27:52.756609+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:31.262407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.223792+0000","last_change":"2024-09-11T23:26:52.077450+0000","last_active":"2024-09-11T23:27:52.223792+0000","last_peered":"2024-09-11T23:27:52.223792+0000","last_clean":"2024-09-11T23:27:52.223792+0000","last_became_active":"2024-09-11T23:26:52.065052+0000","last_became_peered":"2024-09-11T23:26:52.065052+0000","last_unstale":"2024-09-11T23:27:52.223792+0000","last_undegraded":"2024-09-11T23:27:52.223792+0000","last_fullsized":"2024-09-11T23:27:52.223792+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:27.541991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.489217+0000","last_change":"2024-09-11T23:26:52.064296+0000","last_active":"2024-09-11T23:27:52.489217+0000","last_peered":"2024-09-11T23:27:52.489217+0000","last_clean":"2024-09-11T23:27:52.489217+0000","last_became_active":"2024-09-11T23:26:52.063488+0000","last_became_peered":"2024-09-11T23:26:52.063488+0000","last_unstale":"2024-09-11T23:27:52.489217+0000","last_undegraded":"2024-09-11T23:27:52.489217+0000","last_fullsized":"2024-09-11T23:27:52.489217+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:39.815984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.756344+0000","last_change":"2024-09-11T23:26:52.071603+0000","last_active":"2024-09-11T23:27:52.756344+0000","last_peered":"2024-09-11T23:27:52.756344+0000","last_clean":"2024-09-11T23:27:52.756344+0000","last_became_active":"2024-09-11T23:26:52.071190+0000","last_became_peered":"2024-09-11T23:26:52.071190+0000","last_unstale":"2024-09-11T23:27:52.756344+0000","last_undegraded":"2024-09-11T23:27:52.756344+0000","last_fullsized":"2024-09-11T23:27:52.756344+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:52.171622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.104796+0000","last_change":"2024-09-11T23:26:42.612493+0000","last_active":"2024-09-11T23:27:52.104796+0000","last_peered":"2024-09-11T23:27:52.104796+0000","last_clean":"2024-09-11T23:27:52.104796+0000","last_became_active":"2024-09-11T23:26:42.612018+0000","last_became_peered":"2024-09-11T23:26:42.612018+0000","last_unstale":"2024-09-11T23:27:52.104796+0000","last_undegraded":"2024-09-11T23:27:52.104796+0000","last_fullsized":"2024-09-11T23:27:52.104796+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:08.590684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.489481+0000","last_change":"2024-09-11T23:26:52.063634+0000","last_active":"2024-09-11T23:27:52.489481+0000","last_peered":"2024-09-11T23:27:52.489481+0000","last_clean":"2024-09-11T23:27:52.489481+0000","last_became_active":"2024-09-11T23:26:52.063205+0000","last_became_peered":"2024-09-11T23:26:52.063205+0000","last_unstale":"2024-09-11T23:27:52.489481+0000","last_undegraded":"2024-09-11T23:27:52.489481+0000","last_fullsized":"2024-09-11T23:27:52.489481+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:12.371238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.489688+0000","last_change":"2024-09-11T23:26:44.692776+0000","last_active":"2024-09-11T23:27:52.489688+0000","last_peered":"2024-09-11T23:27:52.489688+0000","last_clean":"2024-09-11T23:27:52.489688+0000","last_became_active":"2024-09-11T23:26:44.691989+0000","last_became_peered":"2024-09-11T23:26:44.691989+0000","last_unstale":"2024-09-11T23:27:52.489688+0000","last_undegraded":"2024-09-11T23:27:52.489688+0000","last_fullsized":"2024-09-11T23:27:52.489688+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:41.781016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"86'15","reported_seq":66,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.103476+0000","last_change":"2024-09-11T23:26:52.075909+0000","last_active":"2024-09-11T23:27:52.103476+0000","last_peered":"2024-09-11T23:27:52.103476+0000","last_clean":"2024-09-11T23:27:52.103476+0000","last_became_active":"2024-09-11T23:26:52.061277+0000","last_became_peered":"2024-09-11T23:26:52.061277+0000","last_unstale":"2024-09-11T23:27:52.103476+0000","last_undegraded":"2024-09-11T23:27:52.103476+0000","last_fullsized":"2024-09-11T23:27:52.103476+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:11.940951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.223736+0000","last_change":"2024-09-11T23:26:52.064172+0000","last_active":"2024-09-11T23:27:52.223736+0000","last_peered":"2024-09-11T23:27:52.223736+0000","last_clean":"2024-09-11T23:27:52.223736+0000","last_became_active":"2024-09-11T23:26:52.063807+0000","last_became_peered":"2024-09-11T23:26:52.063807+0000","last_unstale":"2024-09-11T23:27:52.223736+0000","last_undegraded":"2024-09-11T23:27:52.223736+0000","last_fullsized":"2024-09-11T23:27:52.223736+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:32.134115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.756132+0000","last_change":"2024-09-11T23:26:44.703624+0000","last_active":"2024-09-11T23:27:52.756132+0000","last_peered":"2024-09-11T23:27:52.756132+0000","last_clean":"2024-09-11T23:27:52.756132+0000","last_became_active":"2024-09-11T23:26:44.703298+0000","last_became_peered":"2024-09-11T23:26:44.703298+0000","last_unstale":"2024-09-11T23:27:52.756132+0000","last_undegraded":"2024-09-11T23:27:52.756132+0000","last_fullsized":"2024-09-11T23:27:52.756132+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:17.441926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'3","reported_seq":93,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:28:14.120366+0000","last_change":"2024-09-11T23:26:42.618328+0000","last_active":"2024-09-11T23:28:14.120366+0000","last_peered":"2024-09-11T23:28:14.120366+0000","last_clean":"2024-09-11T23:28:14.120366+0000","last_became_active":"2024-09-11T23:26:42.618005+0000","last_became_peered":"2024-09-11T23:26:42.618005+0000","last_unstale":"2024-09-11T23:28:14.120366+0000","last_undegraded":"2024-09-11T23:28:14.120366+0000","last_fullsized":"2024-09-11T23:28:14.120366+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:58.593887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.101618+0000","last_change":"2024-09-11T23:26:52.069824+0000","last_active":"2024-09-11T23:27:52.101618+0000","last_peered":"2024-09-11T23:27:52.101618+0000","last_clean":"2024-09-11T23:27:52.101618+0000","last_became_active":"2024-09-11T23:26:52.069341+0000","last_became_peered":"2024-09-11T23:26:52.069341+0000","last_unstale":"2024-09-11T23:27:52.101618+0000","last_undegraded":"2024-09-11T23:27:52.101618+0000","last_fullsized":"2024-09-11T23:27:52.101618+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:10.922896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.756643+0000","last_change":"2024-09-11T23:26:44.696963+0000","last_active":"2024-09-11T23:27:52.756643+0000","last_peered":"2024-09-11T23:27:52.756643+0000","last_clean":"2024-09-11T23:27:52.756643+0000","last_became_active":"2024-09-11T23:26:44.696543+0000","last_became_peered":"2024-09-11T23:26:44.696543+0000","last_unstale":"2024-09-11T23:27:52.756643+0000","last_undegraded":"2024-09-11T23:27:52.756643+0000","last_fullsized":"2024-09-11T23:27:52.756643+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:14.502969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"86'3","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.490056+0000","last_change":"2024-09-11T23:26:42.615454+0000","last_active":"2024-09-11T23:27:52.490056+0000","last_peered":"2024-09-11T23:27:52.490056+0000","last_clean":"2024-09-11T23:27:52.490056+0000","last_became_active":"2024-09-11T23:26:42.614948+0000","last_became_peered":"2024-09-11T23:26:42.614948+0000","last_unstale":"2024-09-11T23:27:52.490056+0000","last_undegraded":"2024-09-11T23:27:52.490056+0000","last_fullsized":"2024-09-11T23:27:52.490056+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:59.056748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.755999+0000","last_change":"2024-09-11T23:26:52.069846+0000","last_active":"2024-09-11T23:27:52.755999+0000","last_peered":"2024-09-11T23:27:52.755999+0000","last_clean":"2024-09-11T23:27:52.755999+0000","last_became_active":"2024-09-11T23:26:52.069398+0000","last_became_peered":"2024-09-11T23:26:52.069398+0000","last_unstale":"2024-09-11T23:27:52.755999+0000","last_undegraded":"2024-09-11T23:27:52.755999+0000","last_fullsized":"2024-09-11T23:27:52.755999+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:31.931388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.223415+0000","last_change":"2024-09-11T23:26:44.697114+0000","last_active":"2024-09-11T23:27:52.223415+0000","last_peered":"2024-09-11T23:27:52.223415+0000","last_clean":"2024-09-11T23:27:52.223415+0000","last_became_active":"2024-09-11T23:26:44.696811+0000","last_became_peered":"2024-09-11T23:26:44.696811+0000","last_unstale":"2024-09-11T23:27:52.223415+0000","last_undegraded":"2024-09-11T23:27:52.223415+0000","last_fullsized":"2024-09-11T23:27:52.223415+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:47:52.650877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"86'6","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.103151+0000","last_change":"2024-09-11T23:26:42.616377+0000","last_active":"2024-09-11T23:27:52.103151+0000","last_peered":"2024-09-11T23:27:52.103151+0000","last_clean":"2024-09-11T23:27:52.103151+0000","last_became_active":"2024-09-11T23:26:42.615887+0000","last_became_peered":"2024-09-11T23:26:42.615887+0000","last_unstale":"2024-09-11T23:27:52.103151+0000","last_undegraded":"2024-09-11T23:27:52.103151+0000","last_fullsized":"2024-09-11T23:27:52.103151+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:48.089178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.490255+0000","last_change":"2024-09-11T23:26:52.068340+0000","last_active":"2024-09-11T23:27:52.490255+0000","last_peered":"2024-09-11T23:27:52.490255+0000","last_clean":"2024-09-11T23:27:52.490255+0000","last_became_active":"2024-09-11T23:26:52.067905+0000","last_became_peered":"2024-09-11T23:26:52.067905+0000","last_unstale":"2024-09-11T23:27:52.490255+0000","last_undegraded":"2024-09-11T23:27:52.490255+0000","last_fullsized":"2024-09-11T23:27:52.490255+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:15.517992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.103589+0000","last_change":"2024-09-11T23:26:44.704570+0000","last_active":"2024-09-11T23:27:52.103589+0000","last_peered":"2024-09-11T23:27:52.103589+0000","last_clean":"2024-09-11T23:27:52.103589+0000","last_became_active":"2024-09-11T23:26:44.704263+0000","last_became_peered":"2024-09-11T23:26:44.704263+0000","last_unstale":"2024-09-11T23:27:52.103589+0000","last_undegraded":"2024-09-11T23:27:52.103589+0000","last_fullsized":"2024-09-11T23:27:52.103589+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:25.112831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"86'33","reported_seq":178,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:28:12.117763+0000","last_change":"2024-09-11T23:26:42.620726+0000","last_active":"2024-09-11T23:28:12.117763+0000","last_peered":"2024-09-11T23:28:12.117763+0000","last_clean":"2024-09-11T23:28:12.117763+0000","last_became_active":"2024-09-11T23:26:42.620381+0000","last_became_peered":"2024-09-11T23:26:42.620381+0000","last_unstale":"2024-09-11T23:28:12.117763+0000","last_undegraded":"2024-09-11T23:28:12.117763+0000","last_fullsized":"2024-09-11T23:28:12.117763+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:41.001056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63479,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":111,"num_read_kb":117,"num_write":34,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.101188+0000","last_change":"2024-09-11T23:26:52.073830+0000","last_active":"2024-09-11T23:27:52.101188+0000","last_peered":"2024-09-11T23:27:52.101188+0000","last_clean":"2024-09-11T23:27:52.101188+0000","last_became_active":"2024-09-11T23:26:52.073415+0000","last_became_peered":"2024-09-11T23:26:52.073415+0000","last_unstale":"2024-09-11T23:27:52.101188+0000","last_undegraded":"2024-09-11T23:27:52.101188+0000","last_fullsized":"2024-09-11T23:27:52.101188+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:25.310980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.881596+0000","last_change":"2024-09-11T23:26:44.694203+0000","last_active":"2024-09-11T23:27:52.881596+0000","last_peered":"2024-09-11T23:27:52.881596+0000","last_clean":"2024-09-11T23:27:52.881596+0000","last_became_active":"2024-09-11T23:26:44.693827+0000","last_became_peered":"2024-09-11T23:26:44.693827+0000","last_unstale":"2024-09-11T23:27:52.881596+0000","last_undegraded":"2024-09-11T23:27:52.881596+0000","last_fullsized":"2024-09-11T23:27:52.881596+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:29.929206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"86'4","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.490373+0000","last_change":"2024-09-11T23:26:42.646046+0000","last_active":"2024-09-11T23:27:52.490373+0000","last_peered":"2024-09-11T23:27:52.490373+0000","last_clean":"2024-09-11T23:27:52.490373+0000","last_became_active":"2024-09-11T23:26:42.645735+0000","last_became_peered":"2024-09-11T23:26:42.645735+0000","last_unstale":"2024-09-11T23:27:52.490373+0000","last_undegraded":"2024-09-11T23:27:52.490373+0000","last_fullsized":"2024-09-11T23:27:52.490373+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:12.159712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.104639+0000","last_change":"2024-09-11T23:26:52.069732+0000","last_active":"2024-09-11T23:27:52.104639+0000","last_peered":"2024-09-11T23:27:52.104639+0000","last_clean":"2024-09-11T23:27:52.104639+0000","last_became_active":"2024-09-11T23:26:52.069230+0000","last_became_peered":"2024-09-11T23:26:52.069230+0000","last_unstale":"2024-09-11T23:27:52.104639+0000","last_undegraded":"2024-09-11T23:27:52.104639+0000","last_fullsized":"2024-09-11T23:27:52.104639+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:50:17.304900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.160511+0000","last_change":"2024-09-11T23:26:44.691704+0000","last_active":"2024-09-11T23:27:52.160511+0000","last_peered":"2024-09-11T23:27:52.160511+0000","last_clean":"2024-09-11T23:27:52.160511+0000","last_became_active":"2024-09-11T23:26:44.690686+0000","last_became_peered":"2024-09-11T23:26:44.690686+0000","last_unstale":"2024-09-11T23:27:52.160511+0000","last_undegraded":"2024-09-11T23:27:52.160511+0000","last_fullsized":"2024-09-11T23:27:52.160511+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:44.046933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"86'2","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.756515+0000","last_change":"2024-09-11T23:26:42.616271+0000","last_active":"2024-09-11T23:27:52.756515+0000","last_peered":"2024-09-11T23:27:52.756515+0000","last_clean":"2024-09-11T23:27:52.756515+0000","last_became_active":"2024-09-11T23:26:42.615870+0000","last_became_peered":"2024-09-11T23:26:42.615870+0000","last_unstale":"2024-09-11T23:27:52.756515+0000","last_undegraded":"2024-09-11T23:27:52.756515+0000","last_fullsized":"2024-09-11T23:27:52.756515+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:08.573352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.100961+0000","last_change":"2024-09-11T23:26:52.072615+0000","last_active":"2024-09-11T23:27:52.100961+0000","last_peered":"2024-09-11T23:27:52.100961+0000","last_clean":"2024-09-11T23:27:52.100961+0000","last_became_active":"2024-09-11T23:26:52.072219+0000","last_became_peered":"2024-09-11T23:26:52.072219+0000","last_unstale":"2024-09-11T23:27:52.100961+0000","last_undegraded":"2024-09-11T23:27:52.100961+0000","last_fullsized":"2024-09-11T23:27:52.100961+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:57.598375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.881796+0000","last_change":"2024-09-11T23:26:44.690099+0000","last_active":"2024-09-11T23:27:52.881796+0000","last_peered":"2024-09-11T23:27:52.881796+0000","last_clean":"2024-09-11T23:27:52.881796+0000","last_became_active":"2024-09-11T23:26:44.689763+0000","last_became_peered":"2024-09-11T23:26:44.689763+0000","last_unstale":"2024-09-11T23:27:52.881796+0000","last_undegraded":"2024-09-11T23:27:52.881796+0000","last_fullsized":"2024-09-11T23:27:52.881796+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:45.316508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"86'3","reported_seq":88,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:28:11.116192+0000","last_change":"2024-09-11T23:26:42.620930+0000","last_active":"2024-09-11T23:28:11.116192+0000","last_peered":"2024-09-11T23:28:11.116192+0000","last_clean":"2024-09-11T23:28:11.116192+0000","last_became_active":"2024-09-11T23:26:42.620544+0000","last_became_peered":"2024-09-11T23:26:42.620544+0000","last_unstale":"2024-09-11T23:28:11.116192+0000","last_undegraded":"2024-09-11T23:28:11.116192+0000","last_fullsized":"2024-09-11T23:28:11.116192+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:26.625004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.179305+0000","last_change":"2024-09-11T23:26:52.065014+0000","last_active":"2024-09-11T23:27:52.179305+0000","last_peered":"2024-09-11T23:27:52.179305+0000","last_clean":"2024-09-11T23:27:52.179305+0000","last_became_active":"2024-09-11T23:26:52.064570+0000","last_became_peered":"2024-09-11T23:26:52.064570+0000","last_unstale":"2024-09-11T23:27:52.179305+0000","last_undegraded":"2024-09-11T23:27:52.179305+0000","last_fullsized":"2024-09-11T23:27:52.179305+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:53.658310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.160346+0000","last_change":"2024-09-11T23:26:52.065559+0000","last_active":"2024-09-11T23:27:52.160346+0000","last_peered":"2024-09-11T23:27:52.160346+0000","last_clean":"2024-09-11T23:27:52.160346+0000","last_became_active":"2024-09-11T23:26:52.065197+0000","last_became_peered":"2024-09-11T23:26:52.065197+0000","last_unstale":"2024-09-11T23:27:52.160346+0000","last_undegraded":"2024-09-11T23:27:52.160346+0000","last_fullsized":"2024-09-11T23:27:52.160346+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:19.371054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.101073+0000","last_change":"2024-09-11T23:26:44.691726+0000","last_active":"2024-09-11T23:27:52.101073+0000","last_peered":"2024-09-11T23:27:52.101073+0000","last_clean":"2024-09-11T23:27:52.101073+0000","last_became_active":"2024-09-11T23:26:44.691417+0000","last_became_peered":"2024-09-11T23:26:44.691417+0000","last_unstale":"2024-09-11T23:27:52.101073+0000","last_undegraded":"2024-09-11T23:27:52.101073+0000","last_fullsized":"2024-09-11T23:27:52.101073+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:38.139576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"86'1","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.489750+0000","last_change":"2024-09-11T23:26:42.615287+0000","last_active":"2024-09-11T23:27:52.489750+0000","last_peered":"2024-09-11T23:27:52.489750+0000","last_clean":"2024-09-11T23:27:52.489750+0000","last_became_active":"2024-09-11T23:26:42.614939+0000","last_became_peered":"2024-09-11T23:26:42.614939+0000","last_unstale":"2024-09-11T23:27:52.489750+0000","last_undegraded":"2024-09-11T23:27:52.489750+0000","last_fullsized":"2024-09-11T23:27:52.489750+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:23.250573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.756340+0000","last_change":"2024-09-11T23:26:52.069773+0000","last_active":"2024-09-11T23:27:52.756340+0000","last_peered":"2024-09-11T23:27:52.756340+0000","last_clean":"2024-09-11T23:27:52.756340+0000","last_became_active":"2024-09-11T23:26:52.069365+0000","last_became_peered":"2024-09-11T23:26:52.069365+0000","last_unstale":"2024-09-11T23:27:52.756340+0000","last_undegraded":"2024-09-11T23:27:52.756340+0000","last_fullsized":"2024-09-11T23:27:52.756340+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:00.101851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.179211+0000","last_change":"2024-09-11T23:26:44.689869+0000","last_active":"2024-09-11T23:27:52.179211+0000","last_peered":"2024-09-11T23:27:52.179211+0000","last_clean":"2024-09-11T23:27:52.179211+0000","last_became_active":"2024-09-11T23:26:44.689474+0000","last_became_peered":"2024-09-11T23:26:44.689474+0000","last_unstale":"2024-09-11T23:27:52.179211+0000","last_undegraded":"2024-09-11T23:27:52.179211+0000","last_fullsized":"2024-09-11T23:27:52.179211+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:10.255840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"86'2","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.223204+0000","last_change":"2024-09-11T23:26:42.609857+0000","last_active":"2024-09-11T23:27:52.223204+0000","last_peered":"2024-09-11T23:27:52.223204+0000","last_clean":"2024-09-11T23:27:52.223204+0000","last_became_active":"2024-09-11T23:26:42.609536+0000","last_became_peered":"2024-09-11T23:26:42.609536+0000","last_unstale":"2024-09-11T23:27:52.223204+0000","last_undegraded":"2024-09-11T23:27:52.223204+0000","last_fullsized":"2024-09-11T23:27:52.223204+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:17.751298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"86'3","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.102213+0000","last_change":"2024-09-11T23:26:52.061076+0000","last_active":"2024-09-11T23:27:52.102213+0000","last_peered":"2024-09-11T23:27:52.102213+0000","last_clean":"2024-09-11T23:27:52.102213+0000","last_became_active":"2024-09-11T23:26:52.060543+0000","last_became_peered":"2024-09-11T23:26:52.060543+0000","last_unstale":"2024-09-11T23:27:52.102213+0000","last_undegraded":"2024-09-11T23:27:52.102213+0000","last_fullsized":"2024-09-11T23:27:52.102213+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:10.566235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.490139+0000","last_change":"2024-09-11T23:26:44.690699+0000","last_active":"2024-09-11T23:27:52.490139+0000","last_peered":"2024-09-11T23:27:52.490139+0000","last_clean":"2024-09-11T23:27:52.490139+0000","last_became_active":"2024-09-11T23:26:44.690142+0000","last_became_peered":"2024-09-11T23:26:44.690142+0000","last_unstale":"2024-09-11T23:27:52.490139+0000","last_undegraded":"2024-09-11T23:27:52.490139+0000","last_fullsized":"2024-09-11T23:27:52.490139+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:20.790171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.491613+0000","last_change":"2024-09-11T23:27:52.491613+0000","last_active":"2024-09-11T23:27:52.491613+0000","last_peered":"2024-09-11T23:27:52.491613+0000","last_clean":"2024-09-11T23:27:52.491613+0000","last_became_active":"2024-09-11T23:27:52.491102+0000","last_became_peered":"2024-09-11T23:27:52.491102+0000","last_unstale":"2024-09-11T23:27:52.491613+0000","last_undegraded":"2024-09-11T23:27:52.491613+0000","last_fullsized":"2024-09-11T23:27:52.491613+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:22.536173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"86'5","reported_seq":77,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:28:12.118284+0000","last_change":"2024-09-11T23:26:52.059895+0000","last_active":"2024-09-11T23:28:12.118284+0000","last_peered":"2024-09-11T23:28:12.118284+0000","last_clean":"2024-09-11T23:28:12.118284+0000","last_became_active":"2024-09-11T23:26:52.059431+0000","last_became_peered":"2024-09-11T23:26:52.059431+0000","last_unstale":"2024-09-11T23:28:12.118284+0000","last_undegraded":"2024-09-11T23:28:12.118284+0000","last_fullsized":"2024-09-11T23:28:12.118284+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:58.922483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.104276+0000","last_change":"2024-09-11T23:26:44.690449+0000","last_active":"2024-09-11T23:27:52.104276+0000","last_peered":"2024-09-11T23:27:52.104276+0000","last_clean":"2024-09-11T23:27:52.104276+0000","last_became_active":"2024-09-11T23:26:44.690102+0000","last_became_peered":"2024-09-11T23:26:44.690102+0000","last_unstale":"2024-09-11T23:27:52.104276+0000","last_undegraded":"2024-09-11T23:27:52.104276+0000","last_fullsized":"2024-09-11T23:27:52.104276+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:49.730602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.102873+0000","last_change":"2024-09-11T23:26:52.062826+0000","last_active":"2024-09-11T23:27:52.102873+0000","last_peered":"2024-09-11T23:27:52.102873+0000","last_clean":"2024-09-11T23:27:52.102873+0000","last_became_active":"2024-09-11T23:26:52.062405+0000","last_became_peered":"2024-09-11T23:26:52.062405+0000","last_unstale":"2024-09-11T23:27:52.102873+0000","last_undegraded":"2024-09-11T23:27:52.102873+0000","last_fullsized":"2024-09-11T23:27:52.102873+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:46.141117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.755883+0000","last_change":"2024-09-11T23:26:44.707056+0000","last_active":"2024-09-11T23:27:52.755883+0000","last_peered":"2024-09-11T23:27:52.755883+0000","last_clean":"2024-09-11T23:27:52.755883+0000","last_became_active":"2024-09-11T23:26:44.706704+0000","last_became_peered":"2024-09-11T23:26:44.706704+0000","last_unstale":"2024-09-11T23:27:52.755883+0000","last_undegraded":"2024-09-11T23:27:52.755883+0000","last_fullsized":"2024-09-11T23:27:52.755883+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:29.221070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.103867+0000","last_change":"2024-09-11T23:26:44.699807+0000","last_active":"2024-09-11T23:27:52.103867+0000","last_peered":"2024-09-11T23:27:52.103867+0000","last_clean":"2024-09-11T23:27:52.103867+0000","last_became_active":"2024-09-11T23:26:44.699497+0000","last_became_peered":"2024-09-11T23:26:44.699497+0000","last_unstale":"2024-09-11T23:27:52.103867+0000","last_undegraded":"2024-09-11T23:27:52.103867+0000","last_fullsized":"2024-09-11T23:27:52.103867+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:17.954048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.102652+0000","last_change":"2024-09-11T23:26:44.698751+0000","last_active":"2024-09-11T23:27:52.102652+0000","last_peered":"2024-09-11T23:27:52.102652+0000","last_clean":"2024-09-11T23:27:52.102652+0000","last_became_active":"2024-09-11T23:26:44.698429+0000","last_became_peered":"2024-09-11T23:26:44.698429+0000","last_unstale":"2024-09-11T23:27:52.102652+0000","last_undegraded":"2024-09-11T23:27:52.102652+0000","last_fullsized":"2024-09-11T23:27:52.102652+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:25.452225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.160210+0000","last_change":"2024-09-11T23:26:44.690356+0000","last_active":"2024-09-11T23:27:52.160210+0000","last_peered":"2024-09-11T23:27:52.160210+0000","last_clean":"2024-09-11T23:27:52.160210+0000","last_became_active":"2024-09-11T23:26:44.690057+0000","last_became_peered":"2024-09-11T23:26:44.690057+0000","last_unstale":"2024-09-11T23:27:52.160210+0000","last_undegraded":"2024-09-11T23:27:52.160210+0000","last_fullsized":"2024-09-11T23:27:52.160210+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:38.950284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.223675+0000","last_change":"2024-09-11T23:26:44.691251+0000","last_active":"2024-09-11T23:27:52.223675+0000","last_peered":"2024-09-11T23:27:52.223675+0000","last_clean":"2024-09-11T23:27:52.223675+0000","last_became_active":"2024-09-11T23:26:44.690905+0000","last_became_peered":"2024-09-11T23:26:44.690905+0000","last_unstale":"2024-09-11T23:27:52.223675+0000","last_undegraded":"2024-09-11T23:27:52.223675+0000","last_fullsized":"2024-09-11T23:27:52.223675+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:18.509826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.756347+0000","last_change":"2024-09-11T23:26:44.707581+0000","last_active":"2024-09-11T23:27:52.756347+0000","last_peered":"2024-09-11T23:27:52.756347+0000","last_clean":"2024-09-11T23:27:52.756347+0000","last_became_active":"2024-09-11T23:26:44.707266+0000","last_became_peered":"2024-09-11T23:26:44.707266+0000","last_unstale":"2024-09-11T23:27:52.756347+0000","last_undegraded":"2024-09-11T23:27:52.756347+0000","last_fullsized":"2024-09-11T23:27:52.756347+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:40:28.248560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.103149+0000","last_change":"2024-09-11T23:26:44.704003+0000","last_active":"2024-09-11T23:27:52.103149+0000","last_peered":"2024-09-11T23:27:52.103149+0000","last_clean":"2024-09-11T23:27:52.103149+0000","last_became_active":"2024-09-11T23:26:44.703702+0000","last_became_peered":"2024-09-11T23:26:44.703702+0000","last_unstale":"2024-09-11T23:27:52.103149+0000","last_undegraded":"2024-09-11T23:27:52.103149+0000","last_fullsized":"2024-09-11T23:27:52.103149+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:28:17.511868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.179883+0000","last_change":"2024-09-11T23:26:44.694601+0000","last_active":"2024-09-11T23:27:52.179883+0000","last_peered":"2024-09-11T23:27:52.179883+0000","last_clean":"2024-09-11T23:27:52.179883+0000","last_became_active":"2024-09-11T23:26:44.694304+0000","last_became_peered":"2024-09-11T23:26:44.694304+0000","last_unstale":"2024-09-11T23:27:52.179883+0000","last_undegraded":"2024-09-11T23:27:52.179883+0000","last_fullsized":"2024-09-11T23:27:52.179883+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:32:04.171439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.489412+0000","last_change":"2024-09-11T23:26:44.691565+0000","last_active":"2024-09-11T23:27:52.489412+0000","last_peered":"2024-09-11T23:27:52.489412+0000","last_clean":"2024-09-11T23:27:52.489412+0000","last_became_active":"2024-09-11T23:26:44.691237+0000","last_became_peered":"2024-09-11T23:26:44.691237+0000","last_unstale":"2024-09-11T23:27:52.489412+0000","last_undegraded":"2024-09-11T23:27:52.489412+0000","last_fullsized":"2024-09-11T23:27:52.489412+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:01.413447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.179386+0000","last_change":"2024-09-11T23:26:44.699372+0000","last_active":"2024-09-11T23:27:52.179386+0000","last_peered":"2024-09-11T23:27:52.179386+0000","last_clean":"2024-09-11T23:27:52.179386+0000","last_became_active":"2024-09-11T23:26:44.698934+0000","last_became_peered":"2024-09-11T23:26:44.698934+0000","last_unstale":"2024-09-11T23:27:52.179386+0000","last_undegraded":"2024-09-11T23:27:52.179386+0000","last_fullsized":"2024-09-11T23:27:52.179386+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:44:41.486314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.881594+0000","last_change":"2024-09-11T23:26:44.698595+0000","last_active":"2024-09-11T23:27:52.881594+0000","last_peered":"2024-09-11T23:27:52.881594+0000","last_clean":"2024-09-11T23:27:52.881594+0000","last_became_active":"2024-09-11T23:26:44.698268+0000","last_became_peered":"2024-09-11T23:26:44.698268+0000","last_unstale":"2024-09-11T23:27:52.881594+0000","last_undegraded":"2024-09-11T23:27:52.881594+0000","last_fullsized":"2024-09-11T23:27:52.881594+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:57:55.304720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.223528+0000","last_change":"2024-09-11T23:26:44.697049+0000","last_active":"2024-09-11T23:27:52.223528+0000","last_peered":"2024-09-11T23:27:52.223528+0000","last_clean":"2024-09-11T23:27:52.223528+0000","last_became_active":"2024-09-11T23:26:44.696748+0000","last_became_peered":"2024-09-11T23:26:44.696748+0000","last_unstale":"2024-09-11T23:27:52.223528+0000","last_undegraded":"2024-09-11T23:27:52.223528+0000","last_fullsized":"2024-09-11T23:27:52.223528+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:55.486695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.756127+0000","last_change":"2024-09-11T23:26:44.705094+0000","last_active":"2024-09-11T23:27:52.756127+0000","last_peered":"2024-09-11T23:27:52.756127+0000","last_clean":"2024-09-11T23:27:52.756127+0000","last_became_active":"2024-09-11T23:26:44.704750+0000","last_became_peered":"2024-09-11T23:26:44.704750+0000","last_unstale":"2024-09-11T23:27:52.756127+0000","last_undegraded":"2024-09-11T23:27:52.756127+0000","last_fullsized":"2024-09-11T23:27:52.756127+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:19.058557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.103016+0000","last_change":"2024-09-11T23:26:52.070615+0000","last_active":"2024-09-11T23:27:52.103016+0000","last_peered":"2024-09-11T23:27:52.103016+0000","last_clean":"2024-09-11T23:27:52.103016+0000","last_became_active":"2024-09-11T23:26:52.070182+0000","last_became_peered":"2024-09-11T23:26:52.070182+0000","last_unstale":"2024-09-11T23:27:52.103016+0000","last_undegraded":"2024-09-11T23:27:52.103016+0000","last_fullsized":"2024-09-11T23:27:52.103016+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:37.888276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,6],"acting":[2,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.101641+0000","last_change":"2024-09-11T23:26:44.690032+0000","last_active":"2024-09-11T23:27:52.101641+0000","last_peered":"2024-09-11T23:27:52.101641+0000","last_clean":"2024-09-11T23:27:52.101641+0000","last_became_active":"2024-09-11T23:26:44.689715+0000","last_became_peered":"2024-09-11T23:26:44.689715+0000","last_unstale":"2024-09-11T23:27:52.101641+0000","last_undegraded":"2024-09-11T23:27:52.101641+0000","last_fullsized":"2024-09-11T23:27:52.101641+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:10.325376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.756535+0000","last_change":"2024-09-11T23:26:44.707675+0000","last_active":"2024-09-11T23:27:52.756535+0000","last_peered":"2024-09-11T23:27:52.756535+0000","last_clean":"2024-09-11T23:27:52.756535+0000","last_became_active":"2024-09-11T23:26:44.707063+0000","last_became_peered":"2024-09-11T23:26:44.707063+0000","last_unstale":"2024-09-11T23:27:52.756535+0000","last_undegraded":"2024-09-11T23:27:52.756535+0000","last_fullsized":"2024-09-11T23:27:52.756535+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:52.289558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.881222+0000","last_change":"2024-09-11T23:26:44.697512+0000","last_active":"2024-09-11T23:27:52.881222+0000","last_peered":"2024-09-11T23:27:52.881222+0000","last_clean":"2024-09-11T23:27:52.881222+0000","last_became_active":"2024-09-11T23:26:44.697208+0000","last_became_peered":"2024-09-11T23:26:44.697208+0000","last_unstale":"2024-09-11T23:27:52.881222+0000","last_undegraded":"2024-09-11T23:27:52.881222+0000","last_fullsized":"2024-09-11T23:27:52.881222+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:57.001816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.160232+0000","last_change":"2024-09-11T23:26:44.700661+0000","last_active":"2024-09-11T23:27:52.160232+0000","last_peered":"2024-09-11T23:27:52.160232+0000","last_clean":"2024-09-11T23:27:52.160232+0000","last_became_active":"2024-09-11T23:26:44.700298+0000","last_became_peered":"2024-09-11T23:26:44.700298+0000","last_unstale":"2024-09-11T23:27:52.160232+0000","last_undegraded":"2024-09-11T23:27:52.160232+0000","last_fullsized":"2024-09-11T23:27:52.160232+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:03.774789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.160078+0000","last_change":"2024-09-11T23:26:44.695295+0000","last_active":"2024-09-11T23:27:52.160078+0000","last_peered":"2024-09-11T23:27:52.160078+0000","last_clean":"2024-09-11T23:27:52.160078+0000","last_became_active":"2024-09-11T23:26:44.694905+0000","last_became_peered":"2024-09-11T23:26:44.694905+0000","last_unstale":"2024-09-11T23:27:52.160078+0000","last_undegraded":"2024-09-11T23:27:52.160078+0000","last_fullsized":"2024-09-11T23:27:52.160078+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:59.016335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.223507+0000","last_change":"2024-09-11T23:26:44.689876+0000","last_active":"2024-09-11T23:27:52.223507+0000","last_peered":"2024-09-11T23:27:52.223507+0000","last_clean":"2024-09-11T23:27:52.223507+0000","last_became_active":"2024-09-11T23:26:44.689541+0000","last_became_peered":"2024-09-11T23:26:44.689541+0000","last_unstale":"2024-09-11T23:27:52.223507+0000","last_undegraded":"2024-09-11T23:27:52.223507+0000","last_fullsized":"2024-09-11T23:27:52.223507+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:18.693201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.104539+0000","last_change":"2024-09-11T23:26:44.696308+0000","last_active":"2024-09-11T23:27:52.104539+0000","last_peered":"2024-09-11T23:27:52.104539+0000","last_clean":"2024-09-11T23:27:52.104539+0000","last_became_active":"2024-09-11T23:26:44.695973+0000","last_became_peered":"2024-09-11T23:26:44.695973+0000","last_unstale":"2024-09-11T23:27:52.104539+0000","last_undegraded":"2024-09-11T23:27:52.104539+0000","last_fullsized":"2024-09-11T23:27:52.104539+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:46.890624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.756600+0000","last_change":"2024-09-11T23:26:44.703180+0000","last_active":"2024-09-11T23:27:52.756600+0000","last_peered":"2024-09-11T23:27:52.756600+0000","last_clean":"2024-09-11T23:27:52.756600+0000","last_became_active":"2024-09-11T23:26:44.702843+0000","last_became_peered":"2024-09-11T23:26:44.702843+0000","last_unstale":"2024-09-11T23:27:52.756600+0000","last_undegraded":"2024-09-11T23:27:52.756600+0000","last_fullsized":"2024-09-11T23:27:52.756600+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:35.425199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.102748+0000","last_change":"2024-09-11T23:26:52.069650+0000","last_active":"2024-09-11T23:27:52.102748+0000","last_peered":"2024-09-11T23:27:52.102748+0000","last_clean":"2024-09-11T23:27:52.102748+0000","last_became_active":"2024-09-11T23:26:52.069258+0000","last_became_peered":"2024-09-11T23:26:52.069258+0000","last_unstale":"2024-09-11T23:27:52.102748+0000","last_undegraded":"2024-09-11T23:27:52.102748+0000","last_fullsized":"2024-09-11T23:27:52.102748+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:29.073360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.881921+0000","last_change":"2024-09-11T23:26:44.701547+0000","last_active":"2024-09-11T23:27:52.881921+0000","last_peered":"2024-09-11T23:27:52.881921+0000","last_clean":"2024-09-11T23:27:52.881921+0000","last_became_active":"2024-09-11T23:26:44.701215+0000","last_became_peered":"2024-09-11T23:26:44.701215+0000","last_unstale":"2024-09-11T23:27:52.881921+0000","last_undegraded":"2024-09-11T23:27:52.881921+0000","last_fullsized":"2024-09-11T23:27:52.881921+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:39.774757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.179143+0000","last_change":"2024-09-11T23:26:44.696446+0000","last_active":"2024-09-11T23:27:52.179143+0000","last_peered":"2024-09-11T23:27:52.179143+0000","last_clean":"2024-09-11T23:27:52.179143+0000","last_became_active":"2024-09-11T23:26:44.696129+0000","last_became_peered":"2024-09-11T23:26:44.696129+0000","last_unstale":"2024-09-11T23:27:52.179143+0000","last_undegraded":"2024-09-11T23:27:52.179143+0000","last_fullsized":"2024-09-11T23:27:52.179143+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:02.441274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.756237+0000","last_change":"2024-09-11T23:26:44.702036+0000","last_active":"2024-09-11T23:27:52.756237+0000","last_peered":"2024-09-11T23:27:52.756237+0000","last_clean":"2024-09-11T23:27:52.756237+0000","last_became_active":"2024-09-11T23:26:44.701517+0000","last_became_peered":"2024-09-11T23:26:44.701517+0000","last_unstale":"2024-09-11T23:27:52.756237+0000","last_undegraded":"2024-09-11T23:27:52.756237+0000","last_fullsized":"2024-09-11T23:27:52.756237+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:56.577107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.102201+0000","last_change":"2024-09-11T23:26:44.693533+0000","last_active":"2024-09-11T23:27:52.102201+0000","last_peered":"2024-09-11T23:27:52.102201+0000","last_clean":"2024-09-11T23:27:52.102201+0000","last_became_active":"2024-09-11T23:26:44.693199+0000","last_became_peered":"2024-09-11T23:26:44.693199+0000","last_unstale":"2024-09-11T23:27:52.102201+0000","last_undegraded":"2024-09-11T23:27:52.102201+0000","last_fullsized":"2024-09-11T23:27:52.102201+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:33.125162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.103755+0000","last_change":"2024-09-11T23:26:44.691525+0000","last_active":"2024-09-11T23:27:52.103755+0000","last_peered":"2024-09-11T23:27:52.103755+0000","last_clean":"2024-09-11T23:27:52.103755+0000","last_became_active":"2024-09-11T23:26:44.691186+0000","last_became_peered":"2024-09-11T23:26:44.691186+0000","last_unstale":"2024-09-11T23:27:52.103755+0000","last_undegraded":"2024-09-11T23:27:52.103755+0000","last_fullsized":"2024-09-11T23:27:52.103755+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:05.002600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.104489+0000","last_change":"2024-09-11T23:26:44.700076+0000","last_active":"2024-09-11T23:27:52.104489+0000","last_peered":"2024-09-11T23:27:52.104489+0000","last_clean":"2024-09-11T23:27:52.104489+0000","last_became_active":"2024-09-11T23:26:44.699746+0000","last_became_peered":"2024-09-11T23:26:44.699746+0000","last_unstale":"2024-09-11T23:27:52.104489+0000","last_undegraded":"2024-09-11T23:27:52.104489+0000","last_fullsized":"2024-09-11T23:27:52.104489+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:49.311174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.160142+0000","last_change":"2024-09-11T23:26:44.699385+0000","last_active":"2024-09-11T23:27:52.160142+0000","last_peered":"2024-09-11T23:27:52.160142+0000","last_clean":"2024-09-11T23:27:52.160142+0000","last_became_active":"2024-09-11T23:26:44.699095+0000","last_became_peered":"2024-09-11T23:26:44.699095+0000","last_unstale":"2024-09-11T23:27:52.160142+0000","last_undegraded":"2024-09-11T23:27:52.160142+0000","last_fullsized":"2024-09-11T23:27:52.160142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:40:30.583732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.160353+0000","last_change":"2024-09-11T23:26:44.696893+0000","last_active":"2024-09-11T23:27:52.160353+0000","last_peered":"2024-09-11T23:27:52.160353+0000","last_clean":"2024-09-11T23:27:52.160353+0000","last_became_active":"2024-09-11T23:26:44.696493+0000","last_became_peered":"2024-09-11T23:26:44.696493+0000","last_unstale":"2024-09-11T23:27:52.160353+0000","last_undegraded":"2024-09-11T23:27:52.160353+0000","last_fullsized":"2024-09-11T23:27:52.160353+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:32.320327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.756515+0000","last_change":"2024-09-11T23:26:44.707902+0000","last_active":"2024-09-11T23:27:52.756515+0000","last_peered":"2024-09-11T23:27:52.756515+0000","last_clean":"2024-09-11T23:27:52.756515+0000","last_became_active":"2024-09-11T23:26:44.706664+0000","last_became_peered":"2024-09-11T23:26:44.706664+0000","last_unstale":"2024-09-11T23:27:52.756515+0000","last_undegraded":"2024-09-11T23:27:52.756515+0000","last_fullsized":"2024-09-11T23:27:52.756515+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:57.865640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67089,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":340,"num_read_kb":240,"num_write":167,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":201267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":142,"ondisk_log_size":142,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":3542208,"data_compressed":214348,"data_compressed_allocated":270336,"data_compressed_original":3506176,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579936,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":978944,"data_stored":500115,"data_compressed":23713,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808869,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28120,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717032,"statfs":{"total":95995035648,"available":95966240768,"internally_reserved":0,"allocated":1118208,"data_stored":1150240,"data_compressed":59983,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972394,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36320,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708832,"statfs":{"total":95995035648,"available":95957843968,"internally_reserved":0,"allocated":991232,"data_stored":503825,"data_compressed":23713,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201327,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":987136,"data_stored":499649,"data_compressed":23713,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430260,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32200,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712952,"statfs":{"total":95995035648,"available":95962062848,"internally_reserved":0,"allocated":1036288,"data_stored":1095167,"data_compressed":59983,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626489,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":966656,"data_stored":494905,"data_compressed":23713,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855423,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1036288,"data_stored":1090133,"data_compressed":59983,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018948,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":987136,"data_stored":499667,"data_compressed":23713,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247880,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36304,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708848,"statfs":{"total":95995035648,"available":95957860352,"internally_reserved":0,"allocated":978944,"data_stored":495099,"data_compressed":23713,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444110,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1052672,"data_stored":559532,"data_compressed":23713,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1036288,"data_stored":558294,"data_compressed":23713,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":991232,"data_stored":496293,"data_compressed":23713,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34634,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34634,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36270,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36270,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36270,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36270,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":63479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":64717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:28:17.142 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T23:28:17.419 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:28:17.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:17 smithi005 ceph-mon[31201]: pgmap v331: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T23:28:17.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:17 smithi005 ceph-mon[31201]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:28:17.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:17 smithi159 ceph-mon[34394]: pgmap v331: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T23:28:17.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:17 smithi159 ceph-mon[34394]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:28:17.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:17 smithi172 ceph-mon[34855]: pgmap v331: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T23:28:17.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:17 smithi172 ceph-mon[34855]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:28:17.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:17.923+0000 7ffa42511640 1 -- 172.21.15.5:0/1879591054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa3c102570 msgr2=0x7ffa3c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:17.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:17.923+0000 7ffa42511640 1 --2- 172.21.15.5:0/1879591054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa3c102570 0x7ffa3c1029b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ffa24009900 tx=0x7ffa2402a480 comp rx=0 tx=0).stop 2024-09-11T23:28:17.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:17.923+0000 7ffa42511640 1 -- 172.21.15.5:0/1879591054 shutdown_connections 2024-09-11T23:28:17.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:17.923+0000 7ffa42511640 1 --2- 172.21.15.5:0/1879591054 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa3c102ef0 0x7ffa3c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:17.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:17.923+0000 7ffa42511640 1 --2- 172.21.15.5:0/1879591054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa3c102570 0x7ffa3c1029b0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:17.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:17.923+0000 7ffa42511640 1 --2- 172.21.15.5:0/1879591054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa3c100e20 0x7ffa3c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:17.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:17.923+0000 7ffa42511640 1 -- 172.21.15.5:0/1879591054 >> 172.21.15.5:0/1879591054 conn(0x7ffa3c0fc7d0 msgr2=0x7ffa3c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:17.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:17.923+0000 7ffa42511640 1 -- 172.21.15.5:0/1879591054 shutdown_connections 2024-09-11T23:28:17.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:17.923+0000 7ffa42511640 1 -- 172.21.15.5:0/1879591054 wait complete. 2024-09-11T23:28:17.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:17.924+0000 7ffa42511640 1 Processor -- start 2024-09-11T23:28:17.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:17.924+0000 7ffa42511640 1 -- start start 2024-09-11T23:28:17.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:17.924+0000 7ffa42511640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa3c100e20 0x7ffa3c198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:17.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:17.924+0000 7ffa42511640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa3c102570 0x7ffa3c198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:17.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:17.924+0000 7ffa42511640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa3c102ef0 0x7ffa3c19ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:17.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:17.924+0000 7ffa42511640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3c110e50 con 0x7ffa3c100e20 2024-09-11T23:28:17.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:17.924+0000 7ffa42511640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3c110cd0 con 0x7ffa3c102ef0 2024-09-11T23:28:17.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:17.924+0000 7ffa42511640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3c110fd0 con 0x7ffa3c102570 2024-09-11T23:28:17.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:17.925+0000 7ffa3bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa3c100e20 0x7ffa3c198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:17.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:17.925+0000 7ffa3bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa3c100e20 0x7ffa3c198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54186/0 (socket says 172.21.15.5:54186) 2024-09-11T23:28:17.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:17.925+0000 7ffa3bfff640 1 -- 172.21.15.5:0/1424500734 learned_addr learned my addr 172.21.15.5:0/1424500734 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:17.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:17.925+0000 7ffa33fff640 1 --2- 172.21.15.5:0/1424500734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa3c102570 0x7ffa3c198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:17.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:17.925+0000 7ffa40aae640 1 --2- 172.21.15.5:0/1424500734 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa3c102ef0 0x7ffa3c19ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:17.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:17.925+0000 7ffa3bfff640 1 -- 172.21.15.5:0/1424500734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa3c102570 msgr2=0x7ffa3c198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:17.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:17.925+0000 7ffa3bfff640 1 --2- 172.21.15.5:0/1424500734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa3c102570 0x7ffa3c198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:17.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:17.925+0000 7ffa3bfff640 1 -- 172.21.15.5:0/1424500734 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa3c102ef0 msgr2=0x7ffa3c19ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:17.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:17.925+0000 7ffa3bfff640 1 --2- 172.21.15.5:0/1424500734 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa3c102ef0 0x7ffa3c19ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:17.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:17.925+0000 7ffa3bfff640 1 -- 172.21.15.5:0/1424500734 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa3c19d3d0 con 0x7ffa3c100e20 2024-09-11T23:28:17.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:17.925+0000 7ffa3bfff640 1 --2- 172.21.15.5:0/1424500734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa3c100e20 0x7ffa3c198420 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c00b4a0 tx=0x7ffa2c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:17.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:17.925+0000 7ffa39ffb640 1 -- 172.21.15.5:0/1424500734 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c014070 con 0x7ffa3c100e20 2024-09-11T23:28:17.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:17.925+0000 7ffa39ffb640 1 -- 172.21.15.5:0/1424500734 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffa2c010ac0 con 0x7ffa3c100e20 2024-09-11T23:28:17.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:17.925+0000 7ffa42511640 1 -- 172.21.15.5:0/1424500734 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa3c19d6c0 con 0x7ffa3c100e20 2024-09-11T23:28:17.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:17.925+0000 7ffa39ffb640 1 -- 172.21.15.5:0/1424500734 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c017c30 con 0x7ffa3c100e20 2024-09-11T23:28:17.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:17.925+0000 7ffa42511640 1 -- 172.21.15.5:0/1424500734 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa3c1a4fa0 con 0x7ffa3c100e20 2024-09-11T23:28:17.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:17.926+0000 7ffa42511640 1 -- 172.21.15.5:0/1424500734 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa3c101200 con 0x7ffa3c100e20 2024-09-11T23:28:17.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:17.928+0000 7ffa39ffb640 1 -- 172.21.15.5:0/1424500734 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7ffa2c017070 con 0x7ffa3c100e20 2024-09-11T23:28:17.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:17.928+0000 7ffa39ffb640 1 --2- 172.21.15.5:0/1424500734 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7ffa280a2c90 0x7ffa280a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:17.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:17.929+0000 7ffa33fff640 1 --2- 172.21.15.5:0/1424500734 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7ffa280a2c90 0x7ffa280a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:17.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:17.929+0000 7ffa39ffb640 1 -- 172.21.15.5:0/1424500734 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7ffa2c0ce850 con 0x7ffa3c100e20 2024-09-11T23:28:17.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:17.929+0000 7ffa33fff640 1 --2- 172.21.15.5:0/1424500734 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7ffa280a2c90 0x7ffa280a5150 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c0ff060 tx=0x7ffa24005a20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:17.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:17.933+0000 7ffa39ffb640 1 -- 172.21.15.5:0/1424500734 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffa2c09b3a0 con 0x7ffa3c100e20 2024-09-11T23:28:18.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:18.109+0000 7ffa42511640 1 -- 172.21.15.5:0/1424500734 --> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffa3c10a110 con 0x7ffa280a2c90 2024-09-11T23:28:18.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:18.117+0000 7ffa39ffb640 1 -- 172.21.15.5:0/1424500734 <== mgr.14148 v2:172.21.15.5:6800/2285128668 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340575 (secure 0 0 0) 0x7ffa24031e50 con 0x7ffa280a2c90 2024-09-11T23:28:18.121 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:28:18.122 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-11T23:28:18.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:18.120+0000 7ffa42511640 1 -- 172.21.15.5:0/1424500734 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7ffa280a2c90 msgr2=0x7ffa280a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:18.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:18.120+0000 7ffa42511640 1 --2- 172.21.15.5:0/1424500734 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7ffa280a2c90 0x7ffa280a5150 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c0ff060 tx=0x7ffa24005a20 comp rx=0 tx=0).stop 2024-09-11T23:28:18.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:18.120+0000 7ffa42511640 1 -- 172.21.15.5:0/1424500734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa3c100e20 msgr2=0x7ffa3c198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:18.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:18.120+0000 7ffa42511640 1 --2- 172.21.15.5:0/1424500734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa3c100e20 0x7ffa3c198420 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c00b4a0 tx=0x7ffa2c00b960 comp rx=0 tx=0).stop 2024-09-11T23:28:18.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:18.120+0000 7ffa42511640 1 -- 172.21.15.5:0/1424500734 shutdown_connections 2024-09-11T23:28:18.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:18.120+0000 7ffa42511640 1 --2- 172.21.15.5:0/1424500734 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7ffa280a2c90 0x7ffa280a5150 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:18.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:18.120+0000 7ffa42511640 1 --2- 172.21.15.5:0/1424500734 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffa3c102ef0 0x7ffa3c19ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:18.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:18.120+0000 7ffa42511640 1 --2- 172.21.15.5:0/1424500734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa3c102570 0x7ffa3c198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:18.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:18.120+0000 7ffa42511640 1 --2- 172.21.15.5:0/1424500734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa3c100e20 0x7ffa3c198420 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:18.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:18.120+0000 7ffa42511640 1 -- 172.21.15.5:0/1424500734 >> 172.21.15.5:0/1424500734 conn(0x7ffa3c0fc7d0 msgr2=0x7ffa3c06a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:18.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:18.120+0000 7ffa42511640 1 -- 172.21.15.5:0/1424500734 shutdown_connections 2024-09-11T23:28:18.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:18.120+0000 7ffa42511640 1 -- 172.21.15.5:0/1424500734 wait complete. 2024-09-11T23:28:18.894 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":331,"stamp":"2024-09-11T23:28:16.142871+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657691,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":466,"num_read_kb":349,"num_write":350,"num_write_kb":3056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":281,"ondisk_log_size":281,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":369516,"kb_used_data":11876,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124572308,"statfs":{"total":1151940427776,"available":1151562043392,"internally_reserved":0,"allocated":12161024,"data_stored":7942919,"data_compressed":393366,"data_compressed_allocated":528384,"data_compressed_original":2555904,"omap_allocated":19142,"internal_metadata":365933882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":35,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003492"},"pg_stats":[{"pgid":"2.1f","version":"86'9","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.101738+0000","last_change":"2024-09-11T23:26:42.617529+0000","last_active":"2024-09-11T23:27:52.101738+0000","last_peered":"2024-09-11T23:27:52.101738+0000","last_clean":"2024-09-11T23:27:52.101738+0000","last_became_active":"2024-09-11T23:26:42.616841+0000","last_became_peered":"2024-09-11T23:26:42.616841+0000","last_unstale":"2024-09-11T23:27:52.101738+0000","last_undegraded":"2024-09-11T23:27:52.101738+0000","last_fullsized":"2024-09-11T23:27:52.101738+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:32.464566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.179696+0000","last_change":"2024-09-11T23:26:44.700282+0000","last_active":"2024-09-11T23:27:52.179696+0000","last_peered":"2024-09-11T23:27:52.179696+0000","last_clean":"2024-09-11T23:27:52.179696+0000","last_became_active":"2024-09-11T23:26:44.700046+0000","last_became_peered":"2024-09-11T23:26:44.700046+0000","last_unstale":"2024-09-11T23:27:52.179696+0000","last_undegraded":"2024-09-11T23:27:52.179696+0000","last_fullsized":"2024-09-11T23:27:52.179696+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:10.211467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.180486+0000","last_change":"2024-09-11T23:27:52.180486+0000","last_active":"2024-09-11T23:27:52.180486+0000","last_peered":"2024-09-11T23:27:52.180486+0000","last_clean":"2024-09-11T23:27:52.180486+0000","last_became_active":"2024-09-11T23:27:52.180057+0000","last_became_peered":"2024-09-11T23:27:52.180057+0000","last_unstale":"2024-09-11T23:27:52.180486+0000","last_undegraded":"2024-09-11T23:27:52.180486+0000","last_fullsized":"2024-09-11T23:27:52.180486+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:08.087489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,10,0],"acting":[2,3,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.179881+0000","last_change":"2024-09-11T23:26:42.645941+0000","last_active":"2024-09-11T23:27:52.179881+0000","last_peered":"2024-09-11T23:27:52.179881+0000","last_clean":"2024-09-11T23:27:52.179881+0000","last_became_active":"2024-09-11T23:26:42.645590+0000","last_became_peered":"2024-09-11T23:26:42.645590+0000","last_unstale":"2024-09-11T23:27:52.179881+0000","last_undegraded":"2024-09-11T23:27:52.179881+0000","last_fullsized":"2024-09-11T23:27:52.179881+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:20.374936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.160516+0000","last_change":"2024-09-11T23:26:44.684678+0000","last_active":"2024-09-11T23:27:52.160516+0000","last_peered":"2024-09-11T23:27:52.160516+0000","last_clean":"2024-09-11T23:27:52.160516+0000","last_became_active":"2024-09-11T23:26:44.684001+0000","last_became_peered":"2024-09-11T23:26:44.684001+0000","last_unstale":"2024-09-11T23:27:52.160516+0000","last_undegraded":"2024-09-11T23:27:52.160516+0000","last_fullsized":"2024-09-11T23:27:52.160516+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:57.773985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.103686+0000","last_change":"2024-09-11T23:26:52.073563+0000","last_active":"2024-09-11T23:27:52.103686+0000","last_peered":"2024-09-11T23:27:52.103686+0000","last_clean":"2024-09-11T23:27:52.103686+0000","last_became_active":"2024-09-11T23:26:52.072851+0000","last_became_peered":"2024-09-11T23:26:52.072851+0000","last_unstale":"2024-09-11T23:27:52.103686+0000","last_undegraded":"2024-09-11T23:27:52.103686+0000","last_fullsized":"2024-09-11T23:27:52.103686+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:25.711274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"86'4","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.103801+0000","last_change":"2024-09-11T23:26:42.618190+0000","last_active":"2024-09-11T23:27:52.103801+0000","last_peered":"2024-09-11T23:27:52.103801+0000","last_clean":"2024-09-11T23:27:52.103801+0000","last_became_active":"2024-09-11T23:26:42.617797+0000","last_became_peered":"2024-09-11T23:26:42.617797+0000","last_unstale":"2024-09-11T23:27:52.103801+0000","last_undegraded":"2024-09-11T23:27:52.103801+0000","last_fullsized":"2024-09-11T23:27:52.103801+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:47.800168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.881543+0000","last_change":"2024-09-11T23:26:44.690899+0000","last_active":"2024-09-11T23:27:52.881543+0000","last_peered":"2024-09-11T23:27:52.881543+0000","last_clean":"2024-09-11T23:27:52.881543+0000","last_became_active":"2024-09-11T23:26:44.690552+0000","last_became_peered":"2024-09-11T23:26:44.690552+0000","last_unstale":"2024-09-11T23:27:52.881543+0000","last_undegraded":"2024-09-11T23:27:52.881543+0000","last_fullsized":"2024-09-11T23:27:52.881543+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:02.148342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.490928+0000","last_change":"2024-09-11T23:27:52.490928+0000","last_active":"2024-09-11T23:27:52.490928+0000","last_peered":"2024-09-11T23:27:52.490928+0000","last_clean":"2024-09-11T23:27:52.490928+0000","last_became_active":"2024-09-11T23:27:52.490568+0000","last_became_peered":"2024-09-11T23:27:52.490568+0000","last_unstale":"2024-09-11T23:27:52.490928+0000","last_undegraded":"2024-09-11T23:27:52.490928+0000","last_fullsized":"2024-09-11T23:27:52.490928+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:31.196463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.756064+0000","last_change":"2024-09-11T23:26:52.072018+0000","last_active":"2024-09-11T23:27:52.756064+0000","last_peered":"2024-09-11T23:27:52.756064+0000","last_clean":"2024-09-11T23:27:52.756064+0000","last_became_active":"2024-09-11T23:26:52.062541+0000","last_became_peered":"2024-09-11T23:26:52.062541+0000","last_unstale":"2024-09-11T23:27:52.756064+0000","last_undegraded":"2024-09-11T23:27:52.756064+0000","last_fullsized":"2024-09-11T23:27:52.756064+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:38.371660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.490251+0000","last_change":"2024-09-11T23:26:52.068090+0000","last_active":"2024-09-11T23:27:52.490251+0000","last_peered":"2024-09-11T23:27:52.490251+0000","last_clean":"2024-09-11T23:27:52.490251+0000","last_became_active":"2024-09-11T23:26:52.067755+0000","last_became_peered":"2024-09-11T23:26:52.067755+0000","last_unstale":"2024-09-11T23:27:52.490251+0000","last_undegraded":"2024-09-11T23:27:52.490251+0000","last_fullsized":"2024-09-11T23:27:52.490251+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:09.250735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.103911+0000","last_change":"2024-09-11T23:26:52.063609+0000","last_active":"2024-09-11T23:27:52.103911+0000","last_peered":"2024-09-11T23:27:52.103911+0000","last_clean":"2024-09-11T23:27:52.103911+0000","last_became_active":"2024-09-11T23:26:52.063212+0000","last_became_peered":"2024-09-11T23:26:52.063212+0000","last_unstale":"2024-09-11T23:27:52.103911+0000","last_undegraded":"2024-09-11T23:27:52.103911+0000","last_fullsized":"2024-09-11T23:27:52.103911+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:51.706288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.756299+0000","last_change":"2024-09-11T23:26:44.700390+0000","last_active":"2024-09-11T23:27:52.756299+0000","last_peered":"2024-09-11T23:27:52.756299+0000","last_clean":"2024-09-11T23:27:52.756299+0000","last_became_active":"2024-09-11T23:26:44.700062+0000","last_became_peered":"2024-09-11T23:26:44.700062+0000","last_unstale":"2024-09-11T23:27:52.756299+0000","last_undegraded":"2024-09-11T23:27:52.756299+0000","last_fullsized":"2024-09-11T23:27:52.756299+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:50.934552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.103862+0000","last_change":"2024-09-11T23:26:42.616879+0000","last_active":"2024-09-11T23:27:52.103862+0000","last_peered":"2024-09-11T23:27:52.103862+0000","last_clean":"2024-09-11T23:27:52.103862+0000","last_became_active":"2024-09-11T23:26:42.616522+0000","last_became_peered":"2024-09-11T23:26:42.616522+0000","last_unstale":"2024-09-11T23:27:52.103862+0000","last_undegraded":"2024-09-11T23:27:52.103862+0000","last_fullsized":"2024-09-11T23:27:52.103862+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:47.903838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.104252+0000","last_change":"2024-09-11T23:26:52.064232+0000","last_active":"2024-09-11T23:27:52.104252+0000","last_peered":"2024-09-11T23:27:52.104252+0000","last_clean":"2024-09-11T23:27:52.104252+0000","last_became_active":"2024-09-11T23:26:52.063559+0000","last_became_peered":"2024-09-11T23:26:52.063559+0000","last_unstale":"2024-09-11T23:27:52.104252+0000","last_undegraded":"2024-09-11T23:27:52.104252+0000","last_fullsized":"2024-09-11T23:27:52.104252+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:48.967531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.179549+0000","last_change":"2024-09-11T23:26:44.691634+0000","last_active":"2024-09-11T23:27:52.179549+0000","last_peered":"2024-09-11T23:27:52.179549+0000","last_clean":"2024-09-11T23:27:52.179549+0000","last_became_active":"2024-09-11T23:26:44.690900+0000","last_became_peered":"2024-09-11T23:26:44.690900+0000","last_unstale":"2024-09-11T23:27:52.179549+0000","last_undegraded":"2024-09-11T23:27:52.179549+0000","last_fullsized":"2024-09-11T23:27:52.179549+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:37.129433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"86'1","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.102793+0000","last_change":"2024-09-11T23:26:42.613452+0000","last_active":"2024-09-11T23:27:52.102793+0000","last_peered":"2024-09-11T23:27:52.102793+0000","last_clean":"2024-09-11T23:27:52.102793+0000","last_became_active":"2024-09-11T23:26:42.612943+0000","last_became_peered":"2024-09-11T23:26:42.612943+0000","last_unstale":"2024-09-11T23:27:52.102793+0000","last_undegraded":"2024-09-11T23:27:52.102793+0000","last_fullsized":"2024-09-11T23:27:52.102793+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:57.337796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"86'1","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.104369+0000","last_change":"2024-09-11T23:26:52.072930+0000","last_active":"2024-09-11T23:27:52.104369+0000","last_peered":"2024-09-11T23:27:52.104369+0000","last_clean":"2024-09-11T23:27:52.104369+0000","last_became_active":"2024-09-11T23:26:52.071512+0000","last_became_peered":"2024-09-11T23:26:52.071512+0000","last_unstale":"2024-09-11T23:27:52.104369+0000","last_undegraded":"2024-09-11T23:27:52.104369+0000","last_fullsized":"2024-09-11T23:27:52.104369+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:48.913194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.755986+0000","last_change":"2024-09-11T23:26:44.705318+0000","last_active":"2024-09-11T23:27:52.755986+0000","last_peered":"2024-09-11T23:27:52.755986+0000","last_clean":"2024-09-11T23:27:52.755986+0000","last_became_active":"2024-09-11T23:26:44.704974+0000","last_became_peered":"2024-09-11T23:26:44.704974+0000","last_unstale":"2024-09-11T23:27:52.755986+0000","last_undegraded":"2024-09-11T23:27:52.755986+0000","last_fullsized":"2024-09-11T23:27:52.755986+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:44.252769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"86'3","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.179463+0000","last_change":"2024-09-11T23:26:42.615528+0000","last_active":"2024-09-11T23:27:52.179463+0000","last_peered":"2024-09-11T23:27:52.179463+0000","last_clean":"2024-09-11T23:27:52.179463+0000","last_became_active":"2024-09-11T23:26:42.615182+0000","last_became_peered":"2024-09-11T23:26:42.615182+0000","last_unstale":"2024-09-11T23:27:52.179463+0000","last_undegraded":"2024-09-11T23:27:52.179463+0000","last_fullsized":"2024-09-11T23:27:52.179463+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:40.491178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.101567+0000","last_change":"2024-09-11T23:26:52.074907+0000","last_active":"2024-09-11T23:27:52.101567+0000","last_peered":"2024-09-11T23:27:52.101567+0000","last_clean":"2024-09-11T23:27:52.101567+0000","last_became_active":"2024-09-11T23:26:52.074645+0000","last_became_peered":"2024-09-11T23:26:52.074645+0000","last_unstale":"2024-09-11T23:27:52.101567+0000","last_undegraded":"2024-09-11T23:27:52.101567+0000","last_fullsized":"2024-09-11T23:27:52.101567+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:37.885656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.103613+0000","last_change":"2024-09-11T23:26:44.700291+0000","last_active":"2024-09-11T23:27:52.103613+0000","last_peered":"2024-09-11T23:27:52.103613+0000","last_clean":"2024-09-11T23:27:52.103613+0000","last_became_active":"2024-09-11T23:26:44.699965+0000","last_became_peered":"2024-09-11T23:26:44.699965+0000","last_unstale":"2024-09-11T23:27:52.103613+0000","last_undegraded":"2024-09-11T23:27:52.103613+0000","last_fullsized":"2024-09-11T23:27:52.103613+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:10.526254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.881347+0000","last_change":"2024-09-11T23:26:42.645574+0000","last_active":"2024-09-11T23:27:52.881347+0000","last_peered":"2024-09-11T23:27:52.881347+0000","last_clean":"2024-09-11T23:27:52.881347+0000","last_became_active":"2024-09-11T23:26:42.645266+0000","last_became_peered":"2024-09-11T23:26:42.645266+0000","last_unstale":"2024-09-11T23:27:52.881347+0000","last_undegraded":"2024-09-11T23:27:52.881347+0000","last_fullsized":"2024-09-11T23:27:52.881347+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:54.343564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.104312+0000","last_change":"2024-09-11T23:26:52.072072+0000","last_active":"2024-09-11T23:27:52.104312+0000","last_peered":"2024-09-11T23:27:52.104312+0000","last_clean":"2024-09-11T23:27:52.104312+0000","last_became_active":"2024-09-11T23:26:52.071488+0000","last_became_peered":"2024-09-11T23:26:52.071488+0000","last_unstale":"2024-09-11T23:27:52.104312+0000","last_undegraded":"2024-09-11T23:27:52.104312+0000","last_fullsized":"2024-09-11T23:27:52.104312+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:22.788819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.160456+0000","last_change":"2024-09-11T23:26:44.692168+0000","last_active":"2024-09-11T23:27:52.160456+0000","last_peered":"2024-09-11T23:27:52.160456+0000","last_clean":"2024-09-11T23:27:52.160456+0000","last_became_active":"2024-09-11T23:26:44.691842+0000","last_became_peered":"2024-09-11T23:26:44.691842+0000","last_unstale":"2024-09-11T23:27:52.160456+0000","last_undegraded":"2024-09-11T23:27:52.160456+0000","last_fullsized":"2024-09-11T23:27:52.160456+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:58.143490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"86'4","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.104484+0000","last_change":"2024-09-11T23:26:42.640164+0000","last_active":"2024-09-11T23:27:52.104484+0000","last_peered":"2024-09-11T23:27:52.104484+0000","last_clean":"2024-09-11T23:27:52.104484+0000","last_became_active":"2024-09-11T23:26:42.639827+0000","last_became_peered":"2024-09-11T23:26:42.639827+0000","last_unstale":"2024-09-11T23:27:52.104484+0000","last_undegraded":"2024-09-11T23:27:52.104484+0000","last_fullsized":"2024-09-11T23:27:52.104484+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:18.250513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.103566+0000","last_change":"2024-09-11T23:26:52.063970+0000","last_active":"2024-09-11T23:27:52.103566+0000","last_peered":"2024-09-11T23:27:52.103566+0000","last_clean":"2024-09-11T23:27:52.103566+0000","last_became_active":"2024-09-11T23:26:52.063575+0000","last_became_peered":"2024-09-11T23:26:52.063575+0000","last_unstale":"2024-09-11T23:27:52.103566+0000","last_undegraded":"2024-09-11T23:27:52.103566+0000","last_fullsized":"2024-09-11T23:27:52.103566+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:59.828888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.179903+0000","last_change":"2024-09-11T23:26:44.696709+0000","last_active":"2024-09-11T23:27:52.179903+0000","last_peered":"2024-09-11T23:27:52.179903+0000","last_clean":"2024-09-11T23:27:52.179903+0000","last_became_active":"2024-09-11T23:26:44.696401+0000","last_became_peered":"2024-09-11T23:26:44.696401+0000","last_unstale":"2024-09-11T23:27:52.179903+0000","last_undegraded":"2024-09-11T23:27:52.179903+0000","last_fullsized":"2024-09-11T23:27:52.179903+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:58:23.823664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"86'11","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.101647+0000","last_change":"2024-09-11T23:26:42.611182+0000","last_active":"2024-09-11T23:27:52.101647+0000","last_peered":"2024-09-11T23:27:52.101647+0000","last_clean":"2024-09-11T23:27:52.101647+0000","last_became_active":"2024-09-11T23:26:42.610843+0000","last_became_peered":"2024-09-11T23:26:42.610843+0000","last_unstale":"2024-09-11T23:27:52.101647+0000","last_undegraded":"2024-09-11T23:27:52.101647+0000","last_fullsized":"2024-09-11T23:27:52.101647+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:14.099591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.179081+0000","last_change":"2024-09-11T23:26:52.061367+0000","last_active":"2024-09-11T23:27:52.179081+0000","last_peered":"2024-09-11T23:27:52.179081+0000","last_clean":"2024-09-11T23:27:52.179081+0000","last_became_active":"2024-09-11T23:26:52.061005+0000","last_became_peered":"2024-09-11T23:26:52.061005+0000","last_unstale":"2024-09-11T23:27:52.179081+0000","last_undegraded":"2024-09-11T23:27:52.179081+0000","last_fullsized":"2024-09-11T23:27:52.179081+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:19.705133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.223722+0000","last_change":"2024-09-11T23:26:44.699122+0000","last_active":"2024-09-11T23:27:52.223722+0000","last_peered":"2024-09-11T23:27:52.223722+0000","last_clean":"2024-09-11T23:27:52.223722+0000","last_became_active":"2024-09-11T23:26:44.698813+0000","last_became_peered":"2024-09-11T23:26:44.698813+0000","last_unstale":"2024-09-11T23:27:52.223722+0000","last_undegraded":"2024-09-11T23:27:52.223722+0000","last_fullsized":"2024-09-11T23:27:52.223722+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:42.286431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"86'1","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.104467+0000","last_change":"2024-09-11T23:26:42.645612+0000","last_active":"2024-09-11T23:27:52.104467+0000","last_peered":"2024-09-11T23:27:52.104467+0000","last_clean":"2024-09-11T23:27:52.104467+0000","last_became_active":"2024-09-11T23:26:42.645228+0000","last_became_peered":"2024-09-11T23:26:42.645228+0000","last_unstale":"2024-09-11T23:27:52.104467+0000","last_undegraded":"2024-09-11T23:27:52.104467+0000","last_fullsized":"2024-09-11T23:27:52.104467+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:12.068952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.755995+0000","last_change":"2024-09-11T23:26:52.062843+0000","last_active":"2024-09-11T23:27:52.755995+0000","last_peered":"2024-09-11T23:27:52.755995+0000","last_clean":"2024-09-11T23:27:52.755995+0000","last_became_active":"2024-09-11T23:26:52.062446+0000","last_became_peered":"2024-09-11T23:26:52.062446+0000","last_unstale":"2024-09-11T23:27:52.755995+0000","last_undegraded":"2024-09-11T23:27:52.755995+0000","last_fullsized":"2024-09-11T23:27:52.755995+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:03.934877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.102293+0000","last_change":"2024-09-11T23:26:44.690179+0000","last_active":"2024-09-11T23:27:52.102293+0000","last_peered":"2024-09-11T23:27:52.102293+0000","last_clean":"2024-09-11T23:27:52.102293+0000","last_became_active":"2024-09-11T23:26:44.689856+0000","last_became_peered":"2024-09-11T23:26:44.689856+0000","last_unstale":"2024-09-11T23:27:52.102293+0000","last_undegraded":"2024-09-11T23:27:52.102293+0000","last_fullsized":"2024-09-11T23:27:52.102293+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:46.546000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.101459+0000","last_change":"2024-09-11T23:26:42.646678+0000","last_active":"2024-09-11T23:27:52.101459+0000","last_peered":"2024-09-11T23:27:52.101459+0000","last_clean":"2024-09-11T23:27:52.101459+0000","last_became_active":"2024-09-11T23:26:42.645748+0000","last_became_peered":"2024-09-11T23:26:42.645748+0000","last_unstale":"2024-09-11T23:27:52.101459+0000","last_undegraded":"2024-09-11T23:27:52.101459+0000","last_fullsized":"2024-09-11T23:27:52.101459+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:41.497025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.104101+0000","last_change":"2024-09-11T23:26:52.065357+0000","last_active":"2024-09-11T23:27:52.104101+0000","last_peered":"2024-09-11T23:27:52.104101+0000","last_clean":"2024-09-11T23:27:52.104101+0000","last_became_active":"2024-09-11T23:26:52.065004+0000","last_became_peered":"2024-09-11T23:26:52.065004+0000","last_unstale":"2024-09-11T23:27:52.104101+0000","last_undegraded":"2024-09-11T23:27:52.104101+0000","last_fullsized":"2024-09-11T23:27:52.104101+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:30.975294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.102312+0000","last_change":"2024-09-11T23:26:44.694358+0000","last_active":"2024-09-11T23:27:52.102312+0000","last_peered":"2024-09-11T23:27:52.102312+0000","last_clean":"2024-09-11T23:27:52.102312+0000","last_became_active":"2024-09-11T23:26:44.693305+0000","last_became_peered":"2024-09-11T23:26:44.693305+0000","last_unstale":"2024-09-11T23:27:52.102312+0000","last_undegraded":"2024-09-11T23:27:52.102312+0000","last_fullsized":"2024-09-11T23:27:52.102312+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:48.107696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'1","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.756706+0000","last_change":"2024-09-11T23:26:42.619221+0000","last_active":"2024-09-11T23:27:52.756706+0000","last_peered":"2024-09-11T23:27:52.756706+0000","last_clean":"2024-09-11T23:27:52.756706+0000","last_became_active":"2024-09-11T23:26:42.618833+0000","last_became_peered":"2024-09-11T23:26:42.618833+0000","last_unstale":"2024-09-11T23:27:52.756706+0000","last_undegraded":"2024-09-11T23:27:52.756706+0000","last_fullsized":"2024-09-11T23:27:52.756706+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:40.584145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.223540+0000","last_change":"2024-09-11T23:26:52.061287+0000","last_active":"2024-09-11T23:27:52.223540+0000","last_peered":"2024-09-11T23:27:52.223540+0000","last_clean":"2024-09-11T23:27:52.223540+0000","last_became_active":"2024-09-11T23:26:52.060904+0000","last_became_peered":"2024-09-11T23:26:52.060904+0000","last_unstale":"2024-09-11T23:27:52.223540+0000","last_undegraded":"2024-09-11T23:27:52.223540+0000","last_fullsized":"2024-09-11T23:27:52.223540+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:49.456325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.489448+0000","last_change":"2024-09-11T23:26:44.696624+0000","last_active":"2024-09-11T23:27:52.489448+0000","last_peered":"2024-09-11T23:27:52.489448+0000","last_clean":"2024-09-11T23:27:52.489448+0000","last_became_active":"2024-09-11T23:26:44.695521+0000","last_became_peered":"2024-09-11T23:26:44.695521+0000","last_unstale":"2024-09-11T23:27:52.489448+0000","last_undegraded":"2024-09-11T23:27:52.489448+0000","last_fullsized":"2024-09-11T23:27:52.489448+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:42.026975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'4","reported_seq":92,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:28:14.119726+0000","last_change":"2024-09-11T23:26:42.645319+0000","last_active":"2024-09-11T23:28:14.119726+0000","last_peered":"2024-09-11T23:28:14.119726+0000","last_clean":"2024-09-11T23:28:14.119726+0000","last_became_active":"2024-09-11T23:26:42.644986+0000","last_became_peered":"2024-09-11T23:26:42.644986+0000","last_unstale":"2024-09-11T23:28:14.119726+0000","last_undegraded":"2024-09-11T23:28:14.119726+0000","last_fullsized":"2024-09-11T23:28:14.119726+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:06.020663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.223751+0000","last_change":"2024-09-11T23:26:52.061235+0000","last_active":"2024-09-11T23:27:52.223751+0000","last_peered":"2024-09-11T23:27:52.223751+0000","last_clean":"2024-09-11T23:27:52.223751+0000","last_became_active":"2024-09-11T23:26:52.060827+0000","last_became_peered":"2024-09-11T23:26:52.060827+0000","last_unstale":"2024-09-11T23:27:52.223751+0000","last_undegraded":"2024-09-11T23:27:52.223751+0000","last_fullsized":"2024-09-11T23:27:52.223751+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:52.354881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.223181+0000","last_change":"2024-09-11T23:26:44.694777+0000","last_active":"2024-09-11T23:27:52.223181+0000","last_peered":"2024-09-11T23:27:52.223181+0000","last_clean":"2024-09-11T23:27:52.223181+0000","last_became_active":"2024-09-11T23:26:44.694485+0000","last_became_peered":"2024-09-11T23:26:44.694485+0000","last_unstale":"2024-09-11T23:27:52.223181+0000","last_undegraded":"2024-09-11T23:27:52.223181+0000","last_fullsized":"2024-09-11T23:27:52.223181+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:58:19.913909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'3","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.756226+0000","last_change":"2024-09-11T23:26:42.619902+0000","last_active":"2024-09-11T23:27:52.756226+0000","last_peered":"2024-09-11T23:27:52.756226+0000","last_clean":"2024-09-11T23:27:52.756226+0000","last_became_active":"2024-09-11T23:26:42.619405+0000","last_became_peered":"2024-09-11T23:26:42.619405+0000","last_unstale":"2024-09-11T23:27:52.756226+0000","last_undegraded":"2024-09-11T23:27:52.756226+0000","last_fullsized":"2024-09-11T23:27:52.756226+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:30.584258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.225250+0000","last_change":"2024-09-11T23:27:52.224858+0000","last_active":"2024-09-11T23:27:52.225250+0000","last_peered":"2024-09-11T23:27:52.225250+0000","last_clean":"2024-09-11T23:27:52.225250+0000","last_became_active":"2024-09-11T23:27:52.224356+0000","last_became_peered":"2024-09-11T23:27:52.224356+0000","last_unstale":"2024-09-11T23:27:52.225250+0000","last_undegraded":"2024-09-11T23:27:52.225250+0000","last_fullsized":"2024-09-11T23:27:52.225250+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:38.924394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6,10],"acting":[8,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.179451+0000","last_change":"2024-09-11T23:26:44.690426+0000","last_active":"2024-09-11T23:27:52.179451+0000","last_peered":"2024-09-11T23:27:52.179451+0000","last_clean":"2024-09-11T23:27:52.179451+0000","last_became_active":"2024-09-11T23:26:44.690127+0000","last_became_peered":"2024-09-11T23:26:44.690127+0000","last_unstale":"2024-09-11T23:27:52.179451+0000","last_undegraded":"2024-09-11T23:27:52.179451+0000","last_fullsized":"2024-09-11T23:27:52.179451+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:42.750965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'3","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.104761+0000","last_change":"2024-09-11T23:26:42.617589+0000","last_active":"2024-09-11T23:27:52.104761+0000","last_peered":"2024-09-11T23:27:52.104761+0000","last_clean":"2024-09-11T23:27:52.104761+0000","last_became_active":"2024-09-11T23:26:42.616853+0000","last_became_peered":"2024-09-11T23:26:42.616853+0000","last_unstale":"2024-09-11T23:27:52.104761+0000","last_undegraded":"2024-09-11T23:27:52.104761+0000","last_fullsized":"2024-09-11T23:27:52.104761+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:57.689231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":349,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.756372+0000","last_change":"2024-09-11T23:25:30.452649+0000","last_active":"2024-09-11T23:27:52.756372+0000","last_peered":"2024-09-11T23:27:52.756372+0000","last_clean":"2024-09-11T23:27:52.756372+0000","last_became_active":"2024-09-11T23:25:30.452234+0000","last_became_peered":"2024-09-11T23:25:30.452234+0000","last_unstale":"2024-09-11T23:27:52.756372+0000","last_undegraded":"2024-09-11T23:27:52.756372+0000","last_fullsized":"2024-09-11T23:27:52.756372+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:04.900818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:04.900818+0000","last_clean_scrub_stamp":"2024-09-11T23:22:04.900818+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:39.029859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"86'1","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.756406+0000","last_change":"2024-09-11T23:26:52.066339+0000","last_active":"2024-09-11T23:27:52.756406+0000","last_peered":"2024-09-11T23:27:52.756406+0000","last_clean":"2024-09-11T23:27:52.756406+0000","last_became_active":"2024-09-11T23:26:52.065945+0000","last_became_peered":"2024-09-11T23:26:52.065945+0000","last_unstale":"2024-09-11T23:27:52.756406+0000","last_undegraded":"2024-09-11T23:27:52.756406+0000","last_fullsized":"2024-09-11T23:27:52.756406+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:49.597372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.756564+0000","last_change":"2024-09-11T23:26:44.700943+0000","last_active":"2024-09-11T23:27:52.756564+0000","last_peered":"2024-09-11T23:27:52.756564+0000","last_clean":"2024-09-11T23:27:52.756564+0000","last_became_active":"2024-09-11T23:26:44.700418+0000","last_became_peered":"2024-09-11T23:26:44.700418+0000","last_unstale":"2024-09-11T23:27:52.756564+0000","last_undegraded":"2024-09-11T23:27:52.756564+0000","last_fullsized":"2024-09-11T23:27:52.756564+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:18.474520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'3","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.103479+0000","last_change":"2024-09-11T23:26:42.645889+0000","last_active":"2024-09-11T23:27:52.103479+0000","last_peered":"2024-09-11T23:27:52.103479+0000","last_clean":"2024-09-11T23:27:52.103479+0000","last_became_active":"2024-09-11T23:26:42.645530+0000","last_became_peered":"2024-09-11T23:26:42.645530+0000","last_unstale":"2024-09-11T23:27:52.103479+0000","last_undegraded":"2024-09-11T23:27:52.103479+0000","last_fullsized":"2024-09-11T23:27:52.103479+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:27.311459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.881348+0000","last_change":"2024-09-11T23:26:52.066911+0000","last_active":"2024-09-11T23:27:52.881348+0000","last_peered":"2024-09-11T23:27:52.881348+0000","last_clean":"2024-09-11T23:27:52.881348+0000","last_became_active":"2024-09-11T23:26:52.065969+0000","last_became_peered":"2024-09-11T23:26:52.065969+0000","last_unstale":"2024-09-11T23:27:52.881348+0000","last_undegraded":"2024-09-11T23:27:52.881348+0000","last_fullsized":"2024-09-11T23:27:52.881348+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:26.406644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.756675+0000","last_change":"2024-09-11T23:26:44.696945+0000","last_active":"2024-09-11T23:27:52.756675+0000","last_peered":"2024-09-11T23:27:52.756675+0000","last_clean":"2024-09-11T23:27:52.756675+0000","last_became_active":"2024-09-11T23:26:44.696546+0000","last_became_peered":"2024-09-11T23:26:44.696546+0000","last_unstale":"2024-09-11T23:27:52.756675+0000","last_undegraded":"2024-09-11T23:27:52.756675+0000","last_fullsized":"2024-09-11T23:27:52.756675+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:52.428610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.490423+0000","last_change":"2024-09-11T23:26:42.616991+0000","last_active":"2024-09-11T23:27:52.490423+0000","last_peered":"2024-09-11T23:27:52.490423+0000","last_clean":"2024-09-11T23:27:52.490423+0000","last_became_active":"2024-09-11T23:26:42.616576+0000","last_became_peered":"2024-09-11T23:26:42.616576+0000","last_unstale":"2024-09-11T23:27:52.490423+0000","last_undegraded":"2024-09-11T23:27:52.490423+0000","last_fullsized":"2024-09-11T23:27:52.490423+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:07.142958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.160127+0000","last_change":"2024-09-11T23:26:52.066240+0000","last_active":"2024-09-11T23:27:52.160127+0000","last_peered":"2024-09-11T23:27:52.160127+0000","last_clean":"2024-09-11T23:27:52.160127+0000","last_became_active":"2024-09-11T23:26:52.065873+0000","last_became_peered":"2024-09-11T23:26:52.065873+0000","last_unstale":"2024-09-11T23:27:52.160127+0000","last_undegraded":"2024-09-11T23:27:52.160127+0000","last_fullsized":"2024-09-11T23:27:52.160127+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:51.175750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.756609+0000","last_change":"2024-09-11T23:26:44.699302+0000","last_active":"2024-09-11T23:27:52.756609+0000","last_peered":"2024-09-11T23:27:52.756609+0000","last_clean":"2024-09-11T23:27:52.756609+0000","last_became_active":"2024-09-11T23:26:44.698948+0000","last_became_peered":"2024-09-11T23:26:44.698948+0000","last_unstale":"2024-09-11T23:27:52.756609+0000","last_undegraded":"2024-09-11T23:27:52.756609+0000","last_fullsized":"2024-09-11T23:27:52.756609+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:31.262407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.223792+0000","last_change":"2024-09-11T23:26:52.077450+0000","last_active":"2024-09-11T23:27:52.223792+0000","last_peered":"2024-09-11T23:27:52.223792+0000","last_clean":"2024-09-11T23:27:52.223792+0000","last_became_active":"2024-09-11T23:26:52.065052+0000","last_became_peered":"2024-09-11T23:26:52.065052+0000","last_unstale":"2024-09-11T23:27:52.223792+0000","last_undegraded":"2024-09-11T23:27:52.223792+0000","last_fullsized":"2024-09-11T23:27:52.223792+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:27.541991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.489217+0000","last_change":"2024-09-11T23:26:52.064296+0000","last_active":"2024-09-11T23:27:52.489217+0000","last_peered":"2024-09-11T23:27:52.489217+0000","last_clean":"2024-09-11T23:27:52.489217+0000","last_became_active":"2024-09-11T23:26:52.063488+0000","last_became_peered":"2024-09-11T23:26:52.063488+0000","last_unstale":"2024-09-11T23:27:52.489217+0000","last_undegraded":"2024-09-11T23:27:52.489217+0000","last_fullsized":"2024-09-11T23:27:52.489217+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:39.815984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.756344+0000","last_change":"2024-09-11T23:26:52.071603+0000","last_active":"2024-09-11T23:27:52.756344+0000","last_peered":"2024-09-11T23:27:52.756344+0000","last_clean":"2024-09-11T23:27:52.756344+0000","last_became_active":"2024-09-11T23:26:52.071190+0000","last_became_peered":"2024-09-11T23:26:52.071190+0000","last_unstale":"2024-09-11T23:27:52.756344+0000","last_undegraded":"2024-09-11T23:27:52.756344+0000","last_fullsized":"2024-09-11T23:27:52.756344+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:52.171622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.104796+0000","last_change":"2024-09-11T23:26:42.612493+0000","last_active":"2024-09-11T23:27:52.104796+0000","last_peered":"2024-09-11T23:27:52.104796+0000","last_clean":"2024-09-11T23:27:52.104796+0000","last_became_active":"2024-09-11T23:26:42.612018+0000","last_became_peered":"2024-09-11T23:26:42.612018+0000","last_unstale":"2024-09-11T23:27:52.104796+0000","last_undegraded":"2024-09-11T23:27:52.104796+0000","last_fullsized":"2024-09-11T23:27:52.104796+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:08.590684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.489481+0000","last_change":"2024-09-11T23:26:52.063634+0000","last_active":"2024-09-11T23:27:52.489481+0000","last_peered":"2024-09-11T23:27:52.489481+0000","last_clean":"2024-09-11T23:27:52.489481+0000","last_became_active":"2024-09-11T23:26:52.063205+0000","last_became_peered":"2024-09-11T23:26:52.063205+0000","last_unstale":"2024-09-11T23:27:52.489481+0000","last_undegraded":"2024-09-11T23:27:52.489481+0000","last_fullsized":"2024-09-11T23:27:52.489481+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:12.371238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.489688+0000","last_change":"2024-09-11T23:26:44.692776+0000","last_active":"2024-09-11T23:27:52.489688+0000","last_peered":"2024-09-11T23:27:52.489688+0000","last_clean":"2024-09-11T23:27:52.489688+0000","last_became_active":"2024-09-11T23:26:44.691989+0000","last_became_peered":"2024-09-11T23:26:44.691989+0000","last_unstale":"2024-09-11T23:27:52.489688+0000","last_undegraded":"2024-09-11T23:27:52.489688+0000","last_fullsized":"2024-09-11T23:27:52.489688+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:41.781016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"86'15","reported_seq":66,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.103476+0000","last_change":"2024-09-11T23:26:52.075909+0000","last_active":"2024-09-11T23:27:52.103476+0000","last_peered":"2024-09-11T23:27:52.103476+0000","last_clean":"2024-09-11T23:27:52.103476+0000","last_became_active":"2024-09-11T23:26:52.061277+0000","last_became_peered":"2024-09-11T23:26:52.061277+0000","last_unstale":"2024-09-11T23:27:52.103476+0000","last_undegraded":"2024-09-11T23:27:52.103476+0000","last_fullsized":"2024-09-11T23:27:52.103476+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:11.940951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.223736+0000","last_change":"2024-09-11T23:26:52.064172+0000","last_active":"2024-09-11T23:27:52.223736+0000","last_peered":"2024-09-11T23:27:52.223736+0000","last_clean":"2024-09-11T23:27:52.223736+0000","last_became_active":"2024-09-11T23:26:52.063807+0000","last_became_peered":"2024-09-11T23:26:52.063807+0000","last_unstale":"2024-09-11T23:27:52.223736+0000","last_undegraded":"2024-09-11T23:27:52.223736+0000","last_fullsized":"2024-09-11T23:27:52.223736+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:32.134115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.756132+0000","last_change":"2024-09-11T23:26:44.703624+0000","last_active":"2024-09-11T23:27:52.756132+0000","last_peered":"2024-09-11T23:27:52.756132+0000","last_clean":"2024-09-11T23:27:52.756132+0000","last_became_active":"2024-09-11T23:26:44.703298+0000","last_became_peered":"2024-09-11T23:26:44.703298+0000","last_unstale":"2024-09-11T23:27:52.756132+0000","last_undegraded":"2024-09-11T23:27:52.756132+0000","last_fullsized":"2024-09-11T23:27:52.756132+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:17.441926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'3","reported_seq":93,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:28:14.120366+0000","last_change":"2024-09-11T23:26:42.618328+0000","last_active":"2024-09-11T23:28:14.120366+0000","last_peered":"2024-09-11T23:28:14.120366+0000","last_clean":"2024-09-11T23:28:14.120366+0000","last_became_active":"2024-09-11T23:26:42.618005+0000","last_became_peered":"2024-09-11T23:26:42.618005+0000","last_unstale":"2024-09-11T23:28:14.120366+0000","last_undegraded":"2024-09-11T23:28:14.120366+0000","last_fullsized":"2024-09-11T23:28:14.120366+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:58.593887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.101618+0000","last_change":"2024-09-11T23:26:52.069824+0000","last_active":"2024-09-11T23:27:52.101618+0000","last_peered":"2024-09-11T23:27:52.101618+0000","last_clean":"2024-09-11T23:27:52.101618+0000","last_became_active":"2024-09-11T23:26:52.069341+0000","last_became_peered":"2024-09-11T23:26:52.069341+0000","last_unstale":"2024-09-11T23:27:52.101618+0000","last_undegraded":"2024-09-11T23:27:52.101618+0000","last_fullsized":"2024-09-11T23:27:52.101618+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:10.922896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.756643+0000","last_change":"2024-09-11T23:26:44.696963+0000","last_active":"2024-09-11T23:27:52.756643+0000","last_peered":"2024-09-11T23:27:52.756643+0000","last_clean":"2024-09-11T23:27:52.756643+0000","last_became_active":"2024-09-11T23:26:44.696543+0000","last_became_peered":"2024-09-11T23:26:44.696543+0000","last_unstale":"2024-09-11T23:27:52.756643+0000","last_undegraded":"2024-09-11T23:27:52.756643+0000","last_fullsized":"2024-09-11T23:27:52.756643+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:14.502969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"86'3","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.490056+0000","last_change":"2024-09-11T23:26:42.615454+0000","last_active":"2024-09-11T23:27:52.490056+0000","last_peered":"2024-09-11T23:27:52.490056+0000","last_clean":"2024-09-11T23:27:52.490056+0000","last_became_active":"2024-09-11T23:26:42.614948+0000","last_became_peered":"2024-09-11T23:26:42.614948+0000","last_unstale":"2024-09-11T23:27:52.490056+0000","last_undegraded":"2024-09-11T23:27:52.490056+0000","last_fullsized":"2024-09-11T23:27:52.490056+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:59.056748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.755999+0000","last_change":"2024-09-11T23:26:52.069846+0000","last_active":"2024-09-11T23:27:52.755999+0000","last_peered":"2024-09-11T23:27:52.755999+0000","last_clean":"2024-09-11T23:27:52.755999+0000","last_became_active":"2024-09-11T23:26:52.069398+0000","last_became_peered":"2024-09-11T23:26:52.069398+0000","last_unstale":"2024-09-11T23:27:52.755999+0000","last_undegraded":"2024-09-11T23:27:52.755999+0000","last_fullsized":"2024-09-11T23:27:52.755999+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:31.931388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.223415+0000","last_change":"2024-09-11T23:26:44.697114+0000","last_active":"2024-09-11T23:27:52.223415+0000","last_peered":"2024-09-11T23:27:52.223415+0000","last_clean":"2024-09-11T23:27:52.223415+0000","last_became_active":"2024-09-11T23:26:44.696811+0000","last_became_peered":"2024-09-11T23:26:44.696811+0000","last_unstale":"2024-09-11T23:27:52.223415+0000","last_undegraded":"2024-09-11T23:27:52.223415+0000","last_fullsized":"2024-09-11T23:27:52.223415+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:47:52.650877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"86'6","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.103151+0000","last_change":"2024-09-11T23:26:42.616377+0000","last_active":"2024-09-11T23:27:52.103151+0000","last_peered":"2024-09-11T23:27:52.103151+0000","last_clean":"2024-09-11T23:27:52.103151+0000","last_became_active":"2024-09-11T23:26:42.615887+0000","last_became_peered":"2024-09-11T23:26:42.615887+0000","last_unstale":"2024-09-11T23:27:52.103151+0000","last_undegraded":"2024-09-11T23:27:52.103151+0000","last_fullsized":"2024-09-11T23:27:52.103151+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:48.089178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.490255+0000","last_change":"2024-09-11T23:26:52.068340+0000","last_active":"2024-09-11T23:27:52.490255+0000","last_peered":"2024-09-11T23:27:52.490255+0000","last_clean":"2024-09-11T23:27:52.490255+0000","last_became_active":"2024-09-11T23:26:52.067905+0000","last_became_peered":"2024-09-11T23:26:52.067905+0000","last_unstale":"2024-09-11T23:27:52.490255+0000","last_undegraded":"2024-09-11T23:27:52.490255+0000","last_fullsized":"2024-09-11T23:27:52.490255+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:15.517992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.103589+0000","last_change":"2024-09-11T23:26:44.704570+0000","last_active":"2024-09-11T23:27:52.103589+0000","last_peered":"2024-09-11T23:27:52.103589+0000","last_clean":"2024-09-11T23:27:52.103589+0000","last_became_active":"2024-09-11T23:26:44.704263+0000","last_became_peered":"2024-09-11T23:26:44.704263+0000","last_unstale":"2024-09-11T23:27:52.103589+0000","last_undegraded":"2024-09-11T23:27:52.103589+0000","last_fullsized":"2024-09-11T23:27:52.103589+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:25.112831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"86'33","reported_seq":178,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:28:12.117763+0000","last_change":"2024-09-11T23:26:42.620726+0000","last_active":"2024-09-11T23:28:12.117763+0000","last_peered":"2024-09-11T23:28:12.117763+0000","last_clean":"2024-09-11T23:28:12.117763+0000","last_became_active":"2024-09-11T23:26:42.620381+0000","last_became_peered":"2024-09-11T23:26:42.620381+0000","last_unstale":"2024-09-11T23:28:12.117763+0000","last_undegraded":"2024-09-11T23:28:12.117763+0000","last_fullsized":"2024-09-11T23:28:12.117763+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:41.001056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63479,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":111,"num_read_kb":117,"num_write":34,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.101188+0000","last_change":"2024-09-11T23:26:52.073830+0000","last_active":"2024-09-11T23:27:52.101188+0000","last_peered":"2024-09-11T23:27:52.101188+0000","last_clean":"2024-09-11T23:27:52.101188+0000","last_became_active":"2024-09-11T23:26:52.073415+0000","last_became_peered":"2024-09-11T23:26:52.073415+0000","last_unstale":"2024-09-11T23:27:52.101188+0000","last_undegraded":"2024-09-11T23:27:52.101188+0000","last_fullsized":"2024-09-11T23:27:52.101188+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:25.310980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.881596+0000","last_change":"2024-09-11T23:26:44.694203+0000","last_active":"2024-09-11T23:27:52.881596+0000","last_peered":"2024-09-11T23:27:52.881596+0000","last_clean":"2024-09-11T23:27:52.881596+0000","last_became_active":"2024-09-11T23:26:44.693827+0000","last_became_peered":"2024-09-11T23:26:44.693827+0000","last_unstale":"2024-09-11T23:27:52.881596+0000","last_undegraded":"2024-09-11T23:27:52.881596+0000","last_fullsized":"2024-09-11T23:27:52.881596+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:29.929206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"86'4","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.490373+0000","last_change":"2024-09-11T23:26:42.646046+0000","last_active":"2024-09-11T23:27:52.490373+0000","last_peered":"2024-09-11T23:27:52.490373+0000","last_clean":"2024-09-11T23:27:52.490373+0000","last_became_active":"2024-09-11T23:26:42.645735+0000","last_became_peered":"2024-09-11T23:26:42.645735+0000","last_unstale":"2024-09-11T23:27:52.490373+0000","last_undegraded":"2024-09-11T23:27:52.490373+0000","last_fullsized":"2024-09-11T23:27:52.490373+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:12.159712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.104639+0000","last_change":"2024-09-11T23:26:52.069732+0000","last_active":"2024-09-11T23:27:52.104639+0000","last_peered":"2024-09-11T23:27:52.104639+0000","last_clean":"2024-09-11T23:27:52.104639+0000","last_became_active":"2024-09-11T23:26:52.069230+0000","last_became_peered":"2024-09-11T23:26:52.069230+0000","last_unstale":"2024-09-11T23:27:52.104639+0000","last_undegraded":"2024-09-11T23:27:52.104639+0000","last_fullsized":"2024-09-11T23:27:52.104639+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:50:17.304900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.160511+0000","last_change":"2024-09-11T23:26:44.691704+0000","last_active":"2024-09-11T23:27:52.160511+0000","last_peered":"2024-09-11T23:27:52.160511+0000","last_clean":"2024-09-11T23:27:52.160511+0000","last_became_active":"2024-09-11T23:26:44.690686+0000","last_became_peered":"2024-09-11T23:26:44.690686+0000","last_unstale":"2024-09-11T23:27:52.160511+0000","last_undegraded":"2024-09-11T23:27:52.160511+0000","last_fullsized":"2024-09-11T23:27:52.160511+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:44.046933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"86'2","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.756515+0000","last_change":"2024-09-11T23:26:42.616271+0000","last_active":"2024-09-11T23:27:52.756515+0000","last_peered":"2024-09-11T23:27:52.756515+0000","last_clean":"2024-09-11T23:27:52.756515+0000","last_became_active":"2024-09-11T23:26:42.615870+0000","last_became_peered":"2024-09-11T23:26:42.615870+0000","last_unstale":"2024-09-11T23:27:52.756515+0000","last_undegraded":"2024-09-11T23:27:52.756515+0000","last_fullsized":"2024-09-11T23:27:52.756515+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:08.573352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.100961+0000","last_change":"2024-09-11T23:26:52.072615+0000","last_active":"2024-09-11T23:27:52.100961+0000","last_peered":"2024-09-11T23:27:52.100961+0000","last_clean":"2024-09-11T23:27:52.100961+0000","last_became_active":"2024-09-11T23:26:52.072219+0000","last_became_peered":"2024-09-11T23:26:52.072219+0000","last_unstale":"2024-09-11T23:27:52.100961+0000","last_undegraded":"2024-09-11T23:27:52.100961+0000","last_fullsized":"2024-09-11T23:27:52.100961+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:57.598375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.881796+0000","last_change":"2024-09-11T23:26:44.690099+0000","last_active":"2024-09-11T23:27:52.881796+0000","last_peered":"2024-09-11T23:27:52.881796+0000","last_clean":"2024-09-11T23:27:52.881796+0000","last_became_active":"2024-09-11T23:26:44.689763+0000","last_became_peered":"2024-09-11T23:26:44.689763+0000","last_unstale":"2024-09-11T23:27:52.881796+0000","last_undegraded":"2024-09-11T23:27:52.881796+0000","last_fullsized":"2024-09-11T23:27:52.881796+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:45.316508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"86'3","reported_seq":88,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:28:11.116192+0000","last_change":"2024-09-11T23:26:42.620930+0000","last_active":"2024-09-11T23:28:11.116192+0000","last_peered":"2024-09-11T23:28:11.116192+0000","last_clean":"2024-09-11T23:28:11.116192+0000","last_became_active":"2024-09-11T23:26:42.620544+0000","last_became_peered":"2024-09-11T23:26:42.620544+0000","last_unstale":"2024-09-11T23:28:11.116192+0000","last_undegraded":"2024-09-11T23:28:11.116192+0000","last_fullsized":"2024-09-11T23:28:11.116192+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:26.625004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.179305+0000","last_change":"2024-09-11T23:26:52.065014+0000","last_active":"2024-09-11T23:27:52.179305+0000","last_peered":"2024-09-11T23:27:52.179305+0000","last_clean":"2024-09-11T23:27:52.179305+0000","last_became_active":"2024-09-11T23:26:52.064570+0000","last_became_peered":"2024-09-11T23:26:52.064570+0000","last_unstale":"2024-09-11T23:27:52.179305+0000","last_undegraded":"2024-09-11T23:27:52.179305+0000","last_fullsized":"2024-09-11T23:27:52.179305+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:53.658310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.160346+0000","last_change":"2024-09-11T23:26:52.065559+0000","last_active":"2024-09-11T23:27:52.160346+0000","last_peered":"2024-09-11T23:27:52.160346+0000","last_clean":"2024-09-11T23:27:52.160346+0000","last_became_active":"2024-09-11T23:26:52.065197+0000","last_became_peered":"2024-09-11T23:26:52.065197+0000","last_unstale":"2024-09-11T23:27:52.160346+0000","last_undegraded":"2024-09-11T23:27:52.160346+0000","last_fullsized":"2024-09-11T23:27:52.160346+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:19.371054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.101073+0000","last_change":"2024-09-11T23:26:44.691726+0000","last_active":"2024-09-11T23:27:52.101073+0000","last_peered":"2024-09-11T23:27:52.101073+0000","last_clean":"2024-09-11T23:27:52.101073+0000","last_became_active":"2024-09-11T23:26:44.691417+0000","last_became_peered":"2024-09-11T23:26:44.691417+0000","last_unstale":"2024-09-11T23:27:52.101073+0000","last_undegraded":"2024-09-11T23:27:52.101073+0000","last_fullsized":"2024-09-11T23:27:52.101073+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:38.139576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"86'1","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.489750+0000","last_change":"2024-09-11T23:26:42.615287+0000","last_active":"2024-09-11T23:27:52.489750+0000","last_peered":"2024-09-11T23:27:52.489750+0000","last_clean":"2024-09-11T23:27:52.489750+0000","last_became_active":"2024-09-11T23:26:42.614939+0000","last_became_peered":"2024-09-11T23:26:42.614939+0000","last_unstale":"2024-09-11T23:27:52.489750+0000","last_undegraded":"2024-09-11T23:27:52.489750+0000","last_fullsized":"2024-09-11T23:27:52.489750+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:23.250573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.756340+0000","last_change":"2024-09-11T23:26:52.069773+0000","last_active":"2024-09-11T23:27:52.756340+0000","last_peered":"2024-09-11T23:27:52.756340+0000","last_clean":"2024-09-11T23:27:52.756340+0000","last_became_active":"2024-09-11T23:26:52.069365+0000","last_became_peered":"2024-09-11T23:26:52.069365+0000","last_unstale":"2024-09-11T23:27:52.756340+0000","last_undegraded":"2024-09-11T23:27:52.756340+0000","last_fullsized":"2024-09-11T23:27:52.756340+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:00.101851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.179211+0000","last_change":"2024-09-11T23:26:44.689869+0000","last_active":"2024-09-11T23:27:52.179211+0000","last_peered":"2024-09-11T23:27:52.179211+0000","last_clean":"2024-09-11T23:27:52.179211+0000","last_became_active":"2024-09-11T23:26:44.689474+0000","last_became_peered":"2024-09-11T23:26:44.689474+0000","last_unstale":"2024-09-11T23:27:52.179211+0000","last_undegraded":"2024-09-11T23:27:52.179211+0000","last_fullsized":"2024-09-11T23:27:52.179211+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:10.255840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"86'2","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.223204+0000","last_change":"2024-09-11T23:26:42.609857+0000","last_active":"2024-09-11T23:27:52.223204+0000","last_peered":"2024-09-11T23:27:52.223204+0000","last_clean":"2024-09-11T23:27:52.223204+0000","last_became_active":"2024-09-11T23:26:42.609536+0000","last_became_peered":"2024-09-11T23:26:42.609536+0000","last_unstale":"2024-09-11T23:27:52.223204+0000","last_undegraded":"2024-09-11T23:27:52.223204+0000","last_fullsized":"2024-09-11T23:27:52.223204+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:17.751298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"86'3","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.102213+0000","last_change":"2024-09-11T23:26:52.061076+0000","last_active":"2024-09-11T23:27:52.102213+0000","last_peered":"2024-09-11T23:27:52.102213+0000","last_clean":"2024-09-11T23:27:52.102213+0000","last_became_active":"2024-09-11T23:26:52.060543+0000","last_became_peered":"2024-09-11T23:26:52.060543+0000","last_unstale":"2024-09-11T23:27:52.102213+0000","last_undegraded":"2024-09-11T23:27:52.102213+0000","last_fullsized":"2024-09-11T23:27:52.102213+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:10.566235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.490139+0000","last_change":"2024-09-11T23:26:44.690699+0000","last_active":"2024-09-11T23:27:52.490139+0000","last_peered":"2024-09-11T23:27:52.490139+0000","last_clean":"2024-09-11T23:27:52.490139+0000","last_became_active":"2024-09-11T23:26:44.690142+0000","last_became_peered":"2024-09-11T23:26:44.690142+0000","last_unstale":"2024-09-11T23:27:52.490139+0000","last_undegraded":"2024-09-11T23:27:52.490139+0000","last_fullsized":"2024-09-11T23:27:52.490139+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:20.790171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.491613+0000","last_change":"2024-09-11T23:27:52.491613+0000","last_active":"2024-09-11T23:27:52.491613+0000","last_peered":"2024-09-11T23:27:52.491613+0000","last_clean":"2024-09-11T23:27:52.491613+0000","last_became_active":"2024-09-11T23:27:52.491102+0000","last_became_peered":"2024-09-11T23:27:52.491102+0000","last_unstale":"2024-09-11T23:27:52.491613+0000","last_undegraded":"2024-09-11T23:27:52.491613+0000","last_fullsized":"2024-09-11T23:27:52.491613+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:22.536173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"86'5","reported_seq":77,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:28:12.118284+0000","last_change":"2024-09-11T23:26:52.059895+0000","last_active":"2024-09-11T23:28:12.118284+0000","last_peered":"2024-09-11T23:28:12.118284+0000","last_clean":"2024-09-11T23:28:12.118284+0000","last_became_active":"2024-09-11T23:26:52.059431+0000","last_became_peered":"2024-09-11T23:26:52.059431+0000","last_unstale":"2024-09-11T23:28:12.118284+0000","last_undegraded":"2024-09-11T23:28:12.118284+0000","last_fullsized":"2024-09-11T23:28:12.118284+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:41.593767+0000","last_clean_scrub_stamp":"2024-09-11T23:26:41.593767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:58.922483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.104276+0000","last_change":"2024-09-11T23:26:44.690449+0000","last_active":"2024-09-11T23:27:52.104276+0000","last_peered":"2024-09-11T23:27:52.104276+0000","last_clean":"2024-09-11T23:27:52.104276+0000","last_became_active":"2024-09-11T23:26:44.690102+0000","last_became_peered":"2024-09-11T23:26:44.690102+0000","last_unstale":"2024-09-11T23:27:52.104276+0000","last_undegraded":"2024-09-11T23:27:52.104276+0000","last_fullsized":"2024-09-11T23:27:52.104276+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:49.730602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.102873+0000","last_change":"2024-09-11T23:26:52.062826+0000","last_active":"2024-09-11T23:27:52.102873+0000","last_peered":"2024-09-11T23:27:52.102873+0000","last_clean":"2024-09-11T23:27:52.102873+0000","last_became_active":"2024-09-11T23:26:52.062405+0000","last_became_peered":"2024-09-11T23:26:52.062405+0000","last_unstale":"2024-09-11T23:27:52.102873+0000","last_undegraded":"2024-09-11T23:27:52.102873+0000","last_fullsized":"2024-09-11T23:27:52.102873+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:51.037604+0000","last_clean_scrub_stamp":"2024-09-11T23:26:51.037604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:46.141117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.755883+0000","last_change":"2024-09-11T23:26:44.707056+0000","last_active":"2024-09-11T23:27:52.755883+0000","last_peered":"2024-09-11T23:27:52.755883+0000","last_clean":"2024-09-11T23:27:52.755883+0000","last_became_active":"2024-09-11T23:26:44.706704+0000","last_became_peered":"2024-09-11T23:26:44.706704+0000","last_unstale":"2024-09-11T23:27:52.755883+0000","last_undegraded":"2024-09-11T23:27:52.755883+0000","last_fullsized":"2024-09-11T23:27:52.755883+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:29.221070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.103867+0000","last_change":"2024-09-11T23:26:44.699807+0000","last_active":"2024-09-11T23:27:52.103867+0000","last_peered":"2024-09-11T23:27:52.103867+0000","last_clean":"2024-09-11T23:27:52.103867+0000","last_became_active":"2024-09-11T23:26:44.699497+0000","last_became_peered":"2024-09-11T23:26:44.699497+0000","last_unstale":"2024-09-11T23:27:52.103867+0000","last_undegraded":"2024-09-11T23:27:52.103867+0000","last_fullsized":"2024-09-11T23:27:52.103867+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:17.954048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.102652+0000","last_change":"2024-09-11T23:26:44.698751+0000","last_active":"2024-09-11T23:27:52.102652+0000","last_peered":"2024-09-11T23:27:52.102652+0000","last_clean":"2024-09-11T23:27:52.102652+0000","last_became_active":"2024-09-11T23:26:44.698429+0000","last_became_peered":"2024-09-11T23:26:44.698429+0000","last_unstale":"2024-09-11T23:27:52.102652+0000","last_undegraded":"2024-09-11T23:27:52.102652+0000","last_fullsized":"2024-09-11T23:27:52.102652+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:25.452225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.160210+0000","last_change":"2024-09-11T23:26:44.690356+0000","last_active":"2024-09-11T23:27:52.160210+0000","last_peered":"2024-09-11T23:27:52.160210+0000","last_clean":"2024-09-11T23:27:52.160210+0000","last_became_active":"2024-09-11T23:26:44.690057+0000","last_became_peered":"2024-09-11T23:26:44.690057+0000","last_unstale":"2024-09-11T23:27:52.160210+0000","last_undegraded":"2024-09-11T23:27:52.160210+0000","last_fullsized":"2024-09-11T23:27:52.160210+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:38.950284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.223675+0000","last_change":"2024-09-11T23:26:44.691251+0000","last_active":"2024-09-11T23:27:52.223675+0000","last_peered":"2024-09-11T23:27:52.223675+0000","last_clean":"2024-09-11T23:27:52.223675+0000","last_became_active":"2024-09-11T23:26:44.690905+0000","last_became_peered":"2024-09-11T23:26:44.690905+0000","last_unstale":"2024-09-11T23:27:52.223675+0000","last_undegraded":"2024-09-11T23:27:52.223675+0000","last_fullsized":"2024-09-11T23:27:52.223675+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:18.509826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.756347+0000","last_change":"2024-09-11T23:26:44.707581+0000","last_active":"2024-09-11T23:27:52.756347+0000","last_peered":"2024-09-11T23:27:52.756347+0000","last_clean":"2024-09-11T23:27:52.756347+0000","last_became_active":"2024-09-11T23:26:44.707266+0000","last_became_peered":"2024-09-11T23:26:44.707266+0000","last_unstale":"2024-09-11T23:27:52.756347+0000","last_undegraded":"2024-09-11T23:27:52.756347+0000","last_fullsized":"2024-09-11T23:27:52.756347+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:40:28.248560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.103149+0000","last_change":"2024-09-11T23:26:44.704003+0000","last_active":"2024-09-11T23:27:52.103149+0000","last_peered":"2024-09-11T23:27:52.103149+0000","last_clean":"2024-09-11T23:27:52.103149+0000","last_became_active":"2024-09-11T23:26:44.703702+0000","last_became_peered":"2024-09-11T23:26:44.703702+0000","last_unstale":"2024-09-11T23:27:52.103149+0000","last_undegraded":"2024-09-11T23:27:52.103149+0000","last_fullsized":"2024-09-11T23:27:52.103149+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:28:17.511868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.179883+0000","last_change":"2024-09-11T23:26:44.694601+0000","last_active":"2024-09-11T23:27:52.179883+0000","last_peered":"2024-09-11T23:27:52.179883+0000","last_clean":"2024-09-11T23:27:52.179883+0000","last_became_active":"2024-09-11T23:26:44.694304+0000","last_became_peered":"2024-09-11T23:26:44.694304+0000","last_unstale":"2024-09-11T23:27:52.179883+0000","last_undegraded":"2024-09-11T23:27:52.179883+0000","last_fullsized":"2024-09-11T23:27:52.179883+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:32:04.171439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.489412+0000","last_change":"2024-09-11T23:26:44.691565+0000","last_active":"2024-09-11T23:27:52.489412+0000","last_peered":"2024-09-11T23:27:52.489412+0000","last_clean":"2024-09-11T23:27:52.489412+0000","last_became_active":"2024-09-11T23:26:44.691237+0000","last_became_peered":"2024-09-11T23:26:44.691237+0000","last_unstale":"2024-09-11T23:27:52.489412+0000","last_undegraded":"2024-09-11T23:27:52.489412+0000","last_fullsized":"2024-09-11T23:27:52.489412+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:01.413447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.179386+0000","last_change":"2024-09-11T23:26:44.699372+0000","last_active":"2024-09-11T23:27:52.179386+0000","last_peered":"2024-09-11T23:27:52.179386+0000","last_clean":"2024-09-11T23:27:52.179386+0000","last_became_active":"2024-09-11T23:26:44.698934+0000","last_became_peered":"2024-09-11T23:26:44.698934+0000","last_unstale":"2024-09-11T23:27:52.179386+0000","last_undegraded":"2024-09-11T23:27:52.179386+0000","last_fullsized":"2024-09-11T23:27:52.179386+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:44:41.486314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.881594+0000","last_change":"2024-09-11T23:26:44.698595+0000","last_active":"2024-09-11T23:27:52.881594+0000","last_peered":"2024-09-11T23:27:52.881594+0000","last_clean":"2024-09-11T23:27:52.881594+0000","last_became_active":"2024-09-11T23:26:44.698268+0000","last_became_peered":"2024-09-11T23:26:44.698268+0000","last_unstale":"2024-09-11T23:27:52.881594+0000","last_undegraded":"2024-09-11T23:27:52.881594+0000","last_fullsized":"2024-09-11T23:27:52.881594+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:57:55.304720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.223528+0000","last_change":"2024-09-11T23:26:44.697049+0000","last_active":"2024-09-11T23:27:52.223528+0000","last_peered":"2024-09-11T23:27:52.223528+0000","last_clean":"2024-09-11T23:27:52.223528+0000","last_became_active":"2024-09-11T23:26:44.696748+0000","last_became_peered":"2024-09-11T23:26:44.696748+0000","last_unstale":"2024-09-11T23:27:52.223528+0000","last_undegraded":"2024-09-11T23:27:52.223528+0000","last_fullsized":"2024-09-11T23:27:52.223528+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:55.486695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.756127+0000","last_change":"2024-09-11T23:26:44.705094+0000","last_active":"2024-09-11T23:27:52.756127+0000","last_peered":"2024-09-11T23:27:52.756127+0000","last_clean":"2024-09-11T23:27:52.756127+0000","last_became_active":"2024-09-11T23:26:44.704750+0000","last_became_peered":"2024-09-11T23:26:44.704750+0000","last_unstale":"2024-09-11T23:27:52.756127+0000","last_undegraded":"2024-09-11T23:27:52.756127+0000","last_fullsized":"2024-09-11T23:27:52.756127+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:19.058557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.103016+0000","last_change":"2024-09-11T23:26:52.070615+0000","last_active":"2024-09-11T23:27:52.103016+0000","last_peered":"2024-09-11T23:27:52.103016+0000","last_clean":"2024-09-11T23:27:52.103016+0000","last_became_active":"2024-09-11T23:26:52.070182+0000","last_became_peered":"2024-09-11T23:26:52.070182+0000","last_unstale":"2024-09-11T23:27:52.103016+0000","last_undegraded":"2024-09-11T23:27:52.103016+0000","last_fullsized":"2024-09-11T23:27:52.103016+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:37.888276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,6],"acting":[2,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.101641+0000","last_change":"2024-09-11T23:26:44.690032+0000","last_active":"2024-09-11T23:27:52.101641+0000","last_peered":"2024-09-11T23:27:52.101641+0000","last_clean":"2024-09-11T23:27:52.101641+0000","last_became_active":"2024-09-11T23:26:44.689715+0000","last_became_peered":"2024-09-11T23:26:44.689715+0000","last_unstale":"2024-09-11T23:27:52.101641+0000","last_undegraded":"2024-09-11T23:27:52.101641+0000","last_fullsized":"2024-09-11T23:27:52.101641+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:10.325376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.756535+0000","last_change":"2024-09-11T23:26:44.707675+0000","last_active":"2024-09-11T23:27:52.756535+0000","last_peered":"2024-09-11T23:27:52.756535+0000","last_clean":"2024-09-11T23:27:52.756535+0000","last_became_active":"2024-09-11T23:26:44.707063+0000","last_became_peered":"2024-09-11T23:26:44.707063+0000","last_unstale":"2024-09-11T23:27:52.756535+0000","last_undegraded":"2024-09-11T23:27:52.756535+0000","last_fullsized":"2024-09-11T23:27:52.756535+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:52.289558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.881222+0000","last_change":"2024-09-11T23:26:44.697512+0000","last_active":"2024-09-11T23:27:52.881222+0000","last_peered":"2024-09-11T23:27:52.881222+0000","last_clean":"2024-09-11T23:27:52.881222+0000","last_became_active":"2024-09-11T23:26:44.697208+0000","last_became_peered":"2024-09-11T23:26:44.697208+0000","last_unstale":"2024-09-11T23:27:52.881222+0000","last_undegraded":"2024-09-11T23:27:52.881222+0000","last_fullsized":"2024-09-11T23:27:52.881222+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:57.001816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.160232+0000","last_change":"2024-09-11T23:26:44.700661+0000","last_active":"2024-09-11T23:27:52.160232+0000","last_peered":"2024-09-11T23:27:52.160232+0000","last_clean":"2024-09-11T23:27:52.160232+0000","last_became_active":"2024-09-11T23:26:44.700298+0000","last_became_peered":"2024-09-11T23:26:44.700298+0000","last_unstale":"2024-09-11T23:27:52.160232+0000","last_undegraded":"2024-09-11T23:27:52.160232+0000","last_fullsized":"2024-09-11T23:27:52.160232+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:03.774789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.160078+0000","last_change":"2024-09-11T23:26:44.695295+0000","last_active":"2024-09-11T23:27:52.160078+0000","last_peered":"2024-09-11T23:27:52.160078+0000","last_clean":"2024-09-11T23:27:52.160078+0000","last_became_active":"2024-09-11T23:26:44.694905+0000","last_became_peered":"2024-09-11T23:26:44.694905+0000","last_unstale":"2024-09-11T23:27:52.160078+0000","last_undegraded":"2024-09-11T23:27:52.160078+0000","last_fullsized":"2024-09-11T23:27:52.160078+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:59.016335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.223507+0000","last_change":"2024-09-11T23:26:44.689876+0000","last_active":"2024-09-11T23:27:52.223507+0000","last_peered":"2024-09-11T23:27:52.223507+0000","last_clean":"2024-09-11T23:27:52.223507+0000","last_became_active":"2024-09-11T23:26:44.689541+0000","last_became_peered":"2024-09-11T23:26:44.689541+0000","last_unstale":"2024-09-11T23:27:52.223507+0000","last_undegraded":"2024-09-11T23:27:52.223507+0000","last_fullsized":"2024-09-11T23:27:52.223507+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:18.693201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.104539+0000","last_change":"2024-09-11T23:26:44.696308+0000","last_active":"2024-09-11T23:27:52.104539+0000","last_peered":"2024-09-11T23:27:52.104539+0000","last_clean":"2024-09-11T23:27:52.104539+0000","last_became_active":"2024-09-11T23:26:44.695973+0000","last_became_peered":"2024-09-11T23:26:44.695973+0000","last_unstale":"2024-09-11T23:27:52.104539+0000","last_undegraded":"2024-09-11T23:27:52.104539+0000","last_fullsized":"2024-09-11T23:27:52.104539+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:46.890624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.756600+0000","last_change":"2024-09-11T23:26:44.703180+0000","last_active":"2024-09-11T23:27:52.756600+0000","last_peered":"2024-09-11T23:27:52.756600+0000","last_clean":"2024-09-11T23:27:52.756600+0000","last_became_active":"2024-09-11T23:26:44.702843+0000","last_became_peered":"2024-09-11T23:26:44.702843+0000","last_unstale":"2024-09-11T23:27:52.756600+0000","last_undegraded":"2024-09-11T23:27:52.756600+0000","last_fullsized":"2024-09-11T23:27:52.756600+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:35.425199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.102748+0000","last_change":"2024-09-11T23:26:52.069650+0000","last_active":"2024-09-11T23:27:52.102748+0000","last_peered":"2024-09-11T23:27:52.102748+0000","last_clean":"2024-09-11T23:27:52.102748+0000","last_became_active":"2024-09-11T23:26:52.069258+0000","last_became_peered":"2024-09-11T23:26:52.069258+0000","last_unstale":"2024-09-11T23:27:52.102748+0000","last_undegraded":"2024-09-11T23:27:52.102748+0000","last_fullsized":"2024-09-11T23:27:52.102748+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:29.073360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.881921+0000","last_change":"2024-09-11T23:26:44.701547+0000","last_active":"2024-09-11T23:27:52.881921+0000","last_peered":"2024-09-11T23:27:52.881921+0000","last_clean":"2024-09-11T23:27:52.881921+0000","last_became_active":"2024-09-11T23:26:44.701215+0000","last_became_peered":"2024-09-11T23:26:44.701215+0000","last_unstale":"2024-09-11T23:27:52.881921+0000","last_undegraded":"2024-09-11T23:27:52.881921+0000","last_fullsized":"2024-09-11T23:27:52.881921+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:39.774757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.179143+0000","last_change":"2024-09-11T23:26:44.696446+0000","last_active":"2024-09-11T23:27:52.179143+0000","last_peered":"2024-09-11T23:27:52.179143+0000","last_clean":"2024-09-11T23:27:52.179143+0000","last_became_active":"2024-09-11T23:26:44.696129+0000","last_became_peered":"2024-09-11T23:26:44.696129+0000","last_unstale":"2024-09-11T23:27:52.179143+0000","last_undegraded":"2024-09-11T23:27:52.179143+0000","last_fullsized":"2024-09-11T23:27:52.179143+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:02.441274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.756237+0000","last_change":"2024-09-11T23:26:44.702036+0000","last_active":"2024-09-11T23:27:52.756237+0000","last_peered":"2024-09-11T23:27:52.756237+0000","last_clean":"2024-09-11T23:27:52.756237+0000","last_became_active":"2024-09-11T23:26:44.701517+0000","last_became_peered":"2024-09-11T23:26:44.701517+0000","last_unstale":"2024-09-11T23:27:52.756237+0000","last_undegraded":"2024-09-11T23:27:52.756237+0000","last_fullsized":"2024-09-11T23:27:52.756237+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:56.577107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.102201+0000","last_change":"2024-09-11T23:26:44.693533+0000","last_active":"2024-09-11T23:27:52.102201+0000","last_peered":"2024-09-11T23:27:52.102201+0000","last_clean":"2024-09-11T23:27:52.102201+0000","last_became_active":"2024-09-11T23:26:44.693199+0000","last_became_peered":"2024-09-11T23:26:44.693199+0000","last_unstale":"2024-09-11T23:27:52.102201+0000","last_undegraded":"2024-09-11T23:27:52.102201+0000","last_fullsized":"2024-09-11T23:27:52.102201+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:33.125162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.103755+0000","last_change":"2024-09-11T23:26:44.691525+0000","last_active":"2024-09-11T23:27:52.103755+0000","last_peered":"2024-09-11T23:27:52.103755+0000","last_clean":"2024-09-11T23:27:52.103755+0000","last_became_active":"2024-09-11T23:26:44.691186+0000","last_became_peered":"2024-09-11T23:26:44.691186+0000","last_unstale":"2024-09-11T23:27:52.103755+0000","last_undegraded":"2024-09-11T23:27:52.103755+0000","last_fullsized":"2024-09-11T23:27:52.103755+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:05.002600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.104489+0000","last_change":"2024-09-11T23:26:44.700076+0000","last_active":"2024-09-11T23:27:52.104489+0000","last_peered":"2024-09-11T23:27:52.104489+0000","last_clean":"2024-09-11T23:27:52.104489+0000","last_became_active":"2024-09-11T23:26:44.699746+0000","last_became_peered":"2024-09-11T23:26:44.699746+0000","last_unstale":"2024-09-11T23:27:52.104489+0000","last_undegraded":"2024-09-11T23:27:52.104489+0000","last_fullsized":"2024-09-11T23:27:52.104489+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:49.311174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.160142+0000","last_change":"2024-09-11T23:26:44.699385+0000","last_active":"2024-09-11T23:27:52.160142+0000","last_peered":"2024-09-11T23:27:52.160142+0000","last_clean":"2024-09-11T23:27:52.160142+0000","last_became_active":"2024-09-11T23:26:44.699095+0000","last_became_peered":"2024-09-11T23:26:44.699095+0000","last_unstale":"2024-09-11T23:27:52.160142+0000","last_undegraded":"2024-09-11T23:27:52.160142+0000","last_fullsized":"2024-09-11T23:27:52.160142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:40:30.583732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.160353+0000","last_change":"2024-09-11T23:26:44.696893+0000","last_active":"2024-09-11T23:27:52.160353+0000","last_peered":"2024-09-11T23:27:52.160353+0000","last_clean":"2024-09-11T23:27:52.160353+0000","last_became_active":"2024-09-11T23:26:44.696493+0000","last_became_peered":"2024-09-11T23:26:44.696493+0000","last_unstale":"2024-09-11T23:27:52.160353+0000","last_undegraded":"2024-09-11T23:27:52.160353+0000","last_fullsized":"2024-09-11T23:27:52.160353+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:32.320327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T23:27:52.756515+0000","last_change":"2024-09-11T23:26:44.707902+0000","last_active":"2024-09-11T23:27:52.756515+0000","last_peered":"2024-09-11T23:27:52.756515+0000","last_clean":"2024-09-11T23:27:52.756515+0000","last_became_active":"2024-09-11T23:26:44.706664+0000","last_became_peered":"2024-09-11T23:26:44.706664+0000","last_unstale":"2024-09-11T23:27:52.756515+0000","last_undegraded":"2024-09-11T23:27:52.756515+0000","last_fullsized":"2024-09-11T23:27:52.756515+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:43.664439+0000","last_clean_scrub_stamp":"2024-09-11T23:26:43.664439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:57.865640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67089,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":340,"num_read_kb":240,"num_write":167,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":201267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":142,"ondisk_log_size":142,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":3542208,"data_compressed":214348,"data_compressed_allocated":270336,"data_compressed_original":3506176,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579936,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":978944,"data_stored":500115,"data_compressed":23713,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808869,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28120,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717032,"statfs":{"total":95995035648,"available":95966240768,"internally_reserved":0,"allocated":1118208,"data_stored":1150240,"data_compressed":59983,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972394,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36320,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708832,"statfs":{"total":95995035648,"available":95957843968,"internally_reserved":0,"allocated":991232,"data_stored":503825,"data_compressed":23713,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201327,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":987136,"data_stored":499649,"data_compressed":23713,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430260,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32200,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712952,"statfs":{"total":95995035648,"available":95962062848,"internally_reserved":0,"allocated":1036288,"data_stored":1095167,"data_compressed":59983,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626489,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":966656,"data_stored":494905,"data_compressed":23713,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855423,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1036288,"data_stored":1090133,"data_compressed":59983,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018948,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":987136,"data_stored":499667,"data_compressed":23713,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247880,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36304,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708848,"statfs":{"total":95995035648,"available":95957860352,"internally_reserved":0,"allocated":978944,"data_stored":495099,"data_compressed":23713,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444110,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1052672,"data_stored":559532,"data_compressed":23713,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1036288,"data_stored":558294,"data_compressed":23713,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":991232,"data_stored":496293,"data_compressed":23713,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34634,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34634,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36270,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36270,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36270,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36270,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":63479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":64717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:28:18.900 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-11T23:28:18.900 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-11T23:28:18.900 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-11T23:28:18.900 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph health --format=json 2024-09-11T23:28:19.158 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:28:19.576 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:19 smithi005 ceph-mon[31201]: from='client.15033 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:28:19.577 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:19 smithi005 ceph-mon[31201]: pgmap v332: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T23:28:19.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:19 smithi159 ceph-mon[34394]: from='client.15033 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:28:19.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:19 smithi159 ceph-mon[34394]: pgmap v332: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T23:28:19.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:19 smithi172 ceph-mon[34855]: from='client.15033 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:28:19.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:19 smithi172 ceph-mon[34855]: pgmap v332: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T23:28:19.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.658+0000 7f208995e640 1 -- 172.21.15.5:0/1991320908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2084102d40 msgr2=0x7f2084103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:19.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.658+0000 7f208995e640 1 --2- 172.21.15.5:0/1991320908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2084102d40 0x7f2084103120 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2074009900 tx=0x7f207402a480 comp rx=0 tx=0).stop 2024-09-11T23:28:19.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.658+0000 7f208995e640 1 -- 172.21.15.5:0/1991320908 shutdown_connections 2024-09-11T23:28:19.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.658+0000 7f208995e640 1 --2- 172.21.15.5:0/1991320908 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f208410c170 0x7f208410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:19.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.658+0000 7f208995e640 1 --2- 172.21.15.5:0/1991320908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2084103660 0x7f208410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:19.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.658+0000 7f208995e640 1 --2- 172.21.15.5:0/1991320908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2084102d40 0x7f2084103120 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:19.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.658+0000 7f208995e640 1 -- 172.21.15.5:0/1991320908 >> 172.21.15.5:0/1991320908 conn(0x7f20840fc7a0 msgr2=0x7f20840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:19.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.658+0000 7f208995e640 1 -- 172.21.15.5:0/1991320908 shutdown_connections 2024-09-11T23:28:19.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.658+0000 7f208995e640 1 -- 172.21.15.5:0/1991320908 wait complete. 2024-09-11T23:28:19.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.658+0000 7f208995e640 1 Processor -- start 2024-09-11T23:28:19.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.659+0000 7f208995e640 1 -- start start 2024-09-11T23:28:19.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.659+0000 7f208995e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2084102d40 0x7f2084198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:19.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.659+0000 7f208995e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2084103660 0x7f20841987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:19.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.659+0000 7f208995e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f208410c170 0x7f208419cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:19.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.659+0000 7f208995e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2084111e20 con 0x7f2084103660 2024-09-11T23:28:19.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.659+0000 7f208995e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f2084111ca0 con 0x7f208410c170 2024-09-11T23:28:19.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.659+0000 7f208995e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2084111fa0 con 0x7f2084102d40 2024-09-11T23:28:19.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.659+0000 7f20827fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2084103660 0x7f20841987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:19.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.659+0000 7f20827fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2084103660 0x7f20841987c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54202/0 (socket says 172.21.15.5:54202) 2024-09-11T23:28:19.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.659+0000 7f20827fc640 1 -- 172.21.15.5:0/2182337649 learned_addr learned my addr 172.21.15.5:0/2182337649 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:19.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.659+0000 7f20837fe640 1 --2- 172.21.15.5:0/2182337649 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f208410c170 0x7f208419cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:19.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.659+0000 7f2082ffd640 1 --2- 172.21.15.5:0/2182337649 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2084102d40 0x7f2084198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:19.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.659+0000 7f20827fc640 1 -- 172.21.15.5:0/2182337649 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2084102d40 msgr2=0x7f2084198280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:19.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.659+0000 7f20827fc640 1 --2- 172.21.15.5:0/2182337649 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2084102d40 0x7f2084198280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:19.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.659+0000 7f20827fc640 1 -- 172.21.15.5:0/2182337649 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f208410c170 msgr2=0x7f208419cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:19.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.659+0000 7f20827fc640 1 --2- 172.21.15.5:0/2182337649 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f208410c170 0x7f208419cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:19.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.659+0000 7f20827fc640 1 -- 172.21.15.5:0/2182337649 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f208419d230 con 0x7f2084103660 2024-09-11T23:28:19.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.659+0000 7f20827fc640 1 --2- 172.21.15.5:0/2182337649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2084103660 0x7f20841987c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f207800c970 tx=0x7f207800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:19.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.660+0000 7f208895c640 1 -- 172.21.15.5:0/2182337649 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2078007bb0 con 0x7f2084103660 2024-09-11T23:28:19.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.660+0000 7f208895c640 1 -- 172.21.15.5:0/2182337649 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2078007d50 con 0x7f2084103660 2024-09-11T23:28:19.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.660+0000 7f208895c640 1 -- 172.21.15.5:0/2182337649 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2078018780 con 0x7f2084103660 2024-09-11T23:28:19.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.660+0000 7f208995e640 1 -- 172.21.15.5:0/2182337649 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f208419d520 con 0x7f2084103660 2024-09-11T23:28:19.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.660+0000 7f208995e640 1 -- 172.21.15.5:0/2182337649 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20841a4e00 con 0x7f2084103660 2024-09-11T23:28:19.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.661+0000 7f208995e640 1 -- 172.21.15.5:0/2182337649 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2084103120 con 0x7f2084103660 2024-09-11T23:28:19.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.662+0000 7f208895c640 1 -- 172.21.15.5:0/2182337649 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f207800f450 con 0x7f2084103660 2024-09-11T23:28:19.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.663+0000 7f208895c640 1 --2- 172.21.15.5:0/2182337649 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f206c0a2c10 0x7f206c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:19.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.663+0000 7f2082ffd640 1 --2- 172.21.15.5:0/2182337649 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f206c0a2c10 0x7f206c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:19.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.663+0000 7f208895c640 1 -- 172.21.15.5:0/2182337649 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7f20780cf9c0 con 0x7f2084103660 2024-09-11T23:28:19.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.663+0000 7f2082ffd640 1 --2- 172.21.15.5:0/2182337649 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f206c0a2c10 0x7f206c0a50d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2074031440 tx=0x7f20740095f0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:19.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.666+0000 7f208895c640 1 -- 172.21.15.5:0/2182337649 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2078014030 con 0x7f2084103660 2024-09-11T23:28:19.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.879+0000 7f208995e640 1 -- 172.21.15.5:0/2182337649 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f20841995e0 con 0x7f2084103660 2024-09-11T23:28:19.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.880+0000 7f208895c640 1 -- 172.21.15.5:0/2182337649 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f20841995e0 con 0x7f2084103660 2024-09-11T23:28:19.881 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:28:19.881 INFO:teuthology.orchestra.run.smithi005.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-11T23:28:19.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.882+0000 7f208995e640 1 -- 172.21.15.5:0/2182337649 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f206c0a2c10 msgr2=0x7f206c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:19.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.882+0000 7f208995e640 1 --2- 172.21.15.5:0/2182337649 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f206c0a2c10 0x7f206c0a50d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2074031440 tx=0x7f20740095f0 comp rx=0 tx=0).stop 2024-09-11T23:28:19.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.882+0000 7f208995e640 1 -- 172.21.15.5:0/2182337649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2084103660 msgr2=0x7f20841987c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:19.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.882+0000 7f208995e640 1 --2- 172.21.15.5:0/2182337649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2084103660 0x7f20841987c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f207800c970 tx=0x7f207800ce30 comp rx=0 tx=0).stop 2024-09-11T23:28:19.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.882+0000 7f208995e640 1 -- 172.21.15.5:0/2182337649 shutdown_connections 2024-09-11T23:28:19.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.882+0000 7f208995e640 1 --2- 172.21.15.5:0/2182337649 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f206c0a2c10 0x7f206c0a50d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:19.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.882+0000 7f208995e640 1 --2- 172.21.15.5:0/2182337649 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f208410c170 0x7f208419cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:19.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.882+0000 7f208995e640 1 --2- 172.21.15.5:0/2182337649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2084103660 0x7f20841987c0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:19.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.882+0000 7f208995e640 1 --2- 172.21.15.5:0/2182337649 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2084102d40 0x7f2084198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:19.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.882+0000 7f208995e640 1 -- 172.21.15.5:0/2182337649 >> 172.21.15.5:0/2182337649 conn(0x7f20840fc7a0 msgr2=0x7f20840fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:19.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.882+0000 7f208995e640 1 -- 172.21.15.5:0/2182337649 shutdown_connections 2024-09-11T23:28:19.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:19.882+0000 7f208995e640 1 -- 172.21.15.5:0/2182337649 wait complete. 2024-09-11T23:28:20.565 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:20 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/2182337649' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-11T23:28:20.596 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-11T23:28:20.597 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:28:20.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:20 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/2182337649' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-11T23:28:20.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:20 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/2182337649' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-11T23:28:20.857 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:28:21.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.326+0000 7f4ffb064640 1 -- 172.21.15.5:0/144092106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ff4101420 msgr2=0x7f4ff410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:21.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.326+0000 7f4ffb064640 1 --2- 172.21.15.5:0/144092106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ff4101420 0x7f4ff410d950 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4fec009cd0 tx=0x7f4fec02a8e0 comp rx=0 tx=0).stop 2024-09-11T23:28:21.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.326+0000 7f4ffb064640 1 -- 172.21.15.5:0/144092106 shutdown_connections 2024-09-11T23:28:21.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.326+0000 7f4ffb064640 1 --2- 172.21.15.5:0/144092106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ff4101420 0x7f4ff410d950 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:21.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.326+0000 7f4ffb064640 1 --2- 172.21.15.5:0/144092106 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ff4100a80 0x7f4ff4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:21.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.326+0000 7f4ffb064640 1 --2- 172.21.15.5:0/144092106 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ff4106a80 0x7f4ff4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:21.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.326+0000 7f4ffb064640 1 -- 172.21.15.5:0/144092106 >> 172.21.15.5:0/144092106 conn(0x7f4ff40fc7a0 msgr2=0x7f4ff40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:21.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.326+0000 7f4ffb064640 1 -- 172.21.15.5:0/144092106 shutdown_connections 2024-09-11T23:28:21.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.326+0000 7f4ffb064640 1 -- 172.21.15.5:0/144092106 wait complete. 2024-09-11T23:28:21.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.327+0000 7f4ffb064640 1 Processor -- start 2024-09-11T23:28:21.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.327+0000 7f4ffb064640 1 -- start start 2024-09-11T23:28:21.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.327+0000 7f4ffb064640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ff4100a80 0x7f4ff4198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:21.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.327+0000 7f4ffb064640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ff4101420 0x7f4ff4198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:21.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.327+0000 7f4ffb064640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ff4106a80 0x7f4ff419cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:21.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.327+0000 7f4ffb064640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff4110d30 con 0x7f4ff4101420 2024-09-11T23:28:21.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.327+0000 7f4ffb064640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff4110bb0 con 0x7f4ff4106a80 2024-09-11T23:28:21.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.327+0000 7f4ffb064640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff4110eb0 con 0x7f4ff4100a80 2024-09-11T23:28:21.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.327+0000 7f4febfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ff4101420 0x7f4ff4198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:21.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.327+0000 7f4febfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ff4101420 0x7f4ff4198890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54220/0 (socket says 172.21.15.5:54220) 2024-09-11T23:28:21.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.327+0000 7f4febfff640 1 -- 172.21.15.5:0/3535314176 learned_addr learned my addr 172.21.15.5:0/3535314176 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:21.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.327+0000 7f4ff9601640 1 --2- 172.21.15.5:0/3535314176 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ff4106a80 0x7f4ff419cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:21.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.327+0000 7f4ff8e00640 1 --2- 172.21.15.5:0/3535314176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ff4100a80 0x7f4ff4198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:21.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.327+0000 7f4febfff640 1 -- 172.21.15.5:0/3535314176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ff4100a80 msgr2=0x7f4ff4198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:21.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.327+0000 7f4febfff640 1 --2- 172.21.15.5:0/3535314176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ff4100a80 0x7f4ff4198350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:21.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.328+0000 7f4febfff640 1 -- 172.21.15.5:0/3535314176 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ff4106a80 msgr2=0x7f4ff419cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:21.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.328+0000 7f4febfff640 1 --2- 172.21.15.5:0/3535314176 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ff4106a80 0x7f4ff419cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:21.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.328+0000 7f4febfff640 1 -- 172.21.15.5:0/3535314176 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff419d300 con 0x7f4ff4101420 2024-09-11T23:28:21.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.328+0000 7f4febfff640 1 --2- 172.21.15.5:0/3535314176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ff4101420 0x7f4ff4198890 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4fe400d950 tx=0x7f4fe400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:21.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.328+0000 7f4fe9ffb640 1 -- 172.21.15.5:0/3535314176 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe4017070 con 0x7f4ff4101420 2024-09-11T23:28:21.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.328+0000 7f4fe9ffb640 1 -- 172.21.15.5:0/3535314176 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4fe4009c30 con 0x7f4ff4101420 2024-09-11T23:28:21.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.328+0000 7f4ffb064640 1 -- 172.21.15.5:0/3535314176 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ff419d5f0 con 0x7f4ff4101420 2024-09-11T23:28:21.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.328+0000 7f4fe9ffb640 1 -- 172.21.15.5:0/3535314176 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe400f620 con 0x7f4ff4101420 2024-09-11T23:28:21.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.328+0000 7f4ffb064640 1 -- 172.21.15.5:0/3535314176 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ff41a4ed0 con 0x7f4ff4101420 2024-09-11T23:28:21.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.329+0000 7f4ffb064640 1 -- 172.21.15.5:0/3535314176 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ff4100ee0 con 0x7f4ff4101420 2024-09-11T23:28:21.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.330+0000 7f4fe9ffb640 1 -- 172.21.15.5:0/3535314176 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f4fe40109a0 con 0x7f4ff4101420 2024-09-11T23:28:21.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.331+0000 7f4fe9ffb640 1 --2- 172.21.15.5:0/3535314176 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f4fdc0a2c90 0x7f4fdc0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:21.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.331+0000 7f4fe9ffb640 1 -- 172.21.15.5:0/3535314176 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7f4fe40cf210 con 0x7f4ff4101420 2024-09-11T23:28:21.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.331+0000 7f4ff8e00640 1 --2- 172.21.15.5:0/3535314176 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f4fdc0a2c90 0x7f4fdc0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:21.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.331+0000 7f4ff8e00640 1 --2- 172.21.15.5:0/3535314176 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f4fdc0a2c90 0x7f4fdc0a5150 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0009a20 tx=0x7f4ff0005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:21.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.335+0000 7f4fe9ffb640 1 -- 172.21.15.5:0/3535314176 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4fe4009de0 con 0x7f4ff4101420 2024-09-11T23:28:21.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.547+0000 7f4ffb064640 1 -- 172.21.15.5:0/3535314176 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ff410a060 con 0x7f4ff4101420 2024-09-11T23:28:21.548 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:21 smithi005 ceph-mon[31201]: pgmap v333: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T23:28:21.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.548+0000 7f4fe9ffb640 1 -- 172.21.15.5:0/3535314176 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11918 (secure 0 0 0) 0x7f4fe409bc50 con 0x7f4ff4101420 2024-09-11T23:28:21.549 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:28:21.549 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":24,"btime":"2024-09-11T23:27:24:041243+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3865435482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3865435482},{"type":"v1","addr":"172.21.15.5:6835","nonce":3865435482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1323314897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":1323314897},{"type":"v1","addr":"172.21.15.5:6837","nonce":1323314897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14610,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6839/4140073288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":4140073288},{"type":"v1","addr":"172.21.15.5:6839","nonce":4140073288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6841/1162578713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":1162578713},{"type":"v1","addr":"172.21.15.5:6841","nonce":1162578713}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3113658116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3113658116},{"type":"v1","addr":"172.21.15.172:6833","nonce":3113658116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3887336060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3887336060},{"type":"v1","addr":"172.21.15.159:6833","nonce":3887336060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:26:45.305894+0000","modified":"2024-09-11T23:27:23.903504+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24475,"mds_2":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24440":{"gid":24440,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.159:6835/2539263301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2539263301},{"type":"v1","addr":"172.21.15.159:6835","nonce":2539263301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/4240913699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":4240913699},{"type":"v1","addr":"172.21.15.172:6835","nonce":4240913699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/4200951601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":4200951601},{"type":"v1","addr":"172.21.15.172:6837","nonce":4200951601}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":16,"addr":"172.21.15.159:6837/4020181017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":4020181017},{"type":"v1","addr":"172.21.15.159:6837","nonce":4020181017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.172:6839/3928313314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3928313314},{"type":"v1","addr":"172.21.15.172:6839","nonce":3928313314}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.159:6839/3843336290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3843336290},{"type":"v1","addr":"172.21.15.159:6839","nonce":3843336290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24461,24475,24494]},"id":1}]} 2024-09-11T23:28:21.550 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 24 2024-09-11T23:28:21.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.551+0000 7f4ffb064640 1 -- 172.21.15.5:0/3535314176 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f4fdc0a2c90 msgr2=0x7f4fdc0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:21.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.551+0000 7f4ffb064640 1 --2- 172.21.15.5:0/3535314176 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f4fdc0a2c90 0x7f4fdc0a5150 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0009a20 tx=0x7f4ff0005f90 comp rx=0 tx=0).stop 2024-09-11T23:28:21.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.551+0000 7f4ffb064640 1 -- 172.21.15.5:0/3535314176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ff4101420 msgr2=0x7f4ff4198890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:21.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.551+0000 7f4ffb064640 1 --2- 172.21.15.5:0/3535314176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ff4101420 0x7f4ff4198890 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4fe400d950 tx=0x7f4fe400de10 comp rx=0 tx=0).stop 2024-09-11T23:28:21.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.551+0000 7f4ffb064640 1 -- 172.21.15.5:0/3535314176 shutdown_connections 2024-09-11T23:28:21.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.551+0000 7f4ffb064640 1 --2- 172.21.15.5:0/3535314176 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f4fdc0a2c90 0x7f4fdc0a5150 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:21.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.551+0000 7f4ffb064640 1 --2- 172.21.15.5:0/3535314176 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ff4106a80 0x7f4ff419cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:21.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.551+0000 7f4ffb064640 1 --2- 172.21.15.5:0/3535314176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ff4101420 0x7f4ff4198890 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:21.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.551+0000 7f4ffb064640 1 --2- 172.21.15.5:0/3535314176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ff4100a80 0x7f4ff4198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:21.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.551+0000 7f4ffb064640 1 -- 172.21.15.5:0/3535314176 >> 172.21.15.5:0/3535314176 conn(0x7f4ff40fc7a0 msgr2=0x7f4ff406aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:21.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.551+0000 7f4ffb064640 1 -- 172.21.15.5:0/3535314176 shutdown_connections 2024-09-11T23:28:21.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:21.551+0000 7f4ffb064640 1 -- 172.21.15.5:0/3535314176 wait complete. 2024-09-11T23:28:21.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:21 smithi159 ceph-mon[34394]: pgmap v333: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T23:28:21.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:21 smithi172 ceph-mon[34855]: pgmap v333: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T23:28:22.318 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:28:22.580 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:28:22.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:22 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/3535314176' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:28:22.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:22 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/3535314176' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:28:22.701 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:22 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/3535314176' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:28:23.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.026+0000 7f3c9eff5640 1 -- 172.21.15.5:0/3383844849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c98106f10 msgr2=0x7f3c9810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:23.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.026+0000 7f3c9eff5640 1 --2- 172.21.15.5:0/3383844849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c98106f10 0x7f3c9810ea90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3c90009ca0 tx=0x7f3c9002a8c0 comp rx=0 tx=0).stop 2024-09-11T23:28:23.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.026+0000 7f3c9eff5640 1 -- 172.21.15.5:0/3383844849 shutdown_connections 2024-09-11T23:28:23.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.026+0000 7f3c9eff5640 1 --2- 172.21.15.5:0/3383844849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c98106f10 0x7f3c9810ea90 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:23.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.026+0000 7f3c9eff5640 1 --2- 172.21.15.5:0/3383844849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c98102790 0x7f3c981067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:23.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.026+0000 7f3c9eff5640 1 --2- 172.21.15.5:0/3383844849 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c98101de0 0x7f3c981021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:23.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.026+0000 7f3c9eff5640 1 -- 172.21.15.5:0/3383844849 >> 172.21.15.5:0/3383844849 conn(0x7f3c980fd8c0 msgr2=0x7f3c980ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:23.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.026+0000 7f3c9eff5640 1 -- 172.21.15.5:0/3383844849 shutdown_connections 2024-09-11T23:28:23.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.026+0000 7f3c9eff5640 1 -- 172.21.15.5:0/3383844849 wait complete. 2024-09-11T23:28:23.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.027+0000 7f3c9eff5640 1 Processor -- start 2024-09-11T23:28:23.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.027+0000 7f3c9eff5640 1 -- start start 2024-09-11T23:28:23.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.027+0000 7f3c9eff5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c98101de0 0x7f3c98198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:23.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.027+0000 7f3c9eff5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c98102790 0x7f3c98198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:23.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.027+0000 7f3c9eff5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c98106f10 0x7f3c9819ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:23.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.027+0000 7f3c9eff5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3c98111e40 con 0x7f3c98102790 2024-09-11T23:28:23.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.027+0000 7f3c9eff5640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3c98111cc0 con 0x7f3c98101de0 2024-09-11T23:28:23.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.027+0000 7f3c9eff5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3c98111fc0 con 0x7f3c98106f10 2024-09-11T23:28:23.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.027+0000 7f3c97fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c98102790 0x7f3c98198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:23.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.027+0000 7f3c97fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c98102790 0x7f3c98198940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54232/0 (socket says 172.21.15.5:54232) 2024-09-11T23:28:23.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.027+0000 7f3c97fff640 1 -- 172.21.15.5:0/2308523481 learned_addr learned my addr 172.21.15.5:0/2308523481 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:23.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.028+0000 7f3c9cd91640 1 --2- 172.21.15.5:0/2308523481 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c98101de0 0x7f3c98198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:23.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.028+0000 7f3c9d592640 1 --2- 172.21.15.5:0/2308523481 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c98106f10 0x7f3c9819ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:23.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.028+0000 7f3c97fff640 1 -- 172.21.15.5:0/2308523481 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c98106f10 msgr2=0x7f3c9819ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:23.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.028+0000 7f3c97fff640 1 --2- 172.21.15.5:0/2308523481 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c98106f10 0x7f3c9819ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:23.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.028+0000 7f3c97fff640 1 -- 172.21.15.5:0/2308523481 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c98101de0 msgr2=0x7f3c98198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:23.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.028+0000 7f3c97fff640 1 --2- 172.21.15.5:0/2308523481 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c98101de0 0x7f3c98198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:23.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.028+0000 7f3c97fff640 1 -- 172.21.15.5:0/2308523481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c9819d3b0 con 0x7f3c98102790 2024-09-11T23:28:23.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.028+0000 7f3c9d592640 1 --2- 172.21.15.5:0/2308523481 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c98106f10 0x7f3c9819ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:28:23.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.028+0000 7f3c97fff640 1 --2- 172.21.15.5:0/2308523481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c98102790 0x7f3c98198940 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3c8400b4a0 tx=0x7f3c8400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:23.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.028+0000 7f3c95ffb640 1 -- 172.21.15.5:0/2308523481 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c84014070 con 0x7f3c98102790 2024-09-11T23:28:23.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.028+0000 7f3c9eff5640 1 -- 172.21.15.5:0/2308523481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c9819d6a0 con 0x7f3c98102790 2024-09-11T23:28:23.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.028+0000 7f3c95ffb640 1 -- 172.21.15.5:0/2308523481 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3c84010ac0 con 0x7f3c98102790 2024-09-11T23:28:23.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.028+0000 7f3c95ffb640 1 -- 172.21.15.5:0/2308523481 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c84017c30 con 0x7f3c98102790 2024-09-11T23:28:23.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.028+0000 7f3c9eff5640 1 -- 172.21.15.5:0/2308523481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c981a4f80 con 0x7f3c98102790 2024-09-11T23:28:23.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.029+0000 7f3c9eff5640 1 -- 172.21.15.5:0/2308523481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c981021c0 con 0x7f3c98102790 2024-09-11T23:28:23.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.030+0000 7f3c95ffb640 1 -- 172.21.15.5:0/2308523481 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f3c84017070 con 0x7f3c98102790 2024-09-11T23:28:23.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.031+0000 7f3c95ffb640 1 --2- 172.21.15.5:0/2308523481 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f3c880a2c10 0x7f3c880a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:23.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.031+0000 7f3c9cd91640 1 --2- 172.21.15.5:0/2308523481 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f3c880a2c10 0x7f3c880a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:23.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.031+0000 7f3c95ffb640 1 -- 172.21.15.5:0/2308523481 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7f3c840ce8e0 con 0x7f3c98102790 2024-09-11T23:28:23.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.031+0000 7f3c9cd91640 1 --2- 172.21.15.5:0/2308523481 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f3c880a2c10 0x7f3c880a50d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c0058c0 tx=0x7f3c8c00a4c0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:23.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.035+0000 7f3c95ffb640 1 -- 172.21.15.5:0/2308523481 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3c8409b430 con 0x7f3c98102790 2024-09-11T23:28:23.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.249+0000 7f3c9eff5640 1 -- 172.21.15.5:0/2308523481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3c9810a150 con 0x7f3c98102790 2024-09-11T23:28:23.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.250+0000 7f3c95ffb640 1 -- 172.21.15.5:0/2308523481 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11918 (secure 0 0 0) 0x7f3c8409ad30 con 0x7f3c98102790 2024-09-11T23:28:23.251 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:28:23.251 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":24,"btime":"2024-09-11T23:27:24:041243+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3865435482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3865435482},{"type":"v1","addr":"172.21.15.5:6835","nonce":3865435482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1323314897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":1323314897},{"type":"v1","addr":"172.21.15.5:6837","nonce":1323314897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14610,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6839/4140073288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":4140073288},{"type":"v1","addr":"172.21.15.5:6839","nonce":4140073288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6841/1162578713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":1162578713},{"type":"v1","addr":"172.21.15.5:6841","nonce":1162578713}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3113658116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3113658116},{"type":"v1","addr":"172.21.15.172:6833","nonce":3113658116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3887336060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3887336060},{"type":"v1","addr":"172.21.15.159:6833","nonce":3887336060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:26:45.305894+0000","modified":"2024-09-11T23:27:23.903504+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24475,"mds_2":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24440":{"gid":24440,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.159:6835/2539263301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2539263301},{"type":"v1","addr":"172.21.15.159:6835","nonce":2539263301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/4240913699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":4240913699},{"type":"v1","addr":"172.21.15.172:6835","nonce":4240913699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/4200951601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":4200951601},{"type":"v1","addr":"172.21.15.172:6837","nonce":4200951601}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":16,"addr":"172.21.15.159:6837/4020181017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":4020181017},{"type":"v1","addr":"172.21.15.159:6837","nonce":4020181017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.172:6839/3928313314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3928313314},{"type":"v1","addr":"172.21.15.172:6839","nonce":3928313314}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.159:6839/3843336290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3843336290},{"type":"v1","addr":"172.21.15.159:6839","nonce":3843336290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24461,24475,24494]},"id":1}]} 2024-09-11T23:28:23.251 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 24 2024-09-11T23:28:23.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.253+0000 7f3c9eff5640 1 -- 172.21.15.5:0/2308523481 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f3c880a2c10 msgr2=0x7f3c880a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:23.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.253+0000 7f3c9eff5640 1 --2- 172.21.15.5:0/2308523481 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f3c880a2c10 0x7f3c880a50d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c0058c0 tx=0x7f3c8c00a4c0 comp rx=0 tx=0).stop 2024-09-11T23:28:23.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.253+0000 7f3c9eff5640 1 -- 172.21.15.5:0/2308523481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c98102790 msgr2=0x7f3c98198940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:23.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.253+0000 7f3c9eff5640 1 --2- 172.21.15.5:0/2308523481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c98102790 0x7f3c98198940 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3c8400b4a0 tx=0x7f3c8400b960 comp rx=0 tx=0).stop 2024-09-11T23:28:23.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.253+0000 7f3c9eff5640 1 -- 172.21.15.5:0/2308523481 shutdown_connections 2024-09-11T23:28:23.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.253+0000 7f3c9eff5640 1 --2- 172.21.15.5:0/2308523481 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f3c880a2c10 0x7f3c880a50d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:23.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.253+0000 7f3c9eff5640 1 --2- 172.21.15.5:0/2308523481 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c98106f10 0x7f3c9819ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:23.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.253+0000 7f3c9eff5640 1 --2- 172.21.15.5:0/2308523481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c98102790 0x7f3c98198940 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:23.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.253+0000 7f3c9eff5640 1 --2- 172.21.15.5:0/2308523481 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c98101de0 0x7f3c98198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:23.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.253+0000 7f3c9eff5640 1 -- 172.21.15.5:0/2308523481 >> 172.21.15.5:0/2308523481 conn(0x7f3c980fd8c0 msgr2=0x7f3c980fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:23.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.253+0000 7f3c9eff5640 1 -- 172.21.15.5:0/2308523481 shutdown_connections 2024-09-11T23:28:23.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:23.253+0000 7f3c9eff5640 1 -- 172.21.15.5:0/2308523481 wait complete. 2024-09-11T23:28:23.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:23 smithi005 ceph-mon[31201]: pgmap v334: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T23:28:23.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:23 smithi159 ceph-mon[34394]: pgmap v334: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T23:28:23.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:23 smithi172 ceph-mon[34855]: pgmap v334: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T23:28:23.932 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T23:28:24.192 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:28:24.595 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:24 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/2308523481' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:28:24.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:24 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/2308523481' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:28:24.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:24 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/2308523481' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:28:24.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.677+0000 7f283f628640 1 -- 172.21.15.5:0/1464348632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2838102d40 msgr2=0x7f2838103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:24.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.677+0000 7f283f628640 1 --2- 172.21.15.5:0/1464348632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2838102d40 0x7f2838103120 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2834009900 tx=0x7f283402a480 comp rx=0 tx=0).stop 2024-09-11T23:28:24.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.677+0000 7f283f628640 1 -- 172.21.15.5:0/1464348632 shutdown_connections 2024-09-11T23:28:24.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.677+0000 7f283f628640 1 --2- 172.21.15.5:0/1464348632 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f283810c170 0x7f283810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:24.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.677+0000 7f283f628640 1 --2- 172.21.15.5:0/1464348632 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2838103660 0x7f283810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:24.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.677+0000 7f283f628640 1 --2- 172.21.15.5:0/1464348632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2838102d40 0x7f2838103120 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:24.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.677+0000 7f283f628640 1 -- 172.21.15.5:0/1464348632 >> 172.21.15.5:0/1464348632 conn(0x7f28380fc7a0 msgr2=0x7f28380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:24.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.677+0000 7f283f628640 1 -- 172.21.15.5:0/1464348632 shutdown_connections 2024-09-11T23:28:24.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.677+0000 7f283f628640 1 -- 172.21.15.5:0/1464348632 wait complete. 2024-09-11T23:28:24.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.678+0000 7f283f628640 1 Processor -- start 2024-09-11T23:28:24.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.678+0000 7f283f628640 1 -- start start 2024-09-11T23:28:24.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.678+0000 7f283f628640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2838102d40 0x7f28381984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:24.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.678+0000 7f283f628640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2838103660 0x7f28381989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:24.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.678+0000 7f283f628640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f283810c170 0x7f283819cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:24.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.678+0000 7f283f628640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2838111e20 con 0x7f2838103660 2024-09-11T23:28:24.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.678+0000 7f283f628640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f2838111ca0 con 0x7f2838102d40 2024-09-11T23:28:24.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.678+0000 7f283f628640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2838111fa0 con 0x7f283810c170 2024-09-11T23:28:24.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.678+0000 7f283cbc3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2838103660 0x7f28381989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:24.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.678+0000 7f283cbc3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2838103660 0x7f28381989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37470/0 (socket says 172.21.15.5:37470) 2024-09-11T23:28:24.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.678+0000 7f283cbc3640 1 -- 172.21.15.5:0/3337482319 learned_addr learned my addr 172.21.15.5:0/3337482319 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:24.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.678+0000 7f283d3c4640 1 --2- 172.21.15.5:0/3337482319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2838102d40 0x7f28381984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:24.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.679+0000 7f283dbc5640 1 --2- 172.21.15.5:0/3337482319 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f283810c170 0x7f283819cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:24.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.679+0000 7f283cbc3640 1 -- 172.21.15.5:0/3337482319 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f283810c170 msgr2=0x7f283819cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:24.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.679+0000 7f283cbc3640 1 --2- 172.21.15.5:0/3337482319 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f283810c170 0x7f283819cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:24.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.679+0000 7f283cbc3640 1 -- 172.21.15.5:0/3337482319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2838102d40 msgr2=0x7f28381984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:24.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.679+0000 7f283cbc3640 1 --2- 172.21.15.5:0/3337482319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2838102d40 0x7f28381984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:24.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.679+0000 7f283cbc3640 1 -- 172.21.15.5:0/3337482319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f283819d450 con 0x7f2838103660 2024-09-11T23:28:24.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.679+0000 7f283cbc3640 1 --2- 172.21.15.5:0/3337482319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2838103660 0x7f28381989e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f282800c970 tx=0x7f282800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:24.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.679+0000 7f282e7fc640 1 -- 172.21.15.5:0/3337482319 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2828007bb0 con 0x7f2838103660 2024-09-11T23:28:24.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.679+0000 7f283f628640 1 -- 172.21.15.5:0/3337482319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f283819d740 con 0x7f2838103660 2024-09-11T23:28:24.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.679+0000 7f282e7fc640 1 -- 172.21.15.5:0/3337482319 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2828007d50 con 0x7f2838103660 2024-09-11T23:28:24.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.679+0000 7f282e7fc640 1 -- 172.21.15.5:0/3337482319 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2828004e10 con 0x7f2838103660 2024-09-11T23:28:24.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.679+0000 7f283f628640 1 -- 172.21.15.5:0/3337482319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28381a5020 con 0x7f2838103660 2024-09-11T23:28:24.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.680+0000 7f283f628640 1 -- 172.21.15.5:0/3337482319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2838103120 con 0x7f2838103660 2024-09-11T23:28:24.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.681+0000 7f282e7fc640 1 -- 172.21.15.5:0/3337482319 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f2828005000 con 0x7f2838103660 2024-09-11T23:28:24.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.682+0000 7f282e7fc640 1 --2- 172.21.15.5:0/3337482319 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f28240a2c10 0x7f28240a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:24.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.682+0000 7f283d3c4640 1 --2- 172.21.15.5:0/3337482319 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f28240a2c10 0x7f28240a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:24.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.682+0000 7f282e7fc640 1 -- 172.21.15.5:0/3337482319 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7f28280cf7b0 con 0x7f2838103660 2024-09-11T23:28:24.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.683+0000 7f283d3c4640 1 --2- 172.21.15.5:0/3337482319 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f28240a2c10 0x7f28240a50d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2834031440 tx=0x7f2834005b50 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:24.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.685+0000 7f282e7fc640 1 -- 172.21.15.5:0/3337482319 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2828014030 con 0x7f2838103660 2024-09-11T23:28:24.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.861+0000 7f283f628640 1 -- 172.21.15.5:0/3337482319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2838107210 con 0x7f2838103660 2024-09-11T23:28:24.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.863+0000 7f282e7fc640 1 -- 172.21.15.5:0/3337482319 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24843 (secure 0 0 0) 0x7f282809c190 con 0x7f2838103660 2024-09-11T23:28:24.863 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:28:24.864 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":88,"fsid":"1f5284d2-7094-11ef-bcea-c7b262605968","created":"2024-09-11T23:19:00.051813+0000","modified":"2024-09-11T23:27:52.098396+0000","last_up_change":"2024-09-11T23:25:53.433445+0000","last_in_change":"2024-09-11T23:25:29.443287+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:22:04.534014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:26:41.220887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:26:43.664094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T23:26:50.471521+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bf95ced0-780b-482f-87da-0b5e61de62ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6803","nonce":624761084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6805","nonce":624761084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6809","nonce":624761084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6807","nonce":624761084}]},"public_addr":"172.21.15.5:6803/624761084","cluster_addr":"172.21.15.5:6805/624761084","heartbeat_back_addr":"172.21.15.5:6809/624761084","heartbeat_front_addr":"172.21.15.5:6807/624761084","state":["exists","up"]},{"osd":1,"uuid":"d926484f-78a6-497b-843d-f2db54ade4a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6801","nonce":2111290186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6803","nonce":2111290186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6807","nonce":2111290186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6805","nonce":2111290186}]},"public_addr":"172.21.15.159:6801/2111290186","cluster_addr":"172.21.15.159:6803/2111290186","heartbeat_back_addr":"172.21.15.159:6807/2111290186","heartbeat_front_addr":"172.21.15.159:6805/2111290186","state":["exists","up"]},{"osd":2,"uuid":"d92cd431-0ba7-4171-82b8-60fa3d63a64b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6801","nonce":299915717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6803","nonce":299915717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6807","nonce":299915717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6805","nonce":299915717}]},"public_addr":"172.21.15.172:6801/299915717","cluster_addr":"172.21.15.172:6803/299915717","heartbeat_back_addr":"172.21.15.172:6807/299915717","heartbeat_front_addr":"172.21.15.172:6805/299915717","state":["exists","up"]},{"osd":3,"uuid":"0521043b-559c-4671-b11e-9117871cff49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6811","nonce":2080498921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6813","nonce":2080498921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6817","nonce":2080498921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6815","nonce":2080498921}]},"public_addr":"172.21.15.5:6811/2080498921","cluster_addr":"172.21.15.5:6813/2080498921","heartbeat_back_addr":"172.21.15.5:6817/2080498921","heartbeat_front_addr":"172.21.15.5:6815/2080498921","state":["exists","up"]},{"osd":4,"uuid":"b968d762-a46e-4ae2-b19d-8225f82de613","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6809","nonce":4185908786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6811","nonce":4185908786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6815","nonce":4185908786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6813","nonce":4185908786}]},"public_addr":"172.21.15.159:6809/4185908786","cluster_addr":"172.21.15.159:6811/4185908786","heartbeat_back_addr":"172.21.15.159:6815/4185908786","heartbeat_front_addr":"172.21.15.159:6813/4185908786","state":["exists","up"]},{"osd":5,"uuid":"1b0a518a-3d17-4635-81da-52f9ef83a574","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6809","nonce":3742759000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6811","nonce":3742759000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6815","nonce":3742759000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6813","nonce":3742759000}]},"public_addr":"172.21.15.172:6809/3742759000","cluster_addr":"172.21.15.172:6811/3742759000","heartbeat_back_addr":"172.21.15.172:6815/3742759000","heartbeat_front_addr":"172.21.15.172:6813/3742759000","state":["exists","up"]},{"osd":6,"uuid":"c3a2db6c-9189-4e42-aa1e-52189a9c4291","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6819","nonce":4156823423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6821","nonce":4156823423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6825","nonce":4156823423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6823","nonce":4156823423}]},"public_addr":"172.21.15.5:6819/4156823423","cluster_addr":"172.21.15.5:6821/4156823423","heartbeat_back_addr":"172.21.15.5:6825/4156823423","heartbeat_front_addr":"172.21.15.5:6823/4156823423","state":["exists","up"]},{"osd":7,"uuid":"dfaadf28-74ab-4cda-8647-dcb58beb7cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6817","nonce":4222571927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6819","nonce":4222571927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6823","nonce":4222571927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6821","nonce":4222571927}]},"public_addr":"172.21.15.159:6817/4222571927","cluster_addr":"172.21.15.159:6819/4222571927","heartbeat_back_addr":"172.21.15.159:6823/4222571927","heartbeat_front_addr":"172.21.15.159:6821/4222571927","state":["exists","up"]},{"osd":8,"uuid":"47f66651-614c-4613-9793-69c140dbf705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6817","nonce":3661505951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6819","nonce":3661505951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6823","nonce":3661505951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6821","nonce":3661505951}]},"public_addr":"172.21.15.172:6817/3661505951","cluster_addr":"172.21.15.172:6819/3661505951","heartbeat_back_addr":"172.21.15.172:6823/3661505951","heartbeat_front_addr":"172.21.15.172:6821/3661505951","state":["exists","up"]},{"osd":9,"uuid":"c97b8221-8cf9-4fab-9e27-ff7f3bd98152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6827","nonce":72036667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6829","nonce":72036667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6833","nonce":72036667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6831","nonce":72036667}]},"public_addr":"172.21.15.5:6827/72036667","cluster_addr":"172.21.15.5:6829/72036667","heartbeat_back_addr":"172.21.15.5:6833/72036667","heartbeat_front_addr":"172.21.15.5:6831/72036667","state":["exists","up"]},{"osd":10,"uuid":"143376c1-f3f1-4df4-bcd3-a9b46fad8c1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6825","nonce":3334483164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6827","nonce":3334483164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6831","nonce":3334483164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6829","nonce":3334483164}]},"public_addr":"172.21.15.159:6825/3334483164","cluster_addr":"172.21.15.159:6827/3334483164","heartbeat_back_addr":"172.21.15.159:6831/3334483164","heartbeat_front_addr":"172.21.15.159:6829/3334483164","state":["exists","up"]},{"osd":11,"uuid":"5cc91ff9-fc0f-4e7a-8e4d-87df0e7efbeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6825","nonce":1965415663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6827","nonce":1965415663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6831","nonce":1965415663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6829","nonce":1965415663}]},"public_addr":"172.21.15.172:6825/1965415663","cluster_addr":"172.21.15.172:6827/1965415663","heartbeat_back_addr":"172.21.15.172:6831/1965415663","heartbeat_front_addr":"172.21.15.172:6829/1965415663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:21:13.024707+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:21:38.063741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:22:02.221583+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:22:27.919711+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:22:53.870543+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:23:18.539905+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:23:43.694229+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:24:08.984704+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:24:34.378582+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:25:00.102231+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:25:25.367178+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:25:51.439033+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":10}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/2713701762":"2024-09-12T23:19:50.031855+0000","172.21.15.5:0/3135835713":"2024-09-12T23:19:50.031855+0000","172.21.15.5:0/3935034940":"2024-09-12T23:19:50.031855+0000","172.21.15.5:6801/1790126649":"2024-09-12T23:19:50.031855+0000","172.21.15.5:6801/1358356358":"2024-09-12T23:19:26.149011+0000","172.21.15.5:6800/1790126649":"2024-09-12T23:19:50.031855+0000","172.21.15.5:6800/1358356358":"2024-09-12T23:19:26.149011+0000","172.21.15.5:0/2243688290":"2024-09-12T23:19:26.149011+0000","172.21.15.5:0/1493331899":"2024-09-12T23:19:26.149011+0000","172.21.15.5:0/2329812802":"2024-09-12T23:19:26.149011+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:28:24.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.865+0000 7f283f628640 1 -- 172.21.15.5:0/3337482319 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f28240a2c10 msgr2=0x7f28240a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:24.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.865+0000 7f283f628640 1 --2- 172.21.15.5:0/3337482319 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f28240a2c10 0x7f28240a50d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2834031440 tx=0x7f2834005b50 comp rx=0 tx=0).stop 2024-09-11T23:28:24.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.865+0000 7f283f628640 1 -- 172.21.15.5:0/3337482319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2838103660 msgr2=0x7f28381989e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:24.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.865+0000 7f283f628640 1 --2- 172.21.15.5:0/3337482319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2838103660 0x7f28381989e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f282800c970 tx=0x7f282800ce30 comp rx=0 tx=0).stop 2024-09-11T23:28:24.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.865+0000 7f283f628640 1 -- 172.21.15.5:0/3337482319 shutdown_connections 2024-09-11T23:28:24.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.865+0000 7f283f628640 1 --2- 172.21.15.5:0/3337482319 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f28240a2c10 0x7f28240a50d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:24.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.865+0000 7f283f628640 1 --2- 172.21.15.5:0/3337482319 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f283810c170 0x7f283819cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:24.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.865+0000 7f283f628640 1 --2- 172.21.15.5:0/3337482319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2838103660 0x7f28381989e0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:24.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.865+0000 7f283f628640 1 --2- 172.21.15.5:0/3337482319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2838102d40 0x7f28381984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:24.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.865+0000 7f283f628640 1 -- 172.21.15.5:0/3337482319 >> 172.21.15.5:0/3337482319 conn(0x7f28380fc7a0 msgr2=0x7f28380fd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:24.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.865+0000 7f283f628640 1 -- 172.21.15.5:0/3337482319 shutdown_connections 2024-09-11T23:28:24.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:24.865+0000 7f283f628640 1 -- 172.21.15.5:0/3337482319 wait complete. 2024-09-11T23:28:25.508 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:25 smithi005 ceph-mon[31201]: pgmap v335: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T23:28:25.508 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:25 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/3337482319' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:28:25.541 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:28:25.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:25 smithi159 ceph-mon[34394]: pgmap v335: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T23:28:25.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:25 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/3337482319' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:28:25.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:25 smithi172 ceph-mon[34855]: pgmap v335: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T23:28:25.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:25 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/3337482319' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:28:25.812 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:28:26.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.330+0000 7f375737e640 1 -- 172.21.15.5:0/277131631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37501027a0 msgr2=0x7f37501067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:26.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.330+0000 7f375737e640 1 --2- 172.21.15.5:0/277131631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37501027a0 0x7f37501067f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3740009900 tx=0x7f374002a410 comp rx=0 tx=0).stop 2024-09-11T23:28:26.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.330+0000 7f375737e640 1 -- 172.21.15.5:0/277131631 shutdown_connections 2024-09-11T23:28:26.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.330+0000 7f375737e640 1 --2- 172.21.15.5:0/277131631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3750106f20 0x7f375010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:26.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.330+0000 7f375737e640 1 --2- 172.21.15.5:0/277131631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37501027a0 0x7f37501067f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:26.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.330+0000 7f375737e640 1 --2- 172.21.15.5:0/277131631 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3750101df0 0x7f37501021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:26.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.330+0000 7f375737e640 1 -- 172.21.15.5:0/277131631 >> 172.21.15.5:0/277131631 conn(0x7f37500fd8f0 msgr2=0x7f37500ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:26.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.330+0000 7f375737e640 1 -- 172.21.15.5:0/277131631 shutdown_connections 2024-09-11T23:28:26.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.330+0000 7f375737e640 1 -- 172.21.15.5:0/277131631 wait complete. 2024-09-11T23:28:26.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.331+0000 7f375737e640 1 Processor -- start 2024-09-11T23:28:26.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.331+0000 7f375737e640 1 -- start start 2024-09-11T23:28:26.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.331+0000 7f375737e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3750101df0 0x7f37501983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:26.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.331+0000 7f375737e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37501027a0 0x7f3750198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:26.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.331+0000 7f375737e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3750106f20 0x7f375019ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:26.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.331+0000 7f375737e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3750111e50 con 0x7f37501027a0 2024-09-11T23:28:26.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.331+0000 7f375737e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3750111cd0 con 0x7f3750106f20 2024-09-11T23:28:26.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.331+0000 7f375737e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3750111fd0 con 0x7f3750101df0 2024-09-11T23:28:26.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.331+0000 7f3754919640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37501027a0 0x7f3750198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:26.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.331+0000 7f3754919640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37501027a0 0x7f3750198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37484/0 (socket says 172.21.15.5:37484) 2024-09-11T23:28:26.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.331+0000 7f3754919640 1 -- 172.21.15.5:0/3910523520 learned_addr learned my addr 172.21.15.5:0/3910523520 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:26.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.332+0000 7f375511a640 1 --2- 172.21.15.5:0/3910523520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3750101df0 0x7f37501983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:26.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.332+0000 7f3754919640 1 -- 172.21.15.5:0/3910523520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3750101df0 msgr2=0x7f37501983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:26.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.332+0000 7f3754919640 1 --2- 172.21.15.5:0/3910523520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3750101df0 0x7f37501983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:26.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.332+0000 7f3754919640 1 -- 172.21.15.5:0/3910523520 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3750106f20 msgr2=0x7f375019ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:26.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.332+0000 7f375591b640 1 --2- 172.21.15.5:0/3910523520 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3750106f20 0x7f375019ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:26.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.332+0000 7f3754919640 1 --2- 172.21.15.5:0/3910523520 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3750106f20 0x7f375019ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:26.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.332+0000 7f3754919640 1 -- 172.21.15.5:0/3910523520 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f375019d3a0 con 0x7f37501027a0 2024-09-11T23:28:26.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.332+0000 7f3754919640 1 --2- 172.21.15.5:0/3910523520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37501027a0 0x7f3750198930 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3740006010 tx=0x7f3740004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:26.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.332+0000 7f37467fc640 1 -- 172.21.15.5:0/3910523520 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f374003f030 con 0x7f37501027a0 2024-09-11T23:28:26.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.332+0000 7f375737e640 1 -- 172.21.15.5:0/3910523520 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f375019d630 con 0x7f37501027a0 2024-09-11T23:28:26.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.332+0000 7f37467fc640 1 -- 172.21.15.5:0/3910523520 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f37400035f0 con 0x7f37501027a0 2024-09-11T23:28:26.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.332+0000 7f37467fc640 1 -- 172.21.15.5:0/3910523520 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3740035070 con 0x7f37501027a0 2024-09-11T23:28:26.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.332+0000 7f375737e640 1 -- 172.21.15.5:0/3910523520 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37501a4f70 con 0x7f37501027a0 2024-09-11T23:28:26.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.333+0000 7f375737e640 1 -- 172.21.15.5:0/3910523520 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37501021d0 con 0x7f37501027a0 2024-09-11T23:28:26.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.334+0000 7f37467fc640 1 -- 172.21.15.5:0/3910523520 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f3740003b10 con 0x7f37501027a0 2024-09-11T23:28:26.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.335+0000 7f37467fc640 1 --2- 172.21.15.5:0/3910523520 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f373c0a2c10 0x7f373c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:26.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.335+0000 7f375511a640 1 --2- 172.21.15.5:0/3910523520 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f373c0a2c10 0x7f373c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:26.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.335+0000 7f37467fc640 1 -- 172.21.15.5:0/3910523520 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7f37400f0220 con 0x7f37501027a0 2024-09-11T23:28:26.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.336+0000 7f375511a640 1 --2- 172.21.15.5:0/3910523520 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f373c0a2c10 0x7f373c0a50d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f374c0058c0 tx=0x7f374c005c60 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:26.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.341+0000 7f37467fc640 1 -- 172.21.15.5:0/3910523520 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f37400bcc00 con 0x7f37501027a0 2024-09-11T23:28:26.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.554+0000 7f375737e640 1 -- 172.21.15.5:0/3910523520 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f375010a100 con 0x7f37501027a0 2024-09-11T23:28:26.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.555+0000 7f37467fc640 1 -- 172.21.15.5:0/3910523520 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11918 (secure 0 0 0) 0x7f37400bc500 con 0x7f37501027a0 2024-09-11T23:28:26.556 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:28:26.556 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":24,"btime":"2024-09-11T23:27:24:041243+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3865435482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3865435482},{"type":"v1","addr":"172.21.15.5:6835","nonce":3865435482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1323314897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":1323314897},{"type":"v1","addr":"172.21.15.5:6837","nonce":1323314897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14610,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6839/4140073288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":4140073288},{"type":"v1","addr":"172.21.15.5:6839","nonce":4140073288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6841/1162578713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":1162578713},{"type":"v1","addr":"172.21.15.5:6841","nonce":1162578713}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3113658116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3113658116},{"type":"v1","addr":"172.21.15.172:6833","nonce":3113658116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3887336060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3887336060},{"type":"v1","addr":"172.21.15.159:6833","nonce":3887336060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:26:45.305894+0000","modified":"2024-09-11T23:27:23.903504+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24475,"mds_2":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24440":{"gid":24440,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.159:6835/2539263301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2539263301},{"type":"v1","addr":"172.21.15.159:6835","nonce":2539263301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/4240913699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":4240913699},{"type":"v1","addr":"172.21.15.172:6835","nonce":4240913699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/4200951601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":4200951601},{"type":"v1","addr":"172.21.15.172:6837","nonce":4200951601}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":16,"addr":"172.21.15.159:6837/4020181017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":4020181017},{"type":"v1","addr":"172.21.15.159:6837","nonce":4020181017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.172:6839/3928313314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3928313314},{"type":"v1","addr":"172.21.15.172:6839","nonce":3928313314}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.159:6839/3843336290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3843336290},{"type":"v1","addr":"172.21.15.159:6839","nonce":3843336290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24461,24475,24494]},"id":1}]} 2024-09-11T23:28:26.557 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 24 2024-09-11T23:28:26.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.557+0000 7f375737e640 1 -- 172.21.15.5:0/3910523520 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f373c0a2c10 msgr2=0x7f373c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:26.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.557+0000 7f375737e640 1 --2- 172.21.15.5:0/3910523520 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f373c0a2c10 0x7f373c0a50d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f374c0058c0 tx=0x7f374c005c60 comp rx=0 tx=0).stop 2024-09-11T23:28:26.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.557+0000 7f375737e640 1 -- 172.21.15.5:0/3910523520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37501027a0 msgr2=0x7f3750198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:26.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.557+0000 7f375737e640 1 --2- 172.21.15.5:0/3910523520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37501027a0 0x7f3750198930 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3740006010 tx=0x7f3740004270 comp rx=0 tx=0).stop 2024-09-11T23:28:26.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.557+0000 7f375737e640 1 -- 172.21.15.5:0/3910523520 shutdown_connections 2024-09-11T23:28:26.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.557+0000 7f375737e640 1 --2- 172.21.15.5:0/3910523520 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f373c0a2c10 0x7f373c0a50d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:26.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.557+0000 7f375737e640 1 --2- 172.21.15.5:0/3910523520 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3750106f20 0x7f375019ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:26.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.557+0000 7f375737e640 1 --2- 172.21.15.5:0/3910523520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37501027a0 0x7f3750198930 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:26.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.558+0000 7f375737e640 1 --2- 172.21.15.5:0/3910523520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3750101df0 0x7f37501983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:26.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.558+0000 7f375737e640 1 -- 172.21.15.5:0/3910523520 >> 172.21.15.5:0/3910523520 conn(0x7f37500fd8f0 msgr2=0x7f37500fed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:26.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.558+0000 7f375737e640 1 -- 172.21.15.5:0/3910523520 shutdown_connections 2024-09-11T23:28:26.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:26.558+0000 7f375737e640 1 -- 172.21.15.5:0/3910523520 wait complete. 2024-09-11T23:28:27.339 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-11T23:26:45.305894+0000', 'modified': '2024-09-11T23:27:23.903504+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24494, 'mds_1': 24475, 'mds_2': 24461}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24440': {'gid': 24440, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.159:6835/2539263301', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.159:6834', 'nonce': 2539263301}, {'type': 'v1', 'addr': '172.21.15.159:6835', 'nonce': 2539263301}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24454': {'gid': 24454, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.172:6835/4240913699', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6834', 'nonce': 4240913699}, {'type': 'v1', 'addr': '172.21.15.172:6835', 'nonce': 4240913699}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24460': {'gid': 24460, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.172:6837/4200951601', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6836', 'nonce': 4200951601}, {'type': 'v1', 'addr': '172.21.15.172:6837', 'nonce': 4200951601}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24461': {'gid': 24461, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.159:6837/4020181017', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.159:6836', 'nonce': 4020181017}, {'type': 'v1', 'addr': '172.21.15.159:6837', 'nonce': 4020181017}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24475': {'gid': 24475, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 15, 'addr': '172.21.15.172:6839/3928313314', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6838', 'nonce': 3928313314}, {'type': 'v1', 'addr': '172.21.15.172:6839', 'nonce': 3928313314}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24494': {'gid': 24494, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.159:6839/3843336290', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.159:6838', 'nonce': 3843336290}, {'type': 'v1', 'addr': '172.21.15.159:6839', 'nonce': 3843336290}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24494, 'qdb_cluster': [24461, 24475, 24494]} 2024-09-11T23:28:27.339 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-11T23:28:27.339 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-11T23:28:27.602 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:28:27.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:27 smithi159 ceph-mon[34394]: pgmap v336: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T23:28:27.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:27 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/3910523520' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:28:27.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:27 smithi172 ceph-mon[34855]: pgmap v336: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T23:28:27.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:27 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/3910523520' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:28:27.723 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:27 smithi005 ceph-mon[31201]: pgmap v336: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T23:28:27.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:27 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/3910523520' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:28:28.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.107+0000 7efdb7c3c640 1 -- 172.21.15.5:0/2394873173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efdb0101de0 msgr2=0x7efdb01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:28.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.107+0000 7efdb7c3c640 1 --2- 172.21.15.5:0/2394873173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efdb0101de0 0x7efdb01021c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7efdac009900 tx=0x7efdac02a410 comp rx=0 tx=0).stop 2024-09-11T23:28:28.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.107+0000 7efdb7c3c640 1 -- 172.21.15.5:0/2394873173 shutdown_connections 2024-09-11T23:28:28.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.107+0000 7efdb7c3c640 1 --2- 172.21.15.5:0/2394873173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdb0106f10 0x7efdb010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:28.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.107+0000 7efdb7c3c640 1 --2- 172.21.15.5:0/2394873173 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdb0102790 0x7efdb01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:28.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.107+0000 7efdb7c3c640 1 --2- 172.21.15.5:0/2394873173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efdb0101de0 0x7efdb01021c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:28.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.107+0000 7efdb7c3c640 1 -- 172.21.15.5:0/2394873173 >> 172.21.15.5:0/2394873173 conn(0x7efdb00fd8c0 msgr2=0x7efdb00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:28.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.107+0000 7efdb7c3c640 1 -- 172.21.15.5:0/2394873173 shutdown_connections 2024-09-11T23:28:28.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.107+0000 7efdb7c3c640 1 -- 172.21.15.5:0/2394873173 wait complete. 2024-09-11T23:28:28.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.108+0000 7efdb7c3c640 1 Processor -- start 2024-09-11T23:28:28.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.108+0000 7efdb7c3c640 1 -- start start 2024-09-11T23:28:28.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.108+0000 7efdb7c3c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdb0101de0 0x7efdb0198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:28.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.108+0000 7efdb7c3c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efdb0102790 0x7efdb0198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:28.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.108+0000 7efdb7c3c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdb0106f10 0x7efdb019cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:28.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.108+0000 7efdb7c3c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7efdb0111e20 con 0x7efdb0102790 2024-09-11T23:28:28.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.108+0000 7efdb7c3c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7efdb0111ca0 con 0x7efdb0101de0 2024-09-11T23:28:28.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.108+0000 7efdb7c3c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efdb0111fa0 con 0x7efdb0106f10 2024-09-11T23:28:28.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.108+0000 7efdb51d7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efdb0102790 0x7efdb0198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:28.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.108+0000 7efdb51d7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efdb0102790 0x7efdb0198850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37492/0 (socket says 172.21.15.5:37492) 2024-09-11T23:28:28.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.108+0000 7efdb51d7640 1 -- 172.21.15.5:0/2029057073 learned_addr learned my addr 172.21.15.5:0/2029057073 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:28.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.108+0000 7efdb59d8640 1 --2- 172.21.15.5:0/2029057073 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdb0101de0 0x7efdb0198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:28.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.108+0000 7efdb61d9640 1 --2- 172.21.15.5:0/2029057073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdb0106f10 0x7efdb019cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:28.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.109+0000 7efdb51d7640 1 -- 172.21.15.5:0/2029057073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdb0106f10 msgr2=0x7efdb019cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:28.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.109+0000 7efdb51d7640 1 --2- 172.21.15.5:0/2029057073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdb0106f10 0x7efdb019cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:28.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.109+0000 7efdb51d7640 1 -- 172.21.15.5:0/2029057073 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdb0101de0 msgr2=0x7efdb0198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:28.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.109+0000 7efdb51d7640 1 --2- 172.21.15.5:0/2029057073 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdb0101de0 0x7efdb0198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:28.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.109+0000 7efdb51d7640 1 -- 172.21.15.5:0/2029057073 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdb019d2c0 con 0x7efdb0102790 2024-09-11T23:28:28.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.109+0000 7efdb51d7640 1 --2- 172.21.15.5:0/2029057073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efdb0102790 0x7efdb0198850 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7efda000d950 tx=0x7efda000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:28.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.109+0000 7efda6ffd640 1 -- 172.21.15.5:0/2029057073 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda0017070 con 0x7efdb0102790 2024-09-11T23:28:28.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.109+0000 7efdb7c3c640 1 -- 172.21.15.5:0/2029057073 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdb019d5b0 con 0x7efdb0102790 2024-09-11T23:28:28.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.109+0000 7efda6ffd640 1 -- 172.21.15.5:0/2029057073 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efda0009c30 con 0x7efdb0102790 2024-09-11T23:28:28.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.109+0000 7efda6ffd640 1 -- 172.21.15.5:0/2029057073 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda000f620 con 0x7efdb0102790 2024-09-11T23:28:28.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.109+0000 7efdb7c3c640 1 -- 172.21.15.5:0/2029057073 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdb01a4e90 con 0x7efdb0102790 2024-09-11T23:28:28.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.111+0000 7efda6ffd640 1 -- 172.21.15.5:0/2029057073 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7efda00109a0 con 0x7efdb0102790 2024-09-11T23:28:28.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.112+0000 7efdba015740 1 Processor -- start 2024-09-11T23:28:28.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.112+0000 7efdba015740 1 -- start start 2024-09-11T23:28:28.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.112+0000 7efdba015740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b424be89d0 0x55b424be8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:28.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.112+0000 7efdba015740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b424be92f0 0x55b424bf3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:28.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.112+0000 7efdba015740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b424bf3bb0 0x55b424bf5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:28.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.112+0000 7efdba015740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55b424b4f090 con 0x55b424be92f0 2024-09-11T23:28:28.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.112+0000 7efdba015740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55b424af6a70 con 0x55b424be89d0 2024-09-11T23:28:28.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.112+0000 7efdba015740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b424b4b050 con 0x55b424bf3bb0 2024-09-11T23:28:28.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.112+0000 7efdb59d8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b424be92f0 0x55b424bf3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:28.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.112+0000 7efdb59d8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b424be92f0 0x55b424bf3670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37496/0 (socket says 172.21.15.5:37496) 2024-09-11T23:28:28.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.112+0000 7efdb59d8640 1 -- 172.21.15.5:0/1955038777 learned_addr learned my addr 172.21.15.5:0/1955038777 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:28.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.112+0000 7efdb61d9640 1 --2- 172.21.15.5:0/1955038777 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b424be89d0 0x55b424be8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:28.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.113+0000 7efdb51d7640 1 --2- 172.21.15.5:0/1955038777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b424bf3bb0 0x55b424bf5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:28.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.113+0000 7efda6ffd640 1 --2- 172.21.15.5:0/2029057073 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7efd9c0a2c10 0x7efd9c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:28.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.113+0000 7efdb61d9640 1 --2- 172.21.15.5:0/2029057073 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7efd9c0a2c10 0x7efd9c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:28.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.113+0000 7efdb59d8640 1 -- 172.21.15.5:0/1955038777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b424bf3bb0 msgr2=0x55b424bf5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:28:28.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.113+0000 7efdb59d8640 1 --2- 172.21.15.5:0/1955038777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b424bf3bb0 0x55b424bf5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:28.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.113+0000 7efdb59d8640 1 -- 172.21.15.5:0/1955038777 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b424be89d0 msgr2=0x55b424be8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:28:28.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.113+0000 7efdb59d8640 1 --2- 172.21.15.5:0/1955038777 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b424be89d0 0x55b424be8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:28.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.113+0000 7efdb59d8640 1 -- 172.21.15.5:0/1955038777 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b424b03130 con 0x55b424be92f0 2024-09-11T23:28:28.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.113+0000 7efda6ffd640 1 -- 172.21.15.5:0/2029057073 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7efda00cf240 con 0x7efdb0102790 2024-09-11T23:28:28.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.113+0000 7efdb59d8640 1 --2- 172.21.15.5:0/1955038777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b424be92f0 0x55b424bf3670 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7efdac009900 tx=0x7efdac032bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2832070db8129eee server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:28.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.113+0000 7efdb61d9640 1 --2- 172.21.15.5:0/2029057073 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7efd9c0a2c10 0x7efd9c0a50d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7efda8005fd0 tx=0x7efda8004ab0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:28.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.113+0000 7efd9bfff640 1 -- 172.21.15.5:0/1955038777 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdac040070 con 0x55b424be92f0 2024-09-11T23:28:28.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.113+0000 7efd9bfff640 1 -- 172.21.15.5:0/1955038777 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efdac004030 con 0x55b424be92f0 2024-09-11T23:28:28.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.113+0000 7efd9bfff640 1 -- 172.21.15.5:0/1955038777 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdac035040 con 0x55b424be92f0 2024-09-11T23:28:28.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.114+0000 7efdba015740 1 -- 172.21.15.5:0/1955038777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b424be92f0 msgr2=0x55b424bf3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:28.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.114+0000 7efdba015740 1 --2- 172.21.15.5:0/1955038777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b424be92f0 0x55b424bf3670 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7efdac009900 tx=0x7efdac032bb0 comp rx=0 tx=0).stop 2024-09-11T23:28:28.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.114+0000 7efdba015740 1 -- 172.21.15.5:0/1955038777 shutdown_connections 2024-09-11T23:28:28.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.114+0000 7efdba015740 1 --2- 172.21.15.5:0/1955038777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b424bf3bb0 0x55b424bf5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:28.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.114+0000 7efdba015740 1 --2- 172.21.15.5:0/1955038777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b424be92f0 0x55b424bf3670 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:28.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.114+0000 7efdba015740 1 --2- 172.21.15.5:0/1955038777 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b424be89d0 0x55b424be8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:28.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.114+0000 7efdba015740 1 -- 172.21.15.5:0/1955038777 >> 172.21.15.5:0/1955038777 conn(0x55b424be4f60 msgr2=0x55b424be5340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:28.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.114+0000 7efdba015740 1 -- 172.21.15.5:0/1955038777 shutdown_connections 2024-09-11T23:28:28.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.114+0000 7efdba015740 1 -- 172.21.15.5:0/1955038777 wait complete. 2024-09-11T23:28:28.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.115+0000 7efdba015740 1 -- start start 2024-09-11T23:28:28.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.115+0000 7efdba015740 1 Processor -- start 2024-09-11T23:28:28.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.115+0000 7efdba015740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b424be89d0 0x55b424bf3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:28.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.115+0000 7efdba015740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b424be92f0 0x55b424bf07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:28.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.115+0000 7efdba015740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b424bf3bb0 0x55b424bf0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:28.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.115+0000 7efdba015740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55b424bf6780 con 0x55b424be89d0 2024-09-11T23:28:28.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.115+0000 7efdba015740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55b424b09f20 con 0x55b424be92f0 2024-09-11T23:28:28.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.115+0000 7efdba015740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b424bf6900 con 0x55b424bf3bb0 2024-09-11T23:28:28.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.115+0000 7efdb59d8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b424be89d0 0x55b424bf3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:28.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.115+0000 7efdb59d8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b424be89d0 0x55b424bf3450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37502/0 (socket says 172.21.15.5:37502) 2024-09-11T23:28:28.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.115+0000 7efdb59d8640 1 -- 172.21.15.5:0/3859489048 learned_addr learned my addr 172.21.15.5:0/3859489048 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:28.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.115+0000 7efdba015740 10 client.0 _ll_register_callbacks cb 0x55b424ad3030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:28:28.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.116+0000 7efdb61d9640 1 --2- 172.21.15.5:0/3859489048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b424bf3bb0 0x55b424bf0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:28.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.116+0000 7efdb51d7640 1 --2- 172.21.15.5:0/3859489048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b424be92f0 0x55b424bf07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:28.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.116+0000 7efdb59d8640 1 -- 172.21.15.5:0/3859489048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b424bf3bb0 msgr2=0x55b424bf0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:28:28.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.116+0000 7efdb59d8640 1 --2- 172.21.15.5:0/3859489048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b424bf3bb0 0x55b424bf0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:28.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.116+0000 7efdb59d8640 1 -- 172.21.15.5:0/3859489048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b424be92f0 msgr2=0x55b424bf07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:28:28.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.116+0000 7efdb59d8640 1 --2- 172.21.15.5:0/3859489048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b424be92f0 0x55b424bf07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:28.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.116+0000 7efdb59d8640 1 -- 172.21.15.5:0/3859489048 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4248c02b0 con 0x55b424be89d0 2024-09-11T23:28:28.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.116+0000 7efdb59d8640 1 --2- 172.21.15.5:0/3859489048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b424be89d0 0x55b424bf3450 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7efdac006010 tx=0x7efdac02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae248c3f8a57c8ac server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:28.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.116+0000 7efd997fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-11T23:28:28.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.116+0000 7efd997fa640 1 -- 172.21.15.5:0/3859489048 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdac040070 con 0x55b424be89d0 2024-09-11T23:28:28.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.116+0000 7efd997fa640 1 -- 172.21.15.5:0/3859489048 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7efdac0041e0 con 0x55b424be89d0 2024-09-11T23:28:28.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.116+0000 7efdba015740 1 -- 172.21.15.5:0/3859489048 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efdac004030 con 0x55b424be89d0 2024-09-11T23:28:28.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.116+0000 7efd997fa640 1 -- 172.21.15.5:0/3859489048 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7efdac056050 con 0x55b424be89d0 2024-09-11T23:28:28.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.116+0000 7efdba015740 10 client.15075 fetch_fsmap learned FSMap version 24 2024-09-11T23:28:28.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.116+0000 7efdba015740 1 -- 172.21.15.5:0/3859489048 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b424c02080 con 0x55b424be89d0 2024-09-11T23:28:28.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.117+0000 7efd997fa640 1 -- 172.21.15.5:0/3859489048 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efdac004030 con 0x55b424be89d0 2024-09-11T23:28:28.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.117+0000 7efd997fa640 1 -- 172.21.15.5:0/3859489048 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7efdac003b90 con 0x55b424be89d0 2024-09-11T23:28:28.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.117+0000 7efdba015740 10 client.15075 fetch_fsmap finished waiting for FSMap version 24 2024-09-11T23:28:28.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.117+0000 7efdba015740 10 client.15075 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-11T23:28:28.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.117+0000 7efdba015740 20 client.15075 populate_metadata read hostname 'smithi005' 2024-09-11T23:28:28.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.117+0000 7efdba015740 1 --2- 172.21.15.5:0/3859489048 >> [v2:172.21.15.159:6836/4020181017,v1:172.21.15.159:6837/4020181017] conn(0x55b424c041d0 0x55b424c05640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:28.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.117+0000 7efdba015740 4 client.15075 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:28:28.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.117+0000 7efdba015740 1 -- 172.21.15.5:0/3859489048 --> [v2:172.21.15.159:6836/4020181017,v1:172.21.15.159:6837/4020181017] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b424b5c600 con 0x55b424c041d0 2024-09-11T23:28:28.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.117+0000 7efdb51d7640 1 --2- 172.21.15.5:0/3859489048 >> [v2:172.21.15.159:6836/4020181017,v1:172.21.15.159:6837/4020181017] conn(0x55b424c041d0 0x55b424c05640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:28.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.117+0000 7efdb51d7640 1 --2- 172.21.15.5:0/3859489048 >> [v2:172.21.15.159:6836/4020181017,v1:172.21.15.159:6837/4020181017] conn(0x55b424c041d0 0x55b424c05640 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f042aa1e10564f41 server_cookie=6fb5f4d066e1309a in_seq=0 out_seq=0 2024-09-11T23:28:28.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.117+0000 7efd997fa640 10 client.15075 ms_handle_connect on v2:172.21.15.159:6836/4020181017 2024-09-11T23:28:28.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.118+0000 7efd997fa640 1 -- 172.21.15.5:0/3859489048 <== mds.2 v2:172.21.15.159:6836/4020181017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b424b5c600 con 0x55b424c041d0 2024-09-11T23:28:28.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.118+0000 7efd997fa640 10 client.15075 handle_command_reply: tid=0 2024-09-11T23:28:28.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.118+0000 7efdba015740 1 client.15075 shutdown 2024-09-11T23:28:28.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.118+0000 7efdba015740 1 -- 172.21.15.5:0/3859489048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b424be89d0 msgr2=0x55b424bf3450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:28.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.118+0000 7efdba015740 1 --2- 172.21.15.5:0/3859489048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b424be89d0 0x55b424bf3450 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7efdac006010 tx=0x7efdac02a410 comp rx=0 tx=0).stop 2024-09-11T23:28:28.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.119+0000 7efdba015740 1 -- 172.21.15.5:0/3859489048 shutdown_connections 2024-09-11T23:28:28.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.119+0000 7efdba015740 1 --2- 172.21.15.5:0/3859489048 >> [v2:172.21.15.159:6836/4020181017,v1:172.21.15.159:6837/4020181017] conn(0x55b424c041d0 0x55b424c05640 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:28.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.119+0000 7efdba015740 1 --2- 172.21.15.5:0/3859489048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b424bf3bb0 0x55b424bf0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:28.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.119+0000 7efdba015740 1 --2- 172.21.15.5:0/3859489048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b424be92f0 0x55b424bf07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:28.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.119+0000 7efd997fa640 0 client.15075 ms_handle_reset on v2:172.21.15.159:6836/4020181017 2024-09-11T23:28:28.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.119+0000 7efdba015740 1 --2- 172.21.15.5:0/3859489048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b424be89d0 0x55b424bf3450 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:28.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.119+0000 7efdba015740 1 -- 172.21.15.5:0/3859489048 >> 172.21.15.5:0/3859489048 conn(0x55b424be4f60 msgr2=0x55b424beac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:28.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.119+0000 7efdba015740 1 -- 172.21.15.5:0/3859489048 shutdown_connections 2024-09-11T23:28:28.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.119+0000 7efdba015740 1 -- 172.21.15.5:0/3859489048 wait complete. 2024-09-11T23:28:28.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.119+0000 7efdba015740 20 client.15075 trim_cache size 0 max 16384 2024-09-11T23:28:28.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.137+0000 7efdba015740 1 Processor -- start 2024-09-11T23:28:28.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.137+0000 7efdba015740 1 -- start start 2024-09-11T23:28:28.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.137+0000 7efdba015740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b424be89d0 0x55b424c05640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:28.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.137+0000 7efdba015740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b424be92f0 0x55b424be3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:28.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.137+0000 7efdba015740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b424bf3bb0 0x55b424beda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:28.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.137+0000 7efdba015740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55b424c03980 con 0x55b424be92f0 2024-09-11T23:28:28.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.137+0000 7efdba015740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55b424c04050 con 0x55b424be89d0 2024-09-11T23:28:28.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.137+0000 7efdba015740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b424c04720 con 0x55b424bf3bb0 2024-09-11T23:28:28.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.137+0000 7efdb51d7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b424be92f0 0x55b424be3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:28.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.137+0000 7efdb51d7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b424be92f0 0x55b424be3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37514/0 (socket says 172.21.15.5:37514) 2024-09-11T23:28:28.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.137+0000 7efdb51d7640 1 -- 172.21.15.5:0/2814456684 learned_addr learned my addr 172.21.15.5:0/2814456684 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:28.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.137+0000 7efdb61d9640 1 --2- 172.21.15.5:0/2814456684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b424bf3bb0 0x55b424beda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:28.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.137+0000 7efdb59d8640 1 --2- 172.21.15.5:0/2814456684 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b424be89d0 0x55b424c05640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:28.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.137+0000 7efdb51d7640 1 -- 172.21.15.5:0/2814456684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b424bf3bb0 msgr2=0x55b424beda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:28:28.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.137+0000 7efdb51d7640 1 --2- 172.21.15.5:0/2814456684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b424bf3bb0 0x55b424beda00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:28.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.137+0000 7efdb51d7640 1 -- 172.21.15.5:0/2814456684 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b424be89d0 msgr2=0x55b424c05640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:28:28.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.137+0000 7efdb51d7640 1 --2- 172.21.15.5:0/2814456684 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b424be89d0 0x55b424c05640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:28.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.137+0000 7efdb51d7640 1 -- 172.21.15.5:0/2814456684 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b424be9120 con 0x55b424be92f0 2024-09-11T23:28:28.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.137+0000 7efdb61d9640 1 --2- 172.21.15.5:0/2814456684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b424bf3bb0 0x55b424beda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:28:28.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.138+0000 7efdb51d7640 1 --2- 172.21.15.5:0/2814456684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b424be92f0 0x55b424be3ef0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7efda009b4b0 tx=0x7efda0086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc6799b6999e3469 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:28.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.138+0000 7efd9b7fe640 1 -- 172.21.15.5:0/2814456684 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda0020040 con 0x55b424be92f0 2024-09-11T23:28:28.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.138+0000 7efd9b7fe640 1 -- 172.21.15.5:0/2814456684 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efda009bc20 con 0x55b424be92f0 2024-09-11T23:28:28.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.138+0000 7efd9b7fe640 1 -- 172.21.15.5:0/2814456684 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda0097b90 con 0x55b424be92f0 2024-09-11T23:28:28.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.138+0000 7efdba015740 1 -- 172.21.15.5:0/2814456684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b424be92f0 msgr2=0x55b424be3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:28.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.138+0000 7efdba015740 1 --2- 172.21.15.5:0/2814456684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b424be92f0 0x55b424be3ef0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7efda009b4b0 tx=0x7efda0086040 comp rx=0 tx=0).stop 2024-09-11T23:28:28.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.138+0000 7efdba015740 1 -- 172.21.15.5:0/2814456684 shutdown_connections 2024-09-11T23:28:28.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.138+0000 7efdba015740 1 --2- 172.21.15.5:0/2814456684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b424bf3bb0 0x55b424beda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:28.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.138+0000 7efdba015740 1 --2- 172.21.15.5:0/2814456684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b424be92f0 0x55b424be3ef0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:28.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.138+0000 7efdba015740 1 --2- 172.21.15.5:0/2814456684 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b424be89d0 0x55b424c05640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:28.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.139+0000 7efdba015740 1 -- 172.21.15.5:0/2814456684 >> 172.21.15.5:0/2814456684 conn(0x55b424be4f60 msgr2=0x55b424be37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:28.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.139+0000 7efdba015740 1 -- 172.21.15.5:0/2814456684 shutdown_connections 2024-09-11T23:28:28.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.139+0000 7efdba015740 1 -- 172.21.15.5:0/2814456684 wait complete. 2024-09-11T23:28:28.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.139+0000 7efdba015740 1 -- start start 2024-09-11T23:28:28.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.139+0000 7efdba015740 1 Processor -- start 2024-09-11T23:28:28.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.139+0000 7efdba015740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b424be89d0 0x55b424c0dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:28.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.139+0000 7efdba015740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b424be92f0 0x55b424c09110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:28.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.139+0000 7efdba015740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b424bf3bb0 0x55b424c09650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:28.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.139+0000 7efdba015740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55b424c054c0 con 0x55b424bf3bb0 2024-09-11T23:28:28.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.139+0000 7efdba015740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55b424c04df0 con 0x55b424be92f0 2024-09-11T23:28:28.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.139+0000 7efdba015740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b424c05b90 con 0x55b424be89d0 2024-09-11T23:28:28.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.140+0000 7efdba015740 10 client.0 _ll_register_callbacks cb 0x7efda8009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:28:28.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.140+0000 7efdb61d9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b424bf3bb0 0x55b424c09650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:28.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.140+0000 7efdb61d9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b424bf3bb0 0x55b424c09650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37528/0 (socket says 172.21.15.5:37528) 2024-09-11T23:28:28.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.140+0000 7efdb61d9640 1 -- 172.21.15.5:0/2541987113 learned_addr learned my addr 172.21.15.5:0/2541987113 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:28.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.140+0000 7efdb59d8640 1 --2- 172.21.15.5:0/2541987113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b424be89d0 0x55b424c0dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:28.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.140+0000 7efdb51d7640 1 --2- 172.21.15.5:0/2541987113 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b424be92f0 0x55b424c09110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:28.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.140+0000 7efdb61d9640 1 -- 172.21.15.5:0/2541987113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b424be89d0 msgr2=0x55b424c0dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:28:28.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.140+0000 7efdb61d9640 1 --2- 172.21.15.5:0/2541987113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b424be89d0 0x55b424c0dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:28.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.140+0000 7efdb61d9640 1 -- 172.21.15.5:0/2541987113 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b424be92f0 msgr2=0x55b424c09110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:28:28.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.140+0000 7efdb61d9640 1 --2- 172.21.15.5:0/2541987113 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b424be92f0 0x55b424c09110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:28.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.140+0000 7efdb61d9640 1 -- 172.21.15.5:0/2541987113 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b424c09c10 con 0x55b424bf3bb0 2024-09-11T23:28:28.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.140+0000 7efdb61d9640 1 --2- 172.21.15.5:0/2541987113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b424bf3bb0 0x55b424c09650 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7efda8012a10 tx=0x7efda80095d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0d6d3c0ec776950 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:28.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.140+0000 7efd997fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-11T23:28:28.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.140+0000 7efd997fa640 1 -- 172.21.15.5:0/2541987113 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda8004b20 con 0x55b424bf3bb0 2024-09-11T23:28:28.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.140+0000 7efd997fa640 1 -- 172.21.15.5:0/2541987113 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7efda8004cc0 con 0x55b424bf3bb0 2024-09-11T23:28:28.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.140+0000 7efdba015740 1 -- 172.21.15.5:0/2541987113 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efda009bc20 con 0x55b424bf3bb0 2024-09-11T23:28:28.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.141+0000 7efd997fa640 1 -- 172.21.15.5:0/2541987113 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7efda8034050 con 0x55b424bf3bb0 2024-09-11T23:28:28.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.141+0000 7efdba015740 10 client.15081 fetch_fsmap learned FSMap version 24 2024-09-11T23:28:28.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.141+0000 7efdba015740 1 -- 172.21.15.5:0/2541987113 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b424c6e670 con 0x55b424bf3bb0 2024-09-11T23:28:28.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.141+0000 7efd997fa640 1 -- 172.21.15.5:0/2541987113 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efda009bc20 con 0x55b424bf3bb0 2024-09-11T23:28:28.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.141+0000 7efd997fa640 1 -- 172.21.15.5:0/2541987113 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7efda800f040 con 0x55b424bf3bb0 2024-09-11T23:28:28.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.141+0000 7efdba015740 10 client.15081 fetch_fsmap finished waiting for FSMap version 24 2024-09-11T23:28:28.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.141+0000 7efdba015740 10 client.15081 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-11T23:28:28.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.141+0000 7efdba015740 20 client.15081 populate_metadata read hostname 'smithi005' 2024-09-11T23:28:28.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.141+0000 7efdba015740 1 --2- 172.21.15.5:0/2541987113 >> [v2:172.21.15.159:6836/4020181017,v1:172.21.15.159:6837/4020181017] conn(0x55b424c73340 0x55b424c72050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:28.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.141+0000 7efdba015740 4 client.15081 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:28:28.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.141+0000 7efdba015740 1 -- 172.21.15.5:0/2541987113 --> [v2:172.21.15.159:6836/4020181017,v1:172.21.15.159:6837/4020181017] -- command(tid 0: {"prefix": "status"}) -- 0x55b424b56b10 con 0x55b424c73340 2024-09-11T23:28:28.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.141+0000 7efdb59d8640 1 --2- 172.21.15.5:0/2541987113 >> [v2:172.21.15.159:6836/4020181017,v1:172.21.15.159:6837/4020181017] conn(0x55b424c73340 0x55b424c72050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:28.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.142+0000 7efdb59d8640 1 --2- 172.21.15.5:0/2541987113 >> [v2:172.21.15.159:6836/4020181017,v1:172.21.15.159:6837/4020181017] conn(0x55b424c73340 0x55b424c72050 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fdb561c027779986 server_cookie=28f80f76c79ec913 in_seq=0 out_seq=0 2024-09-11T23:28:28.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.142+0000 7efd997fa640 10 client.15081 ms_handle_connect on v2:172.21.15.159:6836/4020181017 2024-09-11T23:28:28.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.142+0000 7efd997fa640 1 -- 172.21.15.5:0/2541987113 <== mds.2 v2:172.21.15.159:6836/4020181017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55b424b56b10 con 0x55b424c73340 2024-09-11T23:28:28.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.142+0000 7efd997fa640 10 client.15081 handle_command_reply: tid=0 2024-09-11T23:28:28.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.142+0000 7efdba015740 1 client.15081 shutdown 2024-09-11T23:28:28.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.142+0000 7efdba015740 1 -- 172.21.15.5:0/2541987113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b424bf3bb0 msgr2=0x55b424c09650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:28.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.142+0000 7efdba015740 1 --2- 172.21.15.5:0/2541987113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b424bf3bb0 0x55b424c09650 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7efda8012a10 tx=0x7efda80095d0 comp rx=0 tx=0).stop 2024-09-11T23:28:28.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.142+0000 7efdba015740 1 -- 172.21.15.5:0/2541987113 shutdown_connections 2024-09-11T23:28:28.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.142+0000 7efdba015740 1 --2- 172.21.15.5:0/2541987113 >> [v2:172.21.15.159:6836/4020181017,v1:172.21.15.159:6837/4020181017] conn(0x55b424c73340 0x55b424c72050 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:28.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.142+0000 7efdba015740 1 --2- 172.21.15.5:0/2541987113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b424bf3bb0 0x55b424c09650 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:28.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.142+0000 7efdba015740 1 --2- 172.21.15.5:0/2541987113 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b424be92f0 0x55b424c09110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:28.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.142+0000 7efdba015740 1 --2- 172.21.15.5:0/2541987113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b424be89d0 0x55b424c0dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:28.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.142+0000 7efd997fa640 0 client.15081 ms_handle_reset on v2:172.21.15.159:6836/4020181017 2024-09-11T23:28:28.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.142+0000 7efdba015740 1 -- 172.21.15.5:0/2541987113 >> 172.21.15.5:0/2541987113 conn(0x55b424be4f60 msgr2=0x55b424be4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:28.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.142+0000 7efdba015740 1 -- 172.21.15.5:0/2541987113 shutdown_connections 2024-09-11T23:28:28.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.142+0000 7efdba015740 1 -- 172.21.15.5:0/2541987113 wait complete. 2024-09-11T23:28:28.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.142+0000 7efdba015740 20 client.15081 trim_cache size 0 max 16384 2024-09-11T23:28:28.148 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-11T23:28:28.149 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "1f5284d2-7094-11ef-bcea-c7b262605968", 2024-09-11T23:28:28.149 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 2, 2024-09-11T23:28:28.149 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 24461, 2024-09-11T23:28:28.149 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-09-11T23:28:28.149 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-09-11T23:28:28.149 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-09-11T23:28:28.149 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 67.107365798999993, 2024-09-11T23:28:28.149 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 24, 2024-09-11T23:28:28.149 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 88, 2024-09-11T23:28:28.149 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 86, 2024-09-11T23:28:28.149 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 124.95313967 2024-09-11T23:28:28.150 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-11T23:28:28.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.143+0000 7efdb7c3c640 1 -- 172.21.15.5:0/2029057073 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7efd9c0a2c10 msgr2=0x7efd9c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:28.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.143+0000 7efdb7c3c640 1 --2- 172.21.15.5:0/2029057073 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7efd9c0a2c10 0x7efd9c0a50d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7efda8005fd0 tx=0x7efda8004ab0 comp rx=0 tx=0).stop 2024-09-11T23:28:28.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.143+0000 7efdb7c3c640 1 -- 172.21.15.5:0/2029057073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efdb0102790 msgr2=0x7efdb0198850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:28.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.143+0000 7efdb7c3c640 1 --2- 172.21.15.5:0/2029057073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efdb0102790 0x7efdb0198850 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7efda000d950 tx=0x7efda000de10 comp rx=0 tx=0).stop 2024-09-11T23:28:28.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.143+0000 7efdb7c3c640 1 -- 172.21.15.5:0/2029057073 shutdown_connections 2024-09-11T23:28:28.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.143+0000 7efdb7c3c640 1 --2- 172.21.15.5:0/2029057073 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7efd9c0a2c10 0x7efd9c0a50d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:28.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.143+0000 7efdb7c3c640 1 --2- 172.21.15.5:0/2029057073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdb0106f10 0x7efdb019cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:28.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.143+0000 7efdb7c3c640 1 --2- 172.21.15.5:0/2029057073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efdb0102790 0x7efdb0198850 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:28.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.143+0000 7efdb7c3c640 1 --2- 172.21.15.5:0/2029057073 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdb0101de0 0x7efdb0198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:28.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.143+0000 7efdb7c3c640 1 -- 172.21.15.5:0/2029057073 >> 172.21.15.5:0/2029057073 conn(0x7efdb00fd8c0 msgr2=0x7efdb00fed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:28.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.143+0000 7efdb7c3c640 1 -- 172.21.15.5:0/2029057073 shutdown_connections 2024-09-11T23:28:28.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:28.143+0000 7efdb7c3c640 1 -- 172.21.15.5:0/2029057073 wait complete. 2024-09-11T23:28:29.014 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-11T23:28:29.273 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:28:29.537 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:29 smithi005 ceph-mon[31201]: pgmap v337: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T23:28:29.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:29 smithi159 ceph-mon[34394]: pgmap v337: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T23:28:29.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:29 smithi172 ceph-mon[34855]: pgmap v337: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T23:28:29.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.773+0000 7f5ee76b6640 1 -- 172.21.15.5:0/2631148564 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ee0102d20 msgr2=0x7f5ee0103100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:29.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.773+0000 7f5ee76b6640 1 --2- 172.21.15.5:0/2631148564 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ee0102d20 0x7f5ee0103100 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5edc009900 tx=0x7f5edc02a480 comp rx=0 tx=0).stop 2024-09-11T23:28:29.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.773+0000 7f5ee76b6640 1 -- 172.21.15.5:0/2631148564 shutdown_connections 2024-09-11T23:28:29.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.773+0000 7f5ee76b6640 1 --2- 172.21.15.5:0/2631148564 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ee010c150 0x7f5ee010e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:29.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.773+0000 7f5ee76b6640 1 --2- 172.21.15.5:0/2631148564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ee0103640 0x7f5ee010bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:29.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.773+0000 7f5ee76b6640 1 --2- 172.21.15.5:0/2631148564 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ee0102d20 0x7f5ee0103100 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:29.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.773+0000 7f5ee76b6640 1 -- 172.21.15.5:0/2631148564 >> 172.21.15.5:0/2631148564 conn(0x7f5ee00fc780 msgr2=0x7f5ee00feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:29.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.773+0000 7f5ee76b6640 1 -- 172.21.15.5:0/2631148564 shutdown_connections 2024-09-11T23:28:29.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.773+0000 7f5ee76b6640 1 -- 172.21.15.5:0/2631148564 wait complete. 2024-09-11T23:28:29.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.773+0000 7f5ee76b6640 1 Processor -- start 2024-09-11T23:28:29.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.774+0000 7f5ee76b6640 1 -- start start 2024-09-11T23:28:29.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.774+0000 7f5ee76b6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ee0102d20 0x7f5ee0198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:29.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.774+0000 7f5ee76b6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ee0103640 0x7f5ee0198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:29.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.774+0000 7f5ee76b6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ee010c150 0x7f5ee019ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:29.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.774+0000 7f5ee76b6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee0111e40 con 0x7f5ee0102d20 2024-09-11T23:28:29.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.774+0000 7f5ee76b6640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee0111cc0 con 0x7f5ee0103640 2024-09-11T23:28:29.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.774+0000 7f5ee76b6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee0111fc0 con 0x7f5ee010c150 2024-09-11T23:28:29.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.774+0000 7f5ee5452640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ee0102d20 0x7f5ee0198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:29.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.774+0000 7f5ee5452640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ee0102d20 0x7f5ee0198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37534/0 (socket says 172.21.15.5:37534) 2024-09-11T23:28:29.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.774+0000 7f5ee5452640 1 -- 172.21.15.5:0/4006655792 learned_addr learned my addr 172.21.15.5:0/4006655792 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:29.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.774+0000 7f5ee5c53640 1 --2- 172.21.15.5:0/4006655792 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ee010c150 0x7f5ee019ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:29.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.774+0000 7f5ee4c51640 1 --2- 172.21.15.5:0/4006655792 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ee0103640 0x7f5ee0198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:29.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.774+0000 7f5ee5452640 1 -- 172.21.15.5:0/4006655792 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ee010c150 msgr2=0x7f5ee019ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:29.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.774+0000 7f5ee5452640 1 --2- 172.21.15.5:0/4006655792 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ee010c150 0x7f5ee019ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:29.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.774+0000 7f5ee5452640 1 -- 172.21.15.5:0/4006655792 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ee0103640 msgr2=0x7f5ee0198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:29.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.774+0000 7f5ee5452640 1 --2- 172.21.15.5:0/4006655792 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ee0103640 0x7f5ee0198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:29.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.774+0000 7f5ee5452640 1 -- 172.21.15.5:0/4006655792 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ee019d3d0 con 0x7f5ee0102d20 2024-09-11T23:28:29.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.774+0000 7f5ee5c53640 1 --2- 172.21.15.5:0/4006655792 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ee010c150 0x7f5ee019ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:28:29.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.774+0000 7f5ee4c51640 1 --2- 172.21.15.5:0/4006655792 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ee0103640 0x7f5ee0198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:28:29.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.774+0000 7f5ee5452640 1 --2- 172.21.15.5:0/4006655792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ee0102d20 0x7f5ee0198420 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5edc005940 tx=0x7f5edc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:29.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.775+0000 7f5ed67fc640 1 -- 172.21.15.5:0/4006655792 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5edc03f030 con 0x7f5ee0102d20 2024-09-11T23:28:29.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.775+0000 7f5ee76b6640 1 -- 172.21.15.5:0/4006655792 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ee019d660 con 0x7f5ee0102d20 2024-09-11T23:28:29.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.775+0000 7f5ed67fc640 1 -- 172.21.15.5:0/4006655792 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5edc003aa0 con 0x7f5ee0102d20 2024-09-11T23:28:29.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.775+0000 7f5ed67fc640 1 -- 172.21.15.5:0/4006655792 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5edc035070 con 0x7f5ee0102d20 2024-09-11T23:28:29.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.775+0000 7f5ee76b6640 1 -- 172.21.15.5:0/4006655792 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ee01a4fa0 con 0x7f5ee0102d20 2024-09-11T23:28:29.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.778+0000 7f5ee9a8f740 1 Processor -- start 2024-09-11T23:28:29.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.778+0000 7f5ee9a8f740 1 -- start start 2024-09-11T23:28:29.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.778+0000 7f5ed67fc640 1 -- 172.21.15.5:0/4006655792 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f5edc042030 con 0x7f5ee0102d20 2024-09-11T23:28:29.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.778+0000 7f5ee9a8f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d7a9aa9d0 0x555d7a9aadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:29.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.778+0000 7f5ee9a8f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d7a9ab2f0 0x555d7a9b5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:29.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.778+0000 7f5ee9a8f740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d7a9b5bb0 0x555d7a9b7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:29.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.778+0000 7f5ee9a8f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x555d7a911090 con 0x555d7a9ab2f0 2024-09-11T23:28:29.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.778+0000 7f5ee9a8f740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x555d7a8b8a70 con 0x555d7a9b5bb0 2024-09-11T23:28:29.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.778+0000 7f5ee9a8f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x555d7a90d050 con 0x555d7a9aa9d0 2024-09-11T23:28:29.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.778+0000 7f5ee5452640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d7a9ab2f0 0x555d7a9b5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:29.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.778+0000 7f5ee5452640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d7a9ab2f0 0x555d7a9b5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37544/0 (socket says 172.21.15.5:37544) 2024-09-11T23:28:29.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.778+0000 7f5ee5452640 1 -- 172.21.15.5:0/4158194634 learned_addr learned my addr 172.21.15.5:0/4158194634 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:29.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.779+0000 7f5ee5c53640 1 --2- 172.21.15.5:0/4158194634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d7a9aa9d0 0x555d7a9aadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:29.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.779+0000 7f5ee4c51640 1 --2- 172.21.15.5:0/4158194634 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d7a9b5bb0 0x555d7a9b7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:29.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.779+0000 7f5ee5452640 1 -- 172.21.15.5:0/4158194634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d7a9aa9d0 msgr2=0x555d7a9aadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:28:29.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.779+0000 7f5ee5452640 1 --2- 172.21.15.5:0/4158194634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d7a9aa9d0 0x555d7a9aadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:29.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.779+0000 7f5ee5452640 1 -- 172.21.15.5:0/4158194634 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d7a9b5bb0 msgr2=0x555d7a9b7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:28:29.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.779+0000 7f5ee5452640 1 --2- 172.21.15.5:0/4158194634 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d7a9b5bb0 0x555d7a9b7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:29.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.779+0000 7f5ee5452640 1 -- 172.21.15.5:0/4158194634 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d7a8c5130 con 0x555d7a9ab2f0 2024-09-11T23:28:29.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.779+0000 7f5ee4c51640 1 --2- 172.21.15.5:0/4158194634 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d7a9b5bb0 0x555d7a9b7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:28:29.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.779+0000 7f5ee5452640 1 --2- 172.21.15.5:0/4158194634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d7a9ab2f0 0x555d7a9b5670 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5edc0ed320 tx=0x7f5edc0f81a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d989a1b24f8a84ba server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:29.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.779+0000 7f5ed67fc640 1 --2- 172.21.15.5:0/4006655792 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f5ecc0a2c10 0x7f5ecc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:29.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.779+0000 7f5ee5c53640 1 --2- 172.21.15.5:0/4006655792 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f5ecc0a2c10 0x7f5ecc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:29.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.779+0000 7f5ecb7fe640 1 -- 172.21.15.5:0/4158194634 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5edc0b83d0 con 0x555d7a9ab2f0 2024-09-11T23:28:29.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.779+0000 7f5ecb7fe640 1 -- 172.21.15.5:0/4158194634 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5edc0fd070 con 0x555d7a9ab2f0 2024-09-11T23:28:29.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.779+0000 7f5ecb7fe640 1 -- 172.21.15.5:0/4158194634 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5edc0c4910 con 0x555d7a9ab2f0 2024-09-11T23:28:29.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.779+0000 7f5ed67fc640 1 -- 172.21.15.5:0/4006655792 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7f5edc0efdf0 con 0x7f5ee0102d20 2024-09-11T23:28:29.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.780+0000 7f5ee9a8f740 1 -- 172.21.15.5:0/4158194634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d7a9ab2f0 msgr2=0x555d7a9b5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:29.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.780+0000 7f5ee5c53640 1 --2- 172.21.15.5:0/4006655792 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f5ecc0a2c10 0x7f5ecc0a50d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8005fd0 tx=0x7f5ed8009580 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:29.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.780+0000 7f5ee9a8f740 1 --2- 172.21.15.5:0/4158194634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d7a9ab2f0 0x555d7a9b5670 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5edc0ed320 tx=0x7f5edc0f81a0 comp rx=0 tx=0).stop 2024-09-11T23:28:29.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.780+0000 7f5ee9a8f740 1 -- 172.21.15.5:0/4158194634 shutdown_connections 2024-09-11T23:28:29.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.780+0000 7f5ee9a8f740 1 --2- 172.21.15.5:0/4158194634 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d7a9b5bb0 0x555d7a9b7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:29.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.780+0000 7f5ee9a8f740 1 --2- 172.21.15.5:0/4158194634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d7a9ab2f0 0x555d7a9b5670 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:29.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.780+0000 7f5ee9a8f740 1 --2- 172.21.15.5:0/4158194634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d7a9aa9d0 0x555d7a9aadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:29.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.780+0000 7f5ee9a8f740 1 -- 172.21.15.5:0/4158194634 >> 172.21.15.5:0/4158194634 conn(0x555d7a9a6f60 msgr2=0x555d7a9a7340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:29.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.780+0000 7f5ee9a8f740 1 -- 172.21.15.5:0/4158194634 shutdown_connections 2024-09-11T23:28:29.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.780+0000 7f5ee9a8f740 1 -- 172.21.15.5:0/4158194634 wait complete. 2024-09-11T23:28:29.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.780+0000 7f5ee9a8f740 1 -- start start 2024-09-11T23:28:29.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.781+0000 7f5ee9a8f740 1 Processor -- start 2024-09-11T23:28:29.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.781+0000 7f5ee9a8f740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d7a9aa9d0 0x555d7a9b5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:29.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.781+0000 7f5ee9a8f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d7a9ab2f0 0x555d7a9b26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:29.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.781+0000 7f5ee9a8f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d7a9b5bb0 0x555d7a9b2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:29.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.781+0000 7f5ee9a8f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x555d7a9b8540 con 0x555d7a9b5bb0 2024-09-11T23:28:29.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.781+0000 7f5ee9a8f740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x555d7a8cbf20 con 0x555d7a9aa9d0 2024-09-11T23:28:29.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.781+0000 7f5ee9a8f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x555d7a9b86c0 con 0x555d7a9ab2f0 2024-09-11T23:28:29.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.781+0000 7f5ee9a8f740 10 client.0 _ll_register_callbacks cb 0x555d7a895030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:28:29.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.781+0000 7f5ee5c53640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d7a9b5bb0 0x555d7a9b2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:29.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.781+0000 7f5ee5c53640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d7a9b5bb0 0x555d7a9b2c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37546/0 (socket says 172.21.15.5:37546) 2024-09-11T23:28:29.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.781+0000 7f5ee5c53640 1 -- 172.21.15.5:0/3949541201 learned_addr learned my addr 172.21.15.5:0/3949541201 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:29.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.781+0000 7f5ee5452640 1 --2- 172.21.15.5:0/3949541201 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d7a9aa9d0 0x555d7a9b5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:29.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.781+0000 7f5ee4c51640 1 --2- 172.21.15.5:0/3949541201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d7a9ab2f0 0x555d7a9b26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:29.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.782+0000 7f5ee5c53640 1 -- 172.21.15.5:0/3949541201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d7a9ab2f0 msgr2=0x555d7a9b26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:28:29.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.782+0000 7f5ee5c53640 1 --2- 172.21.15.5:0/3949541201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d7a9ab2f0 0x555d7a9b26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:29.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.782+0000 7f5ee5c53640 1 -- 172.21.15.5:0/3949541201 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d7a9aa9d0 msgr2=0x555d7a9b5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:28:29.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.782+0000 7f5ee5c53640 1 --2- 172.21.15.5:0/3949541201 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d7a9aa9d0 0x555d7a9b5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:29.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.782+0000 7f5ee5c53640 1 -- 172.21.15.5:0/3949541201 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d7a6822b0 con 0x555d7a9b5bb0 2024-09-11T23:28:29.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.782+0000 7f5ee4c51640 1 --2- 172.21.15.5:0/3949541201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d7a9ab2f0 0x555d7a9b26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:28:29.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.782+0000 7f5ee5c53640 1 --2- 172.21.15.5:0/3949541201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d7a9b5bb0 0x555d7a9b2c20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5ed801d8d0 tx=0x7f5ed8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b7ec27f902c37ae server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:29.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.782+0000 7f5ec8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-11T23:28:29.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.782+0000 7f5ec8ff9640 1 -- 172.21.15.5:0/3949541201 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed8027630 con 0x555d7a9b5bb0 2024-09-11T23:28:29.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.782+0000 7f5ec8ff9640 1 -- 172.21.15.5:0/3949541201 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7f5ed801e410 con 0x555d7a9b5bb0 2024-09-11T23:28:29.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.782+0000 7f5ee9a8f740 1 -- 172.21.15.5:0/3949541201 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5edc0fd070 con 0x555d7a9b5bb0 2024-09-11T23:28:29.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.782+0000 7f5ec8ff9640 1 -- 172.21.15.5:0/3949541201 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5ed80277d0 con 0x555d7a9b5bb0 2024-09-11T23:28:29.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.782+0000 7f5ee9a8f740 10 client.15093 fetch_fsmap learned FSMap version 24 2024-09-11T23:28:29.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.782+0000 7f5ee9a8f740 1 -- 172.21.15.5:0/3949541201 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555d7a9c3ce0 con 0x555d7a9b5bb0 2024-09-11T23:28:29.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.782+0000 7f5ec8ff9640 1 -- 172.21.15.5:0/3949541201 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5edc0fd070 con 0x555d7a9b5bb0 2024-09-11T23:28:29.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.782+0000 7f5ec8ff9640 1 -- 172.21.15.5:0/3949541201 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f5ed800f040 con 0x555d7a9b5bb0 2024-09-11T23:28:29.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.783+0000 7f5ee9a8f740 10 client.15093 fetch_fsmap finished waiting for FSMap version 24 2024-09-11T23:28:29.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.783+0000 7f5ee9a8f740 10 client.15093 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-11T23:28:29.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.783+0000 7f5ee9a8f740 20 client.15093 populate_metadata read hostname 'smithi005' 2024-09-11T23:28:29.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.783+0000 7f5ee9a8f740 1 --2- 172.21.15.5:0/3949541201 >> [v2:172.21.15.172:6838/3928313314,v1:172.21.15.172:6839/3928313314] conn(0x555d7a9c63e0 0x555d7a9c7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:29.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.783+0000 7f5ee9a8f740 4 client.15093 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:28:29.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.783+0000 7f5ee9a8f740 1 -- 172.21.15.5:0/3949541201 --> [v2:172.21.15.172:6838/3928313314,v1:172.21.15.172:6839/3928313314] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555d7a91e600 con 0x555d7a9c63e0 2024-09-11T23:28:29.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.783+0000 7f5ee5452640 1 --2- 172.21.15.5:0/3949541201 >> [v2:172.21.15.172:6838/3928313314,v1:172.21.15.172:6839/3928313314] conn(0x555d7a9c63e0 0x555d7a9c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:29.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.783+0000 7f5ec8ff9640 10 client.15093 ms_handle_connect on v2:172.21.15.172:6838/3928313314 2024-09-11T23:28:29.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.783+0000 7f5ee5452640 1 --2- 172.21.15.5:0/3949541201 >> [v2:172.21.15.172:6838/3928313314,v1:172.21.15.172:6839/3928313314] conn(0x555d7a9c63e0 0x555d7a9c7850 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8f11216b9f1009de server_cookie=3b92a8d8c4cc9a22 in_seq=0 out_seq=0 2024-09-11T23:28:29.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.784+0000 7f5ec8ff9640 1 -- 172.21.15.5:0/3949541201 <== mds.1 v2:172.21.15.172:6838/3928313314 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555d7a91e600 con 0x555d7a9c63e0 2024-09-11T23:28:29.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.784+0000 7f5ec8ff9640 10 client.15093 handle_command_reply: tid=0 2024-09-11T23:28:29.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.784+0000 7f5ee9a8f740 1 client.15093 shutdown 2024-09-11T23:28:29.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.784+0000 7f5ee9a8f740 1 -- 172.21.15.5:0/3949541201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d7a9b5bb0 msgr2=0x555d7a9b2c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:29.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.784+0000 7f5ee9a8f740 1 --2- 172.21.15.5:0/3949541201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d7a9b5bb0 0x555d7a9b2c20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5ed801d8d0 tx=0x7f5ed8004a40 comp rx=0 tx=0).stop 2024-09-11T23:28:29.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.784+0000 7f5ee9a8f740 1 -- 172.21.15.5:0/3949541201 shutdown_connections 2024-09-11T23:28:29.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.784+0000 7f5ee9a8f740 1 --2- 172.21.15.5:0/3949541201 >> [v2:172.21.15.172:6838/3928313314,v1:172.21.15.172:6839/3928313314] conn(0x555d7a9c63e0 0x555d7a9c7850 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:29.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.784+0000 7f5ee9a8f740 1 --2- 172.21.15.5:0/3949541201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d7a9b5bb0 0x555d7a9b2c20 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:29.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.784+0000 7f5ec8ff9640 0 client.15093 ms_handle_reset on v2:172.21.15.172:6838/3928313314 2024-09-11T23:28:29.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.784+0000 7f5ee9a8f740 1 --2- 172.21.15.5:0/3949541201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d7a9ab2f0 0x555d7a9b26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:29.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.784+0000 7f5ee9a8f740 1 --2- 172.21.15.5:0/3949541201 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d7a9aa9d0 0x555d7a9b5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:29.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.784+0000 7f5ee9a8f740 1 -- 172.21.15.5:0/3949541201 >> 172.21.15.5:0/3949541201 conn(0x555d7a9a6f60 msgr2=0x555d7a9acc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:29.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.785+0000 7f5ee9a8f740 1 -- 172.21.15.5:0/3949541201 shutdown_connections 2024-09-11T23:28:29.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.785+0000 7f5ee9a8f740 1 -- 172.21.15.5:0/3949541201 wait complete. 2024-09-11T23:28:29.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.785+0000 7f5ee9a8f740 20 client.15093 trim_cache size 0 max 16384 2024-09-11T23:28:29.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.802+0000 7f5ee9a8f740 1 Processor -- start 2024-09-11T23:28:29.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.802+0000 7f5ee9a8f740 1 -- start start 2024-09-11T23:28:29.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.803+0000 7f5ee9a8f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d7a9aa9d0 0x555d7a9c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:29.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.803+0000 7f5ee9a8f740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d7a9ab2f0 0x555d7a9c15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:29.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.803+0000 7f5ee9a8f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d7a9b5bb0 0x555d7a9a1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:29.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.803+0000 7f5ee9a8f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x555d7a9c5b90 con 0x555d7a9b5bb0 2024-09-11T23:28:29.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.803+0000 7f5ee9a8f740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x555d7a9c6260 con 0x555d7a9ab2f0 2024-09-11T23:28:29.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.803+0000 7f5ee9a8f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x555d7a9c6930 con 0x555d7a9aa9d0 2024-09-11T23:28:29.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.803+0000 7f5ee5c53640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d7a9b5bb0 0x555d7a9a1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:29.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.803+0000 7f5ee5c53640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d7a9b5bb0 0x555d7a9a1ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37554/0 (socket says 172.21.15.5:37554) 2024-09-11T23:28:29.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.803+0000 7f5ee5c53640 1 -- 172.21.15.5:0/1526436527 learned_addr learned my addr 172.21.15.5:0/1526436527 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:29.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.803+0000 7f5ee4c51640 1 --2- 172.21.15.5:0/1526436527 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d7a9ab2f0 0x555d7a9c15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:29.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.803+0000 7f5ee5452640 1 --2- 172.21.15.5:0/1526436527 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d7a9aa9d0 0x555d7a9c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:29.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.803+0000 7f5ee5c53640 1 -- 172.21.15.5:0/1526436527 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d7a9aa9d0 msgr2=0x555d7a9c6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:28:29.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.803+0000 7f5ee5c53640 1 --2- 172.21.15.5:0/1526436527 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d7a9aa9d0 0x555d7a9c6ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:29.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.803+0000 7f5ee5c53640 1 -- 172.21.15.5:0/1526436527 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d7a9ab2f0 msgr2=0x555d7a9c15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:28:29.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.803+0000 7f5ee5c53640 1 --2- 172.21.15.5:0/1526436527 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d7a9ab2f0 0x555d7a9c15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:29.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.803+0000 7f5ee5c53640 1 -- 172.21.15.5:0/1526436527 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d7a9a6d90 con 0x555d7a9b5bb0 2024-09-11T23:28:29.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.803+0000 7f5ee5c53640 1 --2- 172.21.15.5:0/1526436527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d7a9b5bb0 0x555d7a9a1ce0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8017040 tx=0x7f5ed801d4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56b34b8f4f7fa583 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:29.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.804+0000 7f5ecaffd640 1 -- 172.21.15.5:0/1526436527 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed8027630 con 0x555d7a9b5bb0 2024-09-11T23:28:29.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.804+0000 7f5ecaffd640 1 -- 172.21.15.5:0/1526436527 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5ed803a070 con 0x555d7a9b5bb0 2024-09-11T23:28:29.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.804+0000 7f5ecaffd640 1 -- 172.21.15.5:0/1526436527 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed8026980 con 0x555d7a9b5bb0 2024-09-11T23:28:29.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.804+0000 7f5ee9a8f740 1 -- 172.21.15.5:0/1526436527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d7a9b5bb0 msgr2=0x555d7a9a1ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:29.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.804+0000 7f5ee9a8f740 1 --2- 172.21.15.5:0/1526436527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d7a9b5bb0 0x555d7a9a1ce0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8017040 tx=0x7f5ed801d4b0 comp rx=0 tx=0).stop 2024-09-11T23:28:29.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.804+0000 7f5ee9a8f740 1 -- 172.21.15.5:0/1526436527 shutdown_connections 2024-09-11T23:28:29.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.804+0000 7f5ee9a8f740 1 --2- 172.21.15.5:0/1526436527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d7a9b5bb0 0x555d7a9a1ce0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:29.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.804+0000 7f5ee9a8f740 1 --2- 172.21.15.5:0/1526436527 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d7a9ab2f0 0x555d7a9c15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:29.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.804+0000 7f5ee9a8f740 1 --2- 172.21.15.5:0/1526436527 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d7a9aa9d0 0x555d7a9c6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:29.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.804+0000 7f5ee9a8f740 1 -- 172.21.15.5:0/1526436527 >> 172.21.15.5:0/1526436527 conn(0x555d7a9a6f60 msgr2=0x555d7a9a7340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:29.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.804+0000 7f5ee9a8f740 1 -- 172.21.15.5:0/1526436527 shutdown_connections 2024-09-11T23:28:29.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.804+0000 7f5ee9a8f740 1 -- 172.21.15.5:0/1526436527 wait complete. 2024-09-11T23:28:29.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.805+0000 7f5ee9a8f740 1 -- start start 2024-09-11T23:28:29.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.805+0000 7f5ee9a8f740 1 Processor -- start 2024-09-11T23:28:29.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.805+0000 7f5ee9a8f740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d7a9aa9d0 0x555d7a9cfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:29.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.805+0000 7f5ee9a8f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d7a9ab2f0 0x555d7a9d0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:29.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.805+0000 7f5ee9a8f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d7a9b5bb0 0x555d7a9c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:29.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.805+0000 7f5ee9a8f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x555d7a9c76d0 con 0x555d7a9b5bb0 2024-09-11T23:28:29.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.805+0000 7f5ee9a8f740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x555d7a9c7000 con 0x555d7a9aa9d0 2024-09-11T23:28:29.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.805+0000 7f5ee9a8f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x555d7a9c7da0 con 0x555d7a9ab2f0 2024-09-11T23:28:29.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.805+0000 7f5ee9a8f740 10 client.0 _ll_register_callbacks cb 0x7f5ed8009710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:28:29.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.805+0000 7f5ee5c53640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d7a9b5bb0 0x555d7a9c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:29.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.805+0000 7f5ee5c53640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d7a9b5bb0 0x555d7a9c9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37562/0 (socket says 172.21.15.5:37562) 2024-09-11T23:28:29.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.805+0000 7f5ee5c53640 1 -- 172.21.15.5:0/2133857085 learned_addr learned my addr 172.21.15.5:0/2133857085 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:29.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.805+0000 7f5ee5452640 1 --2- 172.21.15.5:0/2133857085 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d7a9aa9d0 0x555d7a9cfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:29.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.806+0000 7f5ee4c51640 1 --2- 172.21.15.5:0/2133857085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d7a9ab2f0 0x555d7a9d0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:29.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.806+0000 7f5ee5c53640 1 -- 172.21.15.5:0/2133857085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d7a9ab2f0 msgr2=0x555d7a9d0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:28:29.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.806+0000 7f5ee5c53640 1 --2- 172.21.15.5:0/2133857085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d7a9ab2f0 0x555d7a9d0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:29.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.806+0000 7f5ee5c53640 1 -- 172.21.15.5:0/2133857085 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d7a9aa9d0 msgr2=0x555d7a9cfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:28:29.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.806+0000 7f5ee5c53640 1 --2- 172.21.15.5:0/2133857085 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d7a9aa9d0 0x555d7a9cfbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:29.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.806+0000 7f5ee5c53640 1 -- 172.21.15.5:0/2133857085 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d7a9c9730 con 0x555d7a9b5bb0 2024-09-11T23:28:29.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.806+0000 7f5ee5c53640 1 --2- 172.21.15.5:0/2133857085 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d7a9b5bb0 0x555d7a9c9040 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8000f80 tx=0x7f5ed8027750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=890322cc35b90cc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:29.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.806+0000 7f5ec8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-11T23:28:29.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.806+0000 7f5ec8ff9640 1 -- 172.21.15.5:0/2133857085 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed8045070 con 0x555d7a9b5bb0 2024-09-11T23:28:29.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.806+0000 7f5ec8ff9640 1 -- 172.21.15.5:0/2133857085 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7f5ed80266c0 con 0x555d7a9b5bb0 2024-09-11T23:28:29.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.806+0000 7f5ee9a8f740 1 -- 172.21.15.5:0/2133857085 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ed803a070 con 0x555d7a9b5bb0 2024-09-11T23:28:29.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.806+0000 7f5ec8ff9640 1 -- 172.21.15.5:0/2133857085 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5ed8051050 con 0x555d7a9b5bb0 2024-09-11T23:28:29.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.806+0000 7f5ee9a8f740 10 client.15099 fetch_fsmap learned FSMap version 24 2024-09-11T23:28:29.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.806+0000 7f5ee9a8f740 1 -- 172.21.15.5:0/2133857085 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555d7a9ce110 con 0x555d7a9b5bb0 2024-09-11T23:28:29.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.807+0000 7f5ec8ff9640 1 -- 172.21.15.5:0/2133857085 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5ed803a070 con 0x555d7a9b5bb0 2024-09-11T23:28:29.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.807+0000 7f5ec8ff9640 1 -- 172.21.15.5:0/2133857085 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f5ed801e780 con 0x555d7a9b5bb0 2024-09-11T23:28:29.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.807+0000 7f5ee9a8f740 10 client.15099 fetch_fsmap finished waiting for FSMap version 24 2024-09-11T23:28:29.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.807+0000 7f5ee9a8f740 10 client.15099 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-11T23:28:29.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.807+0000 7f5ee9a8f740 20 client.15099 populate_metadata read hostname 'smithi005' 2024-09-11T23:28:29.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.807+0000 7f5ee9a8f740 1 --2- 172.21.15.5:0/2133857085 >> [v2:172.21.15.172:6838/3928313314,v1:172.21.15.172:6839/3928313314] conn(0x555d7a9c63e0 0x555d7aa33ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:29.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.807+0000 7f5ee9a8f740 4 client.15099 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:28:29.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.807+0000 7f5ee9a8f740 1 -- 172.21.15.5:0/2133857085 --> [v2:172.21.15.172:6838/3928313314,v1:172.21.15.172:6839/3928313314] -- command(tid 0: {"prefix": "status"}) -- 0x555d7a918b10 con 0x555d7a9c63e0 2024-09-11T23:28:29.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.807+0000 7f5ee5452640 1 --2- 172.21.15.5:0/2133857085 >> [v2:172.21.15.172:6838/3928313314,v1:172.21.15.172:6839/3928313314] conn(0x555d7a9c63e0 0x555d7aa33ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:29.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.807+0000 7f5ec8ff9640 10 client.15099 ms_handle_connect on v2:172.21.15.172:6838/3928313314 2024-09-11T23:28:29.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.807+0000 7f5ee5452640 1 --2- 172.21.15.5:0/2133857085 >> [v2:172.21.15.172:6838/3928313314,v1:172.21.15.172:6839/3928313314] conn(0x555d7a9c63e0 0x555d7aa33ad0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=67c80d5bdeab61a5 server_cookie=a99d1387e868f87c in_seq=0 out_seq=0 2024-09-11T23:28:29.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.808+0000 7f5ec8ff9640 1 -- 172.21.15.5:0/2133857085 <== mds.1 v2:172.21.15.172:6838/3928313314 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x555d7a918b10 con 0x555d7a9c63e0 2024-09-11T23:28:29.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.808+0000 7f5ec8ff9640 10 client.15099 handle_command_reply: tid=0 2024-09-11T23:28:29.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.808+0000 7f5ee9a8f740 1 client.15099 shutdown 2024-09-11T23:28:29.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.808+0000 7f5ee9a8f740 1 -- 172.21.15.5:0/2133857085 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d7a9b5bb0 msgr2=0x555d7a9c9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:29.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.808+0000 7f5ee9a8f740 1 --2- 172.21.15.5:0/2133857085 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d7a9b5bb0 0x555d7a9c9040 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8000f80 tx=0x7f5ed8027750 comp rx=0 tx=0).stop 2024-09-11T23:28:29.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.808+0000 7f5ee9a8f740 1 -- 172.21.15.5:0/2133857085 shutdown_connections 2024-09-11T23:28:29.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.808+0000 7f5ee9a8f740 1 --2- 172.21.15.5:0/2133857085 >> [v2:172.21.15.172:6838/3928313314,v1:172.21.15.172:6839/3928313314] conn(0x555d7a9c63e0 0x555d7aa33ad0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:29.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.808+0000 7f5ee9a8f740 1 --2- 172.21.15.5:0/2133857085 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d7a9b5bb0 0x555d7a9c9040 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:29.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.808+0000 7f5ee9a8f740 1 --2- 172.21.15.5:0/2133857085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d7a9ab2f0 0x555d7a9d0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:29.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.808+0000 7f5ee9a8f740 1 --2- 172.21.15.5:0/2133857085 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d7a9aa9d0 0x555d7a9cfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:29.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.808+0000 7f5ee9a8f740 1 -- 172.21.15.5:0/2133857085 >> 172.21.15.5:0/2133857085 conn(0x555d7a9a6f60 msgr2=0x555d7a9a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:29.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.808+0000 7f5ec8ff9640 0 client.15099 ms_handle_reset on v2:172.21.15.172:6838/3928313314 2024-09-11T23:28:29.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.808+0000 7f5ee9a8f740 1 -- 172.21.15.5:0/2133857085 shutdown_connections 2024-09-11T23:28:29.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.808+0000 7f5ee9a8f740 1 -- 172.21.15.5:0/2133857085 wait complete. 2024-09-11T23:28:29.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.808+0000 7f5ee9a8f740 20 client.15099 trim_cache size 0 max 16384 2024-09-11T23:28:29.815 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-11T23:28:29.816 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "1f5284d2-7094-11ef-bcea-c7b262605968", 2024-09-11T23:28:29.816 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 1, 2024-09-11T23:28:29.816 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 24475, 2024-09-11T23:28:29.816 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-09-11T23:28:29.816 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-09-11T23:28:29.816 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-09-11T23:28:29.816 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 69.785489454, 2024-09-11T23:28:29.816 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 24, 2024-09-11T23:28:29.816 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 88, 2024-09-11T23:28:29.816 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 86, 2024-09-11T23:28:29.816 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 124.07104754300001 2024-09-11T23:28:29.817 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-11T23:28:29.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.809+0000 7f5ee76b6640 1 -- 172.21.15.5:0/4006655792 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f5ecc0a2c10 msgr2=0x7f5ecc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:29.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.809+0000 7f5ee76b6640 1 --2- 172.21.15.5:0/4006655792 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f5ecc0a2c10 0x7f5ecc0a50d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8005fd0 tx=0x7f5ed8009580 comp rx=0 tx=0).stop 2024-09-11T23:28:29.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.809+0000 7f5ee76b6640 1 -- 172.21.15.5:0/4006655792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ee0102d20 msgr2=0x7f5ee0198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:29.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.809+0000 7f5ee76b6640 1 --2- 172.21.15.5:0/4006655792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ee0102d20 0x7f5ee0198420 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5edc005940 tx=0x7f5edc004270 comp rx=0 tx=0).stop 2024-09-11T23:28:29.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.809+0000 7f5ee76b6640 1 -- 172.21.15.5:0/4006655792 shutdown_connections 2024-09-11T23:28:29.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.809+0000 7f5ee76b6640 1 --2- 172.21.15.5:0/4006655792 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f5ecc0a2c10 0x7f5ecc0a50d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:29.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.809+0000 7f5ee76b6640 1 --2- 172.21.15.5:0/4006655792 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ee010c150 0x7f5ee019ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:29.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.809+0000 7f5ee76b6640 1 --2- 172.21.15.5:0/4006655792 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5ee0103640 0x7f5ee0198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:29.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.809+0000 7f5ee76b6640 1 --2- 172.21.15.5:0/4006655792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ee0102d20 0x7f5ee0198420 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:29.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.809+0000 7f5ee76b6640 1 -- 172.21.15.5:0/4006655792 >> 172.21.15.5:0/4006655792 conn(0x7f5ee00fc780 msgr2=0x7f5ee00fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:29.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.809+0000 7f5ee76b6640 1 -- 172.21.15.5:0/4006655792 shutdown_connections 2024-09-11T23:28:29.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:29.809+0000 7f5ee76b6640 1 -- 172.21.15.5:0/4006655792 wait complete. 2024-09-11T23:28:30.587 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-11T23:28:30.848 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:28:31.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.333+0000 7f5fbe24e640 1 -- 172.21.15.5:0/156967973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fb8102dd0 msgr2=0x7f5fb81031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:31.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.333+0000 7f5fbe24e640 1 --2- 172.21.15.5:0/156967973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fb8102dd0 0x7f5fb81031b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5fa8009930 tx=0x7f5fa802a420 comp rx=0 tx=0).stop 2024-09-11T23:28:31.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.333+0000 7f5fbe24e640 1 -- 172.21.15.5:0/156967973 shutdown_connections 2024-09-11T23:28:31.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.333+0000 7f5fbe24e640 1 --2- 172.21.15.5:0/156967973 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fb8108300 0x7f5fb810ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:31.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.333+0000 7f5fbe24e640 1 --2- 172.21.15.5:0/156967973 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fb8103780 0x7f5fb8107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:31.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.333+0000 7f5fbe24e640 1 --2- 172.21.15.5:0/156967973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fb8102dd0 0x7f5fb81031b0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:31.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.333+0000 7f5fbe24e640 1 -- 172.21.15.5:0/156967973 >> 172.21.15.5:0/156967973 conn(0x7f5fb80fc7d0 msgr2=0x7f5fb80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:31.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.333+0000 7f5fbe24e640 1 -- 172.21.15.5:0/156967973 shutdown_connections 2024-09-11T23:28:31.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.333+0000 7f5fbe24e640 1 -- 172.21.15.5:0/156967973 wait complete. 2024-09-11T23:28:31.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.333+0000 7f5fbe24e640 1 Processor -- start 2024-09-11T23:28:31.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.334+0000 7f5fbe24e640 1 -- start start 2024-09-11T23:28:31.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.334+0000 7f5fbe24e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fb8102dd0 0x7f5fb8198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:31.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.334+0000 7f5fbe24e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fb8103780 0x7f5fb8198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:31.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.334+0000 7f5fbe24e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fb8108300 0x7f5fb819cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:31.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.334+0000 7f5fbe24e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb8111f90 con 0x7f5fb8103780 2024-09-11T23:28:31.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.334+0000 7f5fbe24e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb8111e10 con 0x7f5fb8108300 2024-09-11T23:28:31.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.334+0000 7f5fbe24e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb8112110 con 0x7f5fb8102dd0 2024-09-11T23:28:31.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.334+0000 7f5fb6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fb8103780 0x7f5fb8198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:31.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.334+0000 7f5fb6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fb8103780 0x7f5fb8198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37578/0 (socket says 172.21.15.5:37578) 2024-09-11T23:28:31.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.334+0000 7f5fb6ffd640 1 -- 172.21.15.5:0/2795498943 learned_addr learned my addr 172.21.15.5:0/2795498943 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:31.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.334+0000 7f5fb77fe640 1 --2- 172.21.15.5:0/2795498943 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fb8102dd0 0x7f5fb8198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:31.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.334+0000 7f5fb7fff640 1 --2- 172.21.15.5:0/2795498943 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fb8108300 0x7f5fb819cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:31.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.334+0000 7f5fb6ffd640 1 -- 172.21.15.5:0/2795498943 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fb8102dd0 msgr2=0x7f5fb8198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:31.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.334+0000 7f5fb6ffd640 1 --2- 172.21.15.5:0/2795498943 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fb8102dd0 0x7f5fb8198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:31.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.334+0000 7f5fb6ffd640 1 -- 172.21.15.5:0/2795498943 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fb8108300 msgr2=0x7f5fb819cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:31.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.334+0000 7f5fb6ffd640 1 --2- 172.21.15.5:0/2795498943 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fb8108300 0x7f5fb819cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:31.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.334+0000 7f5fb6ffd640 1 -- 172.21.15.5:0/2795498943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fb819d4c0 con 0x7f5fb8103780 2024-09-11T23:28:31.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.335+0000 7f5fb6ffd640 1 --2- 172.21.15.5:0/2795498943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fb8103780 0x7f5fb8198a50 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5fac00d740 tx=0x7f5fac00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:31.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.335+0000 7f5fb4ff9640 1 -- 172.21.15.5:0/2795498943 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fac017070 con 0x7f5fb8103780 2024-09-11T23:28:31.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.335+0000 7f5fbe24e640 1 -- 172.21.15.5:0/2795498943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fb819d7b0 con 0x7f5fb8103780 2024-09-11T23:28:31.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.335+0000 7f5fb4ff9640 1 -- 172.21.15.5:0/2795498943 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5fac00de50 con 0x7f5fb8103780 2024-09-11T23:28:31.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.335+0000 7f5fb4ff9640 1 -- 172.21.15.5:0/2795498943 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fac00f620 con 0x7f5fb8103780 2024-09-11T23:28:31.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.335+0000 7f5fbe24e640 1 -- 172.21.15.5:0/2795498943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fb81a5090 con 0x7f5fb8103780 2024-09-11T23:28:31.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.337+0000 7f5fc0627740 1 Processor -- start 2024-09-11T23:28:31.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.337+0000 7f5fb4ff9640 1 -- 172.21.15.5:0/2795498943 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f5fac01a070 con 0x7f5fb8103780 2024-09-11T23:28:31.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.337+0000 7f5fc0627740 1 -- start start 2024-09-11T23:28:31.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.338+0000 7f5fc0627740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f9eda0c9d0 0x55f9eda0cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:31.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.338+0000 7f5fc0627740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9eda0d2f0 0x55f9eda17670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:31.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.338+0000 7f5fc0627740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9eda17bb0 0x55f9eda19fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:31.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.338+0000 7f5fc0627740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f9ed973090 con 0x55f9eda17bb0 2024-09-11T23:28:31.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.338+0000 7f5fc0627740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55f9ed91aa70 con 0x55f9eda0c9d0 2024-09-11T23:28:31.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.338+0000 7f5fc0627740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f9ed96f050 con 0x55f9eda0d2f0 2024-09-11T23:28:31.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.338+0000 7f5fb6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9eda17bb0 0x55f9eda19fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:31.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.338+0000 7f5fb77fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9eda0d2f0 0x55f9eda17670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:31.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.338+0000 7f5fb6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9eda17bb0 0x55f9eda19fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37586/0 (socket says 172.21.15.5:37586) 2024-09-11T23:28:31.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.338+0000 7f5fb6ffd640 1 -- 172.21.15.5:0/1186743427 learned_addr learned my addr 172.21.15.5:0/1186743427 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:31.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.338+0000 7f5fb7fff640 1 --2- 172.21.15.5:0/1186743427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f9eda0c9d0 0x55f9eda0cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:31.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.338+0000 7f5fb77fe640 1 -- 172.21.15.5:0/1186743427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f9eda0c9d0 msgr2=0x55f9eda0cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:28:31.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.338+0000 7f5fb77fe640 1 --2- 172.21.15.5:0/1186743427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f9eda0c9d0 0x55f9eda0cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:31.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.338+0000 7f5fb77fe640 1 -- 172.21.15.5:0/1186743427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9eda17bb0 msgr2=0x55f9eda19fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:28:31.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.338+0000 7f5fb77fe640 1 --2- 172.21.15.5:0/1186743427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9eda17bb0 0x55f9eda19fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:31.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.338+0000 7f5fb77fe640 1 -- 172.21.15.5:0/1186743427 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9ed927130 con 0x55f9eda0d2f0 2024-09-11T23:28:31.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.338+0000 7f5fb4ff9640 1 --2- 172.21.15.5:0/2795498943 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f5fa00a2c10 0x7f5fa00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:31.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.338+0000 7f5fb77fe640 1 --2- 172.21.15.5:0/1186743427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9eda0d2f0 0x55f9eda17670 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5fa802a940 tx=0x7f5fa8004390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8765c2c1b615a6dc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:31.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.338+0000 7f5fb7fff640 1 --2- 172.21.15.5:0/2795498943 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f5fa00a2c10 0x7f5fa00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:31.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.338+0000 7f5fb4ff9640 1 -- 172.21.15.5:0/2795498943 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7f5fac0ceef0 con 0x7f5fb8103780 2024-09-11T23:28:31.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.339+0000 7f5f9dffb640 1 -- 172.21.15.5:0/1186743427 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa8035040 con 0x55f9eda0d2f0 2024-09-11T23:28:31.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.339+0000 7f5f9dffb640 1 -- 172.21.15.5:0/1186743427 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5fa8004750 con 0x55f9eda0d2f0 2024-09-11T23:28:31.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.339+0000 7f5f9dffb640 1 -- 172.21.15.5:0/1186743427 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa8003850 con 0x55f9eda0d2f0 2024-09-11T23:28:31.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.339+0000 7f5fc0627740 1 -- 172.21.15.5:0/1186743427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9eda0d2f0 msgr2=0x55f9eda17670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:31.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.339+0000 7f5fb7fff640 1 --2- 172.21.15.5:0/2795498943 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f5fa00a2c10 0x7f5fa00a50d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5fb000ae40 tx=0x7f5fb000a4d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:31.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.339+0000 7f5fc0627740 1 --2- 172.21.15.5:0/1186743427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9eda0d2f0 0x55f9eda17670 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5fa802a940 tx=0x7f5fa8004390 comp rx=0 tx=0).stop 2024-09-11T23:28:31.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.339+0000 7f5fc0627740 1 -- 172.21.15.5:0/1186743427 shutdown_connections 2024-09-11T23:28:31.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.339+0000 7f5fc0627740 1 --2- 172.21.15.5:0/1186743427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9eda17bb0 0x55f9eda19fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:31.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.339+0000 7f5fc0627740 1 --2- 172.21.15.5:0/1186743427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9eda0d2f0 0x55f9eda17670 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:31.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.339+0000 7f5fc0627740 1 --2- 172.21.15.5:0/1186743427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f9eda0c9d0 0x55f9eda0cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:31.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.339+0000 7f5fc0627740 1 -- 172.21.15.5:0/1186743427 >> 172.21.15.5:0/1186743427 conn(0x55f9eda08f60 msgr2=0x55f9eda09340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:31.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.339+0000 7f5fc0627740 1 -- 172.21.15.5:0/1186743427 shutdown_connections 2024-09-11T23:28:31.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.339+0000 7f5fc0627740 1 -- 172.21.15.5:0/1186743427 wait complete. 2024-09-11T23:28:31.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.340+0000 7f5fc0627740 1 -- start start 2024-09-11T23:28:31.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.340+0000 7f5fc0627740 1 Processor -- start 2024-09-11T23:28:31.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.340+0000 7f5fc0627740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9eda0c9d0 0x55f9eda17420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:31.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.340+0000 7f5fc0627740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f9eda0d2f0 0x55f9eda14770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:31.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.340+0000 7f5fc0627740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9eda17bb0 0x55f9eda14cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:31.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.340+0000 7f5fc0627740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f9eda1a780 con 0x55f9eda17bb0 2024-09-11T23:28:31.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.340+0000 7f5fc0627740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55f9ed92df20 con 0x55f9eda0d2f0 2024-09-11T23:28:31.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.340+0000 7f5fc0627740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f9eda1a900 con 0x55f9eda0c9d0 2024-09-11T23:28:31.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.340+0000 7f5fc0627740 10 client.0 _ll_register_callbacks cb 0x55f9ed8f7030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:28:31.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.340+0000 7f5fb7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9eda17bb0 0x55f9eda14cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:31.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.341+0000 7f5fb7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9eda17bb0 0x55f9eda14cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37598/0 (socket says 172.21.15.5:37598) 2024-09-11T23:28:31.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.341+0000 7f5fb7fff640 1 -- 172.21.15.5:0/4171913014 learned_addr learned my addr 172.21.15.5:0/4171913014 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:31.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.341+0000 7f5fb77fe640 1 --2- 172.21.15.5:0/4171913014 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9eda0c9d0 0x55f9eda17420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:31.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.341+0000 7f5fb6ffd640 1 --2- 172.21.15.5:0/4171913014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f9eda0d2f0 0x55f9eda14770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:31.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.341+0000 7f5fb7fff640 1 -- 172.21.15.5:0/4171913014 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9eda0c9d0 msgr2=0x55f9eda17420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:28:31.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.341+0000 7f5fb7fff640 1 --2- 172.21.15.5:0/4171913014 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9eda0c9d0 0x55f9eda17420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:31.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.341+0000 7f5fb7fff640 1 -- 172.21.15.5:0/4171913014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f9eda0d2f0 msgr2=0x55f9eda14770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:28:31.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.341+0000 7f5fb7fff640 1 --2- 172.21.15.5:0/4171913014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f9eda0d2f0 0x55f9eda14770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:31.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.341+0000 7f5fb7fff640 1 -- 172.21.15.5:0/4171913014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9ed6e42b0 con 0x55f9eda17bb0 2024-09-11T23:28:31.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.341+0000 7f5fb7fff640 1 --2- 172.21.15.5:0/4171913014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9eda17bb0 0x55f9eda14cb0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5fb000fe00 tx=0x7f5fb0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=250a1a306052cb2a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:31.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.341+0000 7f5f96ffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-11T23:28:31.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.341+0000 7f5f96ffd640 1 -- 172.21.15.5:0/4171913014 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb000eb30 con 0x55f9eda17bb0 2024-09-11T23:28:31.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.341+0000 7f5fc0627740 1 -- 172.21.15.5:0/4171913014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5fa8004750 con 0x55f9eda17bb0 2024-09-11T23:28:31.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.341+0000 7f5f96ffd640 1 -- 172.21.15.5:0/4171913014 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7f5fb000ecd0 con 0x55f9eda17bb0 2024-09-11T23:28:31.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.341+0000 7f5f96ffd640 1 -- 172.21.15.5:0/4171913014 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5fb000aa90 con 0x55f9eda17bb0 2024-09-11T23:28:31.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.341+0000 7f5fc0627740 10 client.15111 fetch_fsmap learned FSMap version 24 2024-09-11T23:28:31.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.341+0000 7f5fc0627740 1 -- 172.21.15.5:0/4171913014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f9eda260d0 con 0x55f9eda17bb0 2024-09-11T23:28:31.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.342+0000 7f5f96ffd640 1 -- 172.21.15.5:0/4171913014 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5fa8004750 con 0x55f9eda17bb0 2024-09-11T23:28:31.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.342+0000 7f5f96ffd640 1 -- 172.21.15.5:0/4171913014 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f5fb001c550 con 0x55f9eda17bb0 2024-09-11T23:28:31.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.342+0000 7f5fc0627740 10 client.15111 fetch_fsmap finished waiting for FSMap version 24 2024-09-11T23:28:31.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.342+0000 7f5fc0627740 10 client.15111 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T23:28:31.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.342+0000 7f5fc0627740 20 client.15111 populate_metadata read hostname 'smithi005' 2024-09-11T23:28:31.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.342+0000 7f5fc0627740 1 --2- 172.21.15.5:0/4171913014 >> [v2:172.21.15.159:6838/3843336290,v1:172.21.15.159:6839/3843336290] conn(0x55f9eda28780 0x55f9eda29bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:31.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.342+0000 7f5fc0627740 4 client.15111 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:28:31.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.342+0000 7f5fc0627740 1 -- 172.21.15.5:0/4171913014 --> [v2:172.21.15.159:6838/3843336290,v1:172.21.15.159:6839/3843336290] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f9ed980600 con 0x55f9eda28780 2024-09-11T23:28:31.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.342+0000 7f5fb77fe640 1 --2- 172.21.15.5:0/4171913014 >> [v2:172.21.15.159:6838/3843336290,v1:172.21.15.159:6839/3843336290] conn(0x55f9eda28780 0x55f9eda29bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:31.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.343+0000 7f5fb77fe640 1 --2- 172.21.15.5:0/4171913014 >> [v2:172.21.15.159:6838/3843336290,v1:172.21.15.159:6839/3843336290] conn(0x55f9eda28780 0x55f9eda29bf0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aef3d1edd6ea3972 server_cookie=37b5ade61281b2ed in_seq=0 out_seq=0 2024-09-11T23:28:31.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.343+0000 7f5f96ffd640 10 client.15111 ms_handle_connect on v2:172.21.15.159:6838/3843336290 2024-09-11T23:28:31.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.343+0000 7f5f96ffd640 1 -- 172.21.15.5:0/4171913014 <== mds.0 v2:172.21.15.159:6838/3843336290 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f9ed980600 con 0x55f9eda28780 2024-09-11T23:28:31.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.343+0000 7f5f96ffd640 10 client.15111 handle_command_reply: tid=0 2024-09-11T23:28:31.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.343+0000 7f5fc0627740 1 client.15111 shutdown 2024-09-11T23:28:31.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.344+0000 7f5fc0627740 1 -- 172.21.15.5:0/4171913014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9eda17bb0 msgr2=0x55f9eda14cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:31.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.344+0000 7f5fc0627740 1 --2- 172.21.15.5:0/4171913014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9eda17bb0 0x55f9eda14cb0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5fb000fe00 tx=0x7f5fb0004a40 comp rx=0 tx=0).stop 2024-09-11T23:28:31.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.344+0000 7f5fc0627740 1 -- 172.21.15.5:0/4171913014 shutdown_connections 2024-09-11T23:28:31.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.344+0000 7f5fc0627740 1 --2- 172.21.15.5:0/4171913014 >> [v2:172.21.15.159:6838/3843336290,v1:172.21.15.159:6839/3843336290] conn(0x55f9eda28780 0x55f9eda29bf0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:31.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.344+0000 7f5fc0627740 1 --2- 172.21.15.5:0/4171913014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9eda17bb0 0x55f9eda14cb0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:31.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.344+0000 7f5fc0627740 1 --2- 172.21.15.5:0/4171913014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f9eda0d2f0 0x55f9eda14770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:31.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.344+0000 7f5fc0627740 1 --2- 172.21.15.5:0/4171913014 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9eda0c9d0 0x55f9eda17420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:31.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.344+0000 7f5fc0627740 1 -- 172.21.15.5:0/4171913014 >> 172.21.15.5:0/4171913014 conn(0x55f9eda08f60 msgr2=0x55f9eda0ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:31.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.344+0000 7f5f96ffd640 0 client.15111 ms_handle_reset on v2:172.21.15.159:6838/3843336290 2024-09-11T23:28:31.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.344+0000 7f5fc0627740 1 -- 172.21.15.5:0/4171913014 shutdown_connections 2024-09-11T23:28:31.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.344+0000 7f5fc0627740 1 -- 172.21.15.5:0/4171913014 wait complete. 2024-09-11T23:28:31.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.344+0000 7f5fc0627740 20 client.15111 trim_cache size 0 max 16384 2024-09-11T23:28:31.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.362+0000 7f5fc0627740 1 Processor -- start 2024-09-11T23:28:31.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.362+0000 7f5fc0627740 1 -- start start 2024-09-11T23:28:31.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.362+0000 7f5fc0627740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f9eda0c9d0 0x55f9eda28780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:31.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.362+0000 7f5fc0627740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9eda0d2f0 0x55f9eda14730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:31.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.362+0000 7f5fc0627740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9eda17bb0 0x55f9eda14c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:31.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.362+0000 7f5fc0627740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f9eda27f30 con 0x55f9eda17bb0 2024-09-11T23:28:31.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.362+0000 7f5fc0627740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55f9eda28600 con 0x55f9eda0c9d0 2024-09-11T23:28:31.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.362+0000 7f5fc0627740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f9eda28cd0 con 0x55f9eda0d2f0 2024-09-11T23:28:31.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.362+0000 7f5fb7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9eda17bb0 0x55f9eda14c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:31.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.362+0000 7f5fb7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9eda17bb0 0x55f9eda14c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37614/0 (socket says 172.21.15.5:37614) 2024-09-11T23:28:31.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.362+0000 7f5fb7fff640 1 -- 172.21.15.5:0/132258159 learned_addr learned my addr 172.21.15.5:0/132258159 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:31.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.362+0000 7f5fb77fe640 1 --2- 172.21.15.5:0/132258159 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f9eda0c9d0 0x55f9eda28780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:31.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.363+0000 7f5fb6ffd640 1 --2- 172.21.15.5:0/132258159 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9eda0d2f0 0x55f9eda14730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:31.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.363+0000 7f5fb7fff640 1 -- 172.21.15.5:0/132258159 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9eda0d2f0 msgr2=0x55f9eda14730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:28:31.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.363+0000 7f5fb7fff640 1 --2- 172.21.15.5:0/132258159 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9eda0d2f0 0x55f9eda14730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:31.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.363+0000 7f5fb7fff640 1 -- 172.21.15.5:0/132258159 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f9eda0c9d0 msgr2=0x55f9eda28780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:28:31.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.363+0000 7f5fb7fff640 1 --2- 172.21.15.5:0/132258159 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f9eda0c9d0 0x55f9eda28780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:31.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.363+0000 7f5fb7fff640 1 -- 172.21.15.5:0/132258159 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9eda17790 con 0x55f9eda17bb0 2024-09-11T23:28:31.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.363+0000 7f5fb6ffd640 1 --2- 172.21.15.5:0/132258159 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9eda0d2f0 0x55f9eda14730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:28:31.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.363+0000 7f5fb7fff640 1 --2- 172.21.15.5:0/132258159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9eda17bb0 0x55f9eda14c70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0016040 tx=0x7f5fb000a670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b7461c65daf3178 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:31.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.363+0000 7f5f9d7fa640 1 -- 172.21.15.5:0/132258159 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb0038020 con 0x55f9eda17bb0 2024-09-11T23:28:31.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.363+0000 7f5f9d7fa640 1 -- 172.21.15.5:0/132258159 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5fb0004ab0 con 0x55f9eda17bb0 2024-09-11T23:28:31.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.363+0000 7f5f9d7fa640 1 -- 172.21.15.5:0/132258159 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb0005040 con 0x55f9eda17bb0 2024-09-11T23:28:31.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.364+0000 7f5fc0627740 1 -- 172.21.15.5:0/132258159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9eda17bb0 msgr2=0x55f9eda14c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:31.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.364+0000 7f5fc0627740 1 --2- 172.21.15.5:0/132258159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9eda17bb0 0x55f9eda14c70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0016040 tx=0x7f5fb000a670 comp rx=0 tx=0).stop 2024-09-11T23:28:31.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.364+0000 7f5fc0627740 1 -- 172.21.15.5:0/132258159 shutdown_connections 2024-09-11T23:28:31.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.364+0000 7f5fc0627740 1 --2- 172.21.15.5:0/132258159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9eda17bb0 0x55f9eda14c70 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:31.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.364+0000 7f5fc0627740 1 --2- 172.21.15.5:0/132258159 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9eda0d2f0 0x55f9eda14730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:31.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.364+0000 7f5fc0627740 1 --2- 172.21.15.5:0/132258159 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f9eda0c9d0 0x55f9eda28780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:31.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.364+0000 7f5fc0627740 1 -- 172.21.15.5:0/132258159 >> 172.21.15.5:0/132258159 conn(0x55f9eda08f60 msgr2=0x55f9eda13cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:31.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.364+0000 7f5fc0627740 1 -- 172.21.15.5:0/132258159 shutdown_connections 2024-09-11T23:28:31.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.364+0000 7f5fc0627740 1 -- 172.21.15.5:0/132258159 wait complete. 2024-09-11T23:28:31.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.364+0000 7f5fc0627740 1 -- start start 2024-09-11T23:28:31.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.365+0000 7f5fc0627740 1 Processor -- start 2024-09-11T23:28:31.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.365+0000 7f5fc0627740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9eda0c9d0 0x55f9eda32680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:31.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.365+0000 7f5fc0627740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9eda0d2f0 0x55f9eda2c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:31.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.365+0000 7f5fc0627740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f9eda17bb0 0x55f9eda2cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:31.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.365+0000 7f5fc0627740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f9eda29a70 con 0x55f9eda0c9d0 2024-09-11T23:28:31.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.365+0000 7f5fc0627740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55f9eda293a0 con 0x55f9eda17bb0 2024-09-11T23:28:31.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.365+0000 7f5fc0627740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f9eda2a140 con 0x55f9eda0d2f0 2024-09-11T23:28:31.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.365+0000 7f5fc0627740 10 client.0 _ll_register_callbacks cb 0x7f5fb000fab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:28:31.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.365+0000 7f5fb77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9eda0c9d0 0x55f9eda32680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:31.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.365+0000 7f5fb77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9eda0c9d0 0x55f9eda32680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37630/0 (socket says 172.21.15.5:37630) 2024-09-11T23:28:31.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.365+0000 7f5fb77fe640 1 -- 172.21.15.5:0/714910827 learned_addr learned my addr 172.21.15.5:0/714910827 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:31.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.365+0000 7f5fb7fff640 1 --2- 172.21.15.5:0/714910827 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f9eda17bb0 0x55f9eda2cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:31.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.365+0000 7f5fb6ffd640 1 --2- 172.21.15.5:0/714910827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9eda0d2f0 0x55f9eda2c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:31.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.365+0000 7f5fb77fe640 1 -- 172.21.15.5:0/714910827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9eda0d2f0 msgr2=0x55f9eda2c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:28:31.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.365+0000 7f5fb77fe640 1 --2- 172.21.15.5:0/714910827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9eda0d2f0 0x55f9eda2c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:31.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.365+0000 7f5fb77fe640 1 -- 172.21.15.5:0/714910827 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f9eda17bb0 msgr2=0x55f9eda2cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:28:31.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.365+0000 7f5fb77fe640 1 --2- 172.21.15.5:0/714910827 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f9eda17bb0 0x55f9eda2cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:31.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.365+0000 7f5fb77fe640 1 -- 172.21.15.5:0/714910827 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9eda2d7e0 con 0x55f9eda0c9d0 2024-09-11T23:28:31.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.365+0000 7f5fb77fe640 1 --2- 172.21.15.5:0/714910827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9eda0c9d0 0x55f9eda32680 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5fa802a940 tx=0x7f5fa8005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45509086433fa66e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:31.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.365+0000 7f5f96ffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-11T23:28:31.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.366+0000 7f5f96ffd640 1 -- 172.21.15.5:0/714910827 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa8035040 con 0x55f9eda0c9d0 2024-09-11T23:28:31.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.366+0000 7f5f96ffd640 1 -- 172.21.15.5:0/714910827 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7f5fa8005460 con 0x55f9eda0c9d0 2024-09-11T23:28:31.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.366+0000 7f5fc0627740 1 -- 172.21.15.5:0/714910827 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5fb0004ab0 con 0x55f9eda0c9d0 2024-09-11T23:28:31.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.366+0000 7f5f96ffd640 1 -- 172.21.15.5:0/714910827 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5fa8061050 con 0x55f9eda0c9d0 2024-09-11T23:28:31.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.366+0000 7f5fc0627740 10 client.15117 fetch_fsmap learned FSMap version 24 2024-09-11T23:28:31.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.366+0000 7f5fc0627740 1 -- 172.21.15.5:0/714910827 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f9eda91ed0 con 0x55f9eda0c9d0 2024-09-11T23:28:31.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.366+0000 7f5f96ffd640 1 -- 172.21.15.5:0/714910827 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5fb0004ab0 con 0x55f9eda0c9d0 2024-09-11T23:28:31.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.366+0000 7f5f96ffd640 1 -- 172.21.15.5:0/714910827 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f5fa804f040 con 0x55f9eda0c9d0 2024-09-11T23:28:31.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.366+0000 7f5fc0627740 10 client.15117 fetch_fsmap finished waiting for FSMap version 24 2024-09-11T23:28:31.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.366+0000 7f5fc0627740 10 client.15117 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T23:28:31.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.366+0000 7f5fc0627740 20 client.15117 populate_metadata read hostname 'smithi005' 2024-09-11T23:28:31.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.366+0000 7f5fc0627740 1 --2- 172.21.15.5:0/714910827 >> [v2:172.21.15.159:6838/3843336290,v1:172.21.15.159:6839/3843336290] conn(0x55f9eda96590 0x55f9eda952a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:31.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.366+0000 7f5fc0627740 4 client.15117 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:28:31.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.366+0000 7f5fc0627740 1 -- 172.21.15.5:0/714910827 --> [v2:172.21.15.159:6838/3843336290,v1:172.21.15.159:6839/3843336290] -- command(tid 0: {"prefix": "status"}) -- 0x55f9ed97ab10 con 0x55f9eda96590 2024-09-11T23:28:31.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.367+0000 7f5fb6ffd640 1 --2- 172.21.15.5:0/714910827 >> [v2:172.21.15.159:6838/3843336290,v1:172.21.15.159:6839/3843336290] conn(0x55f9eda96590 0x55f9eda952a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:31.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.367+0000 7f5fb6ffd640 1 --2- 172.21.15.5:0/714910827 >> [v2:172.21.15.159:6838/3843336290,v1:172.21.15.159:6839/3843336290] conn(0x55f9eda96590 0x55f9eda952a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8d471dd83affce5 server_cookie=e410d02e8767b504 in_seq=0 out_seq=0 2024-09-11T23:28:31.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.367+0000 7f5f96ffd640 10 client.15117 ms_handle_connect on v2:172.21.15.159:6838/3843336290 2024-09-11T23:28:31.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.367+0000 7f5f96ffd640 1 -- 172.21.15.5:0/714910827 <== mds.0 v2:172.21.15.159:6838/3843336290 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55f9ed97ab10 con 0x55f9eda96590 2024-09-11T23:28:31.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.367+0000 7f5f96ffd640 10 client.15117 handle_command_reply: tid=0 2024-09-11T23:28:31.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.367+0000 7f5fc0627740 1 client.15117 shutdown 2024-09-11T23:28:31.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.367+0000 7f5fc0627740 1 -- 172.21.15.5:0/714910827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9eda0c9d0 msgr2=0x55f9eda32680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:31.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.367+0000 7f5fc0627740 1 --2- 172.21.15.5:0/714910827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9eda0c9d0 0x55f9eda32680 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5fa802a940 tx=0x7f5fa8005760 comp rx=0 tx=0).stop 2024-09-11T23:28:31.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.368+0000 7f5fc0627740 1 -- 172.21.15.5:0/714910827 shutdown_connections 2024-09-11T23:28:31.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.368+0000 7f5fc0627740 1 --2- 172.21.15.5:0/714910827 >> [v2:172.21.15.159:6838/3843336290,v1:172.21.15.159:6839/3843336290] conn(0x55f9eda96590 0x55f9eda952a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:31.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.368+0000 7f5fc0627740 1 --2- 172.21.15.5:0/714910827 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f9eda17bb0 0x55f9eda2cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:31.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.368+0000 7f5fc0627740 1 --2- 172.21.15.5:0/714910827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9eda0d2f0 0x55f9eda2c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:31.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.368+0000 7f5f96ffd640 0 client.15117 ms_handle_reset on v2:172.21.15.159:6838/3843336290 2024-09-11T23:28:31.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.368+0000 7f5fc0627740 1 --2- 172.21.15.5:0/714910827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9eda0c9d0 0x55f9eda32680 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:31.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.368+0000 7f5fc0627740 1 -- 172.21.15.5:0/714910827 >> 172.21.15.5:0/714910827 conn(0x55f9eda08f60 msgr2=0x55f9eda14730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:31.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.368+0000 7f5fc0627740 1 -- 172.21.15.5:0/714910827 shutdown_connections 2024-09-11T23:28:31.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.368+0000 7f5fc0627740 1 -- 172.21.15.5:0/714910827 wait complete. 2024-09-11T23:28:31.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.368+0000 7f5fc0627740 20 client.15117 trim_cache size 0 max 16384 2024-09-11T23:28:31.374 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-11T23:28:31.374 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "1f5284d2-7094-11ef-bcea-c7b262605968", 2024-09-11T23:28:31.374 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-09-11T23:28:31.374 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 24494, 2024-09-11T23:28:31.374 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-09-11T23:28:31.374 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-09-11T23:28:31.375 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-09-11T23:28:31.375 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 105.35117315700001, 2024-09-11T23:28:31.375 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 24, 2024-09-11T23:28:31.375 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 88, 2024-09-11T23:28:31.375 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 86, 2024-09-11T23:28:31.375 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 116.713319744 2024-09-11T23:28:31.375 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-11T23:28:31.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.368+0000 7f5fbe24e640 1 -- 172.21.15.5:0/2795498943 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f5fa00a2c10 msgr2=0x7f5fa00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:31.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.368+0000 7f5fbe24e640 1 --2- 172.21.15.5:0/2795498943 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f5fa00a2c10 0x7f5fa00a50d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5fb000ae40 tx=0x7f5fb000a4d0 comp rx=0 tx=0).stop 2024-09-11T23:28:31.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.368+0000 7f5fbe24e640 1 -- 172.21.15.5:0/2795498943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fb8103780 msgr2=0x7f5fb8198a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:31.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.368+0000 7f5fbe24e640 1 --2- 172.21.15.5:0/2795498943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fb8103780 0x7f5fb8198a50 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5fac00d740 tx=0x7f5fac00dc00 comp rx=0 tx=0).stop 2024-09-11T23:28:31.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.369+0000 7f5fbe24e640 1 -- 172.21.15.5:0/2795498943 shutdown_connections 2024-09-11T23:28:31.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.369+0000 7f5fbe24e640 1 --2- 172.21.15.5:0/2795498943 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f5fa00a2c10 0x7f5fa00a50d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:31.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.369+0000 7f5fbe24e640 1 --2- 172.21.15.5:0/2795498943 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fb8108300 0x7f5fb819cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:31.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.369+0000 7f5fbe24e640 1 --2- 172.21.15.5:0/2795498943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fb8103780 0x7f5fb8198a50 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:31.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.369+0000 7f5fbe24e640 1 --2- 172.21.15.5:0/2795498943 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fb8102dd0 0x7f5fb8198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:31.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.369+0000 7f5fbe24e640 1 -- 172.21.15.5:0/2795498943 >> 172.21.15.5:0/2795498943 conn(0x7f5fb80fc7d0 msgr2=0x7f5fb8105ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:31.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.369+0000 7f5fbe24e640 1 -- 172.21.15.5:0/2795498943 shutdown_connections 2024-09-11T23:28:31.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:31.369+0000 7f5fbe24e640 1 -- 172.21.15.5:0/2795498943 wait complete. 2024-09-11T23:28:31.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:31 smithi159 ceph-mon[34394]: pgmap v338: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T23:28:31.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:31 smithi172 ceph-mon[34855]: pgmap v338: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T23:28:31.670 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:31 smithi005 ceph-mon[31201]: pgmap v338: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T23:28:32.173 INFO:tasks.cephadm:Setup complete, yielding 2024-09-11T23:28:32.173 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-11T23:28:32.183 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi005.front.sepia.ceph.com 2024-09-11T23:28:32.183 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- bash -c 'ceph orch status' 2024-09-11T23:28:32.447 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:28:32.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:32.908+0000 7f4a926a6640 1 -- 172.21.15.5:0/54696965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a8c101d10 msgr2=0x7f4a8c102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:32.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:32.908+0000 7f4a926a6640 1 --2- 172.21.15.5:0/54696965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a8c101d10 0x7f4a8c102190 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f4a74009900 tx=0x7f4a7402a410 comp rx=0 tx=0).stop 2024-09-11T23:28:32.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:32.909+0000 7f4a926a6640 1 -- 172.21.15.5:0/54696965 shutdown_connections 2024-09-11T23:28:32.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:32.909+0000 7f4a926a6640 1 --2- 172.21.15.5:0/54696965 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a8c1026d0 0x7f4a8c108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:32.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:32.909+0000 7f4a926a6640 1 --2- 172.21.15.5:0/54696965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a8c101d10 0x7f4a8c102190 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:32.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:32.909+0000 7f4a926a6640 1 --2- 172.21.15.5:0/54696965 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a8c100b10 0x7f4a8c100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:32.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:32.909+0000 7f4a926a6640 1 -- 172.21.15.5:0/54696965 >> 172.21.15.5:0/54696965 conn(0x7f4a8c0fc2a0 msgr2=0x7f4a8c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:32.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:32.909+0000 7f4a926a6640 1 -- 172.21.15.5:0/54696965 shutdown_connections 2024-09-11T23:28:32.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:32.909+0000 7f4a926a6640 1 -- 172.21.15.5:0/54696965 wait complete. 2024-09-11T23:28:32.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:32.909+0000 7f4a926a6640 1 Processor -- start 2024-09-11T23:28:32.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:32.909+0000 7f4a926a6640 1 -- start start 2024-09-11T23:28:32.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:32.909+0000 7f4a926a6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a8c100b10 0x7f4a8c197d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:32.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:32.909+0000 7f4a926a6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a8c101d10 0x7f4a8c1982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:32.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:32.909+0000 7f4a926a6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a8c1026d0 0x7f4a8c19f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:32.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:32.910+0000 7f4a926a6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4a8c10c620 con 0x7f4a8c100b10 2024-09-11T23:28:32.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:32.910+0000 7f4a926a6640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f4a8c10c4a0 con 0x7f4a8c101d10 2024-09-11T23:28:32.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:32.910+0000 7f4a926a6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4a8c10c7a0 con 0x7f4a8c1026d0 2024-09-11T23:28:32.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:32.910+0000 7f4a8bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a8c100b10 0x7f4a8c197d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:32.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:32.910+0000 7f4a8bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a8c100b10 0x7f4a8c197d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37650/0 (socket says 172.21.15.5:37650) 2024-09-11T23:28:32.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:32.910+0000 7f4a8bfff640 1 -- 172.21.15.5:0/2279484232 learned_addr learned my addr 172.21.15.5:0/2279484232 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:32.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:32.910+0000 7f4a90c43640 1 --2- 172.21.15.5:0/2279484232 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a8c1026d0 0x7f4a8c19f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:32.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:32.910+0000 7f4a83fff640 1 --2- 172.21.15.5:0/2279484232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a8c101d10 0x7f4a8c1982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:32.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:32.910+0000 7f4a8bfff640 1 -- 172.21.15.5:0/2279484232 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a8c1026d0 msgr2=0x7f4a8c19f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:32.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:32.910+0000 7f4a8bfff640 1 --2- 172.21.15.5:0/2279484232 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a8c1026d0 0x7f4a8c19f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:32.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:32.910+0000 7f4a8bfff640 1 -- 172.21.15.5:0/2279484232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a8c101d10 msgr2=0x7f4a8c1982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:32.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:32.910+0000 7f4a8bfff640 1 --2- 172.21.15.5:0/2279484232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a8c101d10 0x7f4a8c1982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:32.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:32.910+0000 7f4a8bfff640 1 -- 172.21.15.5:0/2279484232 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a8c19f9b0 con 0x7f4a8c100b10 2024-09-11T23:28:32.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:32.910+0000 7f4a8bfff640 1 --2- 172.21.15.5:0/2279484232 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a8c100b10 0x7f4a8c197d90 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c00c970 tx=0x7f4a7c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:32.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:32.910+0000 7f4a89ffb640 1 -- 172.21.15.5:0/2279484232 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7c007c10 con 0x7f4a8c100b10 2024-09-11T23:28:32.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:32.910+0000 7f4a89ffb640 1 -- 172.21.15.5:0/2279484232 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4a7c007db0 con 0x7f4a8c100b10 2024-09-11T23:28:32.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:32.910+0000 7f4a926a6640 1 -- 172.21.15.5:0/2279484232 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a8c19fca0 con 0x7f4a8c100b10 2024-09-11T23:28:32.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:32.910+0000 7f4a89ffb640 1 -- 172.21.15.5:0/2279484232 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7c00f870 con 0x7f4a8c100b10 2024-09-11T23:28:32.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:32.910+0000 7f4a926a6640 1 -- 172.21.15.5:0/2279484232 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a8c1a0190 con 0x7f4a8c100b10 2024-09-11T23:28:32.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:32.911+0000 7f4a926a6640 1 -- 172.21.15.5:0/2279484232 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a8c1a03c0 con 0x7f4a8c100b10 2024-09-11T23:28:32.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:32.913+0000 7f4a89ffb640 1 -- 172.21.15.5:0/2279484232 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f4a7c00fa10 con 0x7f4a8c100b10 2024-09-11T23:28:32.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:32.914+0000 7f4a89ffb640 1 --2- 172.21.15.5:0/2279484232 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f4a780a2c10 0x7f4a780a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:32.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:32.914+0000 7f4a83fff640 1 --2- 172.21.15.5:0/2279484232 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f4a780a2c10 0x7f4a780a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:32.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:32.914+0000 7f4a89ffb640 1 -- 172.21.15.5:0/2279484232 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7f4a7c0cfc20 con 0x7f4a8c100b10 2024-09-11T23:28:32.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:32.915+0000 7f4a83fff640 1 --2- 172.21.15.5:0/2279484232 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f4a780a2c10 0x7f4a780a50d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4a74000c00 tx=0x7f4a740314a0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:32.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:32.917+0000 7f4a89ffb640 1 -- 172.21.15.5:0/2279484232 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4a7c09c720 con 0x7f4a8c100b10 2024-09-11T23:28:33.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:33.109+0000 7f4a926a6640 1 -- 172.21.15.5:0/2279484232 --> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f4a8c1a0590 con 0x7f4a780a2c10 2024-09-11T23:28:33.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:33.110+0000 7f4a89ffb640 1 -- 172.21.15.5:0/2279484232 <== mgr.14148 v2:172.21.15.5:6800/2285128668 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f4a8c1a0590 con 0x7f4a780a2c10 2024-09-11T23:28:33.111 INFO:teuthology.orchestra.run.smithi005.stdout:Backend: cephadm 2024-09-11T23:28:33.111 INFO:teuthology.orchestra.run.smithi005.stdout:Available: Yes 2024-09-11T23:28:33.111 INFO:teuthology.orchestra.run.smithi005.stdout:Paused: No 2024-09-11T23:28:33.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:33.112+0000 7f4a926a6640 1 -- 172.21.15.5:0/2279484232 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f4a780a2c10 msgr2=0x7f4a780a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:33.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:33.112+0000 7f4a926a6640 1 --2- 172.21.15.5:0/2279484232 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f4a780a2c10 0x7f4a780a50d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4a74000c00 tx=0x7f4a740314a0 comp rx=0 tx=0).stop 2024-09-11T23:28:33.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:33.112+0000 7f4a926a6640 1 -- 172.21.15.5:0/2279484232 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a8c100b10 msgr2=0x7f4a8c197d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:33.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:33.112+0000 7f4a926a6640 1 --2- 172.21.15.5:0/2279484232 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a8c100b10 0x7f4a8c197d90 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c00c970 tx=0x7f4a7c00ce30 comp rx=0 tx=0).stop 2024-09-11T23:28:33.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:33.112+0000 7f4a926a6640 1 -- 172.21.15.5:0/2279484232 shutdown_connections 2024-09-11T23:28:33.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:33.112+0000 7f4a926a6640 1 --2- 172.21.15.5:0/2279484232 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f4a780a2c10 0x7f4a780a50d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:33.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:33.112+0000 7f4a926a6640 1 --2- 172.21.15.5:0/2279484232 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a8c1026d0 0x7f4a8c19f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:33.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:33.112+0000 7f4a926a6640 1 --2- 172.21.15.5:0/2279484232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a8c101d10 0x7f4a8c1982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:33.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:33.112+0000 7f4a926a6640 1 --2- 172.21.15.5:0/2279484232 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a8c100b10 0x7f4a8c197d90 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:33.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:33.112+0000 7f4a926a6640 1 -- 172.21.15.5:0/2279484232 >> 172.21.15.5:0/2279484232 conn(0x7f4a8c0fc2a0 msgr2=0x7f4a8c0fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:33.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:33.112+0000 7f4a926a6640 1 -- 172.21.15.5:0/2279484232 shutdown_connections 2024-09-11T23:28:33.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:33.112+0000 7f4a926a6640 1 -- 172.21.15.5:0/2279484232 wait complete. 2024-09-11T23:28:33.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:33 smithi005 ceph-mon[31201]: pgmap v339: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T23:28:33.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:33 smithi159 ceph-mon[34394]: pgmap v339: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T23:28:33.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:33 smithi172 ceph-mon[34855]: pgmap v339: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T23:28:33.940 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-11T23:28:34.201 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:28:34.535 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:34 smithi172 ceph-mon[34855]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:28:34.594 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:34 smithi005 ceph-mon[31201]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:28:34.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:34 smithi159 ceph-mon[34394]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:28:34.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.678+0000 7fa93f59e640 1 -- 172.21.15.5:0/793821567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa940102510 msgr2=0x7fa940108da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:34.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.678+0000 7fa93f59e640 1 --2- 172.21.15.5:0/793821567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa940102510 0x7fa940108da0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa938009ca0 tx=0x7fa93802a8c0 comp rx=0 tx=0).stop 2024-09-11T23:28:34.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.678+0000 7fa93f59e640 1 -- 172.21.15.5:0/793821567 shutdown_connections 2024-09-11T23:28:34.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.678+0000 7fa93f59e640 1 --2- 172.21.15.5:0/793821567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa940102510 0x7fa940108da0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:34.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.678+0000 7fa93f59e640 1 --2- 172.21.15.5:0/793821567 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa940101b50 0x7fa940101fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:34.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.678+0000 7fa93f59e640 1 --2- 172.21.15.5:0/793821567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa940100950 0x7fa940100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:34.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.678+0000 7fa93f59e640 1 -- 172.21.15.5:0/793821567 >> 172.21.15.5:0/793821567 conn(0x7fa9400fc0e0 msgr2=0x7fa9400fe520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:34.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.678+0000 7fa93f59e640 1 -- 172.21.15.5:0/793821567 shutdown_connections 2024-09-11T23:28:34.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.678+0000 7fa93f59e640 1 -- 172.21.15.5:0/793821567 wait complete. 2024-09-11T23:28:34.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.678+0000 7fa93f59e640 1 Processor -- start 2024-09-11T23:28:34.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.678+0000 7fa93f59e640 1 -- start start 2024-09-11T23:28:34.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.679+0000 7fa93f59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa940100950 0x7fa940199f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:34.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.679+0000 7fa93f59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa940101b50 0x7fa94019a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:34.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.679+0000 7fa93f59e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa940102510 0x7fa9401a1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:34.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.679+0000 7fa93f59e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa94010c500 con 0x7fa940101b50 2024-09-11T23:28:34.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.679+0000 7fa93f59e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa94010c380 con 0x7fa940100950 2024-09-11T23:28:34.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.679+0000 7fa93f59e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa94010c680 con 0x7fa940102510 2024-09-11T23:28:34.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.679+0000 7fa93dd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa940101b50 0x7fa94019a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:34.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.679+0000 7fa93dd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa940101b50 0x7fa94019a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43022/0 (socket says 172.21.15.5:43022) 2024-09-11T23:28:34.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.679+0000 7fa93dd9b640 1 -- 172.21.15.5:0/2834520894 learned_addr learned my addr 172.21.15.5:0/2834520894 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:34.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.679+0000 7fa93ed9d640 1 --2- 172.21.15.5:0/2834520894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa940102510 0x7fa9401a1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:34.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.679+0000 7fa93e59c640 1 --2- 172.21.15.5:0/2834520894 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa940100950 0x7fa940199f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:34.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.679+0000 7fa93dd9b640 1 -- 172.21.15.5:0/2834520894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa940102510 msgr2=0x7fa9401a1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:34.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.679+0000 7fa93dd9b640 1 --2- 172.21.15.5:0/2834520894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa940102510 0x7fa9401a1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:34.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.679+0000 7fa93dd9b640 1 -- 172.21.15.5:0/2834520894 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa940100950 msgr2=0x7fa940199f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:34.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.679+0000 7fa93dd9b640 1 --2- 172.21.15.5:0/2834520894 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa940100950 0x7fa940199f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:34.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.679+0000 7fa93dd9b640 1 -- 172.21.15.5:0/2834520894 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9401a1b70 con 0x7fa940101b50 2024-09-11T23:28:34.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.679+0000 7fa93dd9b640 1 --2- 172.21.15.5:0/2834520894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa940101b50 0x7fa94019a480 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa93400b4a0 tx=0x7fa93400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:34.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.680+0000 7fa92f7fe640 1 -- 172.21.15.5:0/2834520894 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa934014070 con 0x7fa940101b50 2024-09-11T23:28:34.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.680+0000 7fa92f7fe640 1 -- 172.21.15.5:0/2834520894 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa934010ac0 con 0x7fa940101b50 2024-09-11T23:28:34.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.680+0000 7fa92f7fe640 1 -- 172.21.15.5:0/2834520894 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa934017c30 con 0x7fa940101b50 2024-09-11T23:28:34.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.680+0000 7fa93f59e640 1 -- 172.21.15.5:0/2834520894 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9401a1e60 con 0x7fa940101b50 2024-09-11T23:28:34.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.680+0000 7fa93f59e640 1 -- 172.21.15.5:0/2834520894 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9401a2310 con 0x7fa940101b50 2024-09-11T23:28:34.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.681+0000 7fa93f59e640 1 -- 172.21.15.5:0/2834520894 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9401a25a0 con 0x7fa940101b50 2024-09-11T23:28:34.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.682+0000 7fa92f7fe640 1 -- 172.21.15.5:0/2834520894 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fa934017070 con 0x7fa940101b50 2024-09-11T23:28:34.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.683+0000 7fa92f7fe640 1 --2- 172.21.15.5:0/2834520894 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fa9280a2c40 0x7fa9280a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:34.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.683+0000 7fa92f7fe640 1 -- 172.21.15.5:0/2834520894 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7fa9340ceac0 con 0x7fa940101b50 2024-09-11T23:28:34.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.683+0000 7fa93e59c640 1 --2- 172.21.15.5:0/2834520894 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fa9280a2c40 0x7fa9280a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:34.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.683+0000 7fa93e59c640 1 --2- 172.21.15.5:0/2834520894 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fa9280a2c40 0x7fa9280a5100 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa930005fd0 tx=0x7fa93000b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:34.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.686+0000 7fa92f7fe640 1 -- 172.21.15.5:0/2834520894 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa93409afc0 con 0x7fa940101b50 2024-09-11T23:28:34.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.869+0000 7fa93f59e640 1 -- 172.21.15.5:0/2834520894 --> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fa9401a2770 con 0x7fa9280a2c40 2024-09-11T23:28:34.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.883+0000 7fa92f7fe640 1 -- 172.21.15.5:0/2834520894 <== mgr.14148 v2:172.21.15.5:6800/2285128668 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4061 (secure 0 0 0) 0x7fa9401a2770 con 0x7fa9280a2c40 2024-09-11T23:28:34.884 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-11T23:28:34.884 INFO:teuthology.orchestra.run.smithi005.stdout:mds.a smithi005 running (2m) 50s ago 2m 16.5M - 19.1.1-298-gb53b6d3e 54467abc55f8 24640fa9d37a 2024-09-11T23:28:34.884 INFO:teuthology.orchestra.run.smithi005.stdout:mds.b smithi159 running (2m) 52s ago 2m 26.7M - 19.1.1-298-gb53b6d3e 54467abc55f8 f6b2c4ebdb71 2024-09-11T23:28:34.884 INFO:teuthology.orchestra.run.smithi005.stdout:mds.c smithi172 running (2m) 52s ago 2m 16.8M - 19.1.1-298-gb53b6d3e 54467abc55f8 a3587b6467da 2024-09-11T23:28:34.884 INFO:teuthology.orchestra.run.smithi005.stdout:mds.d smithi005 running (2m) 50s ago 2m 13.7M - 19.1.1-298-gb53b6d3e 54467abc55f8 3a21c7a513f6 2024-09-11T23:28:34.884 INFO:teuthology.orchestra.run.smithi005.stdout:mds.e smithi159 running (2m) 52s ago 2m 15.8M - 19.1.1-298-gb53b6d3e 54467abc55f8 3fa760af338f 2024-09-11T23:28:34.884 INFO:teuthology.orchestra.run.smithi005.stdout:mds.f smithi172 running (2m) 52s ago 2m 18.1M - 19.1.1-298-gb53b6d3e 54467abc55f8 efbbb98c4e73 2024-09-11T23:28:34.884 INFO:teuthology.orchestra.run.smithi005.stdout:mds.g smithi005 running (2m) 50s ago 2m 15.8M - 19.1.1-298-gb53b6d3e 54467abc55f8 48c20a1f9383 2024-09-11T23:28:34.884 INFO:teuthology.orchestra.run.smithi005.stdout:mds.h smithi159 running (2m) 52s ago 2m 17.0M - 19.1.1-298-gb53b6d3e 54467abc55f8 3aa3463c5375 2024-09-11T23:28:34.884 INFO:teuthology.orchestra.run.smithi005.stdout:mds.i smithi172 running (2m) 52s ago 2m 17.4M - 19.1.1-298-gb53b6d3e 54467abc55f8 2f4e129ca679 2024-09-11T23:28:34.884 INFO:teuthology.orchestra.run.smithi005.stdout:mds.j smithi005 running (2m) 50s ago 2m 16.7M - 19.1.1-298-gb53b6d3e 54467abc55f8 6fd8b844226b 2024-09-11T23:28:34.884 INFO:teuthology.orchestra.run.smithi005.stdout:mds.k smithi159 running (2m) 52s ago 2m 14.5M - 19.1.1-298-gb53b6d3e 54467abc55f8 75a850307749 2024-09-11T23:28:34.885 INFO:teuthology.orchestra.run.smithi005.stdout:mds.l smithi172 running (2m) 52s ago 2m 16.6M - 19.1.1-298-gb53b6d3e 54467abc55f8 568f52ec07f3 2024-09-11T23:28:34.885 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.x smithi005 *:9283,8765 running (9m) 50s ago 9m 509M - 19.1.1-298-gb53b6d3e 54467abc55f8 f1f3982d8ecf 2024-09-11T23:28:34.885 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.y smithi159 *:8443,8765 running (7m) 52s ago 7m 442M - 19.1.1-298-gb53b6d3e 54467abc55f8 cdfc321bcc95 2024-09-11T23:28:34.885 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.z smithi172 *:8443,8765 running (7m) 52s ago 7m 444M - 19.1.1-298-gb53b6d3e 54467abc55f8 6d4592a099c9 2024-09-11T23:28:34.885 INFO:teuthology.orchestra.run.smithi005.stdout:mon.a smithi005 running (9m) 50s ago 9m 50.0M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 f8f83307d57d 2024-09-11T23:28:34.885 INFO:teuthology.orchestra.run.smithi005.stdout:mon.b smithi159 running (8m) 52s ago 8m 39.7M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 2ee6c08b90d3 2024-09-11T23:28:34.885 INFO:teuthology.orchestra.run.smithi005.stdout:mon.c smithi172 running (8m) 52s ago 8m 40.1M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 ed4a3eb32157 2024-09-11T23:28:34.885 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (7m) 50s ago 7m 46.1M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 8ff4210548e9 2024-09-11T23:28:34.885 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi159 running (7m) 52s ago 7m 47.2M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 99c9ffbd3395 2024-09-11T23:28:34.885 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi172 running (6m) 52s ago 6m 47.9M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 d659cb011028 2024-09-11T23:28:34.885 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi005 running (6m) 50s ago 6m 56.7M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 ebb09251c091 2024-09-11T23:28:34.885 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi159 running (5m) 52s ago 5m 45.5M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 f04068ec645d 2024-09-11T23:28:34.885 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi172 running (5m) 52s ago 5m 45.2M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 5fa46bde900e 2024-09-11T23:28:34.885 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6 smithi005 running (4m) 50s ago 4m 55.7M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 92219e28af49 2024-09-11T23:28:34.886 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7 smithi159 running (4m) 52s ago 4m 55.6M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 18de8a52d56c 2024-09-11T23:28:34.886 INFO:teuthology.orchestra.run.smithi005.stdout:osd.8 smithi172 running (4m) 52s ago 4m 42.1M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 cd2e4639a2b0 2024-09-11T23:28:34.886 INFO:teuthology.orchestra.run.smithi005.stdout:osd.9 smithi005 running (3m) 50s ago 3m 53.3M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 27e4dfe9e9a5 2024-09-11T23:28:34.886 INFO:teuthology.orchestra.run.smithi005.stdout:osd.10 smithi159 running (3m) 52s ago 3m 45.5M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 74623e2a7977 2024-09-11T23:28:34.886 INFO:teuthology.orchestra.run.smithi005.stdout:osd.11 smithi172 running (2m) 52s ago 2m 53.8M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 e9df7bd98fce 2024-09-11T23:28:34.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.885+0000 7fa93f59e640 1 -- 172.21.15.5:0/2834520894 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fa9280a2c40 msgr2=0x7fa9280a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:34.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.885+0000 7fa93f59e640 1 --2- 172.21.15.5:0/2834520894 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fa9280a2c40 0x7fa9280a5100 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa930005fd0 tx=0x7fa93000b390 comp rx=0 tx=0).stop 2024-09-11T23:28:34.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.885+0000 7fa93f59e640 1 -- 172.21.15.5:0/2834520894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa940101b50 msgr2=0x7fa94019a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:34.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.885+0000 7fa93f59e640 1 --2- 172.21.15.5:0/2834520894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa940101b50 0x7fa94019a480 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa93400b4a0 tx=0x7fa93400b960 comp rx=0 tx=0).stop 2024-09-11T23:28:34.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.885+0000 7fa93f59e640 1 -- 172.21.15.5:0/2834520894 shutdown_connections 2024-09-11T23:28:34.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.885+0000 7fa93f59e640 1 --2- 172.21.15.5:0/2834520894 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fa9280a2c40 0x7fa9280a5100 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:34.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.885+0000 7fa93f59e640 1 --2- 172.21.15.5:0/2834520894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa940102510 0x7fa9401a1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:34.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.885+0000 7fa93f59e640 1 --2- 172.21.15.5:0/2834520894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa940101b50 0x7fa94019a480 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:34.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.885+0000 7fa93f59e640 1 --2- 172.21.15.5:0/2834520894 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa940100950 0x7fa940199f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:34.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.885+0000 7fa93f59e640 1 -- 172.21.15.5:0/2834520894 >> 172.21.15.5:0/2834520894 conn(0x7fa9400fc0e0 msgr2=0x7fa94006a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:34.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.885+0000 7fa93f59e640 1 -- 172.21.15.5:0/2834520894 shutdown_connections 2024-09-11T23:28:34.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:34.885+0000 7fa93f59e640 1 -- 172.21.15.5:0/2834520894 wait complete. 2024-09-11T23:28:35.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:35 smithi159 ceph-mon[34394]: pgmap v340: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T23:28:35.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:35 smithi159 ceph-mon[34394]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:28:35.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:35 smithi172 ceph-mon[34855]: pgmap v340: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T23:28:35.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:35 smithi172 ceph-mon[34855]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:28:35.658 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:35 smithi005 ceph-mon[31201]: pgmap v340: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T23:28:35.699 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:35 smithi005 ceph-mon[31201]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:28:35.701 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-11T23:28:35.967 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:28:36.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.385+0000 7fa876d46640 1 -- 172.21.15.5:0/3511431089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa870100280 msgr2=0x7fa8701073f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:36.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.385+0000 7fa876d46640 1 --2- 172.21.15.5:0/3511431089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa870100280 0x7fa8701073f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa85c009900 tx=0x7fa85c02a410 comp rx=0 tx=0).stop 2024-09-11T23:28:36.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.385+0000 7fa876d46640 1 -- 172.21.15.5:0/3511431089 shutdown_connections 2024-09-11T23:28:36.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.385+0000 7fa876d46640 1 --2- 172.21.15.5:0/3511431089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa870107930 0x7fa870109d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:36.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.385+0000 7fa876d46640 1 --2- 172.21.15.5:0/3511431089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa870100280 0x7fa8701073f0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:36.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.385+0000 7fa876d46640 1 --2- 172.21.15.5:0/3511431089 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8700ff8b0 0x7fa8700ffcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:36.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.385+0000 7fa876d46640 1 -- 172.21.15.5:0/3511431089 >> 172.21.15.5:0/3511431089 conn(0x7fa8700fb610 msgr2=0x7fa8700fda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:36.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.385+0000 7fa876d46640 1 -- 172.21.15.5:0/3511431089 shutdown_connections 2024-09-11T23:28:36.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.385+0000 7fa876d46640 1 -- 172.21.15.5:0/3511431089 wait complete. 2024-09-11T23:28:36.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.386+0000 7fa876d46640 1 Processor -- start 2024-09-11T23:28:36.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.386+0000 7fa876d46640 1 -- start start 2024-09-11T23:28:36.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.386+0000 7fa876d46640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8700ff8b0 0x7fa87019a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:36.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.386+0000 7fa876d46640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa870100280 0x7fa87019a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:36.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.386+0000 7fa876d46640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa870107930 0x7fa8701a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:36.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.386+0000 7fa876d46640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa87010d6f0 con 0x7fa8700ff8b0 2024-09-11T23:28:36.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.386+0000 7fa876d46640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa87010d570 con 0x7fa870107930 2024-09-11T23:28:36.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.386+0000 7fa876d46640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa87010d870 con 0x7fa870100280 2024-09-11T23:28:36.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.386+0000 7fa874ae2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8700ff8b0 0x7fa87019a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:36.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.386+0000 7fa874ae2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8700ff8b0 0x7fa87019a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43040/0 (socket says 172.21.15.5:43040) 2024-09-11T23:28:36.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.386+0000 7fa874ae2640 1 -- 172.21.15.5:0/2979841896 learned_addr learned my addr 172.21.15.5:0/2979841896 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:36.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.386+0000 7fa86ffff640 1 --2- 172.21.15.5:0/2979841896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa870100280 0x7fa87019a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:36.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.387+0000 7fa8752e3640 1 --2- 172.21.15.5:0/2979841896 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa870107930 0x7fa8701a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:36.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.387+0000 7fa874ae2640 1 -- 172.21.15.5:0/2979841896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa870100280 msgr2=0x7fa87019a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:36.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.387+0000 7fa874ae2640 1 --2- 172.21.15.5:0/2979841896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa870100280 0x7fa87019a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:36.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.387+0000 7fa874ae2640 1 -- 172.21.15.5:0/2979841896 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa870107930 msgr2=0x7fa8701a15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:36.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.387+0000 7fa874ae2640 1 --2- 172.21.15.5:0/2979841896 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa870107930 0x7fa8701a15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:36.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.387+0000 7fa874ae2640 1 -- 172.21.15.5:0/2979841896 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8701a1c60 con 0x7fa8700ff8b0 2024-09-11T23:28:36.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.387+0000 7fa8752e3640 1 --2- 172.21.15.5:0/2979841896 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa870107930 0x7fa8701a15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:28:36.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.387+0000 7fa874ae2640 1 --2- 172.21.15.5:0/2979841896 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8700ff8b0 0x7fa87019a030 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa86400c890 tx=0x7fa86400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:36.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.387+0000 7fa86dffb640 1 -- 172.21.15.5:0/2979841896 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa864004220 con 0x7fa8700ff8b0 2024-09-11T23:28:36.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.387+0000 7fa876d46640 1 -- 172.21.15.5:0/2979841896 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8701a1f50 con 0x7fa8700ff8b0 2024-09-11T23:28:36.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.387+0000 7fa86dffb640 1 -- 172.21.15.5:0/2979841896 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa8640043c0 con 0x7fa8700ff8b0 2024-09-11T23:28:36.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.387+0000 7fa86dffb640 1 -- 172.21.15.5:0/2979841896 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa864004a00 con 0x7fa8700ff8b0 2024-09-11T23:28:36.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.387+0000 7fa876d46640 1 -- 172.21.15.5:0/2979841896 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8701a23b0 con 0x7fa8700ff8b0 2024-09-11T23:28:36.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.388+0000 7fa876d46640 1 -- 172.21.15.5:0/2979841896 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8701a2640 con 0x7fa8700ff8b0 2024-09-11T23:28:36.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.390+0000 7fa86dffb640 1 -- 172.21.15.5:0/2979841896 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fa864004ba0 con 0x7fa8700ff8b0 2024-09-11T23:28:36.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.390+0000 7fa86dffb640 1 --2- 172.21.15.5:0/2979841896 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fa8600a2c40 0x7fa8600a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:36.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.390+0000 7fa86ffff640 1 --2- 172.21.15.5:0/2979841896 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fa8600a2c40 0x7fa8600a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:36.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.390+0000 7fa86dffb640 1 -- 172.21.15.5:0/2979841896 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7fa8640cf1f0 con 0x7fa8700ff8b0 2024-09-11T23:28:36.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.391+0000 7fa86ffff640 1 --2- 172.21.15.5:0/2979841896 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fa8600a2c40 0x7fa8600a5100 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa85c006010 tx=0x7fa85c000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:36.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.395+0000 7fa86dffb640 1 -- 172.21.15.5:0/2979841896 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa864014030 con 0x7fa8700ff8b0 2024-09-11T23:28:36.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.577+0000 7fa876d46640 1 -- 172.21.15.5:0/2979841896 --> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fa8701a2810 con 0x7fa8600a2c40 2024-09-11T23:28:36.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.583+0000 7fa86dffb640 1 -- 172.21.15.5:0/2979841896 <== mgr.14148 v2:172.21.15.5:6800/2285128668 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7fa8701a2810 con 0x7fa8600a2c40 2024-09-11T23:28:36.584 INFO:teuthology.orchestra.run.smithi005.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-11T23:28:36.584 INFO:teuthology.orchestra.run.smithi005.stdout:mds.all 12/12 54s ago 2m smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi159=b;smithi159=e;smithi159=h;smithi159=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l;count:12 2024-09-11T23:28:36.584 INFO:teuthology.orchestra.run.smithi005.stdout:mgr 3/3 54s ago 7m smithi005=x;smithi159=y;smithi172=z;count:3 2024-09-11T23:28:36.584 INFO:teuthology.orchestra.run.smithi005.stdout:mon 3/3 54s ago 8m smithi005:172.21.15.5=a;smithi159:172.21.15.159=b;smithi172:172.21.15.172=c;count:3 2024-09-11T23:28:36.584 INFO:teuthology.orchestra.run.smithi005.stdout:osd 12 54s ago - 2024-09-11T23:28:36.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.585+0000 7fa876d46640 1 -- 172.21.15.5:0/2979841896 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fa8600a2c40 msgr2=0x7fa8600a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:36.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.585+0000 7fa876d46640 1 --2- 172.21.15.5:0/2979841896 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fa8600a2c40 0x7fa8600a5100 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa85c006010 tx=0x7fa85c000bc0 comp rx=0 tx=0).stop 2024-09-11T23:28:36.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.585+0000 7fa876d46640 1 -- 172.21.15.5:0/2979841896 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8700ff8b0 msgr2=0x7fa87019a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:36.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.585+0000 7fa876d46640 1 --2- 172.21.15.5:0/2979841896 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8700ff8b0 0x7fa87019a030 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa86400c890 tx=0x7fa86400cd50 comp rx=0 tx=0).stop 2024-09-11T23:28:36.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.585+0000 7fa876d46640 1 -- 172.21.15.5:0/2979841896 shutdown_connections 2024-09-11T23:28:36.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.585+0000 7fa876d46640 1 --2- 172.21.15.5:0/2979841896 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fa8600a2c40 0x7fa8600a5100 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:36.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.585+0000 7fa876d46640 1 --2- 172.21.15.5:0/2979841896 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa870107930 0x7fa8701a15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:36.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.585+0000 7fa876d46640 1 --2- 172.21.15.5:0/2979841896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa870100280 0x7fa87019a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:36.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.585+0000 7fa876d46640 1 --2- 172.21.15.5:0/2979841896 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8700ff8b0 0x7fa87019a030 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:36.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.585+0000 7fa876d46640 1 -- 172.21.15.5:0/2979841896 >> 172.21.15.5:0/2979841896 conn(0x7fa8700fb610 msgr2=0x7fa8700fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:36.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.586+0000 7fa876d46640 1 -- 172.21.15.5:0/2979841896 shutdown_connections 2024-09-11T23:28:36.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:36.586+0000 7fa876d46640 1 -- 172.21.15.5:0/2979841896 wait complete. 2024-09-11T23:28:37.397 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-11T23:28:37.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:37 smithi159 ceph-mon[34394]: pgmap v341: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T23:28:37.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:37 smithi159 ceph-mon[34394]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:28:37.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:37 smithi172 ceph-mon[34855]: pgmap v341: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T23:28:37.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:37 smithi172 ceph-mon[34855]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:28:37.654 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:28:37.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:37 smithi005 ceph-mon[31201]: pgmap v341: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T23:28:37.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:37 smithi005 ceph-mon[31201]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:28:38.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.129+0000 7f5e7162c640 1 -- 172.21.15.5:0/812021486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e6c107920 msgr2=0x7f5e6c109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:38.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.130+0000 7f5e7162c640 1 --2- 172.21.15.5:0/812021486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e6c107920 0x7f5e6c109d10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5e64009900 tx=0x7f5e6402a410 comp rx=0 tx=0).stop 2024-09-11T23:28:38.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.130+0000 7f5e7162c640 1 -- 172.21.15.5:0/812021486 shutdown_connections 2024-09-11T23:28:38.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.130+0000 7f5e7162c640 1 --2- 172.21.15.5:0/812021486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e6c107920 0x7f5e6c109d10 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:38.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.130+0000 7f5e7162c640 1 --2- 172.21.15.5:0/812021486 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e6c104ff0 0x7f5e6c1073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:38.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.130+0000 7f5e7162c640 1 --2- 172.21.15.5:0/812021486 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e6c1026c0 0x7f5e6c104ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:38.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.130+0000 7f5e7162c640 1 -- 172.21.15.5:0/812021486 >> 172.21.15.5:0/812021486 conn(0x7f5e6c0fc280 msgr2=0x7f5e6c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:38.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.130+0000 7f5e7162c640 1 -- 172.21.15.5:0/812021486 shutdown_connections 2024-09-11T23:28:38.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.130+0000 7f5e7162c640 1 -- 172.21.15.5:0/812021486 wait complete. 2024-09-11T23:28:38.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.130+0000 7f5e7162c640 1 Processor -- start 2024-09-11T23:28:38.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.130+0000 7f5e7162c640 1 -- start start 2024-09-11T23:28:38.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.131+0000 7f5e7162c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e6c1026c0 0x7f5e6c197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:38.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.131+0000 7f5e7162c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e6c104ff0 0x7f5e6c1982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:38.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.131+0000 7f5e7162c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e6c107920 0x7f5e6c19f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:38.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.131+0000 7f5e7162c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5e6c10d710 con 0x7f5e6c104ff0 2024-09-11T23:28:38.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.131+0000 7f5e7162c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5e6c10d590 con 0x7f5e6c107920 2024-09-11T23:28:38.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.131+0000 7f5e7162c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5e6c10d890 con 0x7f5e6c1026c0 2024-09-11T23:28:38.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.131+0000 7f5e6a7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e6c104ff0 0x7f5e6c1982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:38.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.131+0000 7f5e6a7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e6c104ff0 0x7f5e6c1982a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43060/0 (socket says 172.21.15.5:43060) 2024-09-11T23:28:38.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.131+0000 7f5e6a7fc640 1 -- 172.21.15.5:0/3823150223 learned_addr learned my addr 172.21.15.5:0/3823150223 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:38.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.131+0000 7f5e6affd640 1 --2- 172.21.15.5:0/3823150223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e6c1026c0 0x7f5e6c197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:38.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.131+0000 7f5e6b7fe640 1 --2- 172.21.15.5:0/3823150223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e6c107920 0x7f5e6c19f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:38.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.131+0000 7f5e6a7fc640 1 -- 172.21.15.5:0/3823150223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e6c1026c0 msgr2=0x7f5e6c197d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:38.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.131+0000 7f5e6a7fc640 1 --2- 172.21.15.5:0/3823150223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e6c1026c0 0x7f5e6c197d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:38.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.131+0000 7f5e6a7fc640 1 -- 172.21.15.5:0/3823150223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e6c107920 msgr2=0x7f5e6c19f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:38.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.131+0000 7f5e6a7fc640 1 --2- 172.21.15.5:0/3823150223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e6c107920 0x7f5e6c19f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:38.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.131+0000 7f5e6a7fc640 1 -- 172.21.15.5:0/3823150223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e6c19f990 con 0x7f5e6c104ff0 2024-09-11T23:28:38.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.131+0000 7f5e6b7fe640 1 --2- 172.21.15.5:0/3823150223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e6c107920 0x7f5e6c19f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:28:38.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.131+0000 7f5e6a7fc640 1 --2- 172.21.15.5:0/3823150223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e6c104ff0 0x7f5e6c1982a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5e6000ccb0 tx=0x7f5e6000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:38.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.131+0000 7f5e53fff640 1 -- 172.21.15.5:0/3823150223 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e6000ce60 con 0x7f5e6c104ff0 2024-09-11T23:28:38.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.131+0000 7f5e53fff640 1 -- 172.21.15.5:0/3823150223 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5e6000fb00 con 0x7f5e6c104ff0 2024-09-11T23:28:38.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.131+0000 7f5e7162c640 1 -- 172.21.15.5:0/3823150223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e6c19fc80 con 0x7f5e6c104ff0 2024-09-11T23:28:38.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.131+0000 7f5e53fff640 1 -- 172.21.15.5:0/3823150223 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e60018bb0 con 0x7f5e6c104ff0 2024-09-11T23:28:38.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.132+0000 7f5e7162c640 1 -- 172.21.15.5:0/3823150223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e6c1a01c0 con 0x7f5e6c104ff0 2024-09-11T23:28:38.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.132+0000 7f5e7162c640 1 -- 172.21.15.5:0/3823150223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e6c0fdd70 con 0x7f5e6c104ff0 2024-09-11T23:28:38.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.134+0000 7f5e53fff640 1 -- 172.21.15.5:0/3823150223 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f5e6000f650 con 0x7f5e6c104ff0 2024-09-11T23:28:38.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.134+0000 7f5e53fff640 1 --2- 172.21.15.5:0/3823150223 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f5e540a2c40 0x7f5e540a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:38.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.134+0000 7f5e6affd640 1 --2- 172.21.15.5:0/3823150223 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f5e540a2c40 0x7f5e540a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:38.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.135+0000 7f5e53fff640 1 -- 172.21.15.5:0/3823150223 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7f5e600cfce0 con 0x7f5e6c104ff0 2024-09-11T23:28:38.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.135+0000 7f5e6affd640 1 --2- 172.21.15.5:0/3823150223 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f5e540a2c40 0x7f5e540a5100 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c0058c0 tx=0x7f5e5c00a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:38.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.137+0000 7f5e53fff640 1 -- 172.21.15.5:0/3823150223 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5e60014030 con 0x7f5e6c104ff0 2024-09-11T23:28:38.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.323+0000 7f5e7162c640 1 -- 172.21.15.5:0/3823150223 --> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f5e6c062630 con 0x7f5e540a2c40 2024-09-11T23:28:38.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.324+0000 7f5e53fff640 1 -- 172.21.15.5:0/3823150223 <== mgr.14148 v2:172.21.15.5:6800/2285128668 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f5e6c062630 con 0x7f5e540a2c40 2024-09-11T23:28:38.324 INFO:teuthology.orchestra.run.smithi005.stdout:HOST ADDR LABELS STATUS 2024-09-11T23:28:38.324 INFO:teuthology.orchestra.run.smithi005.stdout:smithi005 172.21.15.5 2024-09-11T23:28:38.324 INFO:teuthology.orchestra.run.smithi005.stdout:smithi159 172.21.15.159 2024-09-11T23:28:38.324 INFO:teuthology.orchestra.run.smithi005.stdout:smithi172 172.21.15.172 2024-09-11T23:28:38.324 INFO:teuthology.orchestra.run.smithi005.stdout:3 hosts in cluster 2024-09-11T23:28:38.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.326+0000 7f5e7162c640 1 -- 172.21.15.5:0/3823150223 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f5e540a2c40 msgr2=0x7f5e540a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:38.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.327+0000 7f5e7162c640 1 --2- 172.21.15.5:0/3823150223 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f5e540a2c40 0x7f5e540a5100 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c0058c0 tx=0x7f5e5c00a2d0 comp rx=0 tx=0).stop 2024-09-11T23:28:38.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.327+0000 7f5e7162c640 1 -- 172.21.15.5:0/3823150223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e6c104ff0 msgr2=0x7f5e6c1982a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:38.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.327+0000 7f5e7162c640 1 --2- 172.21.15.5:0/3823150223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e6c104ff0 0x7f5e6c1982a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5e6000ccb0 tx=0x7f5e6000a620 comp rx=0 tx=0).stop 2024-09-11T23:28:38.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.327+0000 7f5e7162c640 1 -- 172.21.15.5:0/3823150223 shutdown_connections 2024-09-11T23:28:38.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.327+0000 7f5e7162c640 1 --2- 172.21.15.5:0/3823150223 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f5e540a2c40 0x7f5e540a5100 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:38.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.327+0000 7f5e7162c640 1 --2- 172.21.15.5:0/3823150223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e6c107920 0x7f5e6c19f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:38.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.327+0000 7f5e7162c640 1 --2- 172.21.15.5:0/3823150223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e6c104ff0 0x7f5e6c1982a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:38.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.327+0000 7f5e7162c640 1 --2- 172.21.15.5:0/3823150223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e6c1026c0 0x7f5e6c197d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:38.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.327+0000 7f5e7162c640 1 -- 172.21.15.5:0/3823150223 >> 172.21.15.5:0/3823150223 conn(0x7f5e6c0fc280 msgr2=0x7f5e6c102f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:38.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.327+0000 7f5e7162c640 1 -- 172.21.15.5:0/3823150223 shutdown_connections 2024-09-11T23:28:38.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:38.327+0000 7f5e7162c640 1 -- 172.21.15.5:0/3823150223 wait complete. 2024-09-11T23:28:39.175 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-11T23:28:39.433 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:28:39.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:39 smithi005 ceph-mon[31201]: pgmap v342: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T23:28:39.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:39 smithi005 ceph-mon[31201]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:28:39.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:39 smithi159 ceph-mon[34394]: pgmap v342: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T23:28:39.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:39 smithi159 ceph-mon[34394]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:28:39.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:39 smithi172 ceph-mon[34855]: pgmap v342: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T23:28:39.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:39 smithi172 ceph-mon[34855]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:28:39.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:39.923+0000 7fd6120bb640 1 -- 172.21.15.5:0/2427630722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd60c1026d0 msgr2=0x7fd60c108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:39.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:39.923+0000 7fd6120bb640 1 --2- 172.21.15.5:0/2427630722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd60c1026d0 0x7fd60c108f60 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd604009900 tx=0x7fd60402a410 comp rx=0 tx=0).stop 2024-09-11T23:28:39.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:39.923+0000 7fd6120bb640 1 -- 172.21.15.5:0/2427630722 shutdown_connections 2024-09-11T23:28:39.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:39.923+0000 7fd6120bb640 1 --2- 172.21.15.5:0/2427630722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd60c1026d0 0x7fd60c108f60 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:39.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:39.923+0000 7fd6120bb640 1 --2- 172.21.15.5:0/2427630722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd60c101d10 0x7fd60c102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:39.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:39.923+0000 7fd6120bb640 1 --2- 172.21.15.5:0/2427630722 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd60c100b10 0x7fd60c100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:39.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:39.923+0000 7fd6120bb640 1 -- 172.21.15.5:0/2427630722 >> 172.21.15.5:0/2427630722 conn(0x7fd60c0fc2a0 msgr2=0x7fd60c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:39.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:39.923+0000 7fd6120bb640 1 -- 172.21.15.5:0/2427630722 shutdown_connections 2024-09-11T23:28:39.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:39.923+0000 7fd6120bb640 1 -- 172.21.15.5:0/2427630722 wait complete. 2024-09-11T23:28:39.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:39.924+0000 7fd6120bb640 1 Processor -- start 2024-09-11T23:28:39.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:39.924+0000 7fd6120bb640 1 -- start start 2024-09-11T23:28:39.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:39.925+0000 7fd6120bb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd60c100b10 0x7fd60c197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:39.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:39.925+0000 7fd6120bb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd60c101d10 0x7fd60c198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:39.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:39.925+0000 7fd6120bb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd60c1026d0 0x7fd60c19f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:39.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:39.925+0000 7fd6120bb640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd60c10c6a0 con 0x7fd60c100b10 2024-09-11T23:28:39.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:39.925+0000 7fd6120bb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fd60c10c520 con 0x7fd60c1026d0 2024-09-11T23:28:39.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:39.925+0000 7fd6120bb640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd60c10c820 con 0x7fd60c101d10 2024-09-11T23:28:39.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:39.925+0000 7fd60b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd60c100b10 0x7fd60c197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:39.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:39.925+0000 7fd60b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd60c100b10 0x7fd60c197e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43076/0 (socket says 172.21.15.5:43076) 2024-09-11T23:28:39.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:39.925+0000 7fd60b7fe640 1 -- 172.21.15.5:0/2912332486 learned_addr learned my addr 172.21.15.5:0/2912332486 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:39.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:39.925+0000 7fd60affd640 1 --2- 172.21.15.5:0/2912332486 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd60c101d10 0x7fd60c198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:39.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:39.925+0000 7fd60b7fe640 1 -- 172.21.15.5:0/2912332486 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd60c101d10 msgr2=0x7fd60c198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:39.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:39.925+0000 7fd60b7fe640 1 --2- 172.21.15.5:0/2912332486 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd60c101d10 0x7fd60c198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:39.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:39.925+0000 7fd60b7fe640 1 -- 172.21.15.5:0/2912332486 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd60c1026d0 msgr2=0x7fd60c19f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:39.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:39.925+0000 7fd60bfff640 1 --2- 172.21.15.5:0/2912332486 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd60c1026d0 0x7fd60c19f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:39.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:39.925+0000 7fd60b7fe640 1 --2- 172.21.15.5:0/2912332486 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd60c1026d0 0x7fd60c19f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:39.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:39.925+0000 7fd60b7fe640 1 -- 172.21.15.5:0/2912332486 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd60c19fa40 con 0x7fd60c100b10 2024-09-11T23:28:39.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:39.925+0000 7fd60affd640 1 --2- 172.21.15.5:0/2912332486 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd60c101d10 0x7fd60c198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:28:39.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:39.925+0000 7fd60b7fe640 1 --2- 172.21.15.5:0/2912332486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd60c100b10 0x7fd60c197e10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc00ea80 tx=0x7fd5fc00ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:39.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:39.925+0000 7fd608ff9640 1 -- 172.21.15.5:0/2912332486 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc00ce40 con 0x7fd60c100b10 2024-09-11T23:28:39.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:39.926+0000 7fd608ff9640 1 -- 172.21.15.5:0/2912332486 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd5fc011920 con 0x7fd60c100b10 2024-09-11T23:28:39.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:39.926+0000 7fd6120bb640 1 -- 172.21.15.5:0/2912332486 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd60c19fd30 con 0x7fd60c100b10 2024-09-11T23:28:39.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:39.926+0000 7fd608ff9640 1 -- 172.21.15.5:0/2912332486 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc01aaa0 con 0x7fd60c100b10 2024-09-11T23:28:39.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:39.926+0000 7fd6120bb640 1 -- 172.21.15.5:0/2912332486 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd60c1a0240 con 0x7fd60c100b10 2024-09-11T23:28:39.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:39.927+0000 7fd6120bb640 1 -- 172.21.15.5:0/2912332486 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd60c1a04d0 con 0x7fd60c100b10 2024-09-11T23:28:39.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:39.929+0000 7fd608ff9640 1 -- 172.21.15.5:0/2912332486 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fd5fc011ad0 con 0x7fd60c100b10 2024-09-11T23:28:39.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:39.929+0000 7fd608ff9640 1 --2- 172.21.15.5:0/2912332486 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fd5f40a2c40 0x7fd5f40a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:39.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:39.929+0000 7fd608ff9640 1 -- 172.21.15.5:0/2912332486 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7fd5fc0cfd90 con 0x7fd60c100b10 2024-09-11T23:28:39.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:39.929+0000 7fd60affd640 1 --2- 172.21.15.5:0/2912332486 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fd5f40a2c40 0x7fd5f40a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:39.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:39.930+0000 7fd60affd640 1 --2- 172.21.15.5:0/2912332486 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fd5f40a2c40 0x7fd5f40a5100 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd60c199330 tx=0x7fd600008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:39.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:39.933+0000 7fd608ff9640 1 -- 172.21.15.5:0/2912332486 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd5fc016030 con 0x7fd60c100b10 2024-09-11T23:28:40.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:40.115+0000 7fd6120bb640 1 -- 172.21.15.5:0/2912332486 --> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7fd60c0fd0e0 con 0x7fd5f40a2c40 2024-09-11T23:28:40.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:40.116+0000 7fd608ff9640 1 -- 172.21.15.5:0/2912332486 <== mgr.14148 v2:172.21.15.5:6800/2285128668 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7fd60c0fd0e0 con 0x7fd5f40a2c40 2024-09-11T23:28:40.116 INFO:teuthology.orchestra.run.smithi005.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-11T23:28:40.116 INFO:teuthology.orchestra.run.smithi005.stdout:smithi005 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB751300EW480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-11T23:28:40.116 INFO:teuthology.orchestra.run.smithi005.stdout:smithi159 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300GH400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-11T23:28:40.116 INFO:teuthology.orchestra.run.smithi005.stdout:smithi172 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6233005M400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-11T23:28:40.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:40.118+0000 7fd6120bb640 1 -- 172.21.15.5:0/2912332486 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fd5f40a2c40 msgr2=0x7fd5f40a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:40.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:40.118+0000 7fd6120bb640 1 --2- 172.21.15.5:0/2912332486 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fd5f40a2c40 0x7fd5f40a5100 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd60c199330 tx=0x7fd600008040 comp rx=0 tx=0).stop 2024-09-11T23:28:40.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:40.118+0000 7fd6120bb640 1 -- 172.21.15.5:0/2912332486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd60c100b10 msgr2=0x7fd60c197e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:40.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:40.118+0000 7fd6120bb640 1 --2- 172.21.15.5:0/2912332486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd60c100b10 0x7fd60c197e10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc00ea80 tx=0x7fd5fc00ef40 comp rx=0 tx=0).stop 2024-09-11T23:28:40.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:40.118+0000 7fd6120bb640 1 -- 172.21.15.5:0/2912332486 shutdown_connections 2024-09-11T23:28:40.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:40.119+0000 7fd6120bb640 1 --2- 172.21.15.5:0/2912332486 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fd5f40a2c40 0x7fd5f40a5100 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:40.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:40.119+0000 7fd6120bb640 1 --2- 172.21.15.5:0/2912332486 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd60c1026d0 0x7fd60c19f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:40.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:40.119+0000 7fd6120bb640 1 --2- 172.21.15.5:0/2912332486 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd60c101d10 0x7fd60c198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:40.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:40.119+0000 7fd6120bb640 1 --2- 172.21.15.5:0/2912332486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd60c100b10 0x7fd60c197e10 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:40.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:40.119+0000 7fd6120bb640 1 -- 172.21.15.5:0/2912332486 >> 172.21.15.5:0/2912332486 conn(0x7fd60c0fc2a0 msgr2=0x7fd60c0fc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:40.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:40.119+0000 7fd6120bb640 1 -- 172.21.15.5:0/2912332486 shutdown_connections 2024-09-11T23:28:40.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:40.119+0000 7fd6120bb640 1 -- 172.21.15.5:0/2912332486 wait complete. 2024-09-11T23:28:40.906 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-11T23:28:40.917 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi005.front.sepia.ceph.com 2024-09-11T23:28:40.917 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-11T23:28:41.176 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:28:41.572 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:41 smithi005 ceph-mon[31201]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:28:41.573 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:41 smithi005 ceph-mon[31201]: pgmap v343: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T23:28:41.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:41 smithi159 ceph-mon[34394]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:28:41.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:41 smithi159 ceph-mon[34394]: pgmap v343: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T23:28:41.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:41 smithi172 ceph-mon[34855]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:28:41.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:41 smithi172 ceph-mon[34855]: pgmap v343: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T23:28:41.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.656+0000 7fe928f09640 1 -- 172.21.15.5:0/859764647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe924107900 msgr2=0x7fe924109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:41.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.656+0000 7fe928f09640 1 --2- 172.21.15.5:0/859764647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe924107900 0x7fe924109d50 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe91c009ca0 tx=0x7fe91c02a8c0 comp rx=0 tx=0).stop 2024-09-11T23:28:41.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.656+0000 7fe928f09640 1 -- 172.21.15.5:0/859764647 shutdown_connections 2024-09-11T23:28:41.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.656+0000 7fe928f09640 1 --2- 172.21.15.5:0/859764647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe924107900 0x7fe924109d50 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:41.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.656+0000 7fe928f09640 1 --2- 172.21.15.5:0/859764647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe924104fd0 0x7fe9241073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:41.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.656+0000 7fe928f09640 1 --2- 172.21.15.5:0/859764647 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9241026a0 0x7fe924104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:41.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.656+0000 7fe928f09640 1 -- 172.21.15.5:0/859764647 >> 172.21.15.5:0/859764647 conn(0x7fe9240fc2a0 msgr2=0x7fe9240fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:41.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.656+0000 7fe928f09640 1 -- 172.21.15.5:0/859764647 shutdown_connections 2024-09-11T23:28:41.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.656+0000 7fe928f09640 1 -- 172.21.15.5:0/859764647 wait complete. 2024-09-11T23:28:41.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.657+0000 7fe928f09640 1 Processor -- start 2024-09-11T23:28:41.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.657+0000 7fe928f09640 1 -- start start 2024-09-11T23:28:41.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.657+0000 7fe928f09640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9241026a0 0x7fe924102000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:41.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.657+0000 7fe928f09640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe924104fd0 0x7fe924100650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:41.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.657+0000 7fe928f09640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe924107900 0x7fe924100b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:41.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.657+0000 7fe928f09640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe92410d840 con 0x7fe9241026a0 2024-09-11T23:28:41.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.657+0000 7fe928f09640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe92410d6c0 con 0x7fe924107900 2024-09-11T23:28:41.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.657+0000 7fe928f09640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe92410d9c0 con 0x7fe924104fd0 2024-09-11T23:28:41.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.657+0000 7fe92259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9241026a0 0x7fe924102000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:41.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.657+0000 7fe92259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9241026a0 0x7fe924102000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43090/0 (socket says 172.21.15.5:43090) 2024-09-11T23:28:41.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.657+0000 7fe92259c640 1 -- 172.21.15.5:0/747533779 learned_addr learned my addr 172.21.15.5:0/747533779 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:41.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.657+0000 7fe922d9d640 1 --2- 172.21.15.5:0/747533779 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe924107900 0x7fe924100b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:41.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.657+0000 7fe921d9b640 1 --2- 172.21.15.5:0/747533779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe924104fd0 0x7fe924100650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:41.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.657+0000 7fe92259c640 1 -- 172.21.15.5:0/747533779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe924104fd0 msgr2=0x7fe924100650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:41.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.657+0000 7fe92259c640 1 --2- 172.21.15.5:0/747533779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe924104fd0 0x7fe924100650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:41.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.657+0000 7fe92259c640 1 -- 172.21.15.5:0/747533779 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe924107900 msgr2=0x7fe924100b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:41.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.657+0000 7fe92259c640 1 --2- 172.21.15.5:0/747533779 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe924107900 0x7fe924100b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:41.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.657+0000 7fe92259c640 1 -- 172.21.15.5:0/747533779 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe924101450 con 0x7fe9241026a0 2024-09-11T23:28:41.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.657+0000 7fe922d9d640 1 --2- 172.21.15.5:0/747533779 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe924107900 0x7fe924100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:28:41.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.657+0000 7fe921d9b640 1 --2- 172.21.15.5:0/747533779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe924104fd0 0x7fe924100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:28:41.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.658+0000 7fe92259c640 1 --2- 172.21.15.5:0/747533779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9241026a0 0x7fe924102000 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe91400b4a0 tx=0x7fe91400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:41.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.658+0000 7fe9137fe640 1 -- 172.21.15.5:0/747533779 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe914014070 con 0x7fe9241026a0 2024-09-11T23:28:41.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.658+0000 7fe928f09640 1 -- 172.21.15.5:0/747533779 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9241a2090 con 0x7fe9241026a0 2024-09-11T23:28:41.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.658+0000 7fe9137fe640 1 -- 172.21.15.5:0/747533779 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe914010ac0 con 0x7fe9241026a0 2024-09-11T23:28:41.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.658+0000 7fe9137fe640 1 -- 172.21.15.5:0/747533779 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe914017c30 con 0x7fe9241026a0 2024-09-11T23:28:41.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.658+0000 7fe928f09640 1 -- 172.21.15.5:0/747533779 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9241a2620 con 0x7fe9241026a0 2024-09-11T23:28:41.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.659+0000 7fe928f09640 1 -- 172.21.15.5:0/747533779 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9240fdd90 con 0x7fe9241026a0 2024-09-11T23:28:41.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.660+0000 7fe9137fe640 1 -- 172.21.15.5:0/747533779 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fe914017070 con 0x7fe9241026a0 2024-09-11T23:28:41.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.661+0000 7fe9137fe640 1 --2- 172.21.15.5:0/747533779 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe90c0a2c10 0x7fe90c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:41.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.661+0000 7fe921d9b640 1 --2- 172.21.15.5:0/747533779 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe90c0a2c10 0x7fe90c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:41.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.661+0000 7fe9137fe640 1 -- 172.21.15.5:0/747533779 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7fe9140cebe0 con 0x7fe9241026a0 2024-09-11T23:28:41.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.661+0000 7fe921d9b640 1 --2- 172.21.15.5:0/747533779 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe90c0a2c10 0x7fe90c0a50d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe918006fd0 tx=0x7fe918008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:41.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.665+0000 7fe9137fe640 1 -- 172.21.15.5:0/747533779 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe91409b730 con 0x7fe9241026a0 2024-09-11T23:28:41.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.880+0000 7fe928f09640 1 -- 172.21.15.5:0/747533779 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fe92402d7c0 con 0x7fe9241026a0 2024-09-11T23:28:41.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.880+0000 7fe9137fe640 1 -- 172.21.15.5:0/747533779 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+3092 (secure 0 0 0) 0x7fe91409b030 con 0x7fe9241026a0 2024-09-11T23:28:41.880 INFO:teuthology.orchestra.run.smithi005.stdout:e24 2024-09-11T23:28:41.880 INFO:teuthology.orchestra.run.smithi005.stdout:btime 2024-09-11T23:27:24:041243+0000 2024-09-11T23:28:41.880 INFO:teuthology.orchestra.run.smithi005.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-11T23:28:41.880 INFO:teuthology.orchestra.run.smithi005.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-11T23:28:41.880 INFO:teuthology.orchestra.run.smithi005.stdout:legacy client fscid: 1 2024-09-11T23:28:41.880 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:28:41.880 INFO:teuthology.orchestra.run.smithi005.stdout:Filesystem 'cephfs' (1) 2024-09-11T23:28:41.881 INFO:teuthology.orchestra.run.smithi005.stdout:fs_name cephfs 2024-09-11T23:28:41.881 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 24 2024-09-11T23:28:41.881 INFO:teuthology.orchestra.run.smithi005.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-11T23:28:41.881 INFO:teuthology.orchestra.run.smithi005.stdout:created 2024-09-11T23:26:45.305894+0000 2024-09-11T23:28:41.881 INFO:teuthology.orchestra.run.smithi005.stdout:modified 2024-09-11T23:27:23.903504+0000 2024-09-11T23:28:41.881 INFO:teuthology.orchestra.run.smithi005.stdout:tableserver 0 2024-09-11T23:28:41.881 INFO:teuthology.orchestra.run.smithi005.stdout:root 0 2024-09-11T23:28:41.881 INFO:teuthology.orchestra.run.smithi005.stdout:session_timeout 300 2024-09-11T23:28:41.881 INFO:teuthology.orchestra.run.smithi005.stdout:session_autoclose 300 2024-09-11T23:28:41.881 INFO:teuthology.orchestra.run.smithi005.stdout:max_file_size 1099511627776 2024-09-11T23:28:41.881 INFO:teuthology.orchestra.run.smithi005.stdout:max_xattr_size 65536 2024-09-11T23:28:41.881 INFO:teuthology.orchestra.run.smithi005.stdout:required_client_features {} 2024-09-11T23:28:41.881 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure 0 2024-09-11T23:28:41.882 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure_osd_epoch 0 2024-09-11T23:28:41.882 INFO:teuthology.orchestra.run.smithi005.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-11T23:28:41.882 INFO:teuthology.orchestra.run.smithi005.stdout:max_mds 3 2024-09-11T23:28:41.882 INFO:teuthology.orchestra.run.smithi005.stdout:in 0,1,2 2024-09-11T23:28:41.882 INFO:teuthology.orchestra.run.smithi005.stdout:up {0=24494,1=24475,2=24461} 2024-09-11T23:28:41.882 INFO:teuthology.orchestra.run.smithi005.stdout:failed 2024-09-11T23:28:41.882 INFO:teuthology.orchestra.run.smithi005.stdout:damaged 2024-09-11T23:28:41.882 INFO:teuthology.orchestra.run.smithi005.stdout:stopped 2024-09-11T23:28:41.882 INFO:teuthology.orchestra.run.smithi005.stdout:data_pools [3,4] 2024-09-11T23:28:41.882 INFO:teuthology.orchestra.run.smithi005.stdout:metadata_pool 2 2024-09-11T23:28:41.882 INFO:teuthology.orchestra.run.smithi005.stdout:inline_data disabled 2024-09-11T23:28:41.882 INFO:teuthology.orchestra.run.smithi005.stdout:balancer 2024-09-11T23:28:41.883 INFO:teuthology.orchestra.run.smithi005.stdout:bal_rank_mask -1 2024-09-11T23:28:41.883 INFO:teuthology.orchestra.run.smithi005.stdout:standby_count_wanted 0 2024-09-11T23:28:41.883 INFO:teuthology.orchestra.run.smithi005.stdout:qdb_cluster leader: 24494 members: 24461,24475,24494 2024-09-11T23:28:41.883 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.b{0:24494} state up:active seq 4 addr [v2:172.21.15.159:6838/3843336290,v1:172.21.15.159:6839/3843336290] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T23:28:41.883 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.c{0:24460} state up:standby-replay seq 1 addr [v2:172.21.15.172:6836/4200951601,v1:172.21.15.172:6837/4200951601] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T23:28:41.883 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.i{1:24475} state up:active seq 15 addr [v2:172.21.15.172:6838/3928313314,v1:172.21.15.172:6839/3928313314] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T23:28:41.883 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.f{1:24454} state up:standby-replay seq 1 addr [v2:172.21.15.172:6834/4240913699,v1:172.21.15.172:6835/4240913699] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T23:28:41.883 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.h{2:24461} state up:active seq 16 addr [v2:172.21.15.159:6836/4020181017,v1:172.21.15.159:6837/4020181017] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T23:28:41.883 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.e{2:24440} state up:standby-replay seq 1 addr [v2:172.21.15.159:6834/2539263301,v1:172.21.15.159:6835/2539263301] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T23:28:41.883 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:28:41.883 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:28:41.883 INFO:teuthology.orchestra.run.smithi005.stdout:Standby daemons: 2024-09-11T23:28:41.883 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:28:41.884 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.j{-1:14556} state up:standby seq 1 addr [v2:172.21.15.5:6834/3865435482,v1:172.21.15.5:6835/3865435482] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T23:28:41.884 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.d{-1:14568} state up:standby seq 1 addr [v2:172.21.15.5:6836/1323314897,v1:172.21.15.5:6837/1323314897] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T23:28:41.884 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.g{-1:14610} state up:standby seq 1 addr [v2:172.21.15.5:6838/4140073288,v1:172.21.15.5:6839/4140073288] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T23:28:41.884 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.a{-1:14622} state up:standby seq 1 addr [v2:172.21.15.5:6840/1162578713,v1:172.21.15.5:6841/1162578713] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T23:28:41.884 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.l{-1:24421} state up:standby seq 1 addr [v2:172.21.15.172:6832/3113658116,v1:172.21.15.172:6833/3113658116] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T23:28:41.884 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.k{-1:24422} state up:standby seq 1 addr [v2:172.21.15.159:6832/3887336060,v1:172.21.15.159:6833/3887336060] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T23:28:41.885 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 24 2024-09-11T23:28:41.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.882+0000 7fe928f09640 1 -- 172.21.15.5:0/747533779 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe90c0a2c10 msgr2=0x7fe90c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:41.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.882+0000 7fe928f09640 1 --2- 172.21.15.5:0/747533779 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe90c0a2c10 0x7fe90c0a50d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe918006fd0 tx=0x7fe918008040 comp rx=0 tx=0).stop 2024-09-11T23:28:41.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.882+0000 7fe928f09640 1 -- 172.21.15.5:0/747533779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9241026a0 msgr2=0x7fe924102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:41.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.882+0000 7fe928f09640 1 --2- 172.21.15.5:0/747533779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9241026a0 0x7fe924102000 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe91400b4a0 tx=0x7fe91400b960 comp rx=0 tx=0).stop 2024-09-11T23:28:41.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.882+0000 7fe928f09640 1 -- 172.21.15.5:0/747533779 shutdown_connections 2024-09-11T23:28:41.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.882+0000 7fe928f09640 1 --2- 172.21.15.5:0/747533779 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe90c0a2c10 0x7fe90c0a50d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:41.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.882+0000 7fe928f09640 1 --2- 172.21.15.5:0/747533779 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe924107900 0x7fe924100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:41.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.882+0000 7fe928f09640 1 --2- 172.21.15.5:0/747533779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe924104fd0 0x7fe924100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:41.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.882+0000 7fe928f09640 1 --2- 172.21.15.5:0/747533779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9241026a0 0x7fe924102000 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:41.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.882+0000 7fe928f09640 1 -- 172.21.15.5:0/747533779 >> 172.21.15.5:0/747533779 conn(0x7fe9240fc2a0 msgr2=0x7fe924103000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:41.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.883+0000 7fe928f09640 1 -- 172.21.15.5:0/747533779 shutdown_connections 2024-09-11T23:28:41.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:41.883+0000 7fe928f09640 1 -- 172.21.15.5:0/747533779 wait complete. 2024-09-11T23:28:42.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:42 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/747533779' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-11T23:28:42.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:42 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/747533779' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-11T23:28:42.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:42 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/747533779' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-11T23:28:42.778 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-11T23:28:43.038 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:28:43.465 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:43 smithi005 ceph-mon[31201]: pgmap v344: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T23:28:43.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.548+0000 7f208709c640 1 -- 172.21.15.5:0/3857551686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2080102690 msgr2=0x7f2080108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:43.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.548+0000 7f208709c640 1 --2- 172.21.15.5:0/3857551686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2080102690 0x7f2080108f20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2078009ca0 tx=0x7f207802a8c0 comp rx=0 tx=0).stop 2024-09-11T23:28:43.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.548+0000 7f208709c640 1 -- 172.21.15.5:0/3857551686 shutdown_connections 2024-09-11T23:28:43.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.548+0000 7f208709c640 1 --2- 172.21.15.5:0/3857551686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2080102690 0x7f2080108f20 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:43.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.548+0000 7f208709c640 1 --2- 172.21.15.5:0/3857551686 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2080101cd0 0x7f2080102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:43.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.548+0000 7f208709c640 1 --2- 172.21.15.5:0/3857551686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2080100ad0 0x7f2080100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:43.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.548+0000 7f208709c640 1 -- 172.21.15.5:0/3857551686 >> 172.21.15.5:0/3857551686 conn(0x7f20800fc280 msgr2=0x7f20800fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:43.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.548+0000 7f208709c640 1 -- 172.21.15.5:0/3857551686 shutdown_connections 2024-09-11T23:28:43.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.548+0000 7f208709c640 1 -- 172.21.15.5:0/3857551686 wait complete. 2024-09-11T23:28:43.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.549+0000 7f208709c640 1 Processor -- start 2024-09-11T23:28:43.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.549+0000 7f208709c640 1 -- start start 2024-09-11T23:28:43.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.549+0000 7f208709c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2080100ad0 0x7f208006ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:43.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.549+0000 7f208709c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2080101cd0 0x7f208019ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:43.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.549+0000 7f208709c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2080102690 0x7f208019f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:43.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.549+0000 7f208709c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f208010c600 con 0x7f2080100ad0 2024-09-11T23:28:43.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.549+0000 7f208709c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f208010c480 con 0x7f2080101cd0 2024-09-11T23:28:43.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.549+0000 7f208709c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f208010c780 con 0x7f2080102690 2024-09-11T23:28:43.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.549+0000 7f2084e38640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2080100ad0 0x7f208006ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:43.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.549+0000 7f2084e38640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2080100ad0 0x7f208006ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37824/0 (socket says 172.21.15.5:37824) 2024-09-11T23:28:43.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.549+0000 7f2084e38640 1 -- 172.21.15.5:0/3570702152 learned_addr learned my addr 172.21.15.5:0/3570702152 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:43.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.549+0000 7f207ffff640 1 --2- 172.21.15.5:0/3570702152 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2080101cd0 0x7f208019ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:43.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.549+0000 7f2085639640 1 --2- 172.21.15.5:0/3570702152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2080102690 0x7f208019f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:43.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.549+0000 7f2084e38640 1 -- 172.21.15.5:0/3570702152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2080102690 msgr2=0x7f208019f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:43.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.549+0000 7f2084e38640 1 --2- 172.21.15.5:0/3570702152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2080102690 0x7f208019f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:43.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.549+0000 7f2084e38640 1 -- 172.21.15.5:0/3570702152 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2080101cd0 msgr2=0x7f208019ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:43.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.549+0000 7f2084e38640 1 --2- 172.21.15.5:0/3570702152 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2080101cd0 0x7f208019ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:43.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.549+0000 7f2084e38640 1 -- 172.21.15.5:0/3570702152 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f208019f950 con 0x7f2080100ad0 2024-09-11T23:28:43.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.550+0000 7f2084e38640 1 --2- 172.21.15.5:0/3570702152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2080100ad0 0x7f208006ab10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f207000c970 tx=0x7f207000cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:43.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.550+0000 7f207dffb640 1 -- 172.21.15.5:0/3570702152 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2070004220 con 0x7f2080100ad0 2024-09-11T23:28:43.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.550+0000 7f207dffb640 1 -- 172.21.15.5:0/3570702152 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f20700043c0 con 0x7f2080100ad0 2024-09-11T23:28:43.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.550+0000 7f208709c640 1 -- 172.21.15.5:0/3570702152 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f208019fc40 con 0x7f2080100ad0 2024-09-11T23:28:43.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.550+0000 7f207dffb640 1 -- 172.21.15.5:0/3570702152 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20700047c0 con 0x7f2080100ad0 2024-09-11T23:28:43.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.550+0000 7f208709c640 1 -- 172.21.15.5:0/3570702152 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20801a0180 con 0x7f2080100ad0 2024-09-11T23:28:43.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.551+0000 7f208709c640 1 -- 172.21.15.5:0/3570702152 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2080107ea0 con 0x7f2080100ad0 2024-09-11T23:28:43.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.552+0000 7f207dffb640 1 -- 172.21.15.5:0/3570702152 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f20700079b0 con 0x7f2080100ad0 2024-09-11T23:28:43.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.553+0000 7f207dffb640 1 --2- 172.21.15.5:0/3570702152 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f206c0a2c90 0x7f206c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:43.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.553+0000 7f207dffb640 1 -- 172.21.15.5:0/3570702152 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7f20700cf2a0 con 0x7f2080100ad0 2024-09-11T23:28:43.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.553+0000 7f207ffff640 1 --2- 172.21.15.5:0/3570702152 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f206c0a2c90 0x7f206c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:43.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.553+0000 7f207ffff640 1 --2- 172.21.15.5:0/3570702152 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f206c0a2c90 0x7f206c0a5150 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f208006a890 tx=0x7f206800a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:43.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.557+0000 7f207dffb640 1 -- 172.21.15.5:0/3570702152 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2070014030 con 0x7f2080100ad0 2024-09-11T23:28:43.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:43 smithi159 ceph-mon[34394]: pgmap v344: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T23:28:43.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:43 smithi172 ceph-mon[34855]: pgmap v344: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T23:28:43.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.733+0000 7f208709c640 1 -- 172.21.15.5:0/3570702152 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f208002d9c0 con 0x7f2080100ad0 2024-09-11T23:28:43.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.734+0000 7f207dffb640 1 -- 172.21.15.5:0/3570702152 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v88) ==== 56+0+5657 (secure 0 0 0) 0x7f207009bce0 con 0x7f2080100ad0 2024-09-11T23:28:43.733 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 88 2024-09-11T23:28:43.733 INFO:teuthology.orchestra.run.smithi005.stdout:fsid 1f5284d2-7094-11ef-bcea-c7b262605968 2024-09-11T23:28:43.734 INFO:teuthology.orchestra.run.smithi005.stdout:created 2024-09-11T23:19:00.051813+0000 2024-09-11T23:28:43.734 INFO:teuthology.orchestra.run.smithi005.stdout:modified 2024-09-11T23:27:52.098396+0000 2024-09-11T23:28:43.734 INFO:teuthology.orchestra.run.smithi005.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-11T23:28:43.734 INFO:teuthology.orchestra.run.smithi005.stdout:crush_version 27 2024-09-11T23:28:43.734 INFO:teuthology.orchestra.run.smithi005.stdout:full_ratio 0.95 2024-09-11T23:28:43.734 INFO:teuthology.orchestra.run.smithi005.stdout:backfillfull_ratio 0.9 2024-09-11T23:28:43.734 INFO:teuthology.orchestra.run.smithi005.stdout:nearfull_ratio 0.85 2024-09-11T23:28:43.734 INFO:teuthology.orchestra.run.smithi005.stdout:require_min_compat_client luminous 2024-09-11T23:28:43.734 INFO:teuthology.orchestra.run.smithi005.stdout:min_compat_client luminous 2024-09-11T23:28:43.734 INFO:teuthology.orchestra.run.smithi005.stdout:require_osd_release squid 2024-09-11T23:28:43.734 INFO:teuthology.orchestra.run.smithi005.stdout:stretch_mode_enabled false 2024-09-11T23:28:43.734 INFO:teuthology.orchestra.run.smithi005.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 20 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-11T23:28:43.734 INFO:teuthology.orchestra.run.smithi005.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-11T23:28:43.734 INFO:teuthology.orchestra.run.smithi005.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-09-11T23:28:43.735 INFO:teuthology.orchestra.run.smithi005.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 86 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-09-11T23:28:43.735 INFO:teuthology.orchestra.run.smithi005.stdout:max_osd 12 2024-09-11T23:28:43.735 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 up in weight 1 up_from 8 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.5:6802/624761084,v1:172.21.15.5:6803/624761084] [v2:172.21.15.5:6804/624761084,v1:172.21.15.5:6805/624761084] exists,up bf95ced0-780b-482f-87da-0b5e61de62ca 2024-09-11T23:28:43.735 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 up in weight 1 up_from 13 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.159:6800/2111290186,v1:172.21.15.159:6801/2111290186] [v2:172.21.15.159:6802/2111290186,v1:172.21.15.159:6803/2111290186] exists,up d926484f-78a6-497b-843d-f2db54ade4a0 2024-09-11T23:28:43.735 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 up in weight 1 up_from 17 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6800/299915717,v1:172.21.15.172:6801/299915717] [v2:172.21.15.172:6802/299915717,v1:172.21.15.172:6803/299915717] exists,up d92cd431-0ba7-4171-82b8-60fa3d63a64b 2024-09-11T23:28:43.735 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 up in weight 1 up_from 23 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.5:6810/2080498921,v1:172.21.15.5:6811/2080498921] [v2:172.21.15.5:6812/2080498921,v1:172.21.15.5:6813/2080498921] exists,up 0521043b-559c-4671-b11e-9117871cff49 2024-09-11T23:28:43.735 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 up in weight 1 up_from 30 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.159:6808/4185908786,v1:172.21.15.159:6809/4185908786] [v2:172.21.15.159:6810/4185908786,v1:172.21.15.159:6811/4185908786] exists,up b968d762-a46e-4ae2-b19d-8225f82de613 2024-09-11T23:28:43.735 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 up in weight 1 up_from 35 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6808/3742759000,v1:172.21.15.172:6809/3742759000] [v2:172.21.15.172:6810/3742759000,v1:172.21.15.172:6811/3742759000] exists,up 1b0a518a-3d17-4635-81da-52f9ef83a574 2024-09-11T23:28:43.735 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6 up in weight 1 up_from 42 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.5:6818/4156823423,v1:172.21.15.5:6819/4156823423] [v2:172.21.15.5:6820/4156823423,v1:172.21.15.5:6821/4156823423] exists,up c3a2db6c-9189-4e42-aa1e-52189a9c4291 2024-09-11T23:28:43.735 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7 up in weight 1 up_from 48 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.159:6816/4222571927,v1:172.21.15.159:6817/4222571927] [v2:172.21.15.159:6818/4222571927,v1:172.21.15.159:6819/4222571927] exists,up dfaadf28-74ab-4cda-8647-dcb58beb7cc9 2024-09-11T23:28:43.735 INFO:teuthology.orchestra.run.smithi005.stdout:osd.8 up in weight 1 up_from 55 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6816/3661505951,v1:172.21.15.172:6817/3661505951] [v2:172.21.15.172:6818/3661505951,v1:172.21.15.172:6819/3661505951] exists,up 47f66651-614c-4613-9793-69c140dbf705 2024-09-11T23:28:43.736 INFO:teuthology.orchestra.run.smithi005.stdout:osd.9 up in weight 1 up_from 62 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.5:6826/72036667,v1:172.21.15.5:6827/72036667] [v2:172.21.15.5:6828/72036667,v1:172.21.15.5:6829/72036667] exists,up c97b8221-8cf9-4fab-9e27-ff7f3bd98152 2024-09-11T23:28:43.736 INFO:teuthology.orchestra.run.smithi005.stdout:osd.10 up in weight 1 up_from 67 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.159:6824/3334483164,v1:172.21.15.159:6825/3334483164] [v2:172.21.15.159:6826/3334483164,v1:172.21.15.159:6827/3334483164] exists,up 143376c1-f3f1-4df4-bcd3-a9b46fad8c1b 2024-09-11T23:28:43.736 INFO:teuthology.orchestra.run.smithi005.stdout:osd.11 up in weight 1 up_from 74 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6824/1965415663,v1:172.21.15.172:6825/1965415663] [v2:172.21.15.172:6826/1965415663,v1:172.21.15.172:6827/1965415663] exists,up 5cc91ff9-fc0f-4e7a-8e4d-87df0e7efbeb 2024-09-11T23:28:43.736 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 2.e [2,4] 2024-09-11T23:28:43.736 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 2.10 [2,4] 2024-09-11T23:28:43.736 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 2.1a [8,1] 2024-09-11T23:28:43.736 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 2.1b [5,11] 2024-09-11T23:28:43.736 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 2.1c [8,11] 2024-09-11T23:28:43.736 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 3.e [4,8,5,9] 2024-09-11T23:28:43.736 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 3.1d [4,6] 2024-09-11T23:28:43.736 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 3.2d [3,9] 2024-09-11T23:28:43.736 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 3.36 [4,9] 2024-09-11T23:28:43.736 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 4.6 [5,8] 2024-09-11T23:28:43.736 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 4.19 [9,10] 2024-09-11T23:28:43.736 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 4.1b [9,8] 2024-09-11T23:28:43.737 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 4.1c [9,8] 2024-09-11T23:28:43.737 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:0/2713701762 expires 2024-09-12T23:19:50.031855+0000 2024-09-11T23:28:43.737 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:0/3135835713 expires 2024-09-12T23:19:50.031855+0000 2024-09-11T23:28:43.737 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:0/3935034940 expires 2024-09-12T23:19:50.031855+0000 2024-09-11T23:28:43.737 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:6801/1790126649 expires 2024-09-12T23:19:50.031855+0000 2024-09-11T23:28:43.737 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:6801/1358356358 expires 2024-09-12T23:19:26.149011+0000 2024-09-11T23:28:43.737 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:6800/1790126649 expires 2024-09-12T23:19:50.031855+0000 2024-09-11T23:28:43.737 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:6800/1358356358 expires 2024-09-12T23:19:26.149011+0000 2024-09-11T23:28:43.737 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:0/2243688290 expires 2024-09-12T23:19:26.149011+0000 2024-09-11T23:28:43.737 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:0/1493331899 expires 2024-09-12T23:19:26.149011+0000 2024-09-11T23:28:43.737 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:0/2329812802 expires 2024-09-12T23:19:26.149011+0000 2024-09-11T23:28:43.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.736+0000 7f208709c640 1 -- 172.21.15.5:0/3570702152 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f206c0a2c90 msgr2=0x7f206c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:43.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.736+0000 7f208709c640 1 --2- 172.21.15.5:0/3570702152 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f206c0a2c90 0x7f206c0a5150 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f208006a890 tx=0x7f206800a2d0 comp rx=0 tx=0).stop 2024-09-11T23:28:43.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.736+0000 7f208709c640 1 -- 172.21.15.5:0/3570702152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2080100ad0 msgr2=0x7f208006ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:43.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.736+0000 7f208709c640 1 --2- 172.21.15.5:0/3570702152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2080100ad0 0x7f208006ab10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f207000c970 tx=0x7f207000cd70 comp rx=0 tx=0).stop 2024-09-11T23:28:43.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.736+0000 7f208709c640 1 -- 172.21.15.5:0/3570702152 shutdown_connections 2024-09-11T23:28:43.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.736+0000 7f208709c640 1 --2- 172.21.15.5:0/3570702152 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f206c0a2c90 0x7f206c0a5150 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:43.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.736+0000 7f208709c640 1 --2- 172.21.15.5:0/3570702152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2080102690 0x7f208019f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:43.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.736+0000 7f208709c640 1 --2- 172.21.15.5:0/3570702152 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2080101cd0 0x7f208019ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:43.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.736+0000 7f208709c640 1 --2- 172.21.15.5:0/3570702152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2080100ad0 0x7f208006ab10 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:43.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.736+0000 7f208709c640 1 -- 172.21.15.5:0/3570702152 >> 172.21.15.5:0/3570702152 conn(0x7f20800fc280 msgr2=0x7f2080105070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:43.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.736+0000 7f208709c640 1 -- 172.21.15.5:0/3570702152 shutdown_connections 2024-09-11T23:28:43.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:43.736+0000 7f208709c640 1 -- 172.21.15.5:0/3570702152 wait complete. 2024-09-11T23:28:44.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:44 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/3570702152' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-11T23:28:44.588 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-11T23:28:44.599 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:28:44.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:44 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/3570702152' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-11T23:28:44.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:44 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/3570702152' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-11T23:28:44.882 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:28:45.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.349+0000 7faaa5e49640 1 -- 172.21.15.5:0/2410257703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faaa0102790 msgr2=0x7faaa01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:45.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.349+0000 7faaa5e49640 1 --2- 172.21.15.5:0/2410257703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faaa0102790 0x7faaa01067e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7faa94009900 tx=0x7faa9402e820 comp rx=0 tx=0).stop 2024-09-11T23:28:45.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.349+0000 7faaa5e49640 1 -- 172.21.15.5:0/2410257703 shutdown_connections 2024-09-11T23:28:45.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.349+0000 7faaa5e49640 1 --2- 172.21.15.5:0/2410257703 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faaa0106f10 0x7faaa010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:45.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.349+0000 7faaa5e49640 1 --2- 172.21.15.5:0/2410257703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faaa0102790 0x7faaa01067e0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:45.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.349+0000 7faaa5e49640 1 --2- 172.21.15.5:0/2410257703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaa0101de0 0x7faaa01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:45.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.349+0000 7faaa5e49640 1 -- 172.21.15.5:0/2410257703 >> 172.21.15.5:0/2410257703 conn(0x7faaa00fd8c0 msgr2=0x7faaa00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:45.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.349+0000 7faaa5e49640 1 -- 172.21.15.5:0/2410257703 shutdown_connections 2024-09-11T23:28:45.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.350+0000 7faaa5e49640 1 -- 172.21.15.5:0/2410257703 wait complete. 2024-09-11T23:28:45.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.350+0000 7faaa5e49640 1 Processor -- start 2024-09-11T23:28:45.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.350+0000 7faaa5e49640 1 -- start start 2024-09-11T23:28:45.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.351+0000 7faaa5e49640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaa0101de0 0x7faaa01961b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:45.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.351+0000 7faaa5e49640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faaa0102790 0x7faaa01966f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:45.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.351+0000 7faaa5e49640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faaa0106f10 0x7faaa019aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:45.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.351+0000 7faaa5e49640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7faaa010fc30 con 0x7faaa0106f10 2024-09-11T23:28:45.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.351+0000 7faaa5e49640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7faaa010fab0 con 0x7faaa0102790 2024-09-11T23:28:45.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.351+0000 7faaa5e49640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7faaa010fdb0 con 0x7faaa0101de0 2024-09-11T23:28:45.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.351+0000 7faa9ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faaa0106f10 0x7faaa019aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:45.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.351+0000 7faa9f7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaa0101de0 0x7faaa01961b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:45.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.351+0000 7faa9ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faaa0106f10 0x7faaa019aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37846/0 (socket says 172.21.15.5:37846) 2024-09-11T23:28:45.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.351+0000 7faa9ffff640 1 -- 172.21.15.5:0/485233425 learned_addr learned my addr 172.21.15.5:0/485233425 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:45.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.351+0000 7faa9f7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaa0101de0 0x7faaa01961b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.5:55664/0 (socket says 172.21.15.5:55664) 2024-09-11T23:28:45.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.351+0000 7faa9effd640 1 --2- 172.21.15.5:0/485233425 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faaa0102790 0x7faaa01966f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:45.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.351+0000 7faa9f7fe640 1 -- 172.21.15.5:0/485233425 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faaa0102790 msgr2=0x7faaa01966f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:45.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.351+0000 7faa9f7fe640 1 --2- 172.21.15.5:0/485233425 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faaa0102790 0x7faaa01966f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:45.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.351+0000 7faa9f7fe640 1 -- 172.21.15.5:0/485233425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faaa0106f10 msgr2=0x7faaa019aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:45.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.351+0000 7faa9f7fe640 1 --2- 172.21.15.5:0/485233425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faaa0106f10 0x7faaa019aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:45.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.351+0000 7faa9f7fe640 1 -- 172.21.15.5:0/485233425 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaa019b160 con 0x7faaa0101de0 2024-09-11T23:28:45.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.351+0000 7faa9ffff640 1 --2- 172.21.15.5:0/485233425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faaa0106f10 0x7faaa019aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:28:45.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.351+0000 7faa9f7fe640 1 --2- 172.21.15.5:0/485233425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaa0101de0 0x7faaa01961b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faa9000e9f0 tx=0x7faa9000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:45.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.352+0000 7faa9cff9640 1 -- 172.21.15.5:0/485233425 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9000ccc0 con 0x7faaa0101de0 2024-09-11T23:28:45.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.352+0000 7faaa5e49640 1 -- 172.21.15.5:0/485233425 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaa019b450 con 0x7faaa0101de0 2024-09-11T23:28:45.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.352+0000 7faa9cff9640 1 -- 172.21.15.5:0/485233425 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7faa90005020 con 0x7faaa0101de0 2024-09-11T23:28:45.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.352+0000 7faa9cff9640 1 -- 172.21.15.5:0/485233425 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa90004a00 con 0x7faaa0101de0 2024-09-11T23:28:45.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.352+0000 7faaa5e49640 1 -- 172.21.15.5:0/485233425 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaa01a2d30 con 0x7faaa0101de0 2024-09-11T23:28:45.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.353+0000 7faaa5e49640 1 -- 172.21.15.5:0/485233425 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaa01021c0 con 0x7faaa0101de0 2024-09-11T23:28:45.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.354+0000 7faa9cff9640 1 -- 172.21.15.5:0/485233425 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7faa90004ba0 con 0x7faaa0101de0 2024-09-11T23:28:45.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.354+0000 7faa9cff9640 1 --2- 172.21.15.5:0/485233425 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7faa880a2c10 0x7faa880a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:45.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.355+0000 7faa9effd640 1 --2- 172.21.15.5:0/485233425 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7faa880a2c10 0x7faa880a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:45.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.355+0000 7faa9cff9640 1 -- 172.21.15.5:0/485233425 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7faa900cf510 con 0x7faaa0101de0 2024-09-11T23:28:45.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.355+0000 7faa9effd640 1 --2- 172.21.15.5:0/485233425 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7faa880a2c10 0x7faa880a50d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7faa94004770 tx=0x7faa940058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:45.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.358+0000 7faa9cff9640 1 -- 172.21.15.5:0/485233425 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faa9009bf50 con 0x7faaa0101de0 2024-09-11T23:28:45.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.583+0000 7faaa5e49640 1 -- 172.21.15.5:0/485233425 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faaa0197510 con 0x7faaa0101de0 2024-09-11T23:28:45.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:45 smithi005 ceph-mon[31201]: pgmap v345: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T23:28:45.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:45 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:28:45.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.584+0000 7faa9cff9640 1 -- 172.21.15.5:0/485233425 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11918 (secure 0 0 0) 0x7faa9009b850 con 0x7faaa0101de0 2024-09-11T23:28:45.584 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:28:45.584 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":24,"btime":"2024-09-11T23:27:24:041243+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3865435482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3865435482},{"type":"v1","addr":"172.21.15.5:6835","nonce":3865435482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1323314897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":1323314897},{"type":"v1","addr":"172.21.15.5:6837","nonce":1323314897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14610,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6839/4140073288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":4140073288},{"type":"v1","addr":"172.21.15.5:6839","nonce":4140073288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6841/1162578713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":1162578713},{"type":"v1","addr":"172.21.15.5:6841","nonce":1162578713}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3113658116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3113658116},{"type":"v1","addr":"172.21.15.172:6833","nonce":3113658116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3887336060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3887336060},{"type":"v1","addr":"172.21.15.159:6833","nonce":3887336060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:26:45.305894+0000","modified":"2024-09-11T23:27:23.903504+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24475,"mds_2":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24440":{"gid":24440,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.159:6835/2539263301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2539263301},{"type":"v1","addr":"172.21.15.159:6835","nonce":2539263301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/4240913699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":4240913699},{"type":"v1","addr":"172.21.15.172:6835","nonce":4240913699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/4200951601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":4200951601},{"type":"v1","addr":"172.21.15.172:6837","nonce":4200951601}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":16,"addr":"172.21.15.159:6837/4020181017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":4020181017},{"type":"v1","addr":"172.21.15.159:6837","nonce":4020181017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.172:6839/3928313314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3928313314},{"type":"v1","addr":"172.21.15.172:6839","nonce":3928313314}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.159:6839/3843336290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3843336290},{"type":"v1","addr":"172.21.15.159:6839","nonce":3843336290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24461,24475,24494]},"id":1}]} 2024-09-11T23:28:45.584 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 24 2024-09-11T23:28:45.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.586+0000 7faaa5e49640 1 -- 172.21.15.5:0/485233425 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7faa880a2c10 msgr2=0x7faa880a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:45.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.586+0000 7faaa5e49640 1 --2- 172.21.15.5:0/485233425 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7faa880a2c10 0x7faa880a50d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7faa94004770 tx=0x7faa940058d0 comp rx=0 tx=0).stop 2024-09-11T23:28:45.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.586+0000 7faaa5e49640 1 -- 172.21.15.5:0/485233425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaa0101de0 msgr2=0x7faaa01961b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:45.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.586+0000 7faaa5e49640 1 --2- 172.21.15.5:0/485233425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaa0101de0 0x7faaa01961b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faa9000e9f0 tx=0x7faa9000eeb0 comp rx=0 tx=0).stop 2024-09-11T23:28:45.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.587+0000 7faaa5e49640 1 -- 172.21.15.5:0/485233425 shutdown_connections 2024-09-11T23:28:45.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.587+0000 7faaa5e49640 1 --2- 172.21.15.5:0/485233425 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7faa880a2c10 0x7faa880a50d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:45.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.587+0000 7faaa5e49640 1 --2- 172.21.15.5:0/485233425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faaa0106f10 0x7faaa019aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:45.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.587+0000 7faaa5e49640 1 --2- 172.21.15.5:0/485233425 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faaa0102790 0x7faaa01966f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:45.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.587+0000 7faaa5e49640 1 --2- 172.21.15.5:0/485233425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaa0101de0 0x7faaa01961b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:45.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.587+0000 7faaa5e49640 1 -- 172.21.15.5:0/485233425 >> 172.21.15.5:0/485233425 conn(0x7faaa00fd8c0 msgr2=0x7faaa00fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:45.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.587+0000 7faaa5e49640 1 -- 172.21.15.5:0/485233425 shutdown_connections 2024-09-11T23:28:45.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:45.587+0000 7faaa5e49640 1 -- 172.21.15.5:0/485233425 wait complete. 2024-09-11T23:28:45.589 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:45 smithi159 ceph-mon[34394]: pgmap v345: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T23:28:45.590 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:45 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:28:45.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:45 smithi172 ceph-mon[34855]: pgmap v345: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T23:28:45.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:45 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:28:46.534 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:46 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/485233425' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:28:46.534 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:46 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:28:46.534 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:46 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:28:46.534 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:46 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:28:46.534 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:46 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:28:46.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:46 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/485233425' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:28:46.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:46 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:28:46.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:46 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:28:46.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:46 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:28:46.627 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:46 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:28:46.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:46 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/485233425' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:28:46.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:46 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:28:46.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:46 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:28:46.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:46 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:28:46.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:46 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:28:46.905 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:28:47.183 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:28:47.580 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:47 smithi005 ceph-mon[31201]: pgmap v346: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T23:28:47.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:47 smithi159 ceph-mon[34394]: pgmap v346: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T23:28:47.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:47 smithi172 ceph-mon[34855]: pgmap v346: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T23:28:47.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.663+0000 7f5365ff8640 1 -- 172.21.15.5:0/3383777047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5360102790 msgr2=0x7f53601067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:47.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.663+0000 7f5365ff8640 1 --2- 172.21.15.5:0/3383777047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5360102790 0x7f53601067e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5354009900 tx=0x7f535402a410 comp rx=0 tx=0).stop 2024-09-11T23:28:47.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.663+0000 7f5365ff8640 1 -- 172.21.15.5:0/3383777047 shutdown_connections 2024-09-11T23:28:47.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.663+0000 7f5365ff8640 1 --2- 172.21.15.5:0/3383777047 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5360106f10 0x7f536010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:47.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.663+0000 7f5365ff8640 1 --2- 172.21.15.5:0/3383777047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5360102790 0x7f53601067e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:47.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.663+0000 7f5365ff8640 1 --2- 172.21.15.5:0/3383777047 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5360101de0 0x7f53601021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:47.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.663+0000 7f5365ff8640 1 -- 172.21.15.5:0/3383777047 >> 172.21.15.5:0/3383777047 conn(0x7f53600fd8c0 msgr2=0x7f53600ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:47.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.663+0000 7f5365ff8640 1 -- 172.21.15.5:0/3383777047 shutdown_connections 2024-09-11T23:28:47.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.663+0000 7f5365ff8640 1 -- 172.21.15.5:0/3383777047 wait complete. 2024-09-11T23:28:47.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.664+0000 7f5365ff8640 1 Processor -- start 2024-09-11T23:28:47.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.664+0000 7f5365ff8640 1 -- start start 2024-09-11T23:28:47.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.664+0000 7f5365ff8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5360101de0 0x7f53601983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:47.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.664+0000 7f5365ff8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5360102790 0x7f53601988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:47.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.664+0000 7f5365ff8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5360106f10 0x7f536019cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:47.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.664+0000 7f5365ff8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5360111e20 con 0x7f5360101de0 2024-09-11T23:28:47.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.664+0000 7f5365ff8640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5360111ca0 con 0x7f5360102790 2024-09-11T23:28:47.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.664+0000 7f5365ff8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5360111fa0 con 0x7f5360106f10 2024-09-11T23:28:47.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.664+0000 7f535f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5360101de0 0x7f53601983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:47.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.664+0000 7f535f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5360101de0 0x7f53601983a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37864/0 (socket says 172.21.15.5:37864) 2024-09-11T23:28:47.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.664+0000 7f535f7fe640 1 -- 172.21.15.5:0/1219292100 learned_addr learned my addr 172.21.15.5:0/1219292100 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:47.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.665+0000 7f535f7fe640 1 -- 172.21.15.5:0/1219292100 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5360106f10 msgr2=0x7f536019cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:47.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.665+0000 7f535ffff640 1 --2- 172.21.15.5:0/1219292100 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5360106f10 0x7f536019cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:47.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.665+0000 7f535f7fe640 1 --2- 172.21.15.5:0/1219292100 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5360106f10 0x7f536019cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:47.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.665+0000 7f535effd640 1 --2- 172.21.15.5:0/1219292100 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5360102790 0x7f53601988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:47.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.665+0000 7f535f7fe640 1 -- 172.21.15.5:0/1219292100 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5360102790 msgr2=0x7f53601988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:47.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.665+0000 7f535f7fe640 1 --2- 172.21.15.5:0/1219292100 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5360102790 0x7f53601988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:47.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.665+0000 7f535f7fe640 1 -- 172.21.15.5:0/1219292100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f536019d350 con 0x7f5360101de0 2024-09-11T23:28:47.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.665+0000 7f535ffff640 1 --2- 172.21.15.5:0/1219292100 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5360106f10 0x7f536019cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:28:47.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.665+0000 7f535effd640 1 --2- 172.21.15.5:0/1219292100 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5360102790 0x7f53601988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:28:47.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.665+0000 7f535f7fe640 1 --2- 172.21.15.5:0/1219292100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5360101de0 0x7f53601983a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f535000e9f0 tx=0x7f535000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:47.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.665+0000 7f535cff9640 1 -- 172.21.15.5:0/1219292100 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f535000cd80 con 0x7f5360101de0 2024-09-11T23:28:47.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.665+0000 7f535cff9640 1 -- 172.21.15.5:0/1219292100 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f53500108e0 con 0x7f5360101de0 2024-09-11T23:28:47.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.665+0000 7f5365ff8640 1 -- 172.21.15.5:0/1219292100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f536019d640 con 0x7f5360101de0 2024-09-11T23:28:47.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.665+0000 7f535cff9640 1 -- 172.21.15.5:0/1219292100 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5350018920 con 0x7f5360101de0 2024-09-11T23:28:47.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.665+0000 7f5365ff8640 1 -- 172.21.15.5:0/1219292100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53601a4f20 con 0x7f5360101de0 2024-09-11T23:28:47.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.666+0000 7f5365ff8640 1 -- 172.21.15.5:0/1219292100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53601021c0 con 0x7f5360101de0 2024-09-11T23:28:47.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.667+0000 7f535cff9640 1 -- 172.21.15.5:0/1219292100 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f5350010a90 con 0x7f5360101de0 2024-09-11T23:28:47.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.668+0000 7f535cff9640 1 --2- 172.21.15.5:0/1219292100 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f53480a2c10 0x7f53480a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:47.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.668+0000 7f535effd640 1 --2- 172.21.15.5:0/1219292100 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f53480a2c10 0x7f53480a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:47.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.668+0000 7f535cff9640 1 -- 172.21.15.5:0/1219292100 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7f53500cf9c0 con 0x7f5360101de0 2024-09-11T23:28:47.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.668+0000 7f535effd640 1 --2- 172.21.15.5:0/1219292100 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f53480a2c10 0x7f53480a50d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5354000c00 tx=0x7f5354031400 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:47.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.672+0000 7f535cff9640 1 -- 172.21.15.5:0/1219292100 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f535009c400 con 0x7f5360101de0 2024-09-11T23:28:47.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.899+0000 7f5365ff8640 1 -- 172.21.15.5:0/1219292100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f536002d7c0 con 0x7f5360101de0 2024-09-11T23:28:47.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.899+0000 7f535cff9640 1 -- 172.21.15.5:0/1219292100 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11918 (secure 0 0 0) 0x7f535009bd00 con 0x7f5360101de0 2024-09-11T23:28:47.899 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:28:47.899 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":24,"btime":"2024-09-11T23:27:24:041243+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3865435482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3865435482},{"type":"v1","addr":"172.21.15.5:6835","nonce":3865435482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1323314897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":1323314897},{"type":"v1","addr":"172.21.15.5:6837","nonce":1323314897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14610,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6839/4140073288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":4140073288},{"type":"v1","addr":"172.21.15.5:6839","nonce":4140073288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6841/1162578713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":1162578713},{"type":"v1","addr":"172.21.15.5:6841","nonce":1162578713}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3113658116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3113658116},{"type":"v1","addr":"172.21.15.172:6833","nonce":3113658116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3887336060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3887336060},{"type":"v1","addr":"172.21.15.159:6833","nonce":3887336060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:26:45.305894+0000","modified":"2024-09-11T23:27:23.903504+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24475,"mds_2":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24440":{"gid":24440,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.159:6835/2539263301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2539263301},{"type":"v1","addr":"172.21.15.159:6835","nonce":2539263301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/4240913699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":4240913699},{"type":"v1","addr":"172.21.15.172:6835","nonce":4240913699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/4200951601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":4200951601},{"type":"v1","addr":"172.21.15.172:6837","nonce":4200951601}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":16,"addr":"172.21.15.159:6837/4020181017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":4020181017},{"type":"v1","addr":"172.21.15.159:6837","nonce":4020181017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.172:6839/3928313314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3928313314},{"type":"v1","addr":"172.21.15.172:6839","nonce":3928313314}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.159:6839/3843336290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3843336290},{"type":"v1","addr":"172.21.15.159:6839","nonce":3843336290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24461,24475,24494]},"id":1}]} 2024-09-11T23:28:47.900 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 24 2024-09-11T23:28:47.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.902+0000 7f5365ff8640 1 -- 172.21.15.5:0/1219292100 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f53480a2c10 msgr2=0x7f53480a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:47.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.902+0000 7f5365ff8640 1 --2- 172.21.15.5:0/1219292100 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f53480a2c10 0x7f53480a50d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5354000c00 tx=0x7f5354031400 comp rx=0 tx=0).stop 2024-09-11T23:28:47.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.902+0000 7f5365ff8640 1 -- 172.21.15.5:0/1219292100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5360101de0 msgr2=0x7f53601983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:47.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.902+0000 7f5365ff8640 1 --2- 172.21.15.5:0/1219292100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5360101de0 0x7f53601983a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f535000e9f0 tx=0x7f535000eeb0 comp rx=0 tx=0).stop 2024-09-11T23:28:47.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.902+0000 7f5365ff8640 1 -- 172.21.15.5:0/1219292100 shutdown_connections 2024-09-11T23:28:47.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.902+0000 7f5365ff8640 1 --2- 172.21.15.5:0/1219292100 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f53480a2c10 0x7f53480a50d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:47.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.902+0000 7f5365ff8640 1 --2- 172.21.15.5:0/1219292100 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5360106f10 0x7f536019cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:47.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.902+0000 7f5365ff8640 1 --2- 172.21.15.5:0/1219292100 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5360102790 0x7f53601988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:47.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.902+0000 7f5365ff8640 1 --2- 172.21.15.5:0/1219292100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5360101de0 0x7f53601983a0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:47.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.902+0000 7f5365ff8640 1 -- 172.21.15.5:0/1219292100 >> 172.21.15.5:0/1219292100 conn(0x7f53600fd8c0 msgr2=0x7f53600fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:47.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.902+0000 7f5365ff8640 1 -- 172.21.15.5:0/1219292100 shutdown_connections 2024-09-11T23:28:47.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:47.902+0000 7f5365ff8640 1 -- 172.21.15.5:0/1219292100 wait complete. 2024-09-11T23:28:48.537 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T23:28:48.794 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:28:49.062 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:48 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:28:49.063 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:48 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:28:49.063 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:48 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/1219292100' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:28:49.063 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:48 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:28:49.063 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:48 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:28:49.063 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:48 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:28:49.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:48 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:28:49.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:48 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:28:49.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:48 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/1219292100' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:28:49.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:48 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:28:49.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:48 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:28:49.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:48 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:28:49.133 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:48 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:28:49.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:48 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:28:49.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:48 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/1219292100' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:28:49.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:48 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:28:49.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:48 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:28:49.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:48 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:28:49.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.358+0000 7fcd4c857640 1 -- 172.21.15.5:0/2093326281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd48100a80 msgr2=0x7fcd48100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:49.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.358+0000 7fcd4c857640 1 --2- 172.21.15.5:0/2093326281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd48100a80 0x7fcd48100ee0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c009930 tx=0x7fcd3c02a420 comp rx=0 tx=0).stop 2024-09-11T23:28:49.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.358+0000 7fcd4c857640 1 -- 172.21.15.5:0/2093326281 shutdown_connections 2024-09-11T23:28:49.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.358+0000 7fcd4c857640 1 --2- 172.21.15.5:0/2093326281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd48101420 0x7fcd4810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:49.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.358+0000 7fcd4c857640 1 --2- 172.21.15.5:0/2093326281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd48100a80 0x7fcd48100ee0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:49.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.358+0000 7fcd4c857640 1 --2- 172.21.15.5:0/2093326281 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd48106a80 0x7fcd48106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:49.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.358+0000 7fcd4c857640 1 -- 172.21.15.5:0/2093326281 >> 172.21.15.5:0/2093326281 conn(0x7fcd480fc7a0 msgr2=0x7fcd480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:49.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.358+0000 7fcd4c857640 1 -- 172.21.15.5:0/2093326281 shutdown_connections 2024-09-11T23:28:49.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.358+0000 7fcd4c857640 1 -- 172.21.15.5:0/2093326281 wait complete. 2024-09-11T23:28:49.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.359+0000 7fcd4c857640 1 Processor -- start 2024-09-11T23:28:49.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.359+0000 7fcd4c857640 1 -- start start 2024-09-11T23:28:49.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.359+0000 7fcd4c857640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd48100a80 0x7fcd4810e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:49.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.359+0000 7fcd4c857640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd48101420 0x7fcd4810e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:49.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.359+0000 7fcd4c857640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd48106a80 0x7fcd4810ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:49.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.359+0000 7fcd4c857640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcd48111ea0 con 0x7fcd48106a80 2024-09-11T23:28:49.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.359+0000 7fcd4c857640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fcd48111d20 con 0x7fcd48100a80 2024-09-11T23:28:49.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.359+0000 7fcd4c857640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcd48112020 con 0x7fcd48101420 2024-09-11T23:28:49.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.359+0000 7fcd46d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd48106a80 0x7fcd4810ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:49.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.360+0000 7fcd46d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd48106a80 0x7fcd4810ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37884/0 (socket says 172.21.15.5:37884) 2024-09-11T23:28:49.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.360+0000 7fcd46d9d640 1 -- 172.21.15.5:0/3179787051 learned_addr learned my addr 172.21.15.5:0/3179787051 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:49.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.360+0000 7fcd45d9b640 1 --2- 172.21.15.5:0/3179787051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd48101420 0x7fcd4810e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:49.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.360+0000 7fcd4659c640 1 --2- 172.21.15.5:0/3179787051 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd48100a80 0x7fcd4810e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:49.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.360+0000 7fcd46d9d640 1 -- 172.21.15.5:0/3179787051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd48101420 msgr2=0x7fcd4810e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:49.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.360+0000 7fcd46d9d640 1 --2- 172.21.15.5:0/3179787051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd48101420 0x7fcd4810e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:49.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.360+0000 7fcd46d9d640 1 -- 172.21.15.5:0/3179787051 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd48100a80 msgr2=0x7fcd4810e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:49.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.360+0000 7fcd46d9d640 1 --2- 172.21.15.5:0/3179787051 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd48100a80 0x7fcd4810e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:49.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.360+0000 7fcd46d9d640 1 -- 172.21.15.5:0/3179787051 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd481a68c0 con 0x7fcd48106a80 2024-09-11T23:28:49.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.360+0000 7fcd46d9d640 1 --2- 172.21.15.5:0/3179787051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd48106a80 0x7fcd4810ece0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fcd4000b970 tx=0x7fcd4000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:49.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.360+0000 7fcd377fe640 1 -- 172.21.15.5:0/3179787051 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd40019070 con 0x7fcd48106a80 2024-09-11T23:28:49.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.360+0000 7fcd4c857640 1 -- 172.21.15.5:0/3179787051 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd481a6bb0 con 0x7fcd48106a80 2024-09-11T23:28:49.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.360+0000 7fcd377fe640 1 -- 172.21.15.5:0/3179787051 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcd40014440 con 0x7fcd48106a80 2024-09-11T23:28:49.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.360+0000 7fcd377fe640 1 -- 172.21.15.5:0/3179787051 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd400075d0 con 0x7fcd48106a80 2024-09-11T23:28:49.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.360+0000 7fcd4c857640 1 -- 172.21.15.5:0/3179787051 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd481a70c0 con 0x7fcd48106a80 2024-09-11T23:28:49.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.361+0000 7fcd4c857640 1 -- 172.21.15.5:0/3179787051 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd48100ee0 con 0x7fcd48106a80 2024-09-11T23:28:49.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.362+0000 7fcd377fe640 1 -- 172.21.15.5:0/3179787051 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fcd4001c070 con 0x7fcd48106a80 2024-09-11T23:28:49.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.363+0000 7fcd377fe640 1 --2- 172.21.15.5:0/3179787051 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fcd300a2c10 0x7fcd300a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:49.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.363+0000 7fcd4659c640 1 --2- 172.21.15.5:0/3179787051 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fcd300a2c10 0x7fcd300a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:49.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.363+0000 7fcd377fe640 1 -- 172.21.15.5:0/3179787051 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7fcd400cea10 con 0x7fcd48106a80 2024-09-11T23:28:49.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.364+0000 7fcd4659c640 1 --2- 172.21.15.5:0/3179787051 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fcd300a2c10 0x7fcd300a50d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcd38005fd0 tx=0x7fcd38005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:49.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.368+0000 7fcd377fe640 1 -- 172.21.15.5:0/3179787051 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcd4009af10 con 0x7fcd48106a80 2024-09-11T23:28:49.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.545+0000 7fcd4c857640 1 -- 172.21.15.5:0/3179787051 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcd4802d7c0 con 0x7fcd48106a80 2024-09-11T23:28:49.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.547+0000 7fcd377fe640 1 -- 172.21.15.5:0/3179787051 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24843 (secure 0 0 0) 0x7fcd4009f210 con 0x7fcd48106a80 2024-09-11T23:28:49.547 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:28:49.547 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":88,"fsid":"1f5284d2-7094-11ef-bcea-c7b262605968","created":"2024-09-11T23:19:00.051813+0000","modified":"2024-09-11T23:27:52.098396+0000","last_up_change":"2024-09-11T23:25:53.433445+0000","last_in_change":"2024-09-11T23:25:29.443287+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:22:04.534014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:26:41.220887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:26:43.664094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T23:26:50.471521+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bf95ced0-780b-482f-87da-0b5e61de62ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6803","nonce":624761084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6805","nonce":624761084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6809","nonce":624761084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6807","nonce":624761084}]},"public_addr":"172.21.15.5:6803/624761084","cluster_addr":"172.21.15.5:6805/624761084","heartbeat_back_addr":"172.21.15.5:6809/624761084","heartbeat_front_addr":"172.21.15.5:6807/624761084","state":["exists","up"]},{"osd":1,"uuid":"d926484f-78a6-497b-843d-f2db54ade4a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6801","nonce":2111290186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6803","nonce":2111290186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6807","nonce":2111290186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6805","nonce":2111290186}]},"public_addr":"172.21.15.159:6801/2111290186","cluster_addr":"172.21.15.159:6803/2111290186","heartbeat_back_addr":"172.21.15.159:6807/2111290186","heartbeat_front_addr":"172.21.15.159:6805/2111290186","state":["exists","up"]},{"osd":2,"uuid":"d92cd431-0ba7-4171-82b8-60fa3d63a64b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6801","nonce":299915717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6803","nonce":299915717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6807","nonce":299915717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6805","nonce":299915717}]},"public_addr":"172.21.15.172:6801/299915717","cluster_addr":"172.21.15.172:6803/299915717","heartbeat_back_addr":"172.21.15.172:6807/299915717","heartbeat_front_addr":"172.21.15.172:6805/299915717","state":["exists","up"]},{"osd":3,"uuid":"0521043b-559c-4671-b11e-9117871cff49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6811","nonce":2080498921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6813","nonce":2080498921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6817","nonce":2080498921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6815","nonce":2080498921}]},"public_addr":"172.21.15.5:6811/2080498921","cluster_addr":"172.21.15.5:6813/2080498921","heartbeat_back_addr":"172.21.15.5:6817/2080498921","heartbeat_front_addr":"172.21.15.5:6815/2080498921","state":["exists","up"]},{"osd":4,"uuid":"b968d762-a46e-4ae2-b19d-8225f82de613","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6809","nonce":4185908786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6811","nonce":4185908786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6815","nonce":4185908786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6813","nonce":4185908786}]},"public_addr":"172.21.15.159:6809/4185908786","cluster_addr":"172.21.15.159:6811/4185908786","heartbeat_back_addr":"172.21.15.159:6815/4185908786","heartbeat_front_addr":"172.21.15.159:6813/4185908786","state":["exists","up"]},{"osd":5,"uuid":"1b0a518a-3d17-4635-81da-52f9ef83a574","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6809","nonce":3742759000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6811","nonce":3742759000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6815","nonce":3742759000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6813","nonce":3742759000}]},"public_addr":"172.21.15.172:6809/3742759000","cluster_addr":"172.21.15.172:6811/3742759000","heartbeat_back_addr":"172.21.15.172:6815/3742759000","heartbeat_front_addr":"172.21.15.172:6813/3742759000","state":["exists","up"]},{"osd":6,"uuid":"c3a2db6c-9189-4e42-aa1e-52189a9c4291","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6819","nonce":4156823423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6821","nonce":4156823423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6825","nonce":4156823423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6823","nonce":4156823423}]},"public_addr":"172.21.15.5:6819/4156823423","cluster_addr":"172.21.15.5:6821/4156823423","heartbeat_back_addr":"172.21.15.5:6825/4156823423","heartbeat_front_addr":"172.21.15.5:6823/4156823423","state":["exists","up"]},{"osd":7,"uuid":"dfaadf28-74ab-4cda-8647-dcb58beb7cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6817","nonce":4222571927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6819","nonce":4222571927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6823","nonce":4222571927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6821","nonce":4222571927}]},"public_addr":"172.21.15.159:6817/4222571927","cluster_addr":"172.21.15.159:6819/4222571927","heartbeat_back_addr":"172.21.15.159:6823/4222571927","heartbeat_front_addr":"172.21.15.159:6821/4222571927","state":["exists","up"]},{"osd":8,"uuid":"47f66651-614c-4613-9793-69c140dbf705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6817","nonce":3661505951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6819","nonce":3661505951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6823","nonce":3661505951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6821","nonce":3661505951}]},"public_addr":"172.21.15.172:6817/3661505951","cluster_addr":"172.21.15.172:6819/3661505951","heartbeat_back_addr":"172.21.15.172:6823/3661505951","heartbeat_front_addr":"172.21.15.172:6821/3661505951","state":["exists","up"]},{"osd":9,"uuid":"c97b8221-8cf9-4fab-9e27-ff7f3bd98152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6827","nonce":72036667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6829","nonce":72036667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6833","nonce":72036667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6831","nonce":72036667}]},"public_addr":"172.21.15.5:6827/72036667","cluster_addr":"172.21.15.5:6829/72036667","heartbeat_back_addr":"172.21.15.5:6833/72036667","heartbeat_front_addr":"172.21.15.5:6831/72036667","state":["exists","up"]},{"osd":10,"uuid":"143376c1-f3f1-4df4-bcd3-a9b46fad8c1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6825","nonce":3334483164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6827","nonce":3334483164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6831","nonce":3334483164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6829","nonce":3334483164}]},"public_addr":"172.21.15.159:6825/3334483164","cluster_addr":"172.21.15.159:6827/3334483164","heartbeat_back_addr":"172.21.15.159:6831/3334483164","heartbeat_front_addr":"172.21.15.159:6829/3334483164","state":["exists","up"]},{"osd":11,"uuid":"5cc91ff9-fc0f-4e7a-8e4d-87df0e7efbeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6825","nonce":1965415663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6827","nonce":1965415663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6831","nonce":1965415663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6829","nonce":1965415663}]},"public_addr":"172.21.15.172:6825/1965415663","cluster_addr":"172.21.15.172:6827/1965415663","heartbeat_back_addr":"172.21.15.172:6831/1965415663","heartbeat_front_addr":"172.21.15.172:6829/1965415663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:21:13.024707+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:21:38.063741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:22:02.221583+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:22:27.919711+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:22:53.870543+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:23:18.539905+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:23:43.694229+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:24:08.984704+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:24:34.378582+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:25:00.102231+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:25:25.367178+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:25:51.439033+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":10}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/2713701762":"2024-09-12T23:19:50.031855+0000","172.21.15.5:0/3135835713":"2024-09-12T23:19:50.031855+0000","172.21.15.5:0/3935034940":"2024-09-12T23:19:50.031855+0000","172.21.15.5:6801/1790126649":"2024-09-12T23:19:50.031855+0000","172.21.15.5:6801/1358356358":"2024-09-12T23:19:26.149011+0000","172.21.15.5:6800/1790126649":"2024-09-12T23:19:50.031855+0000","172.21.15.5:6800/1358356358":"2024-09-12T23:19:26.149011+0000","172.21.15.5:0/2243688290":"2024-09-12T23:19:26.149011+0000","172.21.15.5:0/1493331899":"2024-09-12T23:19:26.149011+0000","172.21.15.5:0/2329812802":"2024-09-12T23:19:26.149011+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:28:49.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.549+0000 7fcd4c857640 1 -- 172.21.15.5:0/3179787051 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fcd300a2c10 msgr2=0x7fcd300a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:49.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.549+0000 7fcd4c857640 1 --2- 172.21.15.5:0/3179787051 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fcd300a2c10 0x7fcd300a50d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcd38005fd0 tx=0x7fcd38005850 comp rx=0 tx=0).stop 2024-09-11T23:28:49.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.549+0000 7fcd4c857640 1 -- 172.21.15.5:0/3179787051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd48106a80 msgr2=0x7fcd4810ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:49.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.549+0000 7fcd4c857640 1 --2- 172.21.15.5:0/3179787051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd48106a80 0x7fcd4810ece0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fcd4000b970 tx=0x7fcd4000be30 comp rx=0 tx=0).stop 2024-09-11T23:28:49.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.549+0000 7fcd4c857640 1 -- 172.21.15.5:0/3179787051 shutdown_connections 2024-09-11T23:28:49.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.549+0000 7fcd4c857640 1 --2- 172.21.15.5:0/3179787051 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fcd300a2c10 0x7fcd300a50d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:49.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.549+0000 7fcd4c857640 1 --2- 172.21.15.5:0/3179787051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd48106a80 0x7fcd4810ece0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:49.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.549+0000 7fcd4c857640 1 --2- 172.21.15.5:0/3179787051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd48101420 0x7fcd4810e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:49.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.549+0000 7fcd4c857640 1 --2- 172.21.15.5:0/3179787051 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd48100a80 0x7fcd4810e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:49.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.549+0000 7fcd4c857640 1 -- 172.21.15.5:0/3179787051 >> 172.21.15.5:0/3179787051 conn(0x7fcd480fc7a0 msgr2=0x7fcd480fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:49.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.550+0000 7fcd4c857640 1 -- 172.21.15.5:0/3179787051 shutdown_connections 2024-09-11T23:28:49.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:49.550+0000 7fcd4c857640 1 -- 172.21.15.5:0/3179787051 wait complete. 2024-09-11T23:28:50.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:49 smithi159 ceph-mon[34394]: pgmap v347: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T23:28:50.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:49 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/3179787051' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:28:50.133 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:49 smithi172 ceph-mon[34855]: pgmap v347: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T23:28:50.133 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:49 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/3179787051' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:28:50.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:49 smithi005 ceph-mon[31201]: pgmap v347: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T23:28:50.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:49 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/3179787051' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:28:50.258 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-11T23:26:45.305894+0000', 'modified': '2024-09-11T23:27:23.903504+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24494, 'mds_1': 24475, 'mds_2': 24461}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24440': {'gid': 24440, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.159:6835/2539263301', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.159:6834', 'nonce': 2539263301}, {'type': 'v1', 'addr': '172.21.15.159:6835', 'nonce': 2539263301}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24454': {'gid': 24454, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.172:6835/4240913699', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6834', 'nonce': 4240913699}, {'type': 'v1', 'addr': '172.21.15.172:6835', 'nonce': 4240913699}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24460': {'gid': 24460, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.172:6837/4200951601', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6836', 'nonce': 4200951601}, {'type': 'v1', 'addr': '172.21.15.172:6837', 'nonce': 4200951601}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24461': {'gid': 24461, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.159:6837/4020181017', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.159:6836', 'nonce': 4020181017}, {'type': 'v1', 'addr': '172.21.15.159:6837', 'nonce': 4020181017}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24475': {'gid': 24475, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 15, 'addr': '172.21.15.172:6839/3928313314', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6838', 'nonce': 3928313314}, {'type': 'v1', 'addr': '172.21.15.172:6839', 'nonce': 3928313314}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24494': {'gid': 24494, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.159:6839/3843336290', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.159:6838', 'nonce': 3843336290}, {'type': 'v1', 'addr': '172.21.15.159:6839', 'nonce': 3843336290}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24494, 'qdb_cluster': [24461, 24475, 24494]} 2024-09-11T23:28:50.258 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-11T23:28:50.258 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-11T23:28:50.513 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:28:50.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.984+0000 7f223053a640 1 -- 172.21.15.5:0/1677415653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22281082e0 msgr2=0x7f222810ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:50.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.984+0000 7f223053a640 1 --2- 172.21.15.5:0/1677415653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22281082e0 0x7f222810ec50 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2220009930 tx=0x7f222002a440 comp rx=0 tx=0).stop 2024-09-11T23:28:50.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.984+0000 7f223053a640 1 -- 172.21.15.5:0/1677415653 shutdown_connections 2024-09-11T23:28:50.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.984+0000 7f223053a640 1 --2- 172.21.15.5:0/1677415653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22281082e0 0x7f222810ec50 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:50.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.984+0000 7f223053a640 1 --2- 172.21.15.5:0/1677415653 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2228103760 0x7f2228107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:50.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.984+0000 7f223053a640 1 --2- 172.21.15.5:0/1677415653 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2228102db0 0x7f2228103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:50.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.984+0000 7f223053a640 1 -- 172.21.15.5:0/1677415653 >> 172.21.15.5:0/1677415653 conn(0x7f22280fc7d0 msgr2=0x7f22280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:50.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.984+0000 7f223053a640 1 -- 172.21.15.5:0/1677415653 shutdown_connections 2024-09-11T23:28:50.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.984+0000 7f223053a640 1 -- 172.21.15.5:0/1677415653 wait complete. 2024-09-11T23:28:50.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.984+0000 7f223053a640 1 Processor -- start 2024-09-11T23:28:50.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.984+0000 7f223053a640 1 -- start start 2024-09-11T23:28:50.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.985+0000 7f223053a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2228102db0 0x7f2228198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:50.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.985+0000 7f223053a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2228103760 0x7f2228198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:50.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.985+0000 7f223053a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22281082e0 0x7f222819cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:50.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.985+0000 7f223053a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2228112020 con 0x7f22281082e0 2024-09-11T23:28:50.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.985+0000 7f223053a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f2228111ea0 con 0x7f2228102db0 2024-09-11T23:28:50.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.985+0000 7f223053a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f22281121a0 con 0x7f2228103760 2024-09-11T23:28:50.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.985+0000 7f222ead7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22281082e0 0x7f222819cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:50.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.985+0000 7f222ead7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22281082e0 0x7f222819cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37894/0 (socket says 172.21.15.5:37894) 2024-09-11T23:28:50.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.985+0000 7f222ead7640 1 -- 172.21.15.5:0/1301326184 learned_addr learned my addr 172.21.15.5:0/1301326184 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:50.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.985+0000 7f222dad5640 1 --2- 172.21.15.5:0/1301326184 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2228103760 0x7f2228198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:50.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.985+0000 7f222e2d6640 1 --2- 172.21.15.5:0/1301326184 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2228102db0 0x7f2228198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:50.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.985+0000 7f222ead7640 1 -- 172.21.15.5:0/1301326184 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2228103760 msgr2=0x7f2228198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:50.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.985+0000 7f222ead7640 1 --2- 172.21.15.5:0/1301326184 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2228103760 0x7f2228198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:50.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.985+0000 7f222ead7640 1 -- 172.21.15.5:0/1301326184 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2228102db0 msgr2=0x7f2228198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:50.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.985+0000 7f222ead7640 1 --2- 172.21.15.5:0/1301326184 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2228102db0 0x7f2228198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:50.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.985+0000 7f222ead7640 1 -- 172.21.15.5:0/1301326184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f222819d4d0 con 0x7f22281082e0 2024-09-11T23:28:50.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.985+0000 7f222ead7640 1 --2- 172.21.15.5:0/1301326184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22281082e0 0x7f222819cdf0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2220005ab0 tx=0x7f22200042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:50.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.986+0000 7f22277fe640 1 -- 172.21.15.5:0/1301326184 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f222003f030 con 0x7f22281082e0 2024-09-11T23:28:50.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.986+0000 7f22277fe640 1 -- 172.21.15.5:0/1301326184 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2220003cb0 con 0x7f22281082e0 2024-09-11T23:28:50.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.986+0000 7f223053a640 1 -- 172.21.15.5:0/1301326184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f222819d760 con 0x7f22281082e0 2024-09-11T23:28:50.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.986+0000 7f22277fe640 1 -- 172.21.15.5:0/1301326184 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2220035070 con 0x7f22281082e0 2024-09-11T23:28:50.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.986+0000 7f223053a640 1 -- 172.21.15.5:0/1301326184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22281a50a0 con 0x7f22281082e0 2024-09-11T23:28:50.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.988+0000 7f22277fe640 1 -- 172.21.15.5:0/1301326184 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f2220042030 con 0x7f22281082e0 2024-09-11T23:28:50.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.988+0000 7f2232913740 1 Processor -- start 2024-09-11T23:28:50.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.988+0000 7f2232913740 1 -- start start 2024-09-11T23:28:50.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.988+0000 7f2232913740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5601b9c9b8d0 0x5601b9c9bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:50.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.989+0000 7f2232913740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5601b9c9c1f0 0x5601b9caaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:50.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.989+0000 7f2232913740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601b9caafc0 0x5601b9cad3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:50.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.989+0000 7f2232913740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5601b9c02090 con 0x5601b9caafc0 2024-09-11T23:28:50.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.989+0000 7f2232913740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5601b9ba9a70 con 0x5601b9c9b8d0 2024-09-11T23:28:50.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.989+0000 7f2232913740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5601b9bfe050 con 0x5601b9c9c1f0 2024-09-11T23:28:50.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.989+0000 7f222dad5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601b9caafc0 0x5601b9cad3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:50.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.989+0000 7f222dad5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601b9caafc0 0x5601b9cad3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37906/0 (socket says 172.21.15.5:37906) 2024-09-11T23:28:50.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.989+0000 7f222dad5640 1 -- 172.21.15.5:0/348612243 learned_addr learned my addr 172.21.15.5:0/348612243 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:50.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.989+0000 7f22277fe640 1 --2- 172.21.15.5:0/1301326184 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f22100a2c10 0x7f22100a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:50.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.989+0000 7f222e2d6640 1 --2- 172.21.15.5:0/348612243 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5601b9c9c1f0 0x5601b9caaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:50.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.989+0000 7f222dad5640 1 --2- 172.21.15.5:0/348612243 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5601b9c9b8d0 0x5601b9c9bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:50.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.989+0000 7f22277fe640 1 -- 172.21.15.5:0/1301326184 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7f22200efab0 con 0x7f22281082e0 2024-09-11T23:28:50.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.989+0000 7f222dad5640 1 -- 172.21.15.5:0/348612243 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5601b9c9c1f0 msgr2=0x5601b9caaa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:28:50.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.989+0000 7f222dad5640 1 --2- 172.21.15.5:0/348612243 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5601b9c9c1f0 0x5601b9caaa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:50.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.989+0000 7f222ead7640 1 --2- 172.21.15.5:0/1301326184 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f22100a2c10 0x7f22100a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:50.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.989+0000 7f222dad5640 1 -- 172.21.15.5:0/348612243 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5601b9c9b8d0 msgr2=0x5601b9c9bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:28:50.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.989+0000 7f222dad5640 1 --2- 172.21.15.5:0/348612243 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5601b9c9b8d0 0x5601b9c9bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:50.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.989+0000 7f222dad5640 1 -- 172.21.15.5:0/348612243 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601b9bb6130 con 0x5601b9caafc0 2024-09-11T23:28:50.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.989+0000 7f222dad5640 1 --2- 172.21.15.5:0/348612243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601b9caafc0 0x5601b9cad3b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f221c009330 tx=0x7f221c0094d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f1bd44a1be1dce server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:50.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.990+0000 7f2224ff9640 1 -- 172.21.15.5:0/348612243 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f221c017e60 con 0x5601b9caafc0 2024-09-11T23:28:50.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.990+0000 7f2224ff9640 1 -- 172.21.15.5:0/348612243 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f221c01d070 con 0x5601b9caafc0 2024-09-11T23:28:50.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.990+0000 7f2224ff9640 1 -- 172.21.15.5:0/348612243 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f221c018940 con 0x5601b9caafc0 2024-09-11T23:28:50.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.990+0000 7f2232913740 1 -- 172.21.15.5:0/348612243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601b9caafc0 msgr2=0x5601b9cad3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:50.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.990+0000 7f222ead7640 1 --2- 172.21.15.5:0/1301326184 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f22100a2c10 0x7f22100a50d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f222002a480 tx=0x7f222008de00 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:50.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.990+0000 7f2232913740 1 --2- 172.21.15.5:0/348612243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601b9caafc0 0x5601b9cad3b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f221c009330 tx=0x7f221c0094d0 comp rx=0 tx=0).stop 2024-09-11T23:28:50.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.990+0000 7f2232913740 1 -- 172.21.15.5:0/348612243 shutdown_connections 2024-09-11T23:28:50.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.990+0000 7f2232913740 1 --2- 172.21.15.5:0/348612243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601b9caafc0 0x5601b9cad3b0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:50.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.990+0000 7f2232913740 1 --2- 172.21.15.5:0/348612243 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5601b9c9c1f0 0x5601b9caaa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:50.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.990+0000 7f2232913740 1 --2- 172.21.15.5:0/348612243 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5601b9c9b8d0 0x5601b9c9bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:50.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.990+0000 7f2232913740 1 -- 172.21.15.5:0/348612243 >> 172.21.15.5:0/348612243 conn(0x5601b9c97f60 msgr2=0x5601b9c98340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:50.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.991+0000 7f2232913740 1 -- 172.21.15.5:0/348612243 shutdown_connections 2024-09-11T23:28:50.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.991+0000 7f2232913740 1 -- 172.21.15.5:0/348612243 wait complete. 2024-09-11T23:28:50.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.991+0000 7f2232913740 1 -- start start 2024-09-11T23:28:50.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.991+0000 7f2232913740 1 Processor -- start 2024-09-11T23:28:50.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.991+0000 7f2232913740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5601b9c9b8d0 0x5601b9caa8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:50.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.991+0000 7f2232913740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5601b9c9c1f0 0x5601b9ca7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:50.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.991+0000 7f2232913740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601b9caafc0 0x5601b9ca8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:50.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.991+0000 7f2232913740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5601b9cadb90 con 0x5601b9caafc0 2024-09-11T23:28:50.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.991+0000 7f2232913740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5601b9bbcf20 con 0x5601b9c9c1f0 2024-09-11T23:28:50.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.991+0000 7f2232913740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5601b9cadd10 con 0x5601b9c9b8d0 2024-09-11T23:28:50.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.991+0000 7f2232913740 10 client.0 _ll_register_callbacks cb 0x5601b9b86030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:28:50.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.991+0000 7f222dad5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601b9caafc0 0x5601b9ca8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:50.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.991+0000 7f222dad5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601b9caafc0 0x5601b9ca8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37908/0 (socket says 172.21.15.5:37908) 2024-09-11T23:28:50.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.992+0000 7f222dad5640 1 -- 172.21.15.5:0/4088617666 learned_addr learned my addr 172.21.15.5:0/4088617666 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:50.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.992+0000 7f222dad5640 1 --2- 172.21.15.5:0/4088617666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5601b9c9b8d0 0x5601b9caa8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:50.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.992+0000 7f222e2d6640 1 --2- 172.21.15.5:0/4088617666 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5601b9c9c1f0 0x5601b9ca7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:50.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.992+0000 7f222dad5640 1 -- 172.21.15.5:0/4088617666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5601b9c9b8d0 msgr2=0x5601b9caa8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:28:50.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.992+0000 7f222dad5640 1 --2- 172.21.15.5:0/4088617666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5601b9c9b8d0 0x5601b9caa8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:50.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.992+0000 7f222dad5640 1 -- 172.21.15.5:0/4088617666 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5601b9c9c1f0 msgr2=0x5601b9ca7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:28:50.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.992+0000 7f222dad5640 1 --2- 172.21.15.5:0/4088617666 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5601b9c9c1f0 0x5601b9ca7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:50.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.992+0000 7f222dad5640 1 -- 172.21.15.5:0/4088617666 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601b99732b0 con 0x5601b9caafc0 2024-09-11T23:28:50.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.992+0000 7f222dad5640 1 --2- 172.21.15.5:0/4088617666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601b9caafc0 0x5601b9ca8170 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f221c0091f0 tx=0x7f221c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49dd941ebcd9beae server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:50.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.992+0000 7f220dffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-11T23:28:50.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.992+0000 7f220dffb640 1 -- 172.21.15.5:0/4088617666 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f221c017e60 con 0x5601b9caafc0 2024-09-11T23:28:50.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.992+0000 7f2232913740 1 -- 172.21.15.5:0/4088617666 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f221c01d070 con 0x5601b9caafc0 2024-09-11T23:28:50.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.992+0000 7f220dffb640 1 -- 172.21.15.5:0/4088617666 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7f221c018b30 con 0x5601b9caafc0 2024-09-11T23:28:50.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.992+0000 7f220dffb640 1 -- 172.21.15.5:0/4088617666 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f221c033050 con 0x5601b9caafc0 2024-09-11T23:28:50.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.992+0000 7f2232913740 10 client.15189 fetch_fsmap learned FSMap version 24 2024-09-11T23:28:50.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.992+0000 7f2232913740 1 -- 172.21.15.5:0/4088617666 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5601b9cb9550 con 0x5601b9caafc0 2024-09-11T23:28:50.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.993+0000 7f220dffb640 1 -- 172.21.15.5:0/4088617666 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f221c01d070 con 0x5601b9caafc0 2024-09-11T23:28:50.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.993+0000 7f220dffb640 1 -- 172.21.15.5:0/4088617666 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f221c02e030 con 0x5601b9caafc0 2024-09-11T23:28:50.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.993+0000 7f2232913740 10 client.15189 fetch_fsmap finished waiting for FSMap version 24 2024-09-11T23:28:50.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.993+0000 7f2232913740 10 client.15189 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-11T23:28:50.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.993+0000 7f2232913740 20 client.15189 populate_metadata read hostname 'smithi005' 2024-09-11T23:28:50.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.993+0000 7f2232913740 1 --2- 172.21.15.5:0/4088617666 >> [v2:172.21.15.159:6836/4020181017,v1:172.21.15.159:6837/4020181017] conn(0x5601b9cbb7e0 0x5601b9cbcc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:50.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.993+0000 7f2232913740 4 client.15189 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:28:50.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.993+0000 7f2232913740 1 -- 172.21.15.5:0/4088617666 --> [v2:172.21.15.159:6836/4020181017,v1:172.21.15.159:6837/4020181017] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5601b9c0f600 con 0x5601b9cbb7e0 2024-09-11T23:28:50.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.993+0000 7f222e2d6640 1 --2- 172.21.15.5:0/4088617666 >> [v2:172.21.15.159:6836/4020181017,v1:172.21.15.159:6837/4020181017] conn(0x5601b9cbb7e0 0x5601b9cbcc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:50.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.994+0000 7f220dffb640 10 client.15189 ms_handle_connect on v2:172.21.15.159:6836/4020181017 2024-09-11T23:28:50.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.994+0000 7f222e2d6640 1 --2- 172.21.15.5:0/4088617666 >> [v2:172.21.15.159:6836/4020181017,v1:172.21.15.159:6837/4020181017] conn(0x5601b9cbb7e0 0x5601b9cbcc50 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ddc25ac48ea47fe8 server_cookie=e20abbd7553d0b25 in_seq=0 out_seq=0 2024-09-11T23:28:50.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.994+0000 7f220dffb640 1 -- 172.21.15.5:0/4088617666 <== mds.2 v2:172.21.15.159:6836/4020181017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5601b9c0f600 con 0x5601b9cbb7e0 2024-09-11T23:28:50.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.994+0000 7f220dffb640 10 client.15189 handle_command_reply: tid=0 2024-09-11T23:28:50.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.994+0000 7f2232913740 1 client.15189 shutdown 2024-09-11T23:28:50.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.994+0000 7f2232913740 1 -- 172.21.15.5:0/4088617666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601b9caafc0 msgr2=0x5601b9ca8170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:50.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.995+0000 7f2232913740 1 --2- 172.21.15.5:0/4088617666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601b9caafc0 0x5601b9ca8170 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f221c0091f0 tx=0x7f221c008040 comp rx=0 tx=0).stop 2024-09-11T23:28:50.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.995+0000 7f2232913740 1 -- 172.21.15.5:0/4088617666 shutdown_connections 2024-09-11T23:28:50.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.995+0000 7f2232913740 1 --2- 172.21.15.5:0/4088617666 >> [v2:172.21.15.159:6836/4020181017,v1:172.21.15.159:6837/4020181017] conn(0x5601b9cbb7e0 0x5601b9cbcc50 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:50.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.995+0000 7f2232913740 1 --2- 172.21.15.5:0/4088617666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601b9caafc0 0x5601b9ca8170 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:51.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.995+0000 7f2232913740 1 --2- 172.21.15.5:0/4088617666 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5601b9c9c1f0 0x5601b9ca7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:51.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.995+0000 7f2232913740 1 --2- 172.21.15.5:0/4088617666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5601b9c9b8d0 0x5601b9caa8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:51.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.995+0000 7f2232913740 1 -- 172.21.15.5:0/4088617666 >> 172.21.15.5:0/4088617666 conn(0x5601b9c97f60 msgr2=0x5601b9c9dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:51.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.995+0000 7f220dffb640 0 client.15189 ms_handle_reset on v2:172.21.15.159:6836/4020181017 2024-09-11T23:28:51.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.995+0000 7f2232913740 1 -- 172.21.15.5:0/4088617666 shutdown_connections 2024-09-11T23:28:51.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.995+0000 7f2232913740 1 -- 172.21.15.5:0/4088617666 wait complete. 2024-09-11T23:28:51.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:50.995+0000 7f2232913740 20 client.15189 trim_cache size 0 max 16384 2024-09-11T23:28:51.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.018+0000 7f2232913740 1 Processor -- start 2024-09-11T23:28:51.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.018+0000 7f2232913740 1 -- start start 2024-09-11T23:28:51.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.018+0000 7f2232913740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5601b9c9b8d0 0x5601b9cbcc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:51.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.018+0000 7f2232913740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601b9c9c1f0 0x5601b9ca74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:51.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.018+0000 7f2232913740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5601b9caafc0 0x5601b9ca6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:51.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.018+0000 7f2232913740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5601b9cbaf90 con 0x5601b9c9c1f0 2024-09-11T23:28:51.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.018+0000 7f2232913740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5601b9cbb660 con 0x5601b9c9b8d0 2024-09-11T23:28:51.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.018+0000 7f2232913740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5601b9cbbd30 con 0x5601b9caafc0 2024-09-11T23:28:51.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.018+0000 7f222e2d6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601b9c9c1f0 0x5601b9ca74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:51.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.018+0000 7f222e2d6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601b9c9c1f0 0x5601b9ca74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37924/0 (socket says 172.21.15.5:37924) 2024-09-11T23:28:51.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.018+0000 7f222e2d6640 1 -- 172.21.15.5:0/1156583601 learned_addr learned my addr 172.21.15.5:0/1156583601 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.018+0000 7f222dad5640 1 --2- 172.21.15.5:0/1156583601 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5601b9c9b8d0 0x5601b9cbcc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.018+0000 7f222dad5640 1 --2- 172.21.15.5:0/1156583601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5601b9caafc0 0x5601b9ca6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.018+0000 7f222e2d6640 1 -- 172.21.15.5:0/1156583601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5601b9caafc0 msgr2=0x5601b9ca6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:28:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.018+0000 7f222e2d6640 1 --2- 172.21.15.5:0/1156583601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5601b9caafc0 0x5601b9ca6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.018+0000 7f222e2d6640 1 -- 172.21.15.5:0/1156583601 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5601b9c9b8d0 msgr2=0x5601b9cbcc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:28:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.018+0000 7f222e2d6640 1 --2- 172.21.15.5:0/1156583601 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5601b9c9b8d0 0x5601b9cbcc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.018+0000 7f222e2d6640 1 -- 172.21.15.5:0/1156583601 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601b9cadd00 con 0x5601b9c9c1f0 2024-09-11T23:28:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.018+0000 7f222dad5640 1 --2- 172.21.15.5:0/1156583601 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5601b9c9b8d0 0x5601b9cbcc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:28:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.019+0000 7f222e2d6640 1 --2- 172.21.15.5:0/1156583601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601b9c9c1f0 0x5601b9ca74f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f221800a530 tx=0x7f22180096d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a7155d143ad703f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.019+0000 7f220ffff640 1 -- 172.21.15.5:0/1156583601 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f221801ab40 con 0x5601b9c9c1f0 2024-09-11T23:28:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.019+0000 7f220ffff640 1 -- 172.21.15.5:0/1156583601 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2218025070 con 0x5601b9c9c1f0 2024-09-11T23:28:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.019+0000 7f220ffff640 1 -- 172.21.15.5:0/1156583601 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22180173f0 con 0x5601b9c9c1f0 2024-09-11T23:28:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.019+0000 7f2232913740 1 -- 172.21.15.5:0/1156583601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601b9c9c1f0 msgr2=0x5601b9ca74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.019+0000 7f2232913740 1 --2- 172.21.15.5:0/1156583601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601b9c9c1f0 0x5601b9ca74f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f221800a530 tx=0x7f22180096d0 comp rx=0 tx=0).stop 2024-09-11T23:28:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.019+0000 7f2232913740 1 -- 172.21.15.5:0/1156583601 shutdown_connections 2024-09-11T23:28:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.019+0000 7f2232913740 1 --2- 172.21.15.5:0/1156583601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5601b9caafc0 0x5601b9ca6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:51.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.019+0000 7f2232913740 1 --2- 172.21.15.5:0/1156583601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601b9c9c1f0 0x5601b9ca74f0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:51.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.019+0000 7f2232913740 1 --2- 172.21.15.5:0/1156583601 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5601b9c9b8d0 0x5601b9cbcc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:51.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.019+0000 7f2232913740 1 -- 172.21.15.5:0/1156583601 >> 172.21.15.5:0/1156583601 conn(0x5601b9c97f60 msgr2=0x5601b9ca7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:51.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.019+0000 7f2232913740 1 -- 172.21.15.5:0/1156583601 shutdown_connections 2024-09-11T23:28:51.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.020+0000 7f2232913740 1 -- 172.21.15.5:0/1156583601 wait complete. 2024-09-11T23:28:51.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.020+0000 7f2232913740 1 -- start start 2024-09-11T23:28:51.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.020+0000 7f2232913740 1 Processor -- start 2024-09-11T23:28:51.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.020+0000 7f2232913740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5601b9c9b8d0 0x5601b9cbe720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:51.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.020+0000 7f2232913740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5601b9c9c1f0 0x5601b9cbec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:51.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.020+0000 7f2232913740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601b9caafc0 0x5601b9cc2b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:51.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.020+0000 7f2232913740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5601b9cbcad0 con 0x5601b9caafc0 2024-09-11T23:28:51.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.020+0000 7f2232913740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5601b9cbc400 con 0x5601b9c9c1f0 2024-09-11T23:28:51.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.020+0000 7f2232913740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5601b9cbd1a0 con 0x5601b9c9b8d0 2024-09-11T23:28:51.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.020+0000 7f2232913740 10 client.0 _ll_register_callbacks cb 0x7f221c009c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:28:51.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.020+0000 7f222dad5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601b9caafc0 0x5601b9cc2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:51.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.020+0000 7f222dad5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601b9caafc0 0x5601b9cc2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37932/0 (socket says 172.21.15.5:37932) 2024-09-11T23:28:51.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.020+0000 7f222dad5640 1 -- 172.21.15.5:0/4177853899 learned_addr learned my addr 172.21.15.5:0/4177853899 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:51.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.020+0000 7f222e2d6640 1 --2- 172.21.15.5:0/4177853899 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5601b9c9c1f0 0x5601b9cbec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:51.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.021+0000 7f222dad5640 1 --2- 172.21.15.5:0/4177853899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5601b9c9b8d0 0x5601b9cbe720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:51.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.021+0000 7f222dad5640 1 -- 172.21.15.5:0/4177853899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5601b9c9b8d0 msgr2=0x5601b9cbe720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:28:51.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.021+0000 7f222dad5640 1 --2- 172.21.15.5:0/4177853899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5601b9c9b8d0 0x5601b9cbe720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:51.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.021+0000 7f222dad5640 1 -- 172.21.15.5:0/4177853899 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5601b9c9c1f0 msgr2=0x5601b9cbec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:28:51.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.021+0000 7f222dad5640 1 --2- 172.21.15.5:0/4177853899 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5601b9c9c1f0 0x5601b9cbec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:51.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.021+0000 7f222dad5640 1 -- 172.21.15.5:0/4177853899 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601b9cc3350 con 0x5601b9caafc0 2024-09-11T23:28:51.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.021+0000 7f222dad5640 1 --2- 172.21.15.5:0/4177853899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601b9caafc0 0x5601b9cc2b50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f221c0091f0 tx=0x7f221c018580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c2ed36d5bbae72f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:51.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.021+0000 7f220dffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-11T23:28:51.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.021+0000 7f220dffb640 1 -- 172.21.15.5:0/4177853899 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f221c03c060 con 0x5601b9caafc0 2024-09-11T23:28:51.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.021+0000 7f220dffb640 1 -- 172.21.15.5:0/4177853899 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7f221c018b30 con 0x5601b9caafc0 2024-09-11T23:28:51.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.021+0000 7f2232913740 1 -- 172.21.15.5:0/4177853899 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2218025070 con 0x5601b9caafc0 2024-09-11T23:28:51.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.021+0000 7f220dffb640 1 -- 172.21.15.5:0/4177853899 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f221c043050 con 0x5601b9caafc0 2024-09-11T23:28:51.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.021+0000 7f2232913740 10 client.15195 fetch_fsmap learned FSMap version 24 2024-09-11T23:28:51.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.021+0000 7f2232913740 1 -- 172.21.15.5:0/4177853899 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5601b9cc57a0 con 0x5601b9caafc0 2024-09-11T23:28:51.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.021+0000 7f220dffb640 1 -- 172.21.15.5:0/4177853899 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2218025070 con 0x5601b9caafc0 2024-09-11T23:28:51.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.022+0000 7f220dffb640 1 -- 172.21.15.5:0/4177853899 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7f221c02e040 con 0x5601b9caafc0 2024-09-11T23:28:51.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.022+0000 7f2232913740 10 client.15195 fetch_fsmap finished waiting for FSMap version 24 2024-09-11T23:28:51.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.022+0000 7f2232913740 10 client.15195 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-11T23:28:51.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.022+0000 7f2232913740 20 client.15195 populate_metadata read hostname 'smithi005' 2024-09-11T23:28:51.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.022+0000 7f2232913740 1 --2- 172.21.15.5:0/4177853899 >> [v2:172.21.15.159:6836/4020181017,v1:172.21.15.159:6837/4020181017] conn(0x5601b9d2a480 0x5601b9d29190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:51.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.022+0000 7f2232913740 4 client.15195 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:28:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.022+0000 7f2232913740 1 -- 172.21.15.5:0/4177853899 --> [v2:172.21.15.159:6836/4020181017,v1:172.21.15.159:6837/4020181017] -- command(tid 0: {"prefix": "status"}) -- 0x5601b9c09b10 con 0x5601b9d2a480 2024-09-11T23:28:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.022+0000 7f222e2d6640 1 --2- 172.21.15.5:0/4177853899 >> [v2:172.21.15.159:6836/4020181017,v1:172.21.15.159:6837/4020181017] conn(0x5601b9d2a480 0x5601b9d29190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.022+0000 7f222e2d6640 1 --2- 172.21.15.5:0/4177853899 >> [v2:172.21.15.159:6836/4020181017,v1:172.21.15.159:6837/4020181017] conn(0x5601b9d2a480 0x5601b9d29190 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=afd6f0abd14c5747 server_cookie=f6bd4d5db1534667 in_seq=0 out_seq=0 2024-09-11T23:28:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.022+0000 7f220dffb640 10 client.15195 ms_handle_connect on v2:172.21.15.159:6836/4020181017 2024-09-11T23:28:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.022+0000 7f220dffb640 1 -- 172.21.15.5:0/4177853899 <== mds.2 v2:172.21.15.159:6836/4020181017 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5601b9c09b10 con 0x5601b9d2a480 2024-09-11T23:28:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.022+0000 7f220dffb640 10 client.15195 handle_command_reply: tid=0 2024-09-11T23:28:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.022+0000 7f2232913740 1 client.15195 shutdown 2024-09-11T23:28:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.023+0000 7f2232913740 1 -- 172.21.15.5:0/4177853899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601b9caafc0 msgr2=0x5601b9cc2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.023+0000 7f2232913740 1 --2- 172.21.15.5:0/4177853899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601b9caafc0 0x5601b9cc2b50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f221c0091f0 tx=0x7f221c018580 comp rx=0 tx=0).stop 2024-09-11T23:28:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.023+0000 7f2232913740 1 -- 172.21.15.5:0/4177853899 shutdown_connections 2024-09-11T23:28:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.023+0000 7f2232913740 1 --2- 172.21.15.5:0/4177853899 >> [v2:172.21.15.159:6836/4020181017,v1:172.21.15.159:6837/4020181017] conn(0x5601b9d2a480 0x5601b9d29190 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.023+0000 7f2232913740 1 --2- 172.21.15.5:0/4177853899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601b9caafc0 0x5601b9cc2b50 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.023+0000 7f2232913740 1 --2- 172.21.15.5:0/4177853899 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5601b9c9c1f0 0x5601b9cbec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:51.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.023+0000 7f2232913740 1 --2- 172.21.15.5:0/4177853899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5601b9c9b8d0 0x5601b9cbe720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:51.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.023+0000 7f2232913740 1 -- 172.21.15.5:0/4177853899 >> 172.21.15.5:0/4177853899 conn(0x5601b9c97f60 msgr2=0x5601b9ca64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:51.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.023+0000 7f220dffb640 0 client.15195 ms_handle_reset on v2:172.21.15.159:6836/4020181017 2024-09-11T23:28:51.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.023+0000 7f2232913740 1 -- 172.21.15.5:0/4177853899 shutdown_connections 2024-09-11T23:28:51.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.023+0000 7f2232913740 1 -- 172.21.15.5:0/4177853899 wait complete. 2024-09-11T23:28:51.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.023+0000 7f2232913740 20 client.15195 trim_cache size 0 max 16384 2024-09-11T23:28:51.098 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-11T23:28:51.098 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "1f5284d2-7094-11ef-bcea-c7b262605968", 2024-09-11T23:28:51.098 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 2, 2024-09-11T23:28:51.098 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 24461, 2024-09-11T23:28:51.099 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-09-11T23:28:51.099 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-09-11T23:28:51.099 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-09-11T23:28:51.099 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 89.986965867999999, 2024-09-11T23:28:51.099 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 24, 2024-09-11T23:28:51.099 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 88, 2024-09-11T23:28:51.099 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 86, 2024-09-11T23:28:51.099 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 147.83273965999999 2024-09-11T23:28:51.099 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-11T23:28:51.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.023+0000 7f223053a640 1 -- 172.21.15.5:0/1301326184 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f22100a2c10 msgr2=0x7f22100a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:51.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.023+0000 7f223053a640 1 --2- 172.21.15.5:0/1301326184 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f22100a2c10 0x7f22100a50d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f222002a480 tx=0x7f222008de00 comp rx=0 tx=0).stop 2024-09-11T23:28:51.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.023+0000 7f223053a640 1 -- 172.21.15.5:0/1301326184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22281082e0 msgr2=0x7f222819cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:51.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.023+0000 7f223053a640 1 --2- 172.21.15.5:0/1301326184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22281082e0 0x7f222819cdf0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2220005ab0 tx=0x7f22200042f0 comp rx=0 tx=0).stop 2024-09-11T23:28:51.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.023+0000 7f223053a640 1 -- 172.21.15.5:0/1301326184 shutdown_connections 2024-09-11T23:28:51.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.023+0000 7f223053a640 1 --2- 172.21.15.5:0/1301326184 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f22100a2c10 0x7f22100a50d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:51.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.023+0000 7f223053a640 1 --2- 172.21.15.5:0/1301326184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22281082e0 0x7f222819cdf0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:51.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.023+0000 7f223053a640 1 --2- 172.21.15.5:0/1301326184 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2228103760 0x7f2228198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:51.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.023+0000 7f223053a640 1 --2- 172.21.15.5:0/1301326184 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2228102db0 0x7f2228198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:51.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.024+0000 7f223053a640 1 -- 172.21.15.5:0/1301326184 >> 172.21.15.5:0/1301326184 conn(0x7f22280fc7d0 msgr2=0x7f2228106390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:51.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.024+0000 7f223053a640 1 -- 172.21.15.5:0/1301326184 shutdown_connections 2024-09-11T23:28:51.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:51.024+0000 7f223053a640 1 -- 172.21.15.5:0/1301326184 wait complete. 2024-09-11T23:28:51.682 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-11T23:28:51.938 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:28:52.322 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:52 smithi005 ceph-mon[31201]: pgmap v348: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T23:28:52.322 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:52 smithi005 ceph-mon[31201]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-11T23:28:52.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:52 smithi159 ceph-mon[34394]: pgmap v348: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T23:28:52.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:52 smithi159 ceph-mon[34394]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-11T23:28:52.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:52 smithi172 ceph-mon[34855]: pgmap v348: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T23:28:52.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:52 smithi172 ceph-mon[34855]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-11T23:28:52.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.405+0000 7fda3977b640 1 -- 172.21.15.5:0/984131582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda34100a80 msgr2=0x7fda34100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:52.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.405+0000 7fda3977b640 1 --2- 172.21.15.5:0/984131582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda34100a80 0x7fda34100ee0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fda1c009930 tx=0x7fda1c02a420 comp rx=0 tx=0).stop 2024-09-11T23:28:52.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.405+0000 7fda3977b640 1 -- 172.21.15.5:0/984131582 shutdown_connections 2024-09-11T23:28:52.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.405+0000 7fda3977b640 1 --2- 172.21.15.5:0/984131582 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda34101420 0x7fda3410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:52.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.405+0000 7fda3977b640 1 --2- 172.21.15.5:0/984131582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda34100a80 0x7fda34100ee0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:52.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.405+0000 7fda3977b640 1 --2- 172.21.15.5:0/984131582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda34106a80 0x7fda34106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:52.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.405+0000 7fda3977b640 1 -- 172.21.15.5:0/984131582 >> 172.21.15.5:0/984131582 conn(0x7fda340fc7a0 msgr2=0x7fda340febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:52.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.405+0000 7fda3977b640 1 -- 172.21.15.5:0/984131582 shutdown_connections 2024-09-11T23:28:52.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.405+0000 7fda3977b640 1 -- 172.21.15.5:0/984131582 wait complete. 2024-09-11T23:28:52.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.406+0000 7fda3977b640 1 Processor -- start 2024-09-11T23:28:52.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.406+0000 7fda3977b640 1 -- start start 2024-09-11T23:28:52.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.406+0000 7fda3977b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda34100a80 0x7fda3419a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:52.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.406+0000 7fda3977b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda34101420 0x7fda3419aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:52.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.406+0000 7fda3977b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda34106a80 0x7fda3419ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:52.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.406+0000 7fda3977b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fda34110d50 con 0x7fda34106a80 2024-09-11T23:28:52.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.406+0000 7fda3977b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fda34110bd0 con 0x7fda34101420 2024-09-11T23:28:52.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.406+0000 7fda3977b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fda34110ed0 con 0x7fda34100a80 2024-09-11T23:28:52.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.406+0000 7fda337fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda34106a80 0x7fda3419ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:52.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.406+0000 7fda337fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda34106a80 0x7fda3419ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37956/0 (socket says 172.21.15.5:37956) 2024-09-11T23:28:52.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.406+0000 7fda337fe640 1 -- 172.21.15.5:0/2885815248 learned_addr learned my addr 172.21.15.5:0/2885815248 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:52.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.407+0000 7fda32ffd640 1 --2- 172.21.15.5:0/2885815248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda34100a80 0x7fda3419a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:52.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.407+0000 7fda2bfff640 1 --2- 172.21.15.5:0/2885815248 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda34101420 0x7fda3419aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:52.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.407+0000 7fda337fe640 1 -- 172.21.15.5:0/2885815248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda34100a80 msgr2=0x7fda3419a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:52.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.407+0000 7fda337fe640 1 --2- 172.21.15.5:0/2885815248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda34100a80 0x7fda3419a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:52.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.407+0000 7fda337fe640 1 -- 172.21.15.5:0/2885815248 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda34101420 msgr2=0x7fda3419aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:52.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.407+0000 7fda337fe640 1 --2- 172.21.15.5:0/2885815248 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda34101420 0x7fda3419aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:52.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.407+0000 7fda337fe640 1 -- 172.21.15.5:0/2885815248 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda3419f560 con 0x7fda34106a80 2024-09-11T23:28:52.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.407+0000 7fda2bfff640 1 --2- 172.21.15.5:0/2885815248 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda34101420 0x7fda3419aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:28:52.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.407+0000 7fda337fe640 1 --2- 172.21.15.5:0/2885815248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda34106a80 0x7fda3419ee80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fda2c00cce0 tx=0x7fda2c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:52.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.407+0000 7fda30ff9640 1 -- 172.21.15.5:0/2885815248 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda2c00f450 con 0x7fda34106a80 2024-09-11T23:28:52.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.407+0000 7fda3977b640 1 -- 172.21.15.5:0/2885815248 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda3419f850 con 0x7fda34106a80 2024-09-11T23:28:52.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.407+0000 7fda30ff9640 1 -- 172.21.15.5:0/2885815248 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fda2c00faa0 con 0x7fda34106a80 2024-09-11T23:28:52.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.407+0000 7fda30ff9640 1 -- 172.21.15.5:0/2885815248 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda2c018b70 con 0x7fda34106a80 2024-09-11T23:28:52.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.407+0000 7fda3977b640 1 -- 172.21.15.5:0/2885815248 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda341a7130 con 0x7fda34106a80 2024-09-11T23:28:52.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.409+0000 7fda30ff9640 1 -- 172.21.15.5:0/2885815248 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fda2c018d10 con 0x7fda34106a80 2024-09-11T23:28:52.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.410+0000 7fda3bb54740 1 Processor -- start 2024-09-11T23:28:52.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.410+0000 7fda3bb54740 1 -- start start 2024-09-11T23:28:52.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.410+0000 7fda3bb54740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55923573c9d0 0x55923573cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:52.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.410+0000 7fda3bb54740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55923573d2f0 0x559235747670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:52.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.410+0000 7fda3bb54740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559235747bb0 0x559235749fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:52.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.410+0000 7fda3bb54740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5592356a3090 con 0x55923573c9d0 2024-09-11T23:28:52.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.410+0000 7fda3bb54740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55923564aa70 con 0x559235747bb0 2024-09-11T23:28:52.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.410+0000 7fda3bb54740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55923569f050 con 0x55923573d2f0 2024-09-11T23:28:52.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.410+0000 7fda2bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55923573c9d0 0x55923573cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:52.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.411+0000 7fda30ff9640 1 --2- 172.21.15.5:0/2885815248 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fda200a2c00 0x7fda200a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:52.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.411+0000 7fda2bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55923573c9d0 0x55923573cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37960/0 (socket says 172.21.15.5:37960) 2024-09-11T23:28:52.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.411+0000 7fda2bfff640 1 -- 172.21.15.5:0/2475260509 learned_addr learned my addr 172.21.15.5:0/2475260509 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:52.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.411+0000 7fda32ffd640 1 --2- 172.21.15.5:0/2475260509 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55923573d2f0 0x559235747670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:52.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.411+0000 7fda337fe640 1 --2- 172.21.15.5:0/2885815248 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fda200a2c00 0x7fda200a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:52.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.411+0000 7fda30ff9640 1 -- 172.21.15.5:0/2885815248 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7fda2c0cf900 con 0x7fda34106a80 2024-09-11T23:28:52.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.411+0000 7fda2bfff640 1 -- 172.21.15.5:0/2475260509 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55923573d2f0 msgr2=0x559235747670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:28:52.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.411+0000 7fda2bfff640 1 --2- 172.21.15.5:0/2475260509 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55923573d2f0 0x559235747670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:52.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.411+0000 7fda2bfff640 1 -- 172.21.15.5:0/2475260509 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559235747bb0 msgr2=0x559235749fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:28:52.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.411+0000 7fda2bfff640 1 --2- 172.21.15.5:0/2475260509 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559235747bb0 0x559235749fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:52.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.411+0000 7fda2bfff640 1 -- 172.21.15.5:0/2475260509 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559235657130 con 0x55923573c9d0 2024-09-11T23:28:52.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.411+0000 7fda2bfff640 1 --2- 172.21.15.5:0/2475260509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55923573c9d0 0x55923573cdb0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fda1c005ab0 tx=0x7fda1c032dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a6fad4609f4ae11 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:52.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.411+0000 7fda337fe640 1 --2- 172.21.15.5:0/2885815248 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fda200a2c00 0x7fda200a50c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fda2c0981a0 tx=0x7fda2c066910 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:52.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.411+0000 7fda297fa640 1 -- 172.21.15.5:0/2475260509 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda1c035050 con 0x55923573c9d0 2024-09-11T23:28:52.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.411+0000 7fda297fa640 1 -- 172.21.15.5:0/2475260509 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fda1c0316a0 con 0x55923573c9d0 2024-09-11T23:28:52.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.411+0000 7fda297fa640 1 -- 172.21.15.5:0/2475260509 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda1c0046c0 con 0x55923573c9d0 2024-09-11T23:28:52.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.412+0000 7fda3bb54740 1 -- 172.21.15.5:0/2475260509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55923573c9d0 msgr2=0x55923573cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:52.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.412+0000 7fda3bb54740 1 --2- 172.21.15.5:0/2475260509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55923573c9d0 0x55923573cdb0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fda1c005ab0 tx=0x7fda1c032dd0 comp rx=0 tx=0).stop 2024-09-11T23:28:52.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.412+0000 7fda3bb54740 1 -- 172.21.15.5:0/2475260509 shutdown_connections 2024-09-11T23:28:52.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.412+0000 7fda3bb54740 1 --2- 172.21.15.5:0/2475260509 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559235747bb0 0x559235749fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:52.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.412+0000 7fda3bb54740 1 --2- 172.21.15.5:0/2475260509 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55923573d2f0 0x559235747670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:52.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.412+0000 7fda3bb54740 1 --2- 172.21.15.5:0/2475260509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55923573c9d0 0x55923573cdb0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:52.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.412+0000 7fda3bb54740 1 -- 172.21.15.5:0/2475260509 >> 172.21.15.5:0/2475260509 conn(0x559235738f60 msgr2=0x559235739340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:52.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.412+0000 7fda3bb54740 1 -- 172.21.15.5:0/2475260509 shutdown_connections 2024-09-11T23:28:52.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.412+0000 7fda3bb54740 1 -- 172.21.15.5:0/2475260509 wait complete. 2024-09-11T23:28:52.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.412+0000 7fda3bb54740 1 -- start start 2024-09-11T23:28:52.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.413+0000 7fda3bb54740 1 Processor -- start 2024-09-11T23:28:52.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.413+0000 7fda3bb54740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55923573c9d0 0x5592357474d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:52.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.413+0000 7fda3bb54740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55923573d2f0 0x559235744820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:52.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.413+0000 7fda3bb54740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559235747bb0 0x559235744d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:52.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.413+0000 7fda3bb54740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55923574a780 con 0x55923573d2f0 2024-09-11T23:28:52.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.413+0000 7fda3bb54740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55923565df20 con 0x559235747bb0 2024-09-11T23:28:52.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.413+0000 7fda3bb54740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55923574a900 con 0x55923573c9d0 2024-09-11T23:28:52.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.413+0000 7fda3bb54740 10 client.0 _ll_register_callbacks cb 0x559235627030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:28:52.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.413+0000 7fda32ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55923573d2f0 0x559235744820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:52.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.413+0000 7fda32ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55923573d2f0 0x559235744820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37968/0 (socket says 172.21.15.5:37968) 2024-09-11T23:28:52.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.413+0000 7fda32ffd640 1 -- 172.21.15.5:0/2475556836 learned_addr learned my addr 172.21.15.5:0/2475556836 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:52.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.413+0000 7fda2bfff640 1 --2- 172.21.15.5:0/2475556836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55923573c9d0 0x5592357474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:52.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.413+0000 7fda2bfff640 1 --2- 172.21.15.5:0/2475556836 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559235747bb0 0x559235744d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:52.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.413+0000 7fda32ffd640 1 -- 172.21.15.5:0/2475556836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55923573c9d0 msgr2=0x5592357474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:28:52.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.413+0000 7fda32ffd640 1 --2- 172.21.15.5:0/2475556836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55923573c9d0 0x5592357474d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:52.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.413+0000 7fda32ffd640 1 -- 172.21.15.5:0/2475556836 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559235747bb0 msgr2=0x559235744d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:28:52.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.413+0000 7fda32ffd640 1 --2- 172.21.15.5:0/2475556836 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559235747bb0 0x559235744d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:52.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.413+0000 7fda32ffd640 1 -- 172.21.15.5:0/2475556836 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592354142b0 con 0x55923573d2f0 2024-09-11T23:28:52.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.413+0000 7fda2bfff640 1 --2- 172.21.15.5:0/2475556836 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559235747bb0 0x559235744d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:28:52.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.413+0000 7fda32ffd640 1 --2- 172.21.15.5:0/2475556836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55923573d2f0 0x559235744820 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fda240104d0 tx=0x7fda24010990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8fcd2c5f8f39de3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:52.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.413+0000 7fda1a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-11T23:28:52.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.414+0000 7fda1a7fc640 1 -- 172.21.15.5:0/2475556836 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda2401a020 con 0x55923573d2f0 2024-09-11T23:28:52.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.414+0000 7fda1a7fc640 1 -- 172.21.15.5:0/2475556836 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7fda24016690 con 0x55923573d2f0 2024-09-11T23:28:52.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.414+0000 7fda3bb54740 1 -- 172.21.15.5:0/2475556836 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda1c0316a0 con 0x55923573d2f0 2024-09-11T23:28:52.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.414+0000 7fda1a7fc640 1 -- 172.21.15.5:0/2475556836 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fda24025050 con 0x55923573d2f0 2024-09-11T23:28:52.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.414+0000 7fda3bb54740 10 client.15207 fetch_fsmap learned FSMap version 24 2024-09-11T23:28:52.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.414+0000 7fda3bb54740 1 -- 172.21.15.5:0/2475556836 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559235756160 con 0x55923573d2f0 2024-09-11T23:28:52.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.414+0000 7fda1a7fc640 1 -- 172.21.15.5:0/2475556836 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fda1c0316a0 con 0x55923573d2f0 2024-09-11T23:28:52.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.414+0000 7fda1a7fc640 1 -- 172.21.15.5:0/2475556836 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7fda24014a40 con 0x55923573d2f0 2024-09-11T23:28:52.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.414+0000 7fda3bb54740 10 client.15207 fetch_fsmap finished waiting for FSMap version 24 2024-09-11T23:28:52.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.414+0000 7fda3bb54740 10 client.15207 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-11T23:28:52.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.414+0000 7fda3bb54740 20 client.15207 populate_metadata read hostname 'smithi005' 2024-09-11T23:28:52.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.414+0000 7fda3bb54740 1 --2- 172.21.15.5:0/2475556836 >> [v2:172.21.15.172:6838/3928313314,v1:172.21.15.172:6839/3928313314] conn(0x5592357587e0 0x559235759c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:52.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.414+0000 7fda3bb54740 4 client.15207 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:28:52.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.414+0000 7fda3bb54740 1 -- 172.21.15.5:0/2475556836 --> [v2:172.21.15.172:6838/3928313314,v1:172.21.15.172:6839/3928313314] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5592356b0600 con 0x5592357587e0 2024-09-11T23:28:52.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.415+0000 7fda2bfff640 1 --2- 172.21.15.5:0/2475556836 >> [v2:172.21.15.172:6838/3928313314,v1:172.21.15.172:6839/3928313314] conn(0x5592357587e0 0x559235759c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:52.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.415+0000 7fda2bfff640 1 --2- 172.21.15.5:0/2475556836 >> [v2:172.21.15.172:6838/3928313314,v1:172.21.15.172:6839/3928313314] conn(0x5592357587e0 0x559235759c50 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3c6d8b6986020a47 server_cookie=c884d3ebeeda6464 in_seq=0 out_seq=0 2024-09-11T23:28:52.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.415+0000 7fda1a7fc640 10 client.15207 ms_handle_connect on v2:172.21.15.172:6838/3928313314 2024-09-11T23:28:52.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.416+0000 7fda1a7fc640 1 -- 172.21.15.5:0/2475556836 <== mds.1 v2:172.21.15.172:6838/3928313314 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5592356b0600 con 0x5592357587e0 2024-09-11T23:28:52.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.416+0000 7fda1a7fc640 10 client.15207 handle_command_reply: tid=0 2024-09-11T23:28:52.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.416+0000 7fda3bb54740 1 client.15207 shutdown 2024-09-11T23:28:52.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.416+0000 7fda3bb54740 1 -- 172.21.15.5:0/2475556836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55923573d2f0 msgr2=0x559235744820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:52.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.417+0000 7fda3bb54740 1 --2- 172.21.15.5:0/2475556836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55923573d2f0 0x559235744820 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fda240104d0 tx=0x7fda24010990 comp rx=0 tx=0).stop 2024-09-11T23:28:52.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.417+0000 7fda3bb54740 1 -- 172.21.15.5:0/2475556836 shutdown_connections 2024-09-11T23:28:52.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.417+0000 7fda3bb54740 1 --2- 172.21.15.5:0/2475556836 >> [v2:172.21.15.172:6838/3928313314,v1:172.21.15.172:6839/3928313314] conn(0x5592357587e0 0x559235759c50 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:52.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.417+0000 7fda3bb54740 1 --2- 172.21.15.5:0/2475556836 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559235747bb0 0x559235744d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:52.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.417+0000 7fda3bb54740 1 --2- 172.21.15.5:0/2475556836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55923573d2f0 0x559235744820 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:52.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.417+0000 7fda3bb54740 1 --2- 172.21.15.5:0/2475556836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55923573c9d0 0x5592357474d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:52.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.417+0000 7fda1a7fc640 0 client.15207 ms_handle_reset on v2:172.21.15.172:6838/3928313314 2024-09-11T23:28:52.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.417+0000 7fda3bb54740 1 -- 172.21.15.5:0/2475556836 >> 172.21.15.5:0/2475556836 conn(0x559235738f60 msgr2=0x55923573ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:52.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.417+0000 7fda3bb54740 1 -- 172.21.15.5:0/2475556836 shutdown_connections 2024-09-11T23:28:52.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.417+0000 7fda3bb54740 1 -- 172.21.15.5:0/2475556836 wait complete. 2024-09-11T23:28:52.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.417+0000 7fda3bb54740 20 client.15207 trim_cache size 0 max 16384 2024-09-11T23:28:52.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.434+0000 7fda3bb54740 1 Processor -- start 2024-09-11T23:28:52.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.434+0000 7fda3bb54740 1 -- start start 2024-09-11T23:28:52.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.435+0000 7fda3bb54740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55923573c9d0 0x559235759c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:52.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.435+0000 7fda3bb54740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55923573d2f0 0x559235739340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:52.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.435+0000 7fda3bb54740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559235747bb0 0x559235745f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:52.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.435+0000 7fda3bb54740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x559235757f90 con 0x559235747bb0 2024-09-11T23:28:52.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.435+0000 7fda3bb54740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x559235758660 con 0x55923573c9d0 2024-09-11T23:28:52.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.435+0000 7fda3bb54740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x559235758d30 con 0x55923573d2f0 2024-09-11T23:28:52.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.435+0000 7fda2bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559235747bb0 0x559235745f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:52.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.435+0000 7fda2bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559235747bb0 0x559235745f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37982/0 (socket says 172.21.15.5:37982) 2024-09-11T23:28:52.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.435+0000 7fda2bfff640 1 -- 172.21.15.5:0/2885825463 learned_addr learned my addr 172.21.15.5:0/2885825463 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:52.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.435+0000 7fda2bfff640 1 --2- 172.21.15.5:0/2885825463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55923573c9d0 0x559235759c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:52.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.435+0000 7fda32ffd640 1 --2- 172.21.15.5:0/2885825463 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55923573d2f0 0x559235739340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:52.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.435+0000 7fda2bfff640 1 -- 172.21.15.5:0/2885825463 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55923573d2f0 msgr2=0x559235739340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:28:52.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.435+0000 7fda2bfff640 1 --2- 172.21.15.5:0/2885825463 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55923573d2f0 0x559235739340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:52.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.435+0000 7fda2bfff640 1 -- 172.21.15.5:0/2885825463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55923573c9d0 msgr2=0x559235759c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:28:52.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.435+0000 7fda2bfff640 1 --2- 172.21.15.5:0/2885825463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55923573c9d0 0x559235759c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:52.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.435+0000 7fda2bfff640 1 -- 172.21.15.5:0/2885825463 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55923574a890 con 0x559235747bb0 2024-09-11T23:28:52.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.436+0000 7fda2bfff640 1 --2- 172.21.15.5:0/2885825463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559235747bb0 0x559235745f70 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fda1c000c00 tx=0x7fda1c032dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0a59d71af744fe0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:52.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.436+0000 7fda28ff9640 1 -- 172.21.15.5:0/2885825463 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda1c035040 con 0x559235747bb0 2024-09-11T23:28:52.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.436+0000 7fda28ff9640 1 -- 172.21.15.5:0/2885825463 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fda1c0053d0 con 0x559235747bb0 2024-09-11T23:28:52.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.436+0000 7fda28ff9640 1 -- 172.21.15.5:0/2885825463 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda1c031b90 con 0x559235747bb0 2024-09-11T23:28:52.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.436+0000 7fda3bb54740 1 -- 172.21.15.5:0/2885825463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559235747bb0 msgr2=0x559235745f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:52.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.436+0000 7fda3bb54740 1 --2- 172.21.15.5:0/2885825463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559235747bb0 0x559235745f70 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fda1c000c00 tx=0x7fda1c032dd0 comp rx=0 tx=0).stop 2024-09-11T23:28:52.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.437+0000 7fda3bb54740 1 -- 172.21.15.5:0/2885825463 shutdown_connections 2024-09-11T23:28:52.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.437+0000 7fda3bb54740 1 --2- 172.21.15.5:0/2885825463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559235747bb0 0x559235745f70 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.437+0000 7fda3bb54740 1 --2- 172.21.15.5:0/2885825463 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55923573d2f0 0x559235739340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.437+0000 7fda3bb54740 1 --2- 172.21.15.5:0/2885825463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55923573c9d0 0x559235759c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.437+0000 7fda3bb54740 1 -- 172.21.15.5:0/2885825463 >> 172.21.15.5:0/2885825463 conn(0x559235738f60 msgr2=0x559235743930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.437+0000 7fda3bb54740 1 -- 172.21.15.5:0/2885825463 shutdown_connections 2024-09-11T23:28:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.437+0000 7fda3bb54740 1 -- 172.21.15.5:0/2885825463 wait complete. 2024-09-11T23:28:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.437+0000 7fda3bb54740 1 -- start start 2024-09-11T23:28:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.437+0000 7fda3bb54740 1 Processor -- start 2024-09-11T23:28:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.437+0000 7fda3bb54740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55923573c9d0 0x55923575ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.437+0000 7fda3bb54740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55923573d2f0 0x55923575f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.437+0000 7fda3bb54740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559235747bb0 0x55923575b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.437+0000 7fda3bb54740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x559235759ad0 con 0x55923573c9d0 2024-09-11T23:28:52.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.437+0000 7fda3bb54740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x559235759400 con 0x559235747bb0 2024-09-11T23:28:52.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.437+0000 7fda3bb54740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55923575a1a0 con 0x55923573d2f0 2024-09-11T23:28:52.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.437+0000 7fda3bb54740 10 client.0 _ll_register_callbacks cb 0x7fda2400b520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:28:52.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.437+0000 7fda2bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55923573c9d0 0x55923575ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:52.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.437+0000 7fda2bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55923573c9d0 0x55923575ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37994/0 (socket says 172.21.15.5:37994) 2024-09-11T23:28:52.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.437+0000 7fda2bfff640 1 -- 172.21.15.5:0/504903485 learned_addr learned my addr 172.21.15.5:0/504903485 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:52.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.438+0000 7fda32ffd640 1 --2- 172.21.15.5:0/504903485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55923573d2f0 0x55923575f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:52.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.438+0000 7fda2bfff640 1 -- 172.21.15.5:0/504903485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55923573d2f0 msgr2=0x55923575f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:28:52.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.438+0000 7fda2bfff640 1 --2- 172.21.15.5:0/504903485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55923573d2f0 0x55923575f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:52.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.438+0000 7fda2bfff640 1 -- 172.21.15.5:0/504903485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559235747bb0 msgr2=0x55923575b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:28:52.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.438+0000 7fda2bfff640 1 --2- 172.21.15.5:0/504903485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559235747bb0 0x55923575b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:52.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.438+0000 7fda2bfff640 1 -- 172.21.15.5:0/504903485 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55923575b940 con 0x55923573c9d0 2024-09-11T23:28:52.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.438+0000 7fda2bfff640 1 --2- 172.21.15.5:0/504903485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55923573c9d0 0x55923575ec20 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fda1c02a940 tx=0x7fda1c005160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef749d1f6420515d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:52.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.438+0000 7fda1a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-11T23:28:52.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.438+0000 7fda1a7fc640 1 -- 172.21.15.5:0/504903485 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda1c05d060 con 0x55923573c9d0 2024-09-11T23:28:52.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.438+0000 7fda1a7fc640 1 -- 172.21.15.5:0/504903485 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7fda1c004040 con 0x55923573c9d0 2024-09-11T23:28:52.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.438+0000 7fda3bb54740 1 -- 172.21.15.5:0/504903485 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda1c0053d0 con 0x55923573c9d0 2024-09-11T23:28:52.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.438+0000 7fda1a7fc640 1 -- 172.21.15.5:0/504903485 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fda1c035040 con 0x55923573c9d0 2024-09-11T23:28:52.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.438+0000 7fda3bb54740 10 client.15213 fetch_fsmap learned FSMap version 24 2024-09-11T23:28:52.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.438+0000 7fda3bb54740 1 -- 172.21.15.5:0/504903485 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5592357603e0 con 0x55923573c9d0 2024-09-11T23:28:52.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.439+0000 7fda1a7fc640 1 -- 172.21.15.5:0/504903485 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fda1c0053d0 con 0x55923573c9d0 2024-09-11T23:28:52.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.439+0000 7fda1a7fc640 1 -- 172.21.15.5:0/504903485 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7fda1c004750 con 0x55923573c9d0 2024-09-11T23:28:52.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.439+0000 7fda3bb54740 10 client.15213 fetch_fsmap finished waiting for FSMap version 24 2024-09-11T23:28:52.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.439+0000 7fda3bb54740 10 client.15213 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-11T23:28:52.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.439+0000 7fda3bb54740 20 client.15213 populate_metadata read hostname 'smithi005' 2024-09-11T23:28:52.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.439+0000 7fda3bb54740 1 --2- 172.21.15.5:0/504903485 >> [v2:172.21.15.172:6838/3928313314,v1:172.21.15.172:6839/3928313314] conn(0x5592357c6bc0 0x5592357c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:52.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.439+0000 7fda3bb54740 4 client.15213 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:28:52.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.439+0000 7fda3bb54740 1 -- 172.21.15.5:0/504903485 --> [v2:172.21.15.172:6838/3928313314,v1:172.21.15.172:6839/3928313314] -- command(tid 0: {"prefix": "status"}) -- 0x5592356aab10 con 0x5592357c6bc0 2024-09-11T23:28:52.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.439+0000 7fda32ffd640 1 --2- 172.21.15.5:0/504903485 >> [v2:172.21.15.172:6838/3928313314,v1:172.21.15.172:6839/3928313314] conn(0x5592357c6bc0 0x5592357c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:52.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.440+0000 7fda32ffd640 1 --2- 172.21.15.5:0/504903485 >> [v2:172.21.15.172:6838/3928313314,v1:172.21.15.172:6839/3928313314] conn(0x5592357c6bc0 0x5592357c58d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4a3f29b5c89b41b8 server_cookie=efc7eee51f0e0549 in_seq=0 out_seq=0 2024-09-11T23:28:52.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.440+0000 7fda1a7fc640 10 client.15213 ms_handle_connect on v2:172.21.15.172:6838/3928313314 2024-09-11T23:28:52.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.440+0000 7fda1a7fc640 1 -- 172.21.15.5:0/504903485 <== mds.1 v2:172.21.15.172:6838/3928313314 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5592356aab10 con 0x5592357c6bc0 2024-09-11T23:28:52.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.440+0000 7fda1a7fc640 10 client.15213 handle_command_reply: tid=0 2024-09-11T23:28:52.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.440+0000 7fda3bb54740 1 client.15213 shutdown 2024-09-11T23:28:52.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.440+0000 7fda3bb54740 1 -- 172.21.15.5:0/504903485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55923573c9d0 msgr2=0x55923575ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:52.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.440+0000 7fda3bb54740 1 --2- 172.21.15.5:0/504903485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55923573c9d0 0x55923575ec20 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fda1c02a940 tx=0x7fda1c005160 comp rx=0 tx=0).stop 2024-09-11T23:28:52.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.440+0000 7fda3bb54740 1 -- 172.21.15.5:0/504903485 shutdown_connections 2024-09-11T23:28:52.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.440+0000 7fda3bb54740 1 --2- 172.21.15.5:0/504903485 >> [v2:172.21.15.172:6838/3928313314,v1:172.21.15.172:6839/3928313314] conn(0x5592357c6bc0 0x5592357c58d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:52.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.440+0000 7fda3bb54740 1 --2- 172.21.15.5:0/504903485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559235747bb0 0x55923575b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:52.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.440+0000 7fda3bb54740 1 --2- 172.21.15.5:0/504903485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55923573d2f0 0x55923575f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:52.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.440+0000 7fda1a7fc640 0 client.15213 ms_handle_reset on v2:172.21.15.172:6838/3928313314 2024-09-11T23:28:52.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.440+0000 7fda3bb54740 1 --2- 172.21.15.5:0/504903485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55923573c9d0 0x55923575ec20 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:52.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.440+0000 7fda3bb54740 1 -- 172.21.15.5:0/504903485 >> 172.21.15.5:0/504903485 conn(0x559235738f60 msgr2=0x559235745e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:52.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.440+0000 7fda3bb54740 1 -- 172.21.15.5:0/504903485 shutdown_connections 2024-09-11T23:28:52.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.440+0000 7fda3bb54740 1 -- 172.21.15.5:0/504903485 wait complete. 2024-09-11T23:28:52.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.440+0000 7fda3bb54740 20 client.15213 trim_cache size 0 max 16384 2024-09-11T23:28:52.446 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-11T23:28:52.446 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "1f5284d2-7094-11ef-bcea-c7b262605968", 2024-09-11T23:28:52.446 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 1, 2024-09-11T23:28:52.446 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 24475, 2024-09-11T23:28:52.447 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-09-11T23:28:52.447 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-09-11T23:28:52.447 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-09-11T23:28:52.447 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 92.416523077999997, 2024-09-11T23:28:52.447 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 24, 2024-09-11T23:28:52.447 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 88, 2024-09-11T23:28:52.447 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 86, 2024-09-11T23:28:52.447 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 146.70208021100001 2024-09-11T23:28:52.447 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-11T23:28:52.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.441+0000 7fda3977b640 1 -- 172.21.15.5:0/2885815248 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fda200a2c00 msgr2=0x7fda200a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:52.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.441+0000 7fda3977b640 1 --2- 172.21.15.5:0/2885815248 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fda200a2c00 0x7fda200a50c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fda2c0981a0 tx=0x7fda2c066910 comp rx=0 tx=0).stop 2024-09-11T23:28:52.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.441+0000 7fda3977b640 1 -- 172.21.15.5:0/2885815248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda34106a80 msgr2=0x7fda3419ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:52.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.441+0000 7fda3977b640 1 --2- 172.21.15.5:0/2885815248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda34106a80 0x7fda3419ee80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fda2c00cce0 tx=0x7fda2c00a620 comp rx=0 tx=0).stop 2024-09-11T23:28:52.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.441+0000 7fda3977b640 1 -- 172.21.15.5:0/2885815248 shutdown_connections 2024-09-11T23:28:52.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.441+0000 7fda3977b640 1 --2- 172.21.15.5:0/2885815248 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fda200a2c00 0x7fda200a50c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:52.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.441+0000 7fda3977b640 1 --2- 172.21.15.5:0/2885815248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda34106a80 0x7fda3419ee80 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:52.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.441+0000 7fda3977b640 1 --2- 172.21.15.5:0/2885815248 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda34101420 0x7fda3419aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:52.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.441+0000 7fda3977b640 1 --2- 172.21.15.5:0/2885815248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda34100a80 0x7fda3419a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:52.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.441+0000 7fda3977b640 1 -- 172.21.15.5:0/2885815248 >> 172.21.15.5:0/2885815248 conn(0x7fda340fc7a0 msgr2=0x7fda3406a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:52.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.441+0000 7fda3977b640 1 -- 172.21.15.5:0/2885815248 shutdown_connections 2024-09-11T23:28:52.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:52.441+0000 7fda3977b640 1 -- 172.21.15.5:0/2885815248 wait complete. 2024-09-11T23:28:53.210 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-11T23:28:53.468 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:28:53.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.916+0000 7fe5c80dc640 1 -- 172.21.15.5:0/2340217926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5c0100e20 msgr2=0x7fe5c0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:53.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.916+0000 7fe5c80dc640 1 --2- 172.21.15.5:0/2340217926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5c0100e20 0x7fe5c0101200 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc009900 tx=0x7fe5bc02a480 comp rx=0 tx=0).stop 2024-09-11T23:28:53.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.916+0000 7fe5c80dc640 1 -- 172.21.15.5:0/2340217926 shutdown_connections 2024-09-11T23:28:53.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.916+0000 7fe5c80dc640 1 --2- 172.21.15.5:0/2340217926 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5c0102ef0 0x7fe5c010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:53.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.916+0000 7fe5c80dc640 1 --2- 172.21.15.5:0/2340217926 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5c0102570 0x7fe5c01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:53.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.916+0000 7fe5c80dc640 1 --2- 172.21.15.5:0/2340217926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5c0100e20 0x7fe5c0101200 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:53.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.916+0000 7fe5c80dc640 1 -- 172.21.15.5:0/2340217926 >> 172.21.15.5:0/2340217926 conn(0x7fe5c00fc7d0 msgr2=0x7fe5c00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:53.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.916+0000 7fe5c80dc640 1 -- 172.21.15.5:0/2340217926 shutdown_connections 2024-09-11T23:28:53.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.916+0000 7fe5c80dc640 1 -- 172.21.15.5:0/2340217926 wait complete. 2024-09-11T23:28:53.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.917+0000 7fe5c80dc640 1 Processor -- start 2024-09-11T23:28:53.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.917+0000 7fe5c80dc640 1 -- start start 2024-09-11T23:28:53.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.917+0000 7fe5c80dc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5c0100e20 0x7fe5c0198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:53.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.917+0000 7fe5c80dc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5c0102570 0x7fe5c01989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:53.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.917+0000 7fe5c80dc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5c0102ef0 0x7fe5c019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:53.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.917+0000 7fe5c80dc640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c0111f50 con 0x7fe5c0102570 2024-09-11T23:28:53.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.917+0000 7fe5c80dc640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c0111dd0 con 0x7fe5c0100e20 2024-09-11T23:28:53.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.917+0000 7fe5c80dc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c01120d0 con 0x7fe5c0102ef0 2024-09-11T23:28:53.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.917+0000 7fe5c5677640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5c0102570 0x7fe5c01989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:53.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.917+0000 7fe5c5677640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5c0102570 0x7fe5c01989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54004/0 (socket says 172.21.15.5:54004) 2024-09-11T23:28:53.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.917+0000 7fe5c5677640 1 -- 172.21.15.5:0/1439165985 learned_addr learned my addr 172.21.15.5:0/1439165985 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:53.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.917+0000 7fe5c5e78640 1 --2- 172.21.15.5:0/1439165985 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5c0100e20 0x7fe5c0198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:53.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.917+0000 7fe5c6679640 1 --2- 172.21.15.5:0/1439165985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5c0102ef0 0x7fe5c019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:53.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.917+0000 7fe5c5677640 1 -- 172.21.15.5:0/1439165985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5c0102ef0 msgr2=0x7fe5c019cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:53.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.917+0000 7fe5c5677640 1 --2- 172.21.15.5:0/1439165985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5c0102ef0 0x7fe5c019cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:53.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.917+0000 7fe5c5677640 1 -- 172.21.15.5:0/1439165985 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5c0100e20 msgr2=0x7fe5c0198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:53.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.917+0000 7fe5c5677640 1 --2- 172.21.15.5:0/1439165985 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5c0100e20 0x7fe5c0198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:53.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.917+0000 7fe5c5677640 1 -- 172.21.15.5:0/1439165985 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5c019d440 con 0x7fe5c0102570 2024-09-11T23:28:53.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.917+0000 7fe5c6679640 1 --2- 172.21.15.5:0/1439165985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5c0102ef0 0x7fe5c019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:28:53.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.918+0000 7fe5c5677640 1 --2- 172.21.15.5:0/1439165985 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5c0102570 0x7fe5c01989d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe5b000b4a0 tx=0x7fe5b000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:53.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.918+0000 7fe5b6ffd640 1 -- 172.21.15.5:0/1439165985 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b0014070 con 0x7fe5c0102570 2024-09-11T23:28:53.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.918+0000 7fe5b6ffd640 1 -- 172.21.15.5:0/1439165985 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe5b0010ac0 con 0x7fe5c0102570 2024-09-11T23:28:53.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.918+0000 7fe5c80dc640 1 -- 172.21.15.5:0/1439165985 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5c019d730 con 0x7fe5c0102570 2024-09-11T23:28:53.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.918+0000 7fe5b6ffd640 1 -- 172.21.15.5:0/1439165985 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b0017c30 con 0x7fe5c0102570 2024-09-11T23:28:53.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.918+0000 7fe5c80dc640 1 -- 172.21.15.5:0/1439165985 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5c01a5010 con 0x7fe5c0102570 2024-09-11T23:28:53.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.920+0000 7fe5b6ffd640 1 -- 172.21.15.5:0/1439165985 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fe5b0017070 con 0x7fe5c0102570 2024-09-11T23:28:53.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.920+0000 7fe5ca4b5740 1 Processor -- start 2024-09-11T23:28:53.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.921+0000 7fe5ca4b5740 1 -- start start 2024-09-11T23:28:53.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.921+0000 7fe5ca4b5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613743f39d0 0x5613743f3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:53.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.921+0000 7fe5ca4b5740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5613743f42f0 0x5613743fe670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:53.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.921+0000 7fe5ca4b5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5613743febb0 0x561374400fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:53.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.921+0000 7fe5ca4b5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56137435a090 con 0x5613743febb0 2024-09-11T23:28:53.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.921+0000 7fe5ca4b5740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x561374301a70 con 0x5613743f42f0 2024-09-11T23:28:53.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.921+0000 7fe5ca4b5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561374356050 con 0x5613743f39d0 2024-09-11T23:28:53.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.921+0000 7fe5c5677640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5613743febb0 0x561374400fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:53.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.921+0000 7fe5c5677640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5613743febb0 0x561374400fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54008/0 (socket says 172.21.15.5:54008) 2024-09-11T23:28:53.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.921+0000 7fe5c5677640 1 -- 172.21.15.5:0/1828890924 learned_addr learned my addr 172.21.15.5:0/1828890924 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:53.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.921+0000 7fe5c6679640 1 --2- 172.21.15.5:0/1828890924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613743f39d0 0x5613743f3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:53.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.921+0000 7fe5b6ffd640 1 --2- 172.21.15.5:0/1439165985 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe5ac0a2c00 0x7fe5ac0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:53.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.921+0000 7fe5c5e78640 1 --2- 172.21.15.5:0/1828890924 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5613743f42f0 0x5613743fe670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:53.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.921+0000 7fe5b6ffd640 1 -- 172.21.15.5:0/1439165985 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7fe5b00cea40 con 0x7fe5c0102570 2024-09-11T23:28:53.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.921+0000 7fe5c6679640 1 --2- 172.21.15.5:0/1439165985 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe5ac0a2c00 0x7fe5ac0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:53.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.921+0000 7fe5c5677640 1 -- 172.21.15.5:0/1828890924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613743f39d0 msgr2=0x5613743f3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:28:53.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.921+0000 7fe5c5677640 1 --2- 172.21.15.5:0/1828890924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613743f39d0 0x5613743f3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:53.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.921+0000 7fe5c5677640 1 -- 172.21.15.5:0/1828890924 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5613743f42f0 msgr2=0x5613743fe670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:28:53.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.921+0000 7fe5c5677640 1 --2- 172.21.15.5:0/1828890924 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5613743f42f0 0x5613743fe670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:53.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.921+0000 7fe5c5677640 1 -- 172.21.15.5:0/1828890924 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56137430e130 con 0x5613743febb0 2024-09-11T23:28:53.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.922+0000 7fe5c5677640 1 --2- 172.21.15.5:0/1828890924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5613743febb0 0x561374400fa0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe5b009abe0 tx=0x7fe5b000bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1b0051c0f822542 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:53.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.922+0000 7fe5abfff640 1 -- 172.21.15.5:0/1828890924 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b001e070 con 0x5613743febb0 2024-09-11T23:28:53.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.922+0000 7fe5c6679640 1 --2- 172.21.15.5:0/1439165985 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe5ac0a2c00 0x7fe5ac0a50c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8005fd0 tx=0x7fe5b8004ab0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:53.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.922+0000 7fe5abfff640 1 -- 172.21.15.5:0/1828890924 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe5b009b5e0 con 0x5613743febb0 2024-09-11T23:28:53.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.922+0000 7fe5abfff640 1 -- 172.21.15.5:0/1828890924 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b00991e0 con 0x5613743febb0 2024-09-11T23:28:53.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.922+0000 7fe5ca4b5740 1 -- 172.21.15.5:0/1828890924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5613743febb0 msgr2=0x561374400fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:53.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.923+0000 7fe5ca4b5740 1 --2- 172.21.15.5:0/1828890924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5613743febb0 0x561374400fa0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe5b009abe0 tx=0x7fe5b000bf90 comp rx=0 tx=0).stop 2024-09-11T23:28:53.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.923+0000 7fe5ca4b5740 1 -- 172.21.15.5:0/1828890924 shutdown_connections 2024-09-11T23:28:53.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.923+0000 7fe5ca4b5740 1 --2- 172.21.15.5:0/1828890924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5613743febb0 0x561374400fa0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:53.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.923+0000 7fe5ca4b5740 1 --2- 172.21.15.5:0/1828890924 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5613743f42f0 0x5613743fe670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:53.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.923+0000 7fe5ca4b5740 1 --2- 172.21.15.5:0/1828890924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613743f39d0 0x5613743f3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:53.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.923+0000 7fe5ca4b5740 1 -- 172.21.15.5:0/1828890924 >> 172.21.15.5:0/1828890924 conn(0x5613743eff60 msgr2=0x5613743f0340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:53.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.923+0000 7fe5ca4b5740 1 -- 172.21.15.5:0/1828890924 shutdown_connections 2024-09-11T23:28:53.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.923+0000 7fe5ca4b5740 1 -- 172.21.15.5:0/1828890924 wait complete. 2024-09-11T23:28:53.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.923+0000 7fe5ca4b5740 1 -- start start 2024-09-11T23:28:53.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.923+0000 7fe5ca4b5740 1 Processor -- start 2024-09-11T23:28:53.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.923+0000 7fe5ca4b5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5613743f39d0 0x5613743fe430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:53.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.924+0000 7fe5ca4b5740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5613743f42f0 0x5613743fb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:53.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.924+0000 7fe5ca4b5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613743febb0 0x5613743fbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:53.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.924+0000 7fe5ca4b5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x561374401780 con 0x5613743f39d0 2024-09-11T23:28:53.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.924+0000 7fe5ca4b5740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x561374314f20 con 0x5613743f42f0 2024-09-11T23:28:53.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.924+0000 7fe5ca4b5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561374401900 con 0x5613743febb0 2024-09-11T23:28:53.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.924+0000 7fe5ca4b5740 10 client.0 _ll_register_callbacks cb 0x5613742de030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:28:53.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.924+0000 7fe5c5e78640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5613743f39d0 0x5613743fe430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:53.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.924+0000 7fe5c5e78640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5613743f39d0 0x5613743fe430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54014/0 (socket says 172.21.15.5:54014) 2024-09-11T23:28:53.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.924+0000 7fe5c5e78640 1 -- 172.21.15.5:0/2813455949 learned_addr learned my addr 172.21.15.5:0/2813455949 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:53.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.924+0000 7fe5c5677640 1 --2- 172.21.15.5:0/2813455949 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5613743f42f0 0x5613743fb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:53.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.924+0000 7fe5c6679640 1 --2- 172.21.15.5:0/2813455949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613743febb0 0x5613743fbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:53.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.924+0000 7fe5c5e78640 1 -- 172.21.15.5:0/2813455949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613743febb0 msgr2=0x5613743fbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:28:53.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.924+0000 7fe5c5e78640 1 --2- 172.21.15.5:0/2813455949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613743febb0 0x5613743fbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:53.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.924+0000 7fe5c5e78640 1 -- 172.21.15.5:0/2813455949 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5613743f42f0 msgr2=0x5613743fb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:28:53.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.924+0000 7fe5c5e78640 1 --2- 172.21.15.5:0/2813455949 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5613743f42f0 0x5613743fb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:53.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.924+0000 7fe5c5e78640 1 -- 172.21.15.5:0/2813455949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613740cb2b0 con 0x5613743f39d0 2024-09-11T23:28:53.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.924+0000 7fe5c5e78640 1 --2- 172.21.15.5:0/2813455949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5613743f39d0 0x5613743fe430 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc02a9a0 tx=0x7fe5bc031450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebd57d026ab22e44 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:53.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.924+0000 7fe5a97fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-11T23:28:53.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.924+0000 7fe5a97fa640 1 -- 172.21.15.5:0/2813455949 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc035040 con 0x5613743f39d0 2024-09-11T23:28:53.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.924+0000 7fe5a97fa640 1 -- 172.21.15.5:0/2813455949 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7fe5bc004240 con 0x5613743f39d0 2024-09-11T23:28:53.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.924+0000 7fe5ca4b5740 1 -- 172.21.15.5:0/2813455949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5b009b5e0 con 0x5613743f39d0 2024-09-11T23:28:53.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.924+0000 7fe5a97fa640 1 -- 172.21.15.5:0/2813455949 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe5bc004440 con 0x5613743f39d0 2024-09-11T23:28:53.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.925+0000 7fe5ca4b5740 10 client.15225 fetch_fsmap learned FSMap version 24 2024-09-11T23:28:53.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.925+0000 7fe5ca4b5740 1 -- 172.21.15.5:0/2813455949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56137440d0d0 con 0x5613743f39d0 2024-09-11T23:28:53.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.925+0000 7fe5a97fa640 1 -- 172.21.15.5:0/2813455949 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe5b009b5e0 con 0x5613743f39d0 2024-09-11T23:28:53.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.925+0000 7fe5a97fa640 1 -- 172.21.15.5:0/2813455949 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7fe5bc044020 con 0x5613743f39d0 2024-09-11T23:28:53.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.925+0000 7fe5ca4b5740 10 client.15225 fetch_fsmap finished waiting for FSMap version 24 2024-09-11T23:28:53.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.925+0000 7fe5ca4b5740 10 client.15225 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T23:28:53.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.925+0000 7fe5ca4b5740 20 client.15225 populate_metadata read hostname 'smithi005' 2024-09-11T23:28:53.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.925+0000 7fe5ca4b5740 1 --2- 172.21.15.5:0/2813455949 >> [v2:172.21.15.159:6838/3843336290,v1:172.21.15.159:6839/3843336290] conn(0x56137440f730 0x561374410ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:53.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.925+0000 7fe5ca4b5740 4 client.15225 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:28:53.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.925+0000 7fe5ca4b5740 1 -- 172.21.15.5:0/2813455949 --> [v2:172.21.15.159:6838/3843336290,v1:172.21.15.159:6839/3843336290] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561374367600 con 0x56137440f730 2024-09-11T23:28:53.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.925+0000 7fe5c5677640 1 --2- 172.21.15.5:0/2813455949 >> [v2:172.21.15.159:6838/3843336290,v1:172.21.15.159:6839/3843336290] conn(0x56137440f730 0x561374410ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:53.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.926+0000 7fe5a97fa640 10 client.15225 ms_handle_connect on v2:172.21.15.159:6838/3843336290 2024-09-11T23:28:53.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.926+0000 7fe5c5677640 1 --2- 172.21.15.5:0/2813455949 >> [v2:172.21.15.159:6838/3843336290,v1:172.21.15.159:6839/3843336290] conn(0x56137440f730 0x561374410ba0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce977800ba34560b server_cookie=f241908b93eef574 in_seq=0 out_seq=0 2024-09-11T23:28:53.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.926+0000 7fe5a97fa640 1 -- 172.21.15.5:0/2813455949 <== mds.0 v2:172.21.15.159:6838/3843336290 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561374367600 con 0x56137440f730 2024-09-11T23:28:53.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.926+0000 7fe5a97fa640 10 client.15225 handle_command_reply: tid=0 2024-09-11T23:28:53.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.926+0000 7fe5ca4b5740 1 client.15225 shutdown 2024-09-11T23:28:53.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.926+0000 7fe5ca4b5740 1 -- 172.21.15.5:0/2813455949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5613743f39d0 msgr2=0x5613743fe430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:53.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.926+0000 7fe5ca4b5740 1 --2- 172.21.15.5:0/2813455949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5613743f39d0 0x5613743fe430 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc02a9a0 tx=0x7fe5bc031450 comp rx=0 tx=0).stop 2024-09-11T23:28:53.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.927+0000 7fe5ca4b5740 1 -- 172.21.15.5:0/2813455949 shutdown_connections 2024-09-11T23:28:53.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.927+0000 7fe5ca4b5740 1 --2- 172.21.15.5:0/2813455949 >> [v2:172.21.15.159:6838/3843336290,v1:172.21.15.159:6839/3843336290] conn(0x56137440f730 0x561374410ba0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:53.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.927+0000 7fe5ca4b5740 1 --2- 172.21.15.5:0/2813455949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613743febb0 0x5613743fbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:53.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.927+0000 7fe5ca4b5740 1 --2- 172.21.15.5:0/2813455949 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5613743f42f0 0x5613743fb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:53.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.927+0000 7fe5a97fa640 0 client.15225 ms_handle_reset on v2:172.21.15.159:6838/3843336290 2024-09-11T23:28:53.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.927+0000 7fe5ca4b5740 1 --2- 172.21.15.5:0/2813455949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5613743f39d0 0x5613743fe430 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:53.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.927+0000 7fe5ca4b5740 1 -- 172.21.15.5:0/2813455949 >> 172.21.15.5:0/2813455949 conn(0x5613743eff60 msgr2=0x5613743f5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:53.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.927+0000 7fe5ca4b5740 1 -- 172.21.15.5:0/2813455949 shutdown_connections 2024-09-11T23:28:53.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.927+0000 7fe5ca4b5740 1 -- 172.21.15.5:0/2813455949 wait complete. 2024-09-11T23:28:53.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.927+0000 7fe5ca4b5740 20 client.15225 trim_cache size 0 max 16384 2024-09-11T23:28:53.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.945+0000 7fe5ca4b5740 1 Processor -- start 2024-09-11T23:28:53.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.945+0000 7fe5ca4b5740 1 -- start start 2024-09-11T23:28:53.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.945+0000 7fe5ca4b5740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5613743f39d0 0x561374410ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:53.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.945+0000 7fe5ca4b5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613743f42f0 0x5613743f5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:53.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.945+0000 7fe5ca4b5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5613743febb0 0x5613743f5960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:53.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.945+0000 7fe5ca4b5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56137440eee0 con 0x5613743febb0 2024-09-11T23:28:53.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.945+0000 7fe5ca4b5740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x56137440f5b0 con 0x5613743f39d0 2024-09-11T23:28:53.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.945+0000 7fe5ca4b5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56137440fc80 con 0x5613743f42f0 2024-09-11T23:28:53.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.945+0000 7fe5c6679640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5613743febb0 0x5613743f5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:53.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.945+0000 7fe5c6679640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5613743febb0 0x5613743f5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54020/0 (socket says 172.21.15.5:54020) 2024-09-11T23:28:53.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.945+0000 7fe5c6679640 1 -- 172.21.15.5:0/3299481324 learned_addr learned my addr 172.21.15.5:0/3299481324 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:53.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.945+0000 7fe5c5e78640 1 --2- 172.21.15.5:0/3299481324 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5613743f39d0 0x561374410ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:53.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.945+0000 7fe5c5677640 1 --2- 172.21.15.5:0/3299481324 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613743f42f0 0x5613743f5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:53.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.946+0000 7fe5c6679640 1 -- 172.21.15.5:0/3299481324 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613743f42f0 msgr2=0x5613743f5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:28:53.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.946+0000 7fe5c6679640 1 --2- 172.21.15.5:0/3299481324 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613743f42f0 0x5613743f5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:53.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.946+0000 7fe5c6679640 1 -- 172.21.15.5:0/3299481324 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5613743f39d0 msgr2=0x561374410ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:28:53.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.946+0000 7fe5c6679640 1 --2- 172.21.15.5:0/3299481324 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5613743f39d0 0x561374410ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:53.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.946+0000 7fe5c6679640 1 -- 172.21.15.5:0/3299481324 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56137440b3f0 con 0x5613743febb0 2024-09-11T23:28:53.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.946+0000 7fe5c5e78640 1 --2- 172.21.15.5:0/3299481324 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5613743f39d0 0x561374410ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:28:53.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.946+0000 7fe5c5677640 1 --2- 172.21.15.5:0/3299481324 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613743f42f0 0x5613743f5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:28:53.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.946+0000 7fe5c6679640 1 --2- 172.21.15.5:0/3299481324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5613743febb0 0x5613743f5960 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8014010 tx=0x7fe5b8009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eabd7079cb54728a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:53.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.946+0000 7fe5ab7fe640 1 -- 172.21.15.5:0/3299481324 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b8019070 con 0x5613743febb0 2024-09-11T23:28:53.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.946+0000 7fe5ab7fe640 1 -- 172.21.15.5:0/3299481324 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe5b8025070 con 0x5613743febb0 2024-09-11T23:28:53.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.946+0000 7fe5ab7fe640 1 -- 172.21.15.5:0/3299481324 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b8029680 con 0x5613743febb0 2024-09-11T23:28:53.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.947+0000 7fe5ca4b5740 1 -- 172.21.15.5:0/3299481324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5613743febb0 msgr2=0x5613743f5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:53.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.947+0000 7fe5ca4b5740 1 --2- 172.21.15.5:0/3299481324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5613743febb0 0x5613743f5960 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8014010 tx=0x7fe5b8009800 comp rx=0 tx=0).stop 2024-09-11T23:28:53.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.947+0000 7fe5ca4b5740 1 -- 172.21.15.5:0/3299481324 shutdown_connections 2024-09-11T23:28:53.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.947+0000 7fe5ca4b5740 1 --2- 172.21.15.5:0/3299481324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5613743febb0 0x5613743f5960 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:53.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.947+0000 7fe5ca4b5740 1 --2- 172.21.15.5:0/3299481324 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613743f42f0 0x5613743f5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:53.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.947+0000 7fe5ca4b5740 1 --2- 172.21.15.5:0/3299481324 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5613743f39d0 0x561374410ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:53.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.947+0000 7fe5ca4b5740 1 -- 172.21.15.5:0/3299481324 >> 172.21.15.5:0/3299481324 conn(0x5613743eff60 msgr2=0x5613743fa0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:53.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.947+0000 7fe5ca4b5740 1 -- 172.21.15.5:0/3299481324 shutdown_connections 2024-09-11T23:28:53.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.947+0000 7fe5ca4b5740 1 -- 172.21.15.5:0/3299481324 wait complete. 2024-09-11T23:28:53.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.947+0000 7fe5ca4b5740 1 -- start start 2024-09-11T23:28:53.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.947+0000 7fe5ca4b5740 1 Processor -- start 2024-09-11T23:28:53.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.948+0000 7fe5ca4b5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613743f39d0 0x561374412340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:53.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.948+0000 7fe5ca4b5740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5613743f42f0 0x561374412880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:53.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.948+0000 7fe5ca4b5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5613743febb0 0x561374477e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:53.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.948+0000 7fe5ca4b5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x561374410a20 con 0x5613743febb0 2024-09-11T23:28:53.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.948+0000 7fe5ca4b5740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x561374410350 con 0x5613743f42f0 2024-09-11T23:28:53.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.948+0000 7fe5ca4b5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5613744110f0 con 0x5613743f39d0 2024-09-11T23:28:53.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.948+0000 7fe5ca4b5740 10 client.0 _ll_register_callbacks cb 0x7fe5bc009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:28:53.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.948+0000 7fe5c6679640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5613743febb0 0x561374477e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:53.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.948+0000 7fe5c6679640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5613743febb0 0x561374477e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54036/0 (socket says 172.21.15.5:54036) 2024-09-11T23:28:53.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.948+0000 7fe5c6679640 1 -- 172.21.15.5:0/1782950345 learned_addr learned my addr 172.21.15.5:0/1782950345 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:53.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.948+0000 7fe5c5e78640 1 --2- 172.21.15.5:0/1782950345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613743f39d0 0x561374412340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:53.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.948+0000 7fe5c5677640 1 --2- 172.21.15.5:0/1782950345 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5613743f42f0 0x561374412880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:53.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.948+0000 7fe5c6679640 1 -- 172.21.15.5:0/1782950345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613743f39d0 msgr2=0x561374412340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:28:53.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.948+0000 7fe5c6679640 1 --2- 172.21.15.5:0/1782950345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613743f39d0 0x561374412340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:53.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.948+0000 7fe5c6679640 1 -- 172.21.15.5:0/1782950345 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5613743f42f0 msgr2=0x561374412880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:28:53.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.948+0000 7fe5c6679640 1 --2- 172.21.15.5:0/1782950345 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5613743f42f0 0x561374412880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:53.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.948+0000 7fe5c6679640 1 -- 172.21.15.5:0/1782950345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561374478370 con 0x5613743febb0 2024-09-11T23:28:53.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.948+0000 7fe5c5e78640 1 --2- 172.21.15.5:0/1782950345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613743f39d0 0x561374412340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:28:53.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.948+0000 7fe5c6679640 1 --2- 172.21.15.5:0/1782950345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5613743febb0 0x561374477e30 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8005cc0 tx=0x7fe5b8029650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b02c0be976d6afe5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:53.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.948+0000 7fe5a97fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-11T23:28:53.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.949+0000 7fe5a97fa640 1 -- 172.21.15.5:0/1782950345 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b8037060 con 0x5613743febb0 2024-09-11T23:28:53.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.949+0000 7fe5a97fa640 1 -- 172.21.15.5:0/1782950345 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7fe5b80299d0 con 0x5613743febb0 2024-09-11T23:28:53.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.949+0000 7fe5ca4b5740 1 -- 172.21.15.5:0/1782950345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5b8025070 con 0x5613743febb0 2024-09-11T23:28:53.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.949+0000 7fe5a97fa640 1 -- 172.21.15.5:0/1782950345 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe5b803e050 con 0x5613743febb0 2024-09-11T23:28:53.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.949+0000 7fe5ca4b5740 10 client.15231 fetch_fsmap learned FSMap version 24 2024-09-11T23:28:53.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.949+0000 7fe5ca4b5740 1 -- 172.21.15.5:0/1782950345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x561374479580 con 0x5613743febb0 2024-09-11T23:28:53.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.949+0000 7fe5a97fa640 1 -- 172.21.15.5:0/1782950345 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe5b8025070 con 0x5613743febb0 2024-09-11T23:28:53.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.949+0000 7fe5a97fa640 1 -- 172.21.15.5:0/1782950345 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 24) ==== 8354+0+0 (secure 0 0 0) 0x7fe5b801c070 con 0x5613743febb0 2024-09-11T23:28:53.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.949+0000 7fe5ca4b5740 10 client.15231 fetch_fsmap finished waiting for FSMap version 24 2024-09-11T23:28:53.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.949+0000 7fe5ca4b5740 10 client.15231 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T23:28:53.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.949+0000 7fe5ca4b5740 20 client.15231 populate_metadata read hostname 'smithi005' 2024-09-11T23:28:53.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.949+0000 7fe5ca4b5740 1 --2- 172.21.15.5:0/1782950345 >> [v2:172.21.15.159:6838/3843336290,v1:172.21.15.159:6839/3843336290] conn(0x56137447dce0 0x56137447c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:53.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.949+0000 7fe5ca4b5740 4 client.15231 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:28:53.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.949+0000 7fe5ca4b5740 1 -- 172.21.15.5:0/1782950345 --> [v2:172.21.15.159:6838/3843336290,v1:172.21.15.159:6839/3843336290] -- command(tid 0: {"prefix": "status"}) -- 0x561374361b10 con 0x56137447dce0 2024-09-11T23:28:53.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.949+0000 7fe5c5e78640 1 --2- 172.21.15.5:0/1782950345 >> [v2:172.21.15.159:6838/3843336290,v1:172.21.15.159:6839/3843336290] conn(0x56137447dce0 0x56137447c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:53.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.950+0000 7fe5c5e78640 1 --2- 172.21.15.5:0/1782950345 >> [v2:172.21.15.159:6838/3843336290,v1:172.21.15.159:6839/3843336290] conn(0x56137447dce0 0x56137447c9f0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd15d2ad73211182 server_cookie=5474fdd647b780bc in_seq=0 out_seq=0 2024-09-11T23:28:53.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.950+0000 7fe5a97fa640 10 client.15231 ms_handle_connect on v2:172.21.15.159:6838/3843336290 2024-09-11T23:28:53.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.950+0000 7fe5a97fa640 1 -- 172.21.15.5:0/1782950345 <== mds.0 v2:172.21.15.159:6838/3843336290 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x561374361b10 con 0x56137447dce0 2024-09-11T23:28:53.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.950+0000 7fe5a97fa640 10 client.15231 handle_command_reply: tid=0 2024-09-11T23:28:53.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.950+0000 7fe5ca4b5740 1 client.15231 shutdown 2024-09-11T23:28:53.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.950+0000 7fe5ca4b5740 1 -- 172.21.15.5:0/1782950345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5613743febb0 msgr2=0x561374477e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:53.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.950+0000 7fe5ca4b5740 1 --2- 172.21.15.5:0/1782950345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5613743febb0 0x561374477e30 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8005cc0 tx=0x7fe5b8029650 comp rx=0 tx=0).stop 2024-09-11T23:28:53.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.950+0000 7fe5ca4b5740 1 -- 172.21.15.5:0/1782950345 shutdown_connections 2024-09-11T23:28:53.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.950+0000 7fe5ca4b5740 1 --2- 172.21.15.5:0/1782950345 >> [v2:172.21.15.159:6838/3843336290,v1:172.21.15.159:6839/3843336290] conn(0x56137447dce0 0x56137447c9f0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:53.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.950+0000 7fe5ca4b5740 1 --2- 172.21.15.5:0/1782950345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5613743febb0 0x561374477e30 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:53.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.950+0000 7fe5ca4b5740 1 --2- 172.21.15.5:0/1782950345 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5613743f42f0 0x561374412880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:53.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.950+0000 7fe5ca4b5740 1 --2- 172.21.15.5:0/1782950345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613743f39d0 0x561374412340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:53.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.950+0000 7fe5a97fa640 0 client.15231 ms_handle_reset on v2:172.21.15.159:6838/3843336290 2024-09-11T23:28:53.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.950+0000 7fe5ca4b5740 1 -- 172.21.15.5:0/1782950345 >> 172.21.15.5:0/1782950345 conn(0x5613743eff60 msgr2=0x5613743fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:53.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.950+0000 7fe5ca4b5740 1 -- 172.21.15.5:0/1782950345 shutdown_connections 2024-09-11T23:28:53.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.950+0000 7fe5ca4b5740 1 -- 172.21.15.5:0/1782950345 wait complete. 2024-09-11T23:28:53.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.951+0000 7fe5ca4b5740 20 client.15231 trim_cache size 0 max 16384 2024-09-11T23:28:53.960 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-11T23:28:53.960 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "1f5284d2-7094-11ef-bcea-c7b262605968", 2024-09-11T23:28:53.960 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-09-11T23:28:53.960 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 24494, 2024-09-11T23:28:53.960 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-09-11T23:28:53.960 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-09-11T23:28:53.960 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-09-11T23:28:53.960 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 127.933041906, 2024-09-11T23:28:53.960 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 24, 2024-09-11T23:28:53.961 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 88, 2024-09-11T23:28:53.961 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 86, 2024-09-11T23:28:53.961 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 139.29518688900001 2024-09-11T23:28:53.961 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-11T23:28:53.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.951+0000 7fe5c80dc640 1 -- 172.21.15.5:0/1439165985 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe5ac0a2c00 msgr2=0x7fe5ac0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:53.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.951+0000 7fe5c80dc640 1 --2- 172.21.15.5:0/1439165985 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe5ac0a2c00 0x7fe5ac0a50c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8005fd0 tx=0x7fe5b8004ab0 comp rx=0 tx=0).stop 2024-09-11T23:28:53.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.951+0000 7fe5c80dc640 1 -- 172.21.15.5:0/1439165985 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5c0102570 msgr2=0x7fe5c01989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:53.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.951+0000 7fe5c80dc640 1 --2- 172.21.15.5:0/1439165985 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5c0102570 0x7fe5c01989d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe5b000b4a0 tx=0x7fe5b000b960 comp rx=0 tx=0).stop 2024-09-11T23:28:53.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.951+0000 7fe5c80dc640 1 -- 172.21.15.5:0/1439165985 shutdown_connections 2024-09-11T23:28:53.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.951+0000 7fe5c80dc640 1 --2- 172.21.15.5:0/1439165985 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe5ac0a2c00 0x7fe5ac0a50c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:53.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.951+0000 7fe5c80dc640 1 --2- 172.21.15.5:0/1439165985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5c0102ef0 0x7fe5c019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:53.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.951+0000 7fe5c80dc640 1 --2- 172.21.15.5:0/1439165985 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5c0102570 0x7fe5c01989d0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:53.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.951+0000 7fe5c80dc640 1 --2- 172.21.15.5:0/1439165985 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5c0100e20 0x7fe5c0198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:53.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.951+0000 7fe5c80dc640 1 -- 172.21.15.5:0/1439165985 >> 172.21.15.5:0/1439165985 conn(0x7fe5c00fc7d0 msgr2=0x7fe5c00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:53.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.951+0000 7fe5c80dc640 1 -- 172.21.15.5:0/1439165985 shutdown_connections 2024-09-11T23:28:53.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:53.951+0000 7fe5c80dc640 1 -- 172.21.15.5:0/1439165985 wait complete. 2024-09-11T23:28:54.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:54 smithi005 ceph-mon[31201]: pgmap v349: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T23:28:54.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:54 smithi159 ceph-mon[34394]: pgmap v349: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T23:28:54.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:54 smithi172 ceph-mon[34855]: pgmap v349: 129 pgs: 129 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T23:28:54.694 INFO:teuthology.run_tasks:Running task sequential... 2024-09-11T23:28:54.713 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-11T23:28:54.714 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-11T23:28:54.714 INFO:teuthology.task.print:Enabling mgr modules 2024-09-11T23:28:54.715 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-11T23:28:54.759 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-11T23:28:54.759 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-09-11T23:28:54.759 INFO:tasks.ceph_fuse:client.0 config is {'mount_subvol_num': 0} 2024-09-11T23:28:54.759 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-11T23:28:54.759 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T23:28:54.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:28:54.760 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-09-11T23:28:54.778 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-11T23:28:54.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:28:54.779 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T23:28:54.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:28:54.847 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2024-09-11T23:28:54.949 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-11T23:28:54.950 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-11T23:28:54.950 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-11T23:28:55.213 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:28:55.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.668+0000 7f4f00332640 1 -- 172.21.15.5:0/799773798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ef8106a80 msgr2=0x7f4ef8106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:55.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.668+0000 7f4f00332640 1 --2- 172.21.15.5:0/799773798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ef8106a80 0x7f4ef8106e60 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8009930 tx=0x7f4ee802a420 comp rx=0 tx=0).stop 2024-09-11T23:28:55.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.669+0000 7f4f00332640 1 -- 172.21.15.5:0/799773798 shutdown_connections 2024-09-11T23:28:55.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.669+0000 7f4f00332640 1 --2- 172.21.15.5:0/799773798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ef8101420 0x7f4ef810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:55.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.669+0000 7f4f00332640 1 --2- 172.21.15.5:0/799773798 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ef8100a80 0x7f4ef8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:55.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.669+0000 7f4f00332640 1 --2- 172.21.15.5:0/799773798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ef8106a80 0x7f4ef8106e60 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:55.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.669+0000 7f4f00332640 1 -- 172.21.15.5:0/799773798 >> 172.21.15.5:0/799773798 conn(0x7f4ef80fc7a0 msgr2=0x7f4ef80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:55.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.669+0000 7f4f00332640 1 -- 172.21.15.5:0/799773798 shutdown_connections 2024-09-11T23:28:55.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.669+0000 7f4f00332640 1 -- 172.21.15.5:0/799773798 wait complete. 2024-09-11T23:28:55.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.669+0000 7f4f00332640 1 Processor -- start 2024-09-11T23:28:55.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.669+0000 7f4f00332640 1 -- start start 2024-09-11T23:28:55.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.670+0000 7f4f00332640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ef8100a80 0x7f4ef81973f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:55.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.670+0000 7f4f00332640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ef8101420 0x7f4ef8197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:55.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.670+0000 7f4f00332640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ef8106a80 0x7f4ef819bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:55.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.670+0000 7f4f00332640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef8110dd0 con 0x7f4ef8101420 2024-09-11T23:28:55.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.670+0000 7f4f00332640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef8110c50 con 0x7f4ef8100a80 2024-09-11T23:28:55.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.670+0000 7f4f00332640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef8110f50 con 0x7f4ef8106a80 2024-09-11T23:28:55.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.670+0000 7f4efd8cd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ef8101420 0x7f4ef8197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:55.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.670+0000 7f4efd8cd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ef8101420 0x7f4ef8197930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54068/0 (socket says 172.21.15.5:54068) 2024-09-11T23:28:55.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.670+0000 7f4efd8cd640 1 -- 172.21.15.5:0/3313371445 learned_addr learned my addr 172.21.15.5:0/3313371445 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:55.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.670+0000 7f4efe8cf640 1 --2- 172.21.15.5:0/3313371445 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ef8106a80 0x7f4ef819bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:55.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.670+0000 7f4efe0ce640 1 --2- 172.21.15.5:0/3313371445 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ef8100a80 0x7f4ef81973f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:55.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.670+0000 7f4efd8cd640 1 -- 172.21.15.5:0/3313371445 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ef8106a80 msgr2=0x7f4ef819bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:55.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.670+0000 7f4efd8cd640 1 --2- 172.21.15.5:0/3313371445 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ef8106a80 0x7f4ef819bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:55.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.670+0000 7f4efd8cd640 1 -- 172.21.15.5:0/3313371445 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ef8100a80 msgr2=0x7f4ef81973f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:55.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.670+0000 7f4efd8cd640 1 --2- 172.21.15.5:0/3313371445 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ef8100a80 0x7f4ef81973f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:55.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.670+0000 7f4efd8cd640 1 -- 172.21.15.5:0/3313371445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ef819c3a0 con 0x7f4ef8101420 2024-09-11T23:28:55.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.670+0000 7f4efd8cd640 1 --2- 172.21.15.5:0/3313371445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ef8101420 0x7f4ef8197930 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4ef400d990 tx=0x7f4ef400de50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:55.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.670+0000 7f4eef7fe640 1 -- 172.21.15.5:0/3313371445 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef401b070 con 0x7f4ef8101420 2024-09-11T23:28:55.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.670+0000 7f4eef7fe640 1 -- 172.21.15.5:0/3313371445 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4ef400edf0 con 0x7f4ef8101420 2024-09-11T23:28:55.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.670+0000 7f4f00332640 1 -- 172.21.15.5:0/3313371445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ef819c690 con 0x7f4ef8101420 2024-09-11T23:28:55.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.670+0000 7f4eef7fe640 1 -- 172.21.15.5:0/3313371445 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef4014800 con 0x7f4ef8101420 2024-09-11T23:28:55.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.671+0000 7f4f00332640 1 -- 172.21.15.5:0/3313371445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ef806a790 con 0x7f4ef8101420 2024-09-11T23:28:55.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.671+0000 7f4f00332640 1 -- 172.21.15.5:0/3313371445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ef8100f60 con 0x7f4ef8101420 2024-09-11T23:28:55.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.673+0000 7f4eef7fe640 1 -- 172.21.15.5:0/3313371445 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f4ef401e070 con 0x7f4ef8101420 2024-09-11T23:28:55.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.673+0000 7f4eef7fe640 1 --2- 172.21.15.5:0/3313371445 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f4ee40a2c00 0x7f4ee40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:55.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.673+0000 7f4efe0ce640 1 --2- 172.21.15.5:0/3313371445 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f4ee40a2c00 0x7f4ee40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:55.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.673+0000 7f4eef7fe640 1 -- 172.21.15.5:0/3313371445 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7f4ef40d12b0 con 0x7f4ef8101420 2024-09-11T23:28:55.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.674+0000 7f4efe0ce640 1 --2- 172.21.15.5:0/3313371445 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f4ee40a2c00 0x7f4ee40a50c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8000c00 tx=0x7f4ee8031400 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:55.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.677+0000 7f4eef7fe640 1 -- 172.21.15.5:0/3313371445 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4ef4025070 con 0x7f4ef8101420 2024-09-11T23:28:55.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.889+0000 7f4f00332640 1 -- 172.21.15.5:0/3313371445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f4ef8198750 con 0x7f4ef8101420 2024-09-11T23:28:55.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.889+0000 7f4eef7fe640 1 -- 172.21.15.5:0/3313371445 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) ==== 53+0+88 (secure 0 0 0) 0x7f4ef8198750 con 0x7f4ef8101420 2024-09-11T23:28:55.889 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-11T23:28:55.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.892+0000 7f4f00332640 1 -- 172.21.15.5:0/3313371445 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f4ee40a2c00 msgr2=0x7f4ee40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:55.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.892+0000 7f4f00332640 1 --2- 172.21.15.5:0/3313371445 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f4ee40a2c00 0x7f4ee40a50c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8000c00 tx=0x7f4ee8031400 comp rx=0 tx=0).stop 2024-09-11T23:28:55.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.892+0000 7f4f00332640 1 -- 172.21.15.5:0/3313371445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ef8101420 msgr2=0x7f4ef8197930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:55.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.892+0000 7f4f00332640 1 --2- 172.21.15.5:0/3313371445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ef8101420 0x7f4ef8197930 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4ef400d990 tx=0x7f4ef400de50 comp rx=0 tx=0).stop 2024-09-11T23:28:55.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.892+0000 7f4f00332640 1 -- 172.21.15.5:0/3313371445 shutdown_connections 2024-09-11T23:28:55.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.892+0000 7f4f00332640 1 --2- 172.21.15.5:0/3313371445 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f4ee40a2c00 0x7f4ee40a50c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:55.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.892+0000 7f4f00332640 1 --2- 172.21.15.5:0/3313371445 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ef8106a80 0x7f4ef819bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:55.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.892+0000 7f4f00332640 1 --2- 172.21.15.5:0/3313371445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ef8101420 0x7f4ef8197930 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:55.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.892+0000 7f4f00332640 1 --2- 172.21.15.5:0/3313371445 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ef8100a80 0x7f4ef81973f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:55.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.892+0000 7f4f00332640 1 -- 172.21.15.5:0/3313371445 >> 172.21.15.5:0/3313371445 conn(0x7f4ef80fc7a0 msgr2=0x7f4ef80fd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:55.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.892+0000 7f4f00332640 1 -- 172.21.15.5:0/3313371445 shutdown_connections 2024-09-11T23:28:55.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:55.892+0000 7f4f00332640 1 -- 172.21.15.5:0/3313371445 wait complete. 2024-09-11T23:28:56.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:56 smithi005 ceph-mon[31201]: pgmap v350: 129 pgs: 129 active+clean; 643 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-11T23:28:56.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:56 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/3313371445' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-11T23:28:56.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:56 smithi159 ceph-mon[34394]: pgmap v350: 129 pgs: 129 active+clean; 643 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-11T23:28:56.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:56 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/3313371445' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-11T23:28:56.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:56 smithi172 ceph-mon[34855]: pgmap v350: 129 pgs: 129 active+clean; 643 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-11T23:28:56.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:56 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/3313371445' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-11T23:28:56.578 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T23:28:56.578 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:28:56.578 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-09-11T23:28:56.578 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T23:28:56.578 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T23:28:56.578 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T23:28:56.578 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T23:28:56.578 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:28:56.579 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:28:56.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:28:56.579 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-09-11T23:28:56.597 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:28:56.597 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:28:56.597 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:28:56.597 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:28:56.597 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-09-11T23:28:56.597 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:28:56.598 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:28:56.598 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-09-11T23:28:56.598 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-09-11T23:28:56.598 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:28:56.598 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-09-11T23:28:56.598 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-09-11T23:28:56.598 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:28:56.598 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:28:56.598 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-09-11T23:28:56.598 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-11T23:28:56.598 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42196sec preferred_lft 42196sec 2024-09-11T23:28:56.598 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2024-09-11T23:28:56.598 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:28:56.599 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:28:56.599 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:28:56.599 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-09-11T23:28:56.599 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-11T23:28:56.599 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:28:56.599 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-09-11T23:28:56.599 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add name ceph-brx type bridge 2024-09-11T23:28:56.599 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr flush dev ceph-brx 2024-09-11T23:28:56.599 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set ceph-brx up 2024-09-11T23:28:56.600 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-11T23:28:56.600 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-09-11T23:28:56.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:28:56.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:28:56.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:28:56.746 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:28:56.771 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-09-11T23:28:56.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:28:56.773 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-09-11T23:28:56.830 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-09-11T23:28:56.830 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:28:56.830 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-11T23:28:56.830 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-11T23:28:56.831 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:28:56.831 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:28:56.831 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-09-11T23:28:56.831 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-11T23:28:56.831 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-11T23:28:56.831 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-11T23:28:56.831 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-09-11T23:28:56.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:28:56.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:28:56.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:28:56.964 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-09-11T23:28:56.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:28:56.983 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list-id 2024-09-11T23:28:57.038 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:28:57.038 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-09-11T23:28:57.038 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:28:57.038 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-11T23:28:57.038 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-09-11T23:28:57.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:28:57.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:28:57.161 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-11T23:28:57.162 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:28:57.162 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-09-11T23:28:57.162 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-11T23:28:57.162 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-11T23:28:57.162 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-11T23:28:57.162 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-11T23:28:57.162 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-11T23:28:57.162 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-09-11T23:28:57.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:28:57.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:28:57.281 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:28:57.281 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-09-11T23:28:57.281 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-09-11T23:28:57.281 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set dev brx.0 master ceph-brx 2024-09-11T23:28:57.282 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-09-11T23:28:57.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:28:57.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:28:57.362 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mount_subvol_num': 0} 2024-09-11T23:28:57.362 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:28:57.362 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T23:28:57.378 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:28:57.378 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:28:57.378 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:28:57.434 DEBUG:teuthology.orchestra.run.smithi005:> sudo modprobe fuse 2024-09-11T23:28:57.501 DEBUG:teuthology.orchestra.run.smithi005:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:28:57.558 INFO:teuthology.orchestra.run.smithi005.stdout:/proc 2024-09-11T23:28:57.559 INFO:teuthology.orchestra.run.smithi005.stdout:/sys 2024-09-11T23:28:57.559 INFO:teuthology.orchestra.run.smithi005.stdout:/dev 2024-09-11T23:28:57.559 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/security 2024-09-11T23:28:57.559 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/shm 2024-09-11T23:28:57.559 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/pts 2024-09-11T23:28:57.559 INFO:teuthology.orchestra.run.smithi005.stdout:/run 2024-09-11T23:28:57.559 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup 2024-09-11T23:28:57.559 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/pstore 2024-09-11T23:28:57.559 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/bpf 2024-09-11T23:28:57.559 INFO:teuthology.orchestra.run.smithi005.stdout:/ 2024-09-11T23:28:57.559 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/selinux 2024-09-11T23:28:57.560 INFO:teuthology.orchestra.run.smithi005.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:28:57.560 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/mqueue 2024-09-11T23:28:57.560 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/hugepages 2024-09-11T23:28:57.560 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/debug 2024-09-11T23:28:57.560 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/tracing 2024-09-11T23:28:57.560 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/fuse/connections 2024-09-11T23:28:57.560 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/config 2024-09-11T23:28:57.560 INFO:teuthology.orchestra.run.smithi005.stdout:/run/credentials/systemd-sysctl.service 2024-09-11T23:28:57.560 INFO:teuthology.orchestra.run.smithi005.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-11T23:28:57.560 INFO:teuthology.orchestra.run.smithi005.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-11T23:28:57.560 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/nfs/rpc_pipefs 2024-09-11T23:28:57.560 INFO:teuthology.orchestra.run.smithi005.stdout:/run/user/1000 2024-09-11T23:28:57.560 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph 2024-09-11T23:28:57.561 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay 2024-09-11T23:28:57.561 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/2798300e339ac8ec192b3550985a7eafd80c8eb993440dedf97c9f2213033162/merged 2024-09-11T23:28:57.561 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/6874d985f2af4489392f5f80c06ba8aa05d3617326fdff057e94d2740d8513d6/merged 2024-09-11T23:28:57.561 INFO:teuthology.orchestra.run.smithi005.stdout:/run/user/0 2024-09-11T23:28:57.561 INFO:teuthology.orchestra.run.smithi005.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:28:57.561 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/cc8a9010b3a33fc2e21b88536f311ae5197b52d2fb00362885e149d786556c1a/merged 2024-09-11T23:28:57.561 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/0c4147d0bcd5cde7194ab1bc6e46e72cae5d9687c34a89c249038749d8d0578b/merged 2024-09-11T23:28:57.561 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/703d8be9262b54853e749bfec1f061ecaa38564d010dd15353a71c145106895d/merged 2024-09-11T23:28:57.561 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/a0ecdfd30d8cf15a40abd03f4bfa2366bdcfba3cf9448575a940322c1b5f9b27/merged 2024-09-11T23:28:57.561 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/853fb62203a4b457d14f86b2012081ddcd014be5a7e3023d4f3ded3c4e16cce7/merged 2024-09-11T23:28:57.561 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/e806458ec95f3a34cbf563cab9681bc7bd0b2a50f7ad8ab3c89dc483098cc083/merged 2024-09-11T23:28:57.561 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/adf9affa946bd5dafb30e9259aae1166b07d01aff27d1d551a12643dff905428/merged 2024-09-11T23:28:57.561 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/ba3e861a6b3c965d0d52e0cb02688b297e8ff50b6250c401b739e5f48407a80b/merged 2024-09-11T23:28:57.562 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns 2024-09-11T23:28:57.562 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:28:57.562 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:28:57.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:28:57.562 DEBUG:teuthology.orchestra.run.smithi005:> ls /sys/fs/fuse/connections 2024-09-11T23:28:57.615 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-11T23:28:57.615 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/volumes/qa/sv_0/8efa0809-f9ec-4540-b106-c6b97a1d80bb --client_fs=cephfs) 2024-09-11T23:28:57.658 DEBUG:teuthology.orchestra.run.smithi005:> sudo modprobe fuse 2024-09-11T23:28:57.683 DEBUG:teuthology.orchestra.run.smithi005:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T23:28:57.741 INFO:teuthology.orchestra.run.smithi005.stdout:/proc 2024-09-11T23:28:57.741 INFO:teuthology.orchestra.run.smithi005.stdout:/sys 2024-09-11T23:28:57.742 INFO:teuthology.orchestra.run.smithi005.stdout:/dev 2024-09-11T23:28:57.742 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/security 2024-09-11T23:28:57.742 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/shm 2024-09-11T23:28:57.742 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/pts 2024-09-11T23:28:57.742 INFO:teuthology.orchestra.run.smithi005.stdout:/run 2024-09-11T23:28:57.742 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup 2024-09-11T23:28:57.742 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/pstore 2024-09-11T23:28:57.742 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/bpf 2024-09-11T23:28:57.742 INFO:teuthology.orchestra.run.smithi005.stdout:/ 2024-09-11T23:28:57.742 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/selinux 2024-09-11T23:28:57.743 INFO:teuthology.orchestra.run.smithi005.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:28:57.743 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/mqueue 2024-09-11T23:28:57.743 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/hugepages 2024-09-11T23:28:57.743 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/debug 2024-09-11T23:28:57.743 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/tracing 2024-09-11T23:28:57.743 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/fuse/connections 2024-09-11T23:28:57.743 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/config 2024-09-11T23:28:57.743 INFO:teuthology.orchestra.run.smithi005.stdout:/run/credentials/systemd-sysctl.service 2024-09-11T23:28:57.743 INFO:teuthology.orchestra.run.smithi005.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-11T23:28:57.743 INFO:teuthology.orchestra.run.smithi005.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-11T23:28:57.743 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/nfs/rpc_pipefs 2024-09-11T23:28:57.743 INFO:teuthology.orchestra.run.smithi005.stdout:/run/user/1000 2024-09-11T23:28:57.743 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph 2024-09-11T23:28:57.744 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay 2024-09-11T23:28:57.744 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/2798300e339ac8ec192b3550985a7eafd80c8eb993440dedf97c9f2213033162/merged 2024-09-11T23:28:57.744 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/6874d985f2af4489392f5f80c06ba8aa05d3617326fdff057e94d2740d8513d6/merged 2024-09-11T23:28:57.744 INFO:teuthology.orchestra.run.smithi005.stdout:/run/user/0 2024-09-11T23:28:57.744 INFO:teuthology.orchestra.run.smithi005.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T23:28:57.744 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/cc8a9010b3a33fc2e21b88536f311ae5197b52d2fb00362885e149d786556c1a/merged 2024-09-11T23:28:57.744 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/0c4147d0bcd5cde7194ab1bc6e46e72cae5d9687c34a89c249038749d8d0578b/merged 2024-09-11T23:28:57.744 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/703d8be9262b54853e749bfec1f061ecaa38564d010dd15353a71c145106895d/merged 2024-09-11T23:28:57.744 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/a0ecdfd30d8cf15a40abd03f4bfa2366bdcfba3cf9448575a940322c1b5f9b27/merged 2024-09-11T23:28:57.744 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/853fb62203a4b457d14f86b2012081ddcd014be5a7e3023d4f3ded3c4e16cce7/merged 2024-09-11T23:28:57.744 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/e806458ec95f3a34cbf563cab9681bc7bd0b2a50f7ad8ab3c89dc483098cc083/merged 2024-09-11T23:28:57.744 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/adf9affa946bd5dafb30e9259aae1166b07d01aff27d1d551a12643dff905428/merged 2024-09-11T23:28:57.744 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/ba3e861a6b3c965d0d52e0cb02688b297e8ff50b6250c401b739e5f48407a80b/merged 2024-09-11T23:28:57.745 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns 2024-09-11T23:28:57.745 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:28:57.745 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:28:57.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:28:57.745 DEBUG:teuthology.orchestra.run.smithi005:> ls /sys/fs/fuse/connections 2024-09-11T23:28:57.746 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:2024-09-11T23:28:57.744+0000 7f5636d23480 -1 init, newargv = 0x563b427baaf0 newargc=15 2024-09-11T23:28:57.746 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:ceph-fuse[85170]: starting ceph client 2024-09-11T23:28:57.758 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:ceph-fuse[85170]: starting fuse 2024-09-11T23:28:57.762 INFO:teuthology.orchestra.run.smithi005.stdout:120 2024-09-11T23:28:57.763 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-11T23:28:57.763 DEBUG:teuthology.orchestra.run.smithi005:> sudo stdin-killer -- python3 -c ' 2024-09-11T23:28:57.763 DEBUG:teuthology.orchestra.run.smithi005:> import glob 2024-09-11T23:28:57.763 DEBUG:teuthology.orchestra.run.smithi005:> import re 2024-09-11T23:28:57.763 DEBUG:teuthology.orchestra.run.smithi005:> import os 2024-09-11T23:28:57.763 DEBUG:teuthology.orchestra.run.smithi005:> import subprocess 2024-09-11T23:28:57.763 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-11T23:28:57.763 DEBUG:teuthology.orchestra.run.smithi005:> def _find_admin_socket(client_name): 2024-09-11T23:28:57.763 DEBUG:teuthology.orchestra.run.smithi005:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-11T23:28:57.763 DEBUG:teuthology.orchestra.run.smithi005:> files = glob.glob(asok_path) 2024-09-11T23:28:57.763 DEBUG:teuthology.orchestra.run.smithi005:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-11T23:28:57.764 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-11T23:28:57.764 DEBUG:teuthology.orchestra.run.smithi005:> # Given a non-glob path, it better be there 2024-09-11T23:28:57.764 DEBUG:teuthology.orchestra.run.smithi005:> if "*" not in asok_path: 2024-09-11T23:28:57.764 DEBUG:teuthology.orchestra.run.smithi005:> assert(len(files) == 1) 2024-09-11T23:28:57.764 DEBUG:teuthology.orchestra.run.smithi005:> return files[0] 2024-09-11T23:28:57.764 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-11T23:28:57.764 DEBUG:teuthology.orchestra.run.smithi005:> for f in files: 2024-09-11T23:28:57.764 DEBUG:teuthology.orchestra.run.smithi005:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T23:28:57.764 DEBUG:teuthology.orchestra.run.smithi005:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T23:28:57.764 DEBUG:teuthology.orchestra.run.smithi005:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T23:28:57.764 DEBUG:teuthology.orchestra.run.smithi005:> contents = proc_f.read() 2024-09-11T23:28:57.764 DEBUG:teuthology.orchestra.run.smithi005:> if mountpoint in contents: 2024-09-11T23:28:57.764 DEBUG:teuthology.orchestra.run.smithi005:> return f 2024-09-11T23:28:57.764 DEBUG:teuthology.orchestra.run.smithi005:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T23:28:57.765 DEBUG:teuthology.orchestra.run.smithi005:> 2024-09-11T23:28:57.765 DEBUG:teuthology.orchestra.run.smithi005:> print(_find_admin_socket("client.0")) 2024-09-11T23:28:57.765 DEBUG:teuthology.orchestra.run.smithi005:> ' 2024-09-11T23:28:57.884 INFO:teuthology.orchestra.run.smithi005.stdout:/var/run/ceph/ceph-client.0.85170.asok 2024-09-11T23:28:57.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:28:57.895 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.85170.asok 2024-09-11T23:28:57.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:28:57.895 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.85170.asok status 2024-09-11T23:28:58.032 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-11T23:28:58.032 INFO:teuthology.orchestra.run.smithi005.stdout: "metadata": { 2024-09-11T23:28:58.032 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-11T23:28:58.032 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T23:28:58.033 INFO:teuthology.orchestra.run.smithi005.stdout: "entity_id": "0", 2024-09-11T23:28:58.033 INFO:teuthology.orchestra.run.smithi005.stdout: "hostname": "smithi005", 2024-09-11T23:28:58.033 INFO:teuthology.orchestra.run.smithi005.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-11T23:28:58.033 INFO:teuthology.orchestra.run.smithi005.stdout: "pid": "85170", 2024-09-11T23:28:58.033 INFO:teuthology.orchestra.run.smithi005.stdout: "root": "/volumes/qa/sv_0/8efa0809-f9ec-4540-b106-c6b97a1d80bb" 2024-09-11T23:28:58.033 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:28:58.033 INFO:teuthology.orchestra.run.smithi005.stdout: "dentry_count": 0, 2024-09-11T23:28:58.034 INFO:teuthology.orchestra.run.smithi005.stdout: "dentry_pinned_count": 0, 2024-09-11T23:28:58.034 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 15243, 2024-09-11T23:28:58.034 INFO:teuthology.orchestra.run.smithi005.stdout: "inst": { 2024-09-11T23:28:58.034 INFO:teuthology.orchestra.run.smithi005.stdout: "name": { 2024-09-11T23:28:58.034 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "client", 2024-09-11T23:28:58.035 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 15243 2024-09-11T23:28:58.035 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:28:58.035 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": { 2024-09-11T23:28:58.035 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-11T23:28:58.035 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "192.168.0.1:0", 2024-09-11T23:28:58.035 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1128217809 2024-09-11T23:28:58.035 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:28:58.036 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:28:58.036 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": { 2024-09-11T23:28:58.036 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-11T23:28:58.036 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "192.168.0.1:0", 2024-09-11T23:28:58.036 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1128217809 2024-09-11T23:28:58.036 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:28:58.036 INFO:teuthology.orchestra.run.smithi005.stdout: "inst_str": "client.15243 192.168.0.1:0/1128217809", 2024-09-11T23:28:58.037 INFO:teuthology.orchestra.run.smithi005.stdout: "addr_str": "192.168.0.1:0/1128217809", 2024-09-11T23:28:58.037 INFO:teuthology.orchestra.run.smithi005.stdout: "inode_count": 5, 2024-09-11T23:28:58.037 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_epoch": 24, 2024-09-11T23:28:58.037 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_epoch": 88, 2024-09-11T23:28:58.037 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_epoch_barrier": 0, 2024-09-11T23:28:58.037 INFO:teuthology.orchestra.run.smithi005.stdout: "blocklisted": false, 2024-09-11T23:28:58.037 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs" 2024-09-11T23:28:58.038 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-11T23:28:58.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:28:58.041 DEBUG:teuthology.orchestra.run.smithi005:> stat --file-system '--printf=%T 2024-09-11T23:28:58.042 DEBUG:teuthology.orchestra.run.smithi005:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-11T23:28:58.058 INFO:teuthology.orchestra.run.smithi005.stdout:fuseblk 2024-09-11T23:28:58.059 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-11T23:28:58.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:28:58.059 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:28:58.122 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:58 smithi005 ceph-mon[31201]: pgmap v351: 129 pgs: 129 active+clean; 643 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-11T23:28:58.129 INFO:teuthology.run_tasks:Running task exec... 2024-09-11T23:28:58.139 INFO:teuthology.task.exec:Executing custom commands... 2024-09-11T23:28:58.139 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi005.front.sepia.ceph.com 2024-09-11T23:28:58.139 DEBUG:teuthology.orchestra.run.smithi005:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-11T23:28:58.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:58.274+0000 7f384ea1e640 1 -- 172.21.15.5:0/1278020457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3848102d30 msgr2=0x7f38481031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:58.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:58.274+0000 7f384ea1e640 1 --2- 172.21.15.5:0/1278020457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3848102d30 0x7f38481031b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f383c009900 tx=0x7f383c02a410 comp rx=0 tx=0).stop 2024-09-11T23:28:58.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:58.274+0000 7f384ea1e640 1 -- 172.21.15.5:0/1278020457 shutdown_connections 2024-09-11T23:28:58.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:58.274+0000 7f384ea1e640 1 --2- 172.21.15.5:0/1278020457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38481036f0 0x7f3848109f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:58.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:58.274+0000 7f384ea1e640 1 --2- 172.21.15.5:0/1278020457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3848102d30 0x7f38481031b0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:58.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:58.274+0000 7f384ea1e640 1 --2- 172.21.15.5:0/1278020457 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3848101b40 0x7f3848101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:58.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:58.274+0000 7f384ea1e640 1 -- 172.21.15.5:0/1278020457 >> 172.21.15.5:0/1278020457 conn(0x7f38480fd2e0 msgr2=0x7f38480ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:58.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:58.275+0000 7f384ea1e640 1 -- 172.21.15.5:0/1278020457 shutdown_connections 2024-09-11T23:28:58.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:58.275+0000 7f384ea1e640 1 -- 172.21.15.5:0/1278020457 wait complete. 2024-09-11T23:28:58.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:58.275+0000 7f384ea1e640 1 Processor -- start 2024-09-11T23:28:58.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:58.275+0000 7f384ea1e640 1 -- start start 2024-09-11T23:28:58.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:58.275+0000 7f384ea1e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3848101b40 0x7f3848197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:58.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:58.275+0000 7f384ea1e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3848102d30 0x7f38481982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:58.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:58.275+0000 7f384ea1e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38481036f0 0x7f384819f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:58.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:58.275+0000 7f384ea1e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f384810d6d0 con 0x7f3848101b40 2024-09-11T23:28:58.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:58.275+0000 7f384ea1e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f384810d550 con 0x7f3848102d30 2024-09-11T23:28:58.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:58.275+0000 7f384ea1e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f384810d850 con 0x7f38481036f0 2024-09-11T23:28:58.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:58.276+0000 7f3847fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3848101b40 0x7f3848197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:58.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:58.276+0000 7f3847fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3848101b40 0x7f3848197da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54086/0 (socket says 172.21.15.5:54086) 2024-09-11T23:28:58.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:58.276+0000 7f3847fff640 1 -- 172.21.15.5:0/1298914293 learned_addr learned my addr 172.21.15.5:0/1298914293 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:28:58.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:58.276+0000 7f38477fe640 1 --2- 172.21.15.5:0/1298914293 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3848102d30 0x7f38481982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:58.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:58.276+0000 7f384cfbb640 1 --2- 172.21.15.5:0/1298914293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38481036f0 0x7f384819f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:58.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:58.276+0000 7f3847fff640 1 -- 172.21.15.5:0/1298914293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38481036f0 msgr2=0x7f384819f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:58.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:58.276+0000 7f3847fff640 1 --2- 172.21.15.5:0/1298914293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38481036f0 0x7f384819f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:58.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:58.276+0000 7f3847fff640 1 -- 172.21.15.5:0/1298914293 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3848102d30 msgr2=0x7f38481982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:58.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:58.276+0000 7f3847fff640 1 --2- 172.21.15.5:0/1298914293 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3848102d30 0x7f38481982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:58.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:58.276+0000 7f3847fff640 1 -- 172.21.15.5:0/1298914293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f384819f9b0 con 0x7f3848101b40 2024-09-11T23:28:58.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:58.276+0000 7f384cfbb640 1 --2- 172.21.15.5:0/1298914293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38481036f0 0x7f384819f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:28:58.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:58.276+0000 7f3847fff640 1 --2- 172.21.15.5:0/1298914293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3848101b40 0x7f3848197da0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f383800d770 tx=0x7f383800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:58.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:58.276+0000 7f38457fa640 1 -- 172.21.15.5:0/1298914293 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3838017070 con 0x7f3848101b40 2024-09-11T23:28:58.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:58.276+0000 7f38457fa640 1 -- 172.21.15.5:0/1298914293 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3838009c30 con 0x7f3848101b40 2024-09-11T23:28:58.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:58.276+0000 7f384ea1e640 1 -- 172.21.15.5:0/1298914293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f384819fca0 con 0x7f3848101b40 2024-09-11T23:28:58.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:58.276+0000 7f38457fa640 1 -- 172.21.15.5:0/1298914293 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3838003d00 con 0x7f3848101b40 2024-09-11T23:28:58.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:58.276+0000 7f384ea1e640 1 -- 172.21.15.5:0/1298914293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38481a0210 con 0x7f3848101b40 2024-09-11T23:28:58.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:58.277+0000 7f384ea1e640 1 -- 172.21.15.5:0/1298914293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3848108f20 con 0x7f3848101b40 2024-09-11T23:28:58.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:58.278+0000 7f38457fa640 1 -- 172.21.15.5:0/1298914293 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f3838003ea0 con 0x7f3848101b40 2024-09-11T23:28:58.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:58.279+0000 7f38457fa640 1 --2- 172.21.15.5:0/1298914293 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f38300a2cb0 0x7f38300a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:28:58.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:58.279+0000 7f38457fa640 1 -- 172.21.15.5:0/1298914293 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7f38380cf170 con 0x7f3848101b40 2024-09-11T23:28:58.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:58.279+0000 7f38477fe640 1 --2- 172.21.15.5:0/1298914293 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f38300a2cb0 0x7f38300a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:28:58.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:58.280+0000 7f38477fe640 1 --2- 172.21.15.5:0/1298914293 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f38300a2cb0 0x7f38300a5170 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f383c006010 tx=0x7f383c000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:28:58.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:58.283+0000 7f38457fa640 1 -- 172.21.15.5:0/1298914293 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f383809bcb0 con 0x7f3848101b40 2024-09-11T23:28:58.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:58 smithi159 ceph-mon[34394]: pgmap v351: 129 pgs: 129 active+clean; 643 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-11T23:28:58.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:58 smithi172 ceph-mon[34855]: pgmap v351: 129 pgs: 129 active+clean; 643 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-11T23:28:58.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:58.500+0000 7f384ea1e640 1 -- 172.21.15.5:0/1298914293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f3848062ec0 con 0x7f3848101b40 2024-09-11T23:28:59.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:59.066+0000 7f38457fa640 1 -- 172.21.15.5:0/1298914293 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v25) ==== 117+0+0 (secure 0 0 0) 0x7f3838009de0 con 0x7f3848101b40 2024-09-11T23:28:59.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:59.070+0000 7f384ea1e640 1 -- 172.21.15.5:0/1298914293 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f38300a2cb0 msgr2=0x7f38300a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:59.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:59.070+0000 7f384ea1e640 1 --2- 172.21.15.5:0/1298914293 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f38300a2cb0 0x7f38300a5170 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f383c006010 tx=0x7f383c000bc0 comp rx=0 tx=0).stop 2024-09-11T23:28:59.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:59.070+0000 7f384ea1e640 1 -- 172.21.15.5:0/1298914293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3848101b40 msgr2=0x7f3848197da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:28:59.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:59.070+0000 7f384ea1e640 1 --2- 172.21.15.5:0/1298914293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3848101b40 0x7f3848197da0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f383800d770 tx=0x7f383800dc30 comp rx=0 tx=0).stop 2024-09-11T23:28:59.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:59.070+0000 7f384ea1e640 1 -- 172.21.15.5:0/1298914293 shutdown_connections 2024-09-11T23:28:59.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:59.070+0000 7f384ea1e640 1 --2- 172.21.15.5:0/1298914293 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f38300a2cb0 0x7f38300a5170 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:59.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:59.070+0000 7f384ea1e640 1 --2- 172.21.15.5:0/1298914293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38481036f0 0x7f384819f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:59.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:59.070+0000 7f384ea1e640 1 --2- 172.21.15.5:0/1298914293 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3848102d30 0x7f38481982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:59.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:59.070+0000 7f384ea1e640 1 --2- 172.21.15.5:0/1298914293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3848101b40 0x7f3848197da0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:28:59.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:59.070+0000 7f384ea1e640 1 -- 172.21.15.5:0/1298914293 >> 172.21.15.5:0/1298914293 conn(0x7f38480fd2e0 msgr2=0x7f38481060f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:28:59.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:59.070+0000 7f384ea1e640 1 -- 172.21.15.5:0/1298914293 shutdown_connections 2024-09-11T23:28:59.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:28:59.070+0000 7f384ea1e640 1 -- 172.21.15.5:0/1298914293 wait complete. 2024-09-11T23:28:59.081 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-11T23:28:59.093 INFO:teuthology.run_tasks:Running task workunit... 2024-09-11T23:28:59.137 INFO:tasks.workunit:Pulling workunits from ref 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-11T23:28:59.137 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-11T23:28:59.138 INFO:tasks.workunit:timeout=3h 2024-09-11T23:28:59.138 INFO:tasks.workunit:cleanup=True 2024-09-11T23:28:59.138 DEBUG:teuthology.orchestra.run.smithi005:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-11T23:28:59.156 INFO:teuthology.orchestra.run.smithi005.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-11T23:28:59.156 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-11T23:28:59.156 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 78h/120d Inode: 1 Links: 2 2024-09-11T23:28:59.156 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:28:59.156 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-11T23:28:59.157 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-09-11 23:27:27.532884990 +0000 2024-09-11T23:28:59.157 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-09-11 23:27:27.532884990 +0000 2024-09-11T23:28:59.157 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-09-11 23:28:58.126101476 +0000 2024-09-11T23:28:59.157 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: - 2024-09-11T23:28:59.157 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-11T23:28:59.157 DEBUG:teuthology.orchestra.run.smithi005:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-11T23:28:59.233 DEBUG:teuthology.orchestra.run.smithi005:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-11T23:28:59.291 INFO:tasks.workunit.client.0.smithi005.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-11T23:28:59.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:28:59 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/1298914293' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-11T23:28:59.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:28:59 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/1298914293' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-11T23:28:59.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:28:59 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/1298914293' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-11T23:29:00.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:29:00 smithi159 ceph-mon[34394]: pgmap v352: 129 pgs: 129 active+clean; 643 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-11T23:29:00.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:29:00 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/1298914293' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-11T23:29:00.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:29:00 smithi159 ceph-mon[34394]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T23:29:00.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:29:00 smithi172 ceph-mon[34855]: pgmap v352: 129 pgs: 129 active+clean; 643 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-11T23:29:00.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:29:00 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/1298914293' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-11T23:29:00.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:29:00 smithi172 ceph-mon[34855]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T23:29:00.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:29:00 smithi005 ceph-mon[31201]: pgmap v352: 129 pgs: 129 active+clean; 643 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-11T23:29:00.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:29:00 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/1298914293' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-11T23:29:00.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:29:00 smithi005 ceph-mon[31201]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T23:29:02.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:29:02 smithi159 ceph-mon[34394]: pgmap v353: 129 pgs: 129 active+clean; 643 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-11T23:29:02.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:29:02 smithi172 ceph-mon[34855]: pgmap v353: 129 pgs: 129 active+clean; 643 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-11T23:29:02.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:29:02 smithi005 ceph-mon[31201]: pgmap v353: 129 pgs: 129 active+clean; 643 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-11T23:29:04.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:29:04 smithi159 ceph-mon[34394]: pgmap v354: 129 pgs: 129 active+clean; 643 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-11T23:29:04.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:29:04 smithi172 ceph-mon[34855]: pgmap v354: 129 pgs: 129 active+clean; 643 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-11T23:29:04.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:29:04 smithi005 ceph-mon[31201]: pgmap v354: 129 pgs: 129 active+clean; 643 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-11T23:29:06.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:29:06 smithi159 ceph-mon[34394]: pgmap v355: 129 pgs: 129 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-11T23:29:06.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:29:06 smithi172 ceph-mon[34855]: pgmap v355: 129 pgs: 129 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-11T23:29:06.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:29:06 smithi005 ceph-mon[31201]: pgmap v355: 129 pgs: 129 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-11T23:29:08.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:29:08 smithi159 ceph-mon[34394]: pgmap v356: 129 pgs: 129 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-09-11T23:29:08.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:29:08 smithi172 ceph-mon[34855]: pgmap v356: 129 pgs: 129 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-09-11T23:29:08.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:29:08 smithi005 ceph-mon[31201]: pgmap v356: 129 pgs: 129 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-09-11T23:29:10.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:29:10 smithi159 ceph-mon[34394]: pgmap v357: 129 pgs: 129 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-09-11T23:29:10.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:29:10 smithi172 ceph-mon[34855]: pgmap v357: 129 pgs: 129 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-09-11T23:29:10.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:29:10 smithi005 ceph-mon[31201]: pgmap v357: 129 pgs: 129 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-09-11T23:29:12.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:29:12 smithi159 ceph-mon[34394]: pgmap v358: 129 pgs: 129 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-09-11T23:29:12.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:29:12 smithi172 ceph-mon[34855]: pgmap v358: 129 pgs: 129 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-09-11T23:29:12.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:29:12 smithi005 ceph-mon[31201]: pgmap v358: 129 pgs: 129 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-09-11T23:29:14.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:29:14 smithi159 ceph-mon[34394]: pgmap v359: 129 pgs: 129 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-11T23:29:14.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:29:14 smithi172 ceph-mon[34855]: pgmap v359: 129 pgs: 129 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-11T23:29:14.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:29:14 smithi005 ceph-mon[31201]: pgmap v359: 129 pgs: 129 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-11T23:29:16.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:29:16 smithi159 ceph-mon[34394]: pgmap v360: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-09-11T23:29:16.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:29:16 smithi172 ceph-mon[34855]: pgmap v360: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-09-11T23:29:16.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:29:16 smithi005 ceph-mon[31201]: pgmap v360: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-09-11T23:29:18.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:29:18 smithi159 ceph-mon[34394]: pgmap v361: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-11T23:29:18.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:29:18 smithi172 ceph-mon[34855]: pgmap v361: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-11T23:29:18.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:29:18 smithi005 ceph-mon[31201]: pgmap v361: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-11T23:29:20.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:29:20 smithi159 ceph-mon[34394]: pgmap v362: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-11T23:29:20.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:29:20 smithi172 ceph-mon[34855]: pgmap v362: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-11T23:29:20.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:29:20 smithi005 ceph-mon[31201]: pgmap v362: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-11T23:29:22.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:29:22 smithi159 ceph-mon[34394]: pgmap v363: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-11T23:29:22.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:29:22 smithi172 ceph-mon[34855]: pgmap v363: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-11T23:29:22.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:29:22 smithi005 ceph-mon[31201]: pgmap v363: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-11T23:29:24.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:29:24 smithi159 ceph-mon[34394]: pgmap v364: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-11T23:29:24.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:29:24 smithi172 ceph-mon[34855]: pgmap v364: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-11T23:29:24.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:29:24 smithi005 ceph-mon[31201]: pgmap v364: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-11T23:29:26.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:29:26 smithi159 ceph-mon[34394]: pgmap v365: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-11T23:29:26.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:29:26 smithi172 ceph-mon[34855]: pgmap v365: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-11T23:29:26.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:29:26 smithi005 ceph-mon[31201]: pgmap v365: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-11T23:29:28.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:29:28 smithi159 ceph-mon[34394]: pgmap v366: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T23:29:28.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:29:28 smithi172 ceph-mon[34855]: pgmap v366: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T23:29:28.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:29:28 smithi005 ceph-mon[31201]: pgmap v366: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T23:29:30.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:29:30 smithi159 ceph-mon[34394]: pgmap v367: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T23:29:30.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:29:30 smithi172 ceph-mon[34855]: pgmap v367: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T23:29:30.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:29:30 smithi005 ceph-mon[31201]: pgmap v367: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T23:29:31.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:29:31 smithi005 ceph-mon[31201]: pgmap v368: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T23:29:31.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:29:31 smithi159 ceph-mon[34394]: pgmap v368: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T23:29:31.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:29:31 smithi172 ceph-mon[34855]: pgmap v368: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T23:29:33.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:29:33 smithi005 ceph-mon[31201]: pgmap v369: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T23:29:33.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:29:33 smithi159 ceph-mon[34394]: pgmap v369: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T23:29:33.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:29:33 smithi172 ceph-mon[34855]: pgmap v369: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T23:29:35.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:29:35 smithi005 ceph-mon[31201]: pgmap v370: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T23:29:35.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:29:35 smithi159 ceph-mon[34394]: pgmap v370: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T23:29:35.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:29:35 smithi172 ceph-mon[34855]: pgmap v370: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T23:29:37.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:29:37 smithi005 ceph-mon[31201]: pgmap v371: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T23:29:37.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:29:37 smithi159 ceph-mon[34394]: pgmap v371: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T23:29:37.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:29:37 smithi172 ceph-mon[34855]: pgmap v371: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T23:29:39.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:29:39 smithi159 ceph-mon[34394]: pgmap v372: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T23:29:39.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:29:39 smithi172 ceph-mon[34855]: pgmap v372: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T23:29:39.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:29:39 smithi005 ceph-mon[31201]: pgmap v372: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T23:29:41.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:29:41 smithi159 ceph-mon[34394]: pgmap v373: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T23:29:41.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:29:41 smithi172 ceph-mon[34855]: pgmap v373: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T23:29:41.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:29:41 smithi005 ceph-mon[31201]: pgmap v373: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T23:29:43.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:29:43 smithi159 ceph-mon[34394]: pgmap v374: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T23:29:43.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:29:43 smithi172 ceph-mon[34855]: pgmap v374: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T23:29:43.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:29:43 smithi005 ceph-mon[31201]: pgmap v374: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T23:29:45.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:29:45 smithi159 ceph-mon[34394]: pgmap v375: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T23:29:45.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:29:45 smithi172 ceph-mon[34855]: pgmap v375: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T23:29:45.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:29:45 smithi005 ceph-mon[31201]: pgmap v375: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T23:29:47.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:29:47 smithi159 ceph-mon[34394]: pgmap v376: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T23:29:47.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:29:47 smithi172 ceph-mon[34855]: pgmap v376: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T23:29:47.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:29:47 smithi005 ceph-mon[31201]: pgmap v376: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T23:29:49.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:29:49 smithi159 ceph-mon[34394]: pgmap v377: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T23:29:49.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:29:49 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:29:49.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:29:49 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:29:49.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:29:49 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:29:49.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:29:49 smithi172 ceph-mon[34855]: pgmap v377: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T23:29:49.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:29:49 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:29:49.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:29:49 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:29:49.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:29:49 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:29:49.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:29:49 smithi005 ceph-mon[31201]: pgmap v377: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T23:29:49.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:29:49 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:29:49.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:29:49 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:29:49.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:29:49 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:29:50.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:29:50 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:29:50.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:29:50 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:29:50.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:29:50 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:29:50.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:29:50 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:29:50.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:29:50 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:29:50.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:29:50 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:29:50.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:29:50 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:29:50.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:29:50 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:29:50.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:29:50 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:29:51.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:29:51 smithi159 ceph-mon[34394]: pgmap v378: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T23:29:51.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:29:51 smithi172 ceph-mon[34855]: pgmap v378: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T23:29:51.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:29:51 smithi005 ceph-mon[31201]: pgmap v378: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T23:29:53.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:29:53 smithi159 ceph-mon[34394]: pgmap v379: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T23:29:53.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:29:53 smithi172 ceph-mon[34855]: pgmap v379: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T23:29:53.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:29:53 smithi005 ceph-mon[31201]: pgmap v379: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T23:29:55.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:29:55 smithi159 ceph-mon[34394]: pgmap v380: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T23:29:55.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:29:55 smithi172 ceph-mon[34855]: pgmap v380: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T23:29:55.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:29:55 smithi005 ceph-mon[31201]: pgmap v380: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T23:29:56.678 INFO:tasks.workunit.client.0.smithi005.stderr:Updating files: 94% (12144/12903) Updating files: 95% (12258/12903) Updating files: 96% (12387/12903) Updating files: 97% (12516/12903) Updating files: 98% (12645/12903) Updating files: 99% (12774/12903) Updating files: 100% (12903/12903) Updating files: 100% (12903/12903), done. 2024-09-11T23:29:57.533 INFO:tasks.workunit.client.0.smithi005.stderr:Note: switching to '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'. 2024-09-11T23:29:57.534 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-09-11T23:29:57.534 INFO:tasks.workunit.client.0.smithi005.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-11T23:29:57.534 INFO:tasks.workunit.client.0.smithi005.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-11T23:29:57.534 INFO:tasks.workunit.client.0.smithi005.stderr:state without impacting any branches by switching back to a branch. 2024-09-11T23:29:57.534 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-09-11T23:29:57.534 INFO:tasks.workunit.client.0.smithi005.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-11T23:29:57.534 INFO:tasks.workunit.client.0.smithi005.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-11T23:29:57.534 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-09-11T23:29:57.534 INFO:tasks.workunit.client.0.smithi005.stderr: git switch -c 2024-09-11T23:29:57.534 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-09-11T23:29:57.534 INFO:tasks.workunit.client.0.smithi005.stderr:Or undo this operation with: 2024-09-11T23:29:57.534 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-09-11T23:29:57.535 INFO:tasks.workunit.client.0.smithi005.stderr: git switch - 2024-09-11T23:29:57.535 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-09-11T23:29:57.535 INFO:tasks.workunit.client.0.smithi005.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-11T23:29:57.535 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-09-11T23:29:57.535 INFO:tasks.workunit.client.0.smithi005.stderr:HEAD is now at 086c737fa75 Merge pull request #59733 from zdover23/wip-doc-2024-09-11-backport-59635-to-squid 2024-09-11T23:29:57.539 DEBUG:teuthology.orchestra.run.smithi005:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-11T23:29:57.602 INFO:tasks.workunit.client.0.smithi005.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-11T23:29:58.049 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:29:57 smithi172 ceph-mon[34855]: pgmap v381: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T23:29:58.049 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:29:57 smithi159 ceph-mon[34394]: pgmap v381: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T23:29:58.049 INFO:tasks.workunit.client.0.smithi005.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-11T23:29:58.049 INFO:tasks.workunit.client.0.smithi005.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-11T23:29:58.050 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:29:57 smithi005 ceph-mon[31201]: pgmap v381: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T23:29:58.260 INFO:tasks.workunit.client.0.smithi005.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-11T23:29:58.346 INFO:tasks.workunit.client.0.smithi005.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-11T23:29:58.386 INFO:tasks.workunit.client.0.smithi005.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-11T23:29:58.388 INFO:tasks.workunit.client.0.smithi005.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-11T23:29:58.388 INFO:tasks.workunit.client.0.smithi005.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-11T23:29:58.428 INFO:tasks.workunit.client.0.smithi005.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-11T23:29:58.431 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-11T23:29:58.432 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-11T23:29:58.489 INFO:tasks.workunit:Running workunits matching suites/fsx.sh on client.0... 2024-09-11T23:29:58.491 INFO:tasks.workunit:Running workunit suites/fsx.sh... 2024-09-11T23:29:58.491 DEBUG:teuthology.orchestra.run.smithi005:workunit test suites/fsx.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh 2024-09-11T23:29:58.555 INFO:tasks.workunit.client.0.smithi005.stderr:+ set -e 2024-09-11T23:29:58.555 INFO:tasks.workunit.client.0.smithi005.stderr:+ git clone https://git.ceph.com/xfstests-dev.git 2024-09-11T23:29:58.558 INFO:tasks.workunit.client.0.smithi005.stderr:Cloning into 'xfstests-dev'... 2024-09-11T23:29:59.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:29:59 smithi159 ceph-mon[34394]: pgmap v382: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T23:29:59.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:29:59 smithi172 ceph-mon[34855]: pgmap v382: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T23:29:59.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:29:59 smithi005 ceph-mon[31201]: pgmap v382: 129 pgs: 129 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T23:30:00.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:30:00 smithi159 ceph-mon[34394]: overall HEALTH_OK 2024-09-11T23:30:00.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:30:00 smithi172 ceph-mon[34855]: overall HEALTH_OK 2024-09-11T23:30:00.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:30:00 smithi005 ceph-mon[31201]: overall HEALTH_OK 2024-09-11T23:30:01.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:30:01 smithi159 ceph-mon[34394]: pgmap v383: 129 pgs: 129 active+clean; 665 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-11T23:30:01.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:30:01 smithi172 ceph-mon[34855]: pgmap v383: 129 pgs: 129 active+clean; 665 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-11T23:30:01.725 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:30:01 smithi005 ceph-mon[31201]: pgmap v383: 129 pgs: 129 active+clean; 665 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-11T23:30:03.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:30:03 smithi159 ceph-mon[34394]: pgmap v384: 129 pgs: 129 active+clean; 685 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 3.8 KiB/s wr, 8 op/s 2024-09-11T23:30:03.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:30:03 smithi172 ceph-mon[34855]: pgmap v384: 129 pgs: 129 active+clean; 685 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 3.8 KiB/s wr, 8 op/s 2024-09-11T23:30:03.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:30:03 smithi005 ceph-mon[31201]: pgmap v384: 129 pgs: 129 active+clean; 685 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 3.8 KiB/s wr, 8 op/s 2024-09-11T23:30:05.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:30:05 smithi159 ceph-mon[34394]: pgmap v385: 129 pgs: 129 active+clean; 5.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 403 KiB/s wr, 14 op/s 2024-09-11T23:30:05.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:30:05 smithi172 ceph-mon[34855]: pgmap v385: 129 pgs: 129 active+clean; 5.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 403 KiB/s wr, 14 op/s 2024-09-11T23:30:05.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:30:05 smithi005 ceph-mon[31201]: pgmap v385: 129 pgs: 129 active+clean; 5.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 403 KiB/s wr, 14 op/s 2024-09-11T23:30:07.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:30:07 smithi159 ceph-mon[34394]: pgmap v386: 129 pgs: 129 active+clean; 17 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 1.4 MiB/s wr, 47 op/s 2024-09-11T23:30:07.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:30:07 smithi172 ceph-mon[34855]: pgmap v386: 129 pgs: 129 active+clean; 17 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 1.4 MiB/s wr, 47 op/s 2024-09-11T23:30:07.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:30:07 smithi005 ceph-mon[31201]: pgmap v386: 129 pgs: 129 active+clean; 17 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 1.4 MiB/s wr, 47 op/s 2024-09-11T23:30:09.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:30:09 smithi159 ceph-mon[34394]: pgmap v387: 129 pgs: 129 active+clean; 18 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 1.5 MiB/s wr, 56 op/s 2024-09-11T23:30:09.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:30:09 smithi172 ceph-mon[34855]: pgmap v387: 129 pgs: 129 active+clean; 18 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 1.5 MiB/s wr, 56 op/s 2024-09-11T23:30:09.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:30:09 smithi005 ceph-mon[31201]: pgmap v387: 129 pgs: 129 active+clean; 18 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 1.5 MiB/s wr, 56 op/s 2024-09-11T23:30:11.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:30:11 smithi159 ceph-mon[34394]: pgmap v388: 129 pgs: 129 active+clean; 18 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 1.5 MiB/s wr, 59 op/s 2024-09-11T23:30:11.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:30:11 smithi159 ceph-mon[34394]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T23:30:11.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:30:11 smithi172 ceph-mon[34855]: pgmap v388: 129 pgs: 129 active+clean; 18 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 1.5 MiB/s wr, 59 op/s 2024-09-11T23:30:11.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:30:11 smithi172 ceph-mon[34855]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T23:30:11.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:30:11 smithi005 ceph-mon[31201]: pgmap v388: 129 pgs: 129 active+clean; 18 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 1.5 MiB/s wr, 59 op/s 2024-09-11T23:30:11.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:30:11 smithi005 ceph-mon[31201]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T23:30:13.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:30:13 smithi159 ceph-mon[34394]: pgmap v389: 129 pgs: 129 active+clean; 19 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 1.6 MiB/s wr, 84 op/s 2024-09-11T23:30:13.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:30:13 smithi172 ceph-mon[34855]: pgmap v389: 129 pgs: 129 active+clean; 19 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 1.6 MiB/s wr, 84 op/s 2024-09-11T23:30:13.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:30:13 smithi005 ceph-mon[31201]: pgmap v389: 129 pgs: 129 active+clean; 19 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 1.6 MiB/s wr, 84 op/s 2024-09-11T23:30:15.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:30:15 smithi159 ceph-mon[34394]: pgmap v390: 129 pgs: 129 active+clean; 21 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 1.7 MiB/s wr, 101 op/s 2024-09-11T23:30:15.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:30:15 smithi172 ceph-mon[34855]: pgmap v390: 129 pgs: 129 active+clean; 21 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 1.7 MiB/s wr, 101 op/s 2024-09-11T23:30:15.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:30:15 smithi005 ceph-mon[31201]: pgmap v390: 129 pgs: 129 active+clean; 21 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 1.7 MiB/s wr, 101 op/s 2024-09-11T23:30:17.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:30:17 smithi159 ceph-mon[34394]: pgmap v391: 129 pgs: 129 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 1.5 MiB/s wr, 147 op/s 2024-09-11T23:30:17.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:30:17 smithi172 ceph-mon[34855]: pgmap v391: 129 pgs: 129 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 1.5 MiB/s wr, 147 op/s 2024-09-11T23:30:17.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:30:17 smithi005 ceph-mon[31201]: pgmap v391: 129 pgs: 129 active+clean; 22 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 1.5 MiB/s wr, 147 op/s 2024-09-11T23:30:19.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:30:19 smithi159 ceph-mon[34394]: pgmap v392: 129 pgs: 129 active+clean; 23 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 651 KiB/s wr, 127 op/s 2024-09-11T23:30:19.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:30:19 smithi172 ceph-mon[34855]: pgmap v392: 129 pgs: 129 active+clean; 23 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 651 KiB/s wr, 127 op/s 2024-09-11T23:30:19.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:30:19 smithi005 ceph-mon[31201]: pgmap v392: 129 pgs: 129 active+clean; 23 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 651 KiB/s wr, 127 op/s 2024-09-11T23:30:21.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:30:21 smithi159 ceph-mon[34394]: pgmap v393: 129 pgs: 129 active+clean; 27 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 908 KiB/s wr, 161 op/s 2024-09-11T23:30:21.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:30:21 smithi172 ceph-mon[34855]: pgmap v393: 129 pgs: 129 active+clean; 27 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 908 KiB/s wr, 161 op/s 2024-09-11T23:30:21.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:30:21 smithi005 ceph-mon[31201]: pgmap v393: 129 pgs: 129 active+clean; 27 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 908 KiB/s wr, 161 op/s 2024-09-11T23:30:23.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:30:23 smithi159 ceph-mon[34394]: pgmap v394: 129 pgs: 129 active+clean; 29 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 579 KiB/s rd, 1.1 MiB/s wr, 244 op/s 2024-09-11T23:30:23.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:30:23 smithi172 ceph-mon[34855]: pgmap v394: 129 pgs: 129 active+clean; 29 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 579 KiB/s rd, 1.1 MiB/s wr, 244 op/s 2024-09-11T23:30:23.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:30:23 smithi005 ceph-mon[31201]: pgmap v394: 129 pgs: 129 active+clean; 29 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 579 KiB/s rd, 1.1 MiB/s wr, 244 op/s 2024-09-11T23:30:24.728 INFO:tasks.workunit.client.0.smithi005.stderr:Updating files: 7% (322/4351) Updating files: 8% (349/4351) Updating files: 9% (392/4351) Updating files: 10% (436/4351) Updating files: 11% (479/4351) Updating files: 11% (493/4351) Updating files: 12% (523/4351) Updating files: 13% (566/4351) Updating files: 14% (610/4351) Updating files: 15% (653/4351) Updating files: 16% (697/4351) Updating files: 16% (711/4351) Updating files: 17% (740/4351) Updating files: 18% (784/4351) Updating files: 19% (827/4351) Updating files: 20% (871/4351) Updating files: 21% (914/4351) Updating files: 22% (958/4351) Updating files: 23% (1001/4351) Updating files: 24% (1045/4351) Updating files: 25% (1088/4351) Updating files: 25% (1107/4351) Updating files: 26% (1132/4351) Updating files: 27% (1175/4351) Updating files: 28% (1219/4351) Updating files: 29% (1262/4351) Updating files: 29% (1303/4351) Updating files: 30% (1306/4351) Updating files: 31% (1349/4351) Updating files: 32% (1393/4351) Updating files: 33% (1436/4351) Updating files: 33% (1457/4351) Updating files: 34% (1480/4351) Updating files: 35% (1523/4351) Updating files: 36% (1567/4351) Updating files: 37% (1610/4351) Updating files: 38% (1654/4351) Updating files: 39% (1697/4351) Updating files: 40% (1741/4351) Updating files: 41% (1784/4351) Updating files: 42% (1828/4351) Updating files: 43% (1871/4351) Updating files: 43% (1879/4351) Updating files: 44% (1915/4351) Updating files: 45% (1958/4351) Updating files: 46% (2002/4351) Updating files: 47% (2045/4351) Updating files: 48% (2089/4351) Updating files: 49% (2132/4351) Updating files: 50% (2176/4351) Updating files: 51% (2220/4351) Updating files: 51% (2239/4351) Updating files: 52% (2263/4351) Updating files: 53% (2307/4351) Updating files: 54% (2350/4351) Updating files: 55% (2394/4351) Updating files: 56% (2437/4351) Updating files: 57% (2481/4351) Updating files: 58% (2524/4351) Updating files: 58% (2531/4351) Updating files: 59% (2568/4351) Updating files: 60% (2611/4351) Updating files: 61% (2655/4351) Updating files: 62% (2698/4351) Updating files: 63% (2742/4351) Updating files: 64% (2785/4351) Updating files: 64% (2809/4351) Updating files: 65% (2829/4351) Updating files: 66% (2872/4351) Updating files: 67% (2916/4351) Updating files: 68% (2959/4351) Updating files: 69% (3003/4351) Updating files: 69% (3036/4351) Updating files: 70% (3046/4351) Updating files: 71% (3090/4351) Updating files: 72% (3133/4351) Updating files: 73% (3177/4351) Updating files: 74% (3220/4351) Updating files: 75% (3264/4351) Updating files: 76% (3307/4351) Updating files: 77% (3351/4351) Updating files: 77% (3378/4351) Updating files: 78% (3394/4351) Updating files: 79% (3438/4351) Updating files: 80% (3481/4351) Updating files: 81% (3525/4351) Updating files: 82% (3568/4351) Updating files: 83% (3612/4351) Updating files: 84% (3655/4351) Updating files: 85% (3699/4351) Updating files: 86% (3742/4351) Updating files: 86% (3747/4351) Updating files: 87% (3786/4351) Updating files: 88% (3829/4351) Updating files: 89% (3873/4351) Updating files: 90% (3916/4351) Updating files: 90% (3942/4351) Updating files: 91% (3960/4351) Updating files: 92% (4003/4351) Updating files: 93% (4047/4351) Updating files: 94% (4090/4351) Updating files: 95% (4134/4351) Updating files: 96% (4177/4351) Updating files: 96% (4210/4351) Updating files: 97% (4221/4351) Updating files: 98% (4264/4351) Updating files: 99% (4308/4351) Updating files: 100% (4351/4351) Updating files: 100% (4351/4351), done. 2024-09-11T23:30:24.742 INFO:tasks.workunit.client.0.smithi005.stderr:+ cd xfstests-dev 2024-09-11T23:30:24.743 INFO:tasks.workunit.client.0.smithi005.stderr:+ git checkout 0e5c12dfd008efc2848c98108c9237487e91ef35 2024-09-11T23:30:25.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:30:25 smithi172 ceph-mon[34855]: pgmap v395: 129 pgs: 129 active+clean; 31 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 1.3 MiB/s wr, 251 op/s 2024-09-11T23:30:25.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:30:25 smithi005 ceph-mon[31201]: pgmap v395: 129 pgs: 129 active+clean; 31 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 1.3 MiB/s wr, 251 op/s 2024-09-11T23:30:25.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:30:25 smithi159 ceph-mon[34394]: pgmap v395: 129 pgs: 129 active+clean; 31 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 1.3 MiB/s wr, 251 op/s 2024-09-11T23:30:27.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:30:27 smithi172 ceph-mon[34855]: pgmap v396: 129 pgs: 129 active+clean; 36 MiB data, 522 MiB used, 1.0 TiB / 1.0 TiB avail; 880 KiB/s rd, 1.6 MiB/s wr, 315 op/s 2024-09-11T23:30:27.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:30:27 smithi005 ceph-mon[31201]: pgmap v396: 129 pgs: 129 active+clean; 36 MiB data, 522 MiB used, 1.0 TiB / 1.0 TiB avail; 880 KiB/s rd, 1.6 MiB/s wr, 315 op/s 2024-09-11T23:30:27.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:30:27 smithi159 ceph-mon[34394]: pgmap v396: 129 pgs: 129 active+clean; 36 MiB data, 522 MiB used, 1.0 TiB / 1.0 TiB avail; 880 KiB/s rd, 1.6 MiB/s wr, 315 op/s 2024-09-11T23:30:29.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:30:29 smithi172 ceph-mon[34855]: pgmap v397: 129 pgs: 129 active+clean; 41 MiB data, 536 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.9 MiB/s wr, 287 op/s 2024-09-11T23:30:29.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:30:29 smithi005 ceph-mon[31201]: pgmap v397: 129 pgs: 129 active+clean; 41 MiB data, 536 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.9 MiB/s wr, 287 op/s 2024-09-11T23:30:29.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:30:29 smithi159 ceph-mon[34394]: pgmap v397: 129 pgs: 129 active+clean; 41 MiB data, 536 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.9 MiB/s wr, 287 op/s 2024-09-11T23:30:31.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:30:31 smithi172 ceph-mon[34855]: pgmap v398: 129 pgs: 129 active+clean; 41 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.8 MiB/s wr, 296 op/s 2024-09-11T23:30:31.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:30:31 smithi005 ceph-mon[31201]: pgmap v398: 129 pgs: 129 active+clean; 41 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.8 MiB/s wr, 296 op/s 2024-09-11T23:30:31.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:30:31 smithi159 ceph-mon[34394]: pgmap v398: 129 pgs: 129 active+clean; 41 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.8 MiB/s wr, 296 op/s 2024-09-11T23:30:33.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:30:33 smithi172 ceph-mon[34855]: pgmap v399: 129 pgs: 129 active+clean; 43 MiB data, 565 MiB used, 1.0 TiB / 1.0 TiB avail; 929 KiB/s rd, 1.7 MiB/s wr, 299 op/s 2024-09-11T23:30:33.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:30:33 smithi005 ceph-mon[31201]: pgmap v399: 129 pgs: 129 active+clean; 43 MiB data, 565 MiB used, 1.0 TiB / 1.0 TiB avail; 929 KiB/s rd, 1.7 MiB/s wr, 299 op/s 2024-09-11T23:30:33.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:30:33 smithi159 ceph-mon[34394]: pgmap v399: 129 pgs: 129 active+clean; 43 MiB data, 565 MiB used, 1.0 TiB / 1.0 TiB avail; 929 KiB/s rd, 1.7 MiB/s wr, 299 op/s 2024-09-11T23:30:35.677 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:30:35 smithi159 ceph-mon[34394]: pgmap v400: 129 pgs: 129 active+clean; 48 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 302 op/s 2024-09-11T23:30:35.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:30:35 smithi005 ceph-mon[31201]: pgmap v400: 129 pgs: 129 active+clean; 48 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 302 op/s 2024-09-11T23:30:35.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:30:35 smithi172 ceph-mon[34855]: pgmap v400: 129 pgs: 129 active+clean; 48 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 302 op/s 2024-09-11T23:30:37.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:30:37 smithi005 ceph-mon[31201]: pgmap v401: 129 pgs: 129 active+clean; 50 MiB data, 524 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 344 op/s 2024-09-11T23:30:37.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:30:37 smithi159 ceph-mon[34394]: pgmap v401: 129 pgs: 129 active+clean; 50 MiB data, 524 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 344 op/s 2024-09-11T23:30:37.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:30:37 smithi172 ceph-mon[34855]: pgmap v401: 129 pgs: 129 active+clean; 50 MiB data, 524 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 344 op/s 2024-09-11T23:30:39.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:30:39 smithi005 ceph-mon[31201]: pgmap v402: 129 pgs: 129 active+clean; 51 MiB data, 519 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 288 op/s 2024-09-11T23:30:39.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:30:39 smithi159 ceph-mon[34394]: pgmap v402: 129 pgs: 129 active+clean; 51 MiB data, 519 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 288 op/s 2024-09-11T23:30:39.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:30:39 smithi172 ceph-mon[34855]: pgmap v402: 129 pgs: 129 active+clean; 51 MiB data, 519 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 288 op/s 2024-09-11T23:30:41.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:30:41 smithi005 ceph-mon[31201]: pgmap v403: 129 pgs: 129 active+clean; 55 MiB data, 538 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 318 op/s 2024-09-11T23:30:41.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:30:41 smithi159 ceph-mon[34394]: pgmap v403: 129 pgs: 129 active+clean; 55 MiB data, 538 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 318 op/s 2024-09-11T23:30:41.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:30:41 smithi172 ceph-mon[34855]: pgmap v403: 129 pgs: 129 active+clean; 55 MiB data, 538 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 318 op/s 2024-09-11T23:30:43.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:30:43 smithi005 ceph-mon[31201]: pgmap v404: 129 pgs: 129 active+clean; 57 MiB data, 546 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 389 op/s 2024-09-11T23:30:43.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:30:43 smithi159 ceph-mon[34394]: pgmap v404: 129 pgs: 129 active+clean; 57 MiB data, 546 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 389 op/s 2024-09-11T23:30:43.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:30:43 smithi172 ceph-mon[34855]: pgmap v404: 129 pgs: 129 active+clean; 57 MiB data, 546 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 389 op/s 2024-09-11T23:30:45.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:30:45 smithi005 ceph-mon[31201]: pgmap v405: 129 pgs: 129 active+clean; 61 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 378 op/s 2024-09-11T23:30:45.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:30:45 smithi159 ceph-mon[34394]: pgmap v405: 129 pgs: 129 active+clean; 61 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 378 op/s 2024-09-11T23:30:45.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:30:45 smithi172 ceph-mon[34855]: pgmap v405: 129 pgs: 129 active+clean; 61 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 378 op/s 2024-09-11T23:30:47.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:30:47 smithi005 ceph-mon[31201]: pgmap v406: 129 pgs: 129 active+clean; 70 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.2 MiB/s wr, 370 op/s 2024-09-11T23:30:47.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:30:47 smithi159 ceph-mon[34394]: pgmap v406: 129 pgs: 129 active+clean; 70 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.2 MiB/s wr, 370 op/s 2024-09-11T23:30:47.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:30:47 smithi172 ceph-mon[34855]: pgmap v406: 129 pgs: 129 active+clean; 70 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.2 MiB/s wr, 370 op/s 2024-09-11T23:30:49.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:30:49 smithi005 ceph-mon[31201]: pgmap v407: 129 pgs: 129 active+clean; 73 MiB data, 563 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 315 op/s 2024-09-11T23:30:49.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:30:49 smithi159 ceph-mon[34394]: pgmap v407: 129 pgs: 129 active+clean; 73 MiB data, 563 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 315 op/s 2024-09-11T23:30:49.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:30:49 smithi172 ceph-mon[34855]: pgmap v407: 129 pgs: 129 active+clean; 73 MiB data, 563 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 315 op/s 2024-09-11T23:30:50.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:30:50 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:30:50.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:30:50 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:30:50.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:30:50 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:30:50.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:30:50 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:30:50.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:30:50 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:30:50.725 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:30:50 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:30:50.725 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:30:50 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:30:50.725 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:30:50 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:30:50.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:30:50 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:30:50.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:30:50 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:30:50.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:30:50 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:30:50.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:30:50 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:30:50.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:30:50 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:30:50.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:30:50 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:30:50.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:30:50 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:30:50.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:30:50 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:30:50.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:30:50 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:30:50.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:30:50 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:30:50.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:30:50 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:30:50.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:30:50 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:30:50.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:30:50 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:30:50.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:30:50 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:30:50.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:30:50 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:30:50.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:30:50 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:30:52.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:30:51 smithi159 ceph-mon[34394]: pgmap v408: 129 pgs: 129 active+clean; 73 MiB data, 589 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 299 op/s 2024-09-11T23:30:52.133 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:30:51 smithi172 ceph-mon[34855]: pgmap v408: 129 pgs: 129 active+clean; 73 MiB data, 589 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 299 op/s 2024-09-11T23:30:52.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:30:51 smithi005 ceph-mon[31201]: pgmap v408: 129 pgs: 129 active+clean; 73 MiB data, 589 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 299 op/s 2024-09-11T23:30:54.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:30:53 smithi159 ceph-mon[34394]: pgmap v409: 129 pgs: 129 active+clean; 84 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.7 MiB/s wr, 331 op/s 2024-09-11T23:30:54.133 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:30:53 smithi172 ceph-mon[34855]: pgmap v409: 129 pgs: 129 active+clean; 84 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.7 MiB/s wr, 331 op/s 2024-09-11T23:30:54.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:30:53 smithi005 ceph-mon[31201]: pgmap v409: 129 pgs: 129 active+clean; 84 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.7 MiB/s wr, 331 op/s 2024-09-11T23:30:56.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:30:55 smithi159 ceph-mon[34394]: pgmap v410: 129 pgs: 129 active+clean; 85 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 251 op/s 2024-09-11T23:30:56.133 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:30:55 smithi172 ceph-mon[34855]: pgmap v410: 129 pgs: 129 active+clean; 85 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 251 op/s 2024-09-11T23:30:56.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:30:55 smithi005 ceph-mon[31201]: pgmap v410: 129 pgs: 129 active+clean; 85 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 251 op/s 2024-09-11T23:30:57.101 INFO:tasks.workunit.client.0.smithi005.stderr:Note: switching to '0e5c12dfd008efc2848c98108c9237487e91ef35'. 2024-09-11T23:30:57.102 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-09-11T23:30:57.102 INFO:tasks.workunit.client.0.smithi005.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-11T23:30:57.102 INFO:tasks.workunit.client.0.smithi005.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-11T23:30:57.102 INFO:tasks.workunit.client.0.smithi005.stderr:state without impacting any branches by switching back to a branch. 2024-09-11T23:30:57.102 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-09-11T23:30:57.102 INFO:tasks.workunit.client.0.smithi005.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-11T23:30:57.102 INFO:tasks.workunit.client.0.smithi005.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-11T23:30:57.102 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-09-11T23:30:57.102 INFO:tasks.workunit.client.0.smithi005.stderr: git switch -c 2024-09-11T23:30:57.102 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-09-11T23:30:57.102 INFO:tasks.workunit.client.0.smithi005.stderr:Or undo this operation with: 2024-09-11T23:30:57.102 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-09-11T23:30:57.103 INFO:tasks.workunit.client.0.smithi005.stderr: git switch - 2024-09-11T23:30:57.103 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-09-11T23:30:57.103 INFO:tasks.workunit.client.0.smithi005.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-11T23:30:57.103 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-09-11T23:30:57.103 INFO:tasks.workunit.client.0.smithi005.stderr:HEAD is now at 0e5c12df xfs/522: use reflink instead of crc as test feature 2024-09-11T23:30:57.106 INFO:tasks.workunit.client.0.smithi005.stderr:+ make -j4 2024-09-11T23:30:57.126 INFO:tasks.workunit.client.0.smithi005.stdout:libtoolize -cfi 2024-09-11T23:30:57.564 INFO:tasks.workunit.client.0.smithi005.stdout:libtoolize: putting auxiliary files in '.'. 2024-09-11T23:30:57.564 INFO:tasks.workunit.client.0.smithi005.stdout:libtoolize: copying file './config.guess' 2024-09-11T23:30:57.574 INFO:tasks.workunit.client.0.smithi005.stdout:libtoolize: copying file './config.sub' 2024-09-11T23:30:57.584 INFO:tasks.workunit.client.0.smithi005.stdout:libtoolize: copying file './install-sh' 2024-09-11T23:30:57.595 INFO:tasks.workunit.client.0.smithi005.stdout:libtoolize: copying file './ltmain.sh' 2024-09-11T23:30:57.632 INFO:tasks.workunit.client.0.smithi005.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-09-11T23:30:57.632 INFO:tasks.workunit.client.0.smithi005.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-09-11T23:30:57.642 INFO:tasks.workunit.client.0.smithi005.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-09-11T23:30:57.653 INFO:tasks.workunit.client.0.smithi005.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-09-11T23:30:57.663 INFO:tasks.workunit.client.0.smithi005.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-09-11T23:30:57.672 INFO:tasks.workunit.client.0.smithi005.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-09-11T23:30:57.681 INFO:tasks.workunit.client.0.smithi005.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-09-11T23:30:57.682 INFO:tasks.workunit.client.0.smithi005.stdout:cp include/install-sh . 2024-09-11T23:30:57.696 INFO:tasks.workunit.client.0.smithi005.stdout:aclocal -I m4 2024-09-11T23:30:58.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:30:57 smithi159 ceph-mon[34394]: pgmap v411: 129 pgs: 129 active+clean; 93 MiB data, 661 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.8 MiB/s wr, 280 op/s 2024-09-11T23:30:58.133 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:30:57 smithi172 ceph-mon[34855]: pgmap v411: 129 pgs: 129 active+clean; 93 MiB data, 661 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.8 MiB/s wr, 280 op/s 2024-09-11T23:30:58.225 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:30:57 smithi005 ceph-mon[31201]: pgmap v411: 129 pgs: 129 active+clean; 93 MiB data, 661 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.8 MiB/s wr, 280 op/s 2024-09-11T23:30:58.929 INFO:tasks.workunit.client.0.smithi005.stdout:autoheader 2024-09-11T23:30:59.312 INFO:tasks.workunit.client.0.smithi005.stdout:autoconf 2024-09-11T23:30:59.544 INFO:tasks.workunit.client.0.smithi005.stdout:./configure \ 2024-09-11T23:30:59.544 INFO:tasks.workunit.client.0.smithi005.stdout: --libexecdir=/usr/lib \ 2024-09-11T23:30:59.544 INFO:tasks.workunit.client.0.smithi005.stdout: --exec_prefix=/var/lib 2024-09-11T23:30:59.758 INFO:tasks.workunit.client.0.smithi005.stdout:checking build system type... x86_64-pc-linux-gnu 2024-09-11T23:30:59.759 INFO:tasks.workunit.client.0.smithi005.stdout:checking host system type... x86_64-pc-linux-gnu 2024-09-11T23:30:59.760 INFO:tasks.workunit.client.0.smithi005.stdout:checking how to print strings... printf 2024-09-11T23:30:59.761 INFO:tasks.workunit.client.0.smithi005.stdout:checking for gcc... gcc 2024-09-11T23:30:59.888 INFO:tasks.workunit.client.0.smithi005.stdout:checking whether the C compiler works... yes 2024-09-11T23:30:59.888 INFO:tasks.workunit.client.0.smithi005.stdout:checking for C compiler default output file name... a.out 2024-09-11T23:30:59.949 INFO:tasks.workunit.client.0.smithi005.stdout:checking for suffix of executables... 2024-09-11T23:31:00.007 INFO:tasks.workunit.client.0.smithi005.stdout:checking whether we are cross compiling... no 2024-09-11T23:31:00.062 INFO:tasks.workunit.client.0.smithi005.stdout:checking for suffix of object files... o 2024-09-11T23:31:00.104 INFO:tasks.workunit.client.0.smithi005.stdout:checking whether we are using the GNU C compiler... yes 2024-09-11T23:31:00.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:30:59 smithi159 ceph-mon[34394]: pgmap v412: 129 pgs: 129 active+clean; 98 MiB data, 672 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 247 op/s 2024-09-11T23:31:00.133 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:30:59 smithi172 ceph-mon[34855]: pgmap v412: 129 pgs: 129 active+clean; 98 MiB data, 672 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 247 op/s 2024-09-11T23:31:00.140 INFO:tasks.workunit.client.0.smithi005.stdout:checking whether gcc accepts -g... yes 2024-09-11T23:31:00.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:30:59 smithi005 ceph-mon[31201]: pgmap v412: 129 pgs: 129 active+clean; 98 MiB data, 672 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 247 op/s 2024-09-11T23:31:00.226 INFO:tasks.workunit.client.0.smithi005.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-11T23:31:00.232 INFO:tasks.workunit.client.0.smithi005.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2024-09-11T23:31:00.237 INFO:tasks.workunit.client.0.smithi005.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-09-11T23:31:00.238 INFO:tasks.workunit.client.0.smithi005.stdout:checking for egrep... /usr/bin/grep -E 2024-09-11T23:31:00.240 INFO:tasks.workunit.client.0.smithi005.stdout:checking for fgrep... /usr/bin/grep -F 2024-09-11T23:31:00.244 INFO:tasks.workunit.client.0.smithi005.stdout:checking for ld used by gcc... /usr/bin/ld 2024-09-11T23:31:00.246 INFO:tasks.workunit.client.0.smithi005.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2024-09-11T23:31:00.258 INFO:tasks.workunit.client.0.smithi005.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2024-09-11T23:31:01.217 INFO:tasks.workunit.client.0.smithi005.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2024-09-11T23:31:01.217 INFO:tasks.workunit.client.0.smithi005.stdout:checking whether ln -s works... yes 2024-09-11T23:31:01.400 INFO:tasks.workunit.client.0.smithi005.stdout:checking the maximum length of command line arguments... 1572864 2024-09-11T23:31:01.404 INFO:tasks.workunit.client.0.smithi005.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-09-11T23:31:01.404 INFO:tasks.workunit.client.0.smithi005.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-09-11T23:31:01.405 INFO:tasks.workunit.client.0.smithi005.stdout:checking for /usr/bin/ld option to reload object files... -r 2024-09-11T23:31:01.406 INFO:tasks.workunit.client.0.smithi005.stdout:checking for objdump... objdump 2024-09-11T23:31:01.407 INFO:tasks.workunit.client.0.smithi005.stdout:checking how to recognize dependent libraries... pass_all 2024-09-11T23:31:01.408 INFO:tasks.workunit.client.0.smithi005.stdout:checking for dlltool... no 2024-09-11T23:31:01.409 INFO:tasks.workunit.client.0.smithi005.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-09-11T23:31:01.410 INFO:tasks.workunit.client.0.smithi005.stdout:checking for ar... ar 2024-09-11T23:31:01.547 INFO:tasks.workunit.client.0.smithi005.stdout:checking for archiver @FILE support... @ 2024-09-11T23:31:01.548 INFO:tasks.workunit.client.0.smithi005.stdout:checking for strip... strip 2024-09-11T23:31:01.549 INFO:tasks.workunit.client.0.smithi005.stdout:checking for ranlib... ranlib 2024-09-11T23:31:01.549 INFO:tasks.workunit.client.0.smithi005.stdout:checking for gawk... gawk 2024-09-11T23:31:01.720 INFO:tasks.workunit.client.0.smithi005.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2024-09-11T23:31:01.721 INFO:tasks.workunit.client.0.smithi005.stdout:checking for sysroot... no 2024-09-11T23:31:01.742 INFO:tasks.workunit.client.0.smithi005.stdout:checking for a working dd... /usr/bin/dd 2024-09-11T23:31:01.762 INFO:tasks.workunit.client.0.smithi005.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2024-09-11T23:31:01.809 INFO:tasks.workunit.client.0.smithi005.stdout:checking for mt... no 2024-09-11T23:31:01.828 INFO:tasks.workunit.client.0.smithi005.stdout:checking if : is a manifest tool... no 2024-09-11T23:31:01.945 INFO:tasks.workunit.client.0.smithi005.stdout:checking how to run the C preprocessor... gcc -E 2024-09-11T23:31:02.219 INFO:tasks.workunit.client.0.smithi005.stdout:checking for ANSI C header files... yes 2024-09-11T23:31:02.272 INFO:tasks.workunit.client.0.smithi005.stdout:checking for sys/types.h... yes 2024-09-11T23:31:02.336 INFO:tasks.workunit.client.0.smithi005.stdout:checking for sys/stat.h... yes 2024-09-11T23:31:02.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:31:02 smithi159 ceph-mon[34394]: pgmap v413: 129 pgs: 129 active+clean; 98 MiB data, 673 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 238 op/s 2024-09-11T23:31:02.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:31:02 smithi172 ceph-mon[34855]: pgmap v413: 129 pgs: 129 active+clean; 98 MiB data, 673 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 238 op/s 2024-09-11T23:31:02.403 INFO:tasks.workunit.client.0.smithi005.stdout:checking for stdlib.h... yes 2024-09-11T23:31:02.470 INFO:tasks.workunit.client.0.smithi005.stdout:checking for string.h... yes 2024-09-11T23:31:02.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:31:02 smithi005 ceph-mon[31201]: pgmap v413: 129 pgs: 129 active+clean; 98 MiB data, 673 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 238 op/s 2024-09-11T23:31:02.535 INFO:tasks.workunit.client.0.smithi005.stdout:checking for memory.h... yes 2024-09-11T23:31:02.598 INFO:tasks.workunit.client.0.smithi005.stdout:checking for strings.h... yes 2024-09-11T23:31:02.662 INFO:tasks.workunit.client.0.smithi005.stdout:checking for inttypes.h... yes 2024-09-11T23:31:02.730 INFO:tasks.workunit.client.0.smithi005.stdout:checking for stdint.h... yes 2024-09-11T23:31:02.797 INFO:tasks.workunit.client.0.smithi005.stdout:checking for unistd.h... yes 2024-09-11T23:31:02.864 INFO:tasks.workunit.client.0.smithi005.stdout:checking for dlfcn.h... yes 2024-09-11T23:31:02.877 INFO:tasks.workunit.client.0.smithi005.stdout:checking for objdir... .libs 2024-09-11T23:31:03.044 INFO:tasks.workunit.client.0.smithi005.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-09-11T23:31:03.044 INFO:tasks.workunit.client.0.smithi005.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-09-11T23:31:03.096 INFO:tasks.workunit.client.0.smithi005.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-09-11T23:31:03.161 INFO:tasks.workunit.client.0.smithi005.stdout:checking if gcc static flag -static works... no 2024-09-11T23:31:03.261 INFO:tasks.workunit.client.0.smithi005.stdout:checking if gcc supports -c -o file.o... yes 2024-09-11T23:31:03.261 INFO:tasks.workunit.client.0.smithi005.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-09-11T23:31:03.269 INFO:tasks.workunit.client.0.smithi005.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-09-11T23:31:03.355 INFO:tasks.workunit.client.0.smithi005.stdout:checking whether -lc should be explicitly linked in... no 2024-09-11T23:31:03.440 INFO:tasks.workunit.client.0.smithi005.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-09-11T23:31:03.440 INFO:tasks.workunit.client.0.smithi005.stdout:checking how to hardcode library paths into programs... immediate 2024-09-11T23:31:03.442 INFO:tasks.workunit.client.0.smithi005.stdout:checking whether stripping libraries is possible... yes 2024-09-11T23:31:03.442 INFO:tasks.workunit.client.0.smithi005.stdout:checking if libtool supports shared libraries... yes 2024-09-11T23:31:03.442 INFO:tasks.workunit.client.0.smithi005.stdout:checking whether to build shared libraries... yes 2024-09-11T23:31:03.443 INFO:tasks.workunit.client.0.smithi005.stdout:checking whether to build static libraries... yes 2024-09-11T23:31:03.451 INFO:tasks.workunit.client.0.smithi005.stdout:checking for gcc... (cached) gcc 2024-09-11T23:31:03.505 INFO:tasks.workunit.client.0.smithi005.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-11T23:31:03.505 INFO:tasks.workunit.client.0.smithi005.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-11T23:31:03.505 INFO:tasks.workunit.client.0.smithi005.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-11T23:31:03.506 INFO:tasks.workunit.client.0.smithi005.stdout:checking for gmake... /usr/bin/gmake 2024-09-11T23:31:03.506 INFO:tasks.workunit.client.0.smithi005.stderr:./configure: line 12082: test: $(SHELL): binary operator expected 2024-09-11T23:31:03.507 INFO:tasks.workunit.client.0.smithi005.stdout:checking for tar... /bin/tar 2024-09-11T23:31:03.508 INFO:tasks.workunit.client.0.smithi005.stdout:checking for gzip... /bin/gzip 2024-09-11T23:31:03.535 INFO:tasks.workunit.client.0.smithi005.stdout:checking whether gcc -MM is supported... yes 2024-09-11T23:31:03.535 INFO:tasks.workunit.client.0.smithi005.stdout:checking for sort... /bin/sort 2024-09-11T23:31:03.536 INFO:tasks.workunit.client.0.smithi005.stdout:checking whether ln -s works... yes 2024-09-11T23:31:03.537 INFO:tasks.workunit.client.0.smithi005.stdout:checking for rpm... /bin/rpm 2024-09-11T23:31:03.541 INFO:tasks.workunit.client.0.smithi005.stdout:checking for rpmbuild... no 2024-09-11T23:31:03.608 INFO:tasks.workunit.client.0.smithi005.stdout:checking assert.h usability... yes 2024-09-11T23:31:03.630 INFO:tasks.workunit.client.0.smithi005.stdout:checking assert.h presence... yes 2024-09-11T23:31:03.631 INFO:tasks.workunit.client.0.smithi005.stdout:checking for assert.h... yes 2024-09-11T23:31:03.707 INFO:tasks.workunit.client.0.smithi005.stdout:checking bstring.h usability... no 2024-09-11T23:31:03.748 INFO:tasks.workunit.client.0.smithi005.stdout:checking bstring.h presence... no 2024-09-11T23:31:03.748 INFO:tasks.workunit.client.0.smithi005.stdout:checking for bstring.h... no 2024-09-11T23:31:03.802 INFO:tasks.workunit.client.0.smithi005.stdout:checking libgen.h usability... yes 2024-09-11T23:31:03.825 INFO:tasks.workunit.client.0.smithi005.stdout:checking libgen.h presence... yes 2024-09-11T23:31:03.825 INFO:tasks.workunit.client.0.smithi005.stdout:checking for libgen.h... yes 2024-09-11T23:31:03.908 INFO:tasks.workunit.client.0.smithi005.stdout:checking dirent.h usability... yes 2024-09-11T23:31:03.931 INFO:tasks.workunit.client.0.smithi005.stdout:checking dirent.h presence... yes 2024-09-11T23:31:03.931 INFO:tasks.workunit.client.0.smithi005.stdout:checking for dirent.h... yes 2024-09-11T23:31:04.007 INFO:tasks.workunit.client.0.smithi005.stdout:checking errno.h usability... yes 2024-09-11T23:31:04.033 INFO:tasks.workunit.client.0.smithi005.stdout:checking errno.h presence... yes 2024-09-11T23:31:04.033 INFO:tasks.workunit.client.0.smithi005.stdout:checking for errno.h... yes 2024-09-11T23:31:04.105 INFO:tasks.workunit.client.0.smithi005.stdout:checking malloc.h usability... yes 2024-09-11T23:31:04.130 INFO:tasks.workunit.client.0.smithi005.stdout:checking malloc.h presence... yes 2024-09-11T23:31:04.131 INFO:tasks.workunit.client.0.smithi005.stdout:checking for malloc.h... yes 2024-09-11T23:31:04.227 INFO:tasks.workunit.client.0.smithi005.stdout:checking uuid.h usability... no 2024-09-11T23:31:04.271 INFO:tasks.workunit.client.0.smithi005.stdout:checking uuid.h presence... no 2024-09-11T23:31:04.271 INFO:tasks.workunit.client.0.smithi005.stdout:checking for uuid.h... no 2024-09-11T23:31:04.340 INFO:tasks.workunit.client.0.smithi005.stdout:checking uuid/uuid.h usability... yes 2024-09-11T23:31:04.366 INFO:tasks.workunit.client.0.smithi005.stdout:checking uuid/uuid.h presence... yes 2024-09-11T23:31:04.367 INFO:tasks.workunit.client.0.smithi005.stdout:checking for uuid/uuid.h... yes 2024-09-11T23:31:04.377 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:31:04 smithi159 ceph-mon[34394]: pgmap v414: 129 pgs: 129 active+clean; 103 MiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.7 MiB/s wr, 259 op/s 2024-09-11T23:31:04.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:31:04 smithi172 ceph-mon[34855]: pgmap v414: 129 pgs: 129 active+clean; 103 MiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.7 MiB/s wr, 259 op/s 2024-09-11T23:31:04.442 INFO:tasks.workunit.client.0.smithi005.stdout:checking sys/uuid.h usability... no 2024-09-11T23:31:04.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:31:04 smithi005 ceph-mon[31201]: pgmap v414: 129 pgs: 129 active+clean; 103 MiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.7 MiB/s wr, 259 op/s 2024-09-11T23:31:04.482 INFO:tasks.workunit.client.0.smithi005.stdout:checking sys/uuid.h presence... no 2024-09-11T23:31:04.483 INFO:tasks.workunit.client.0.smithi005.stdout:checking for sys/uuid.h... no 2024-09-11T23:31:04.551 INFO:tasks.workunit.client.0.smithi005.stdout:checking sys/file.h usability... yes 2024-09-11T23:31:04.575 INFO:tasks.workunit.client.0.smithi005.stdout:checking sys/file.h presence... yes 2024-09-11T23:31:04.575 INFO:tasks.workunit.client.0.smithi005.stdout:checking for sys/file.h... yes 2024-09-11T23:31:04.656 INFO:tasks.workunit.client.0.smithi005.stdout:checking sys/fcntl.h usability... yes 2024-09-11T23:31:04.692 INFO:tasks.workunit.client.0.smithi005.stdout:checking sys/fcntl.h presence... yes 2024-09-11T23:31:04.692 INFO:tasks.workunit.client.0.smithi005.stdout:checking for sys/fcntl.h... yes 2024-09-11T23:31:04.875 INFO:tasks.workunit.client.0.smithi005.stdout:checking sys/syssgi.h usability... no 2024-09-11T23:31:04.916 INFO:tasks.workunit.client.0.smithi005.stdout:checking sys/syssgi.h presence... no 2024-09-11T23:31:04.917 INFO:tasks.workunit.client.0.smithi005.stdout:checking for sys/syssgi.h... no 2024-09-11T23:31:05.032 INFO:tasks.workunit.client.0.smithi005.stdout:checking sys/param.h usability... yes 2024-09-11T23:31:05.059 INFO:tasks.workunit.client.0.smithi005.stdout:checking sys/param.h presence... yes 2024-09-11T23:31:05.059 INFO:tasks.workunit.client.0.smithi005.stdout:checking for sys/param.h... yes 2024-09-11T23:31:05.083 INFO:tasks.workunit.client.0.smithi005.stdout:checking for sys/stat.h... (cached) yes 2024-09-11T23:31:05.160 INFO:tasks.workunit.client.0.smithi005.stdout:checking sys/statvfs.h usability... yes 2024-09-11T23:31:05.183 INFO:tasks.workunit.client.0.smithi005.stdout:checking sys/statvfs.h presence... yes 2024-09-11T23:31:05.185 INFO:tasks.workunit.client.0.smithi005.stdout:checking for sys/statvfs.h... yes 2024-09-11T23:31:05.252 INFO:tasks.workunit.client.0.smithi005.stdout:checking sys/time.h usability... yes 2024-09-11T23:31:05.276 INFO:tasks.workunit.client.0.smithi005.stdout:checking sys/time.h presence... yes 2024-09-11T23:31:05.276 INFO:tasks.workunit.client.0.smithi005.stdout:checking for sys/time.h... yes 2024-09-11T23:31:05.346 INFO:tasks.workunit.client.0.smithi005.stdout:checking sys/ioctl.h usability... yes 2024-09-11T23:31:05.370 INFO:tasks.workunit.client.0.smithi005.stdout:checking sys/ioctl.h presence... yes 2024-09-11T23:31:05.371 INFO:tasks.workunit.client.0.smithi005.stdout:checking for sys/ioctl.h... yes 2024-09-11T23:31:05.446 INFO:tasks.workunit.client.0.smithi005.stdout:checking sys/wait.h usability... yes 2024-09-11T23:31:05.473 INFO:tasks.workunit.client.0.smithi005.stdout:checking sys/wait.h presence... yes 2024-09-11T23:31:05.473 INFO:tasks.workunit.client.0.smithi005.stdout:checking for sys/wait.h... yes 2024-09-11T23:31:05.503 INFO:tasks.workunit.client.0.smithi005.stdout:checking for sys/types.h... (cached) yes 2024-09-11T23:31:05.523 INFO:tasks.workunit.client.0.smithi005.stdout:checking for strings.h... (cached) yes 2024-09-11T23:31:05.601 INFO:tasks.workunit.client.0.smithi005.stdout:checking err.h usability... yes 2024-09-11T23:31:05.621 INFO:tasks.workunit.client.0.smithi005.stdout:checking err.h presence... yes 2024-09-11T23:31:05.621 INFO:tasks.workunit.client.0.smithi005.stdout:checking for err.h... yes 2024-09-11T23:31:05.689 INFO:tasks.workunit.client.0.smithi005.stdout:checking linux/falloc.h usability... yes 2024-09-11T23:31:05.712 INFO:tasks.workunit.client.0.smithi005.stdout:checking linux/falloc.h presence... yes 2024-09-11T23:31:05.712 INFO:tasks.workunit.client.0.smithi005.stdout:checking for linux/falloc.h... yes 2024-09-11T23:31:05.796 INFO:tasks.workunit.client.0.smithi005.stdout:checking sys/fs/xfs_fsops.h usability... no 2024-09-11T23:31:05.836 INFO:tasks.workunit.client.0.smithi005.stdout:checking sys/fs/xfs_fsops.h presence... no 2024-09-11T23:31:05.836 INFO:tasks.workunit.client.0.smithi005.stdout:checking for sys/fs/xfs_fsops.h... no 2024-09-11T23:31:05.898 INFO:tasks.workunit.client.0.smithi005.stdout:checking sys/fs/xfs_itable.h usability... no 2024-09-11T23:31:05.937 INFO:tasks.workunit.client.0.smithi005.stdout:checking sys/fs/xfs_itable.h presence... no 2024-09-11T23:31:05.937 INFO:tasks.workunit.client.0.smithi005.stdout:checking for sys/fs/xfs_itable.h... no 2024-09-11T23:31:05.999 INFO:tasks.workunit.client.0.smithi005.stdout:checking xfs/platform_defs.h usability... no 2024-09-11T23:31:06.039 INFO:tasks.workunit.client.0.smithi005.stdout:checking xfs/platform_defs.h presence... no 2024-09-11T23:31:06.039 INFO:tasks.workunit.client.0.smithi005.stdout:checking for xfs/platform_defs.h... no 2024-09-11T23:31:06.104 INFO:tasks.workunit.client.0.smithi005.stdout:checking btrfs/ioctl.h usability... no 2024-09-11T23:31:06.148 INFO:tasks.workunit.client.0.smithi005.stdout:checking btrfs/ioctl.h presence... no 2024-09-11T23:31:06.148 INFO:tasks.workunit.client.0.smithi005.stdout:checking for btrfs/ioctl.h... no 2024-09-11T23:31:06.234 INFO:tasks.workunit.client.0.smithi005.stdout:checking cifs/ioctl.h usability... no 2024-09-11T23:31:06.283 INFO:tasks.workunit.client.0.smithi005.stdout:checking cifs/ioctl.h presence... no 2024-09-11T23:31:06.283 INFO:tasks.workunit.client.0.smithi005.stdout:checking for cifs/ioctl.h... no 2024-09-11T23:31:06.342 INFO:tasks.workunit.client.0.smithi005.stdout:checking sys/mman.h usability... yes 2024-09-11T23:31:06.367 INFO:tasks.workunit.client.0.smithi005.stdout:checking sys/mman.h presence... yes 2024-09-11T23:31:06.367 INFO:tasks.workunit.client.0.smithi005.stdout:checking for sys/mman.h... yes 2024-09-11T23:31:06.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:31:06 smithi159 ceph-mon[34394]: pgmap v415: 129 pgs: 129 active+clean; 104 MiB data, 691 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 181 op/s 2024-09-11T23:31:06.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:31:06 smithi172 ceph-mon[34855]: pgmap v415: 129 pgs: 129 active+clean; 104 MiB data, 691 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 181 op/s 2024-09-11T23:31:06.460 INFO:tasks.workunit.client.0.smithi005.stdout:checking linux/ext4.h usability... no 2024-09-11T23:31:06.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:31:06 smithi005 ceph-mon[31201]: pgmap v415: 129 pgs: 129 active+clean; 104 MiB data, 691 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 181 op/s 2024-09-11T23:31:06.504 INFO:tasks.workunit.client.0.smithi005.stdout:checking linux/ext4.h presence... no 2024-09-11T23:31:06.504 INFO:tasks.workunit.client.0.smithi005.stdout:checking for linux/ext4.h... no 2024-09-11T23:31:06.550 INFO:tasks.workunit.client.0.smithi005.stdout:checking for xfs/xfs_log_format.h... no 2024-09-11T23:31:06.636 INFO:tasks.workunit.client.0.smithi005.stdout:checking for uuid_compare... no 2024-09-11T23:31:06.701 INFO:tasks.workunit.client.0.smithi005.stdout:checking for uuid_compare in -luuid... yes 2024-09-11T23:31:06.777 INFO:tasks.workunit.client.0.smithi005.stdout:checking for xfs/xfs.h... yes 2024-09-11T23:31:06.819 INFO:tasks.workunit.client.0.smithi005.stdout:checking for xfs/libxfs.h... no 2024-09-11T23:31:06.871 INFO:tasks.workunit.client.0.smithi005.stdout:checking whether xlog_assign_lsn is declared... no 2024-09-11T23:31:06.920 INFO:tasks.workunit.client.0.smithi005.stdout:checking for xfs/xqm.h... yes 2024-09-11T23:31:07.005 INFO:tasks.workunit.client.0.smithi005.stdout:checking xfsctl from xfs/xfs.h... ok 2024-09-11T23:31:07.054 INFO:tasks.workunit.client.0.smithi005.stdout:checking xfs/handle.h usability... yes 2024-09-11T23:31:07.075 INFO:tasks.workunit.client.0.smithi005.stdout:checking xfs/handle.h presence... yes 2024-09-11T23:31:07.075 INFO:tasks.workunit.client.0.smithi005.stdout:checking for xfs/handle.h... yes 2024-09-11T23:31:07.162 INFO:tasks.workunit.client.0.smithi005.stdout:checking for attr_list_by_handle in -lhandle... yes 2024-09-11T23:31:07.240 INFO:tasks.workunit.client.0.smithi005.stdout:checking sys/acl.h usability... yes 2024-09-11T23:31:07.268 INFO:tasks.workunit.client.0.smithi005.stdout:checking sys/acl.h presence... yes 2024-09-11T23:31:07.269 INFO:tasks.workunit.client.0.smithi005.stdout:checking for sys/acl.h... yes 2024-09-11T23:31:07.324 INFO:tasks.workunit.client.0.smithi005.stdout:checking acl/libacl.h usability... yes 2024-09-11T23:31:07.348 INFO:tasks.workunit.client.0.smithi005.stdout:checking acl/libacl.h presence... yes 2024-09-11T23:31:07.348 INFO:tasks.workunit.client.0.smithi005.stdout:checking for acl/libacl.h... yes 2024-09-11T23:31:07.420 INFO:tasks.workunit.client.0.smithi005.stdout:checking for acl_init in -lacl... yes 2024-09-11T23:31:07.478 INFO:tasks.workunit.client.0.smithi005.stdout:checking gdbm-ndbm.h usability... no 2024-09-11T23:31:07.520 INFO:tasks.workunit.client.0.smithi005.stdout:checking gdbm-ndbm.h presence... no 2024-09-11T23:31:07.520 INFO:tasks.workunit.client.0.smithi005.stdout:checking for gdbm-ndbm.h... no 2024-09-11T23:31:07.572 INFO:tasks.workunit.client.0.smithi005.stdout:checking gdbm/ndbm.h usability... no 2024-09-11T23:31:07.611 INFO:tasks.workunit.client.0.smithi005.stdout:checking gdbm/ndbm.h presence... no 2024-09-11T23:31:07.612 INFO:tasks.workunit.client.0.smithi005.stdout:checking for gdbm/ndbm.h... no 2024-09-11T23:31:07.666 INFO:tasks.workunit.client.0.smithi005.stdout:checking ndbm.h usability... no 2024-09-11T23:31:07.705 INFO:tasks.workunit.client.0.smithi005.stdout:checking ndbm.h presence... no 2024-09-11T23:31:07.706 INFO:tasks.workunit.client.0.smithi005.stdout:checking for ndbm.h... no 2024-09-11T23:31:07.748 INFO:tasks.workunit.client.0.smithi005.stdout:checking libaio.h usability... yes 2024-09-11T23:31:07.772 INFO:tasks.workunit.client.0.smithi005.stdout:checking libaio.h presence... yes 2024-09-11T23:31:07.773 INFO:tasks.workunit.client.0.smithi005.stdout:checking for libaio.h... yes 2024-09-11T23:31:07.841 INFO:tasks.workunit.client.0.smithi005.stdout:checking liburing.h usability... no 2024-09-11T23:31:07.882 INFO:tasks.workunit.client.0.smithi005.stdout:checking liburing.h presence... no 2024-09-11T23:31:07.883 INFO:tasks.workunit.client.0.smithi005.stdout:checking for liburing.h... no 2024-09-11T23:31:07.934 INFO:tasks.workunit.client.0.smithi005.stdout:checking sys/capability.h usability... no 2024-09-11T23:31:07.975 INFO:tasks.workunit.client.0.smithi005.stdout:checking sys/capability.h presence... no 2024-09-11T23:31:07.975 INFO:tasks.workunit.client.0.smithi005.stdout:checking for sys/capability.h... no 2024-09-11T23:31:08.017 INFO:tasks.workunit.client.0.smithi005.stdout:checking linux/fiemap.h usability... yes 2024-09-11T23:31:08.039 INFO:tasks.workunit.client.0.smithi005.stdout:checking linux/fiemap.h presence... yes 2024-09-11T23:31:08.039 INFO:tasks.workunit.client.0.smithi005.stdout:checking for linux/fiemap.h... yes 2024-09-11T23:31:08.112 INFO:tasks.workunit.client.0.smithi005.stdout:checking for fallocate... yes 2024-09-11T23:31:08.186 INFO:tasks.workunit.client.0.smithi005.stdout:checking for open_by_handle_at... yes 2024-09-11T23:31:08.253 INFO:tasks.workunit.client.0.smithi005.stdout:checking linux/fs.h usability... yes 2024-09-11T23:31:08.277 INFO:tasks.workunit.client.0.smithi005.stdout:checking linux/fs.h presence... yes 2024-09-11T23:31:08.278 INFO:tasks.workunit.client.0.smithi005.stdout:checking for linux/fs.h... yes 2024-09-11T23:31:08.348 INFO:tasks.workunit.client.0.smithi005.stdout:checking btrfsutil.h usability... no 2024-09-11T23:31:08.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:31:08 smithi159 ceph-mon[34394]: pgmap v416: 129 pgs: 129 active+clean; 104 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 205 op/s 2024-09-11T23:31:08.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:31:08 smithi172 ceph-mon[34855]: pgmap v416: 129 pgs: 129 active+clean; 104 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 205 op/s 2024-09-11T23:31:08.388 INFO:tasks.workunit.client.0.smithi005.stdout:checking btrfsutil.h presence... no 2024-09-11T23:31:08.389 INFO:tasks.workunit.client.0.smithi005.stdout:checking for btrfsutil.h... no 2024-09-11T23:31:08.450 INFO:tasks.workunit.client.0.smithi005.stdout:checking for copy_file_range... yes 2024-09-11T23:31:08.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:31:08 smithi005 ceph-mon[31201]: pgmap v416: 129 pgs: 129 active+clean; 104 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 205 op/s 2024-09-11T23:31:08.520 INFO:tasks.workunit.client.0.smithi005.stdout:checking for SEEK_DATA... yes 2024-09-11T23:31:08.601 INFO:tasks.workunit.client.0.smithi005.stdout:checking for BMV_OF_SHARED... yes 2024-09-11T23:31:08.668 INFO:tasks.workunit.client.0.smithi005.stdout:checking for nftw... yes 2024-09-11T23:31:08.744 INFO:tasks.workunit.client.0.smithi005.stdout:checking for RLIMIT_NOFILE... yes 2024-09-11T23:31:08.805 INFO:tasks.workunit.client.0.smithi005.stdout:checking for XFS_IOC_EXCHANGE_RANGE... no 2024-09-11T23:31:08.873 INFO:tasks.workunit.client.0.smithi005.stdout:checking for FICLONE... yes 2024-09-11T23:31:08.945 INFO:tasks.workunit.client.0.smithi005.stdout:checking for renameat2... yes 2024-09-11T23:31:09.015 INFO:tasks.workunit.client.0.smithi005.stdout:checking for reallocarray... yes 2024-09-11T23:31:09.096 INFO:tasks.workunit.client.0.smithi005.stdout:checking for struct mount_attr... yes 2024-09-11T23:31:09.188 INFO:tasks.workunit.client.0.smithi005.stdout:checking for struct btrfs_qgroup_limit... yes 2024-09-11T23:31:09.302 INFO:tasks.workunit.client.0.smithi005.stdout:checking for struct btrfs_qgroup_inherit... yes 2024-09-11T23:31:09.389 INFO:tasks.workunit.client.0.smithi005.stdout:checking for struct btrfs_ioctl_vol_args... yes 2024-09-11T23:31:09.474 INFO:tasks.workunit.client.0.smithi005.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2024-09-11T23:31:09.557 INFO:tasks.workunit.client.0.smithi005.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2024-09-11T23:31:09.640 INFO:tasks.workunit.client.0.smithi005.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2024-09-11T23:31:09.726 INFO:tasks.workunit.client.0.smithi005.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2024-09-11T23:31:09.784 INFO:tasks.workunit.client.0.smithi005.stdout:checking linux/btrfs.h usability... yes 2024-09-11T23:31:09.807 INFO:tasks.workunit.client.0.smithi005.stdout:checking linux/btrfs.h presence... yes 2024-09-11T23:31:09.808 INFO:tasks.workunit.client.0.smithi005.stdout:checking for linux/btrfs.h... yes 2024-09-11T23:31:09.881 INFO:tasks.workunit.client.0.smithi005.stdout:checking linux/btrfs_tree.h usability... yes 2024-09-11T23:31:09.904 INFO:tasks.workunit.client.0.smithi005.stdout:checking linux/btrfs_tree.h presence... yes 2024-09-11T23:31:09.905 INFO:tasks.workunit.client.0.smithi005.stdout:checking for linux/btrfs_tree.h... yes 2024-09-11T23:31:09.962 INFO:tasks.workunit.client.0.smithi005.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2024-09-11T23:31:10.003 INFO:tasks.workunit.client.0.smithi005.stdout:checking whether BTRFS_IOC_SNAP_DESTROY_V2 is declared... yes 2024-09-11T23:31:10.029 INFO:tasks.workunit.client.0.smithi005.stdout:configure: creating ./config.status 2024-09-11T23:31:10.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:31:10 smithi159 ceph-mon[34394]: pgmap v417: 129 pgs: 129 active+clean; 106 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 154 op/s 2024-09-11T23:31:10.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:31:10 smithi172 ceph-mon[34855]: pgmap v417: 129 pgs: 129 active+clean; 106 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 154 op/s 2024-09-11T23:31:10.469 INFO:tasks.workunit.client.0.smithi005.stdout:config.status: creating include/builddefs 2024-09-11T23:31:10.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:31:10 smithi005 ceph-mon[31201]: pgmap v417: 129 pgs: 129 active+clean; 106 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 154 op/s 2024-09-11T23:31:10.517 INFO:tasks.workunit.client.0.smithi005.stdout:config.status: creating include/config.h 2024-09-11T23:31:12.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:31:12 smithi159 ceph-mon[34394]: pgmap v418: 129 pgs: 129 active+clean; 109 MiB data, 731 MiB used, 1.0 TiB / 1.0 TiB avail; 845 KiB/s rd, 1.1 MiB/s wr, 140 op/s 2024-09-11T23:31:12.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:31:12 smithi172 ceph-mon[34855]: pgmap v418: 129 pgs: 129 active+clean; 109 MiB data, 731 MiB used, 1.0 TiB / 1.0 TiB avail; 845 KiB/s rd, 1.1 MiB/s wr, 140 op/s 2024-09-11T23:31:12.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:31:12 smithi005 ceph-mon[31201]: pgmap v418: 129 pgs: 129 active+clean; 109 MiB data, 731 MiB used, 1.0 TiB / 1.0 TiB avail; 845 KiB/s rd, 1.1 MiB/s wr, 140 op/s 2024-09-11T23:31:14.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:31:14 smithi159 ceph-mon[34394]: pgmap v419: 129 pgs: 129 active+clean; 109 MiB data, 756 MiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 1.1 MiB/s wr, 166 op/s 2024-09-11T23:31:14.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:31:14 smithi172 ceph-mon[34855]: pgmap v419: 129 pgs: 129 active+clean; 109 MiB data, 756 MiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 1.1 MiB/s wr, 166 op/s 2024-09-11T23:31:14.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:31:14 smithi005 ceph-mon[31201]: pgmap v419: 129 pgs: 129 active+clean; 109 MiB data, 756 MiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 1.1 MiB/s wr, 166 op/s 2024-09-11T23:31:14.681 INFO:tasks.workunit.client.0.smithi005.stdout:config.status: executing libtool commands 2024-09-11T23:31:14.873 INFO:tasks.workunit.client.0.smithi005.stdout:Building include 2024-09-11T23:31:14.873 INFO:tasks.workunit.client.0.smithi005.stdout:Building lib 2024-09-11T23:31:14.873 INFO:tasks.workunit.client.0.smithi005.stdout:Building tests 2024-09-11T23:31:14.894 INFO:tasks.workunit.client.0.smithi005.stdout: [LTDEP] 2024-09-11T23:31:14.938 INFO:tasks.workunit.client.0.smithi005.stdout:Building ceph 2024-09-11T23:31:14.939 INFO:tasks.workunit.client.0.smithi005.stdout:Building btrfs 2024-09-11T23:31:14.939 INFO:tasks.workunit.client.0.smithi005.stdout:Building cifs 2024-09-11T23:31:14.995 INFO:tasks.workunit.client.0.smithi005.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/cifs/group.list 2024-09-11T23:31:14.998 INFO:tasks.workunit.client.0.smithi005.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/ceph/group.list 2024-09-11T23:31:15.019 INFO:tasks.workunit.client.0.smithi005.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/btrfs/group.list 2024-09-11T23:31:15.072 INFO:tasks.workunit.client.0.smithi005.stdout:Building ext4 2024-09-11T23:31:15.114 INFO:tasks.workunit.client.0.smithi005.stdout:Building f2fs 2024-09-11T23:31:15.128 INFO:tasks.workunit.client.0.smithi005.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/ext4/group.list 2024-09-11T23:31:15.157 INFO:tasks.workunit.client.0.smithi005.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/f2fs/group.list 2024-09-11T23:31:15.260 INFO:tasks.workunit.client.0.smithi005.stdout:Building generic 2024-09-11T23:31:15.438 INFO:tasks.workunit.client.0.smithi005.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/generic/group.list 2024-09-11T23:31:15.647 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] dataascii.lo 2024-09-11T23:31:15.887 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] databin.lo 2024-09-11T23:31:15.900 INFO:tasks.workunit.client.0.smithi005.stdout:Building nfs 2024-09-11T23:31:15.942 INFO:tasks.workunit.client.0.smithi005.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/nfs/group.list 2024-09-11T23:31:16.022 INFO:tasks.workunit.client.0.smithi005.stdout:Building ocfs2 2024-09-11T23:31:16.063 INFO:tasks.workunit.client.0.smithi005.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/ocfs2/group.list 2024-09-11T23:31:16.146 INFO:tasks.workunit.client.0.smithi005.stdout:Building overlay 2024-09-11T23:31:16.226 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] datapid.lo 2024-09-11T23:31:16.227 INFO:tasks.workunit.client.0.smithi005.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/overlay/group.list 2024-09-11T23:31:16.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:31:16 smithi159 ceph-mon[34394]: pgmap v420: 129 pgs: 129 active+clean; 109 MiB data, 757 MiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 621 KiB/s wr, 141 op/s 2024-09-11T23:31:16.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:31:16 smithi172 ceph-mon[34855]: pgmap v420: 129 pgs: 129 active+clean; 109 MiB data, 757 MiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 621 KiB/s wr, 141 op/s 2024-09-11T23:31:16.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:31:16 smithi005 ceph-mon[31201]: pgmap v420: 129 pgs: 129 active+clean; 109 MiB data, 757 MiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 621 KiB/s wr, 141 op/s 2024-09-11T23:31:16.487 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] file_lock.lo 2024-09-11T23:31:16.849 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] forker.lo 2024-09-11T23:31:17.138 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] pattern.lo 2024-09-11T23:31:17.237 INFO:tasks.workunit.client.0.smithi005.stdout:Building perf 2024-09-11T23:31:17.278 INFO:tasks.workunit.client.0.smithi005.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/perf/group.list 2024-09-11T23:31:17.350 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] open_flags.lo 2024-09-11T23:31:17.360 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] random_range.lo 2024-09-11T23:31:17.659 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] string_to_tokens.lo 2024-09-11T23:31:17.753 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] str_to_bytes.lo 2024-09-11T23:31:17.780 INFO:tasks.workunit.client.0.smithi005.stdout:Building selftest 2024-09-11T23:31:17.820 INFO:tasks.workunit.client.0.smithi005.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/selftest/group.list 2024-09-11T23:31:17.859 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] tlibio.lo 2024-09-11T23:31:17.922 INFO:tasks.workunit.client.0.smithi005.stdout:Building shared 2024-09-11T23:31:17.963 INFO:tasks.workunit.client.0.smithi005.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/shared/group.list 2024-09-11T23:31:18.055 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] write_log.lo 2024-09-11T23:31:18.056 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] random.lo 2024-09-11T23:31:18.314 INFO:tasks.workunit.client.0.smithi005.stdout:Building tmpfs 2024-09-11T23:31:18.338 INFO:tasks.workunit.client.0.smithi005.stdout:Building udf 2024-09-11T23:31:18.356 INFO:tasks.workunit.client.0.smithi005.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/tmpfs/group.list 2024-09-11T23:31:18.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:31:18 smithi159 ceph-mon[34394]: pgmap v421: 129 pgs: 129 active+clean; 110 MiB data, 757 MiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 641 KiB/s wr, 145 op/s 2024-09-11T23:31:18.379 INFO:tasks.workunit.client.0.smithi005.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/udf/group.list 2024-09-11T23:31:18.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:31:18 smithi172 ceph-mon[34855]: pgmap v421: 129 pgs: 129 active+clean; 110 MiB data, 757 MiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 641 KiB/s wr, 145 op/s 2024-09-11T23:31:18.426 INFO:tasks.workunit.client.0.smithi005.stdout:Building xfs 2024-09-11T23:31:18.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:31:18 smithi005 ceph-mon[31201]: pgmap v421: 129 pgs: 129 active+clean; 110 MiB data, 757 MiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 641 KiB/s wr, 145 op/s 2024-09-11T23:31:18.517 INFO:tasks.workunit.client.0.smithi005.stdout: [LD] 2024-09-11T23:31:18.590 INFO:tasks.workunit.client.0.smithi005.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/xfs/group.list 2024-09-11T23:31:19.293 INFO:tasks.workunit.client.0.smithi005.stdout:Building ltp 2024-09-11T23:31:19.294 INFO:tasks.workunit.client.0.smithi005.stdout:Building src 2024-09-11T23:31:19.325 INFO:tasks.workunit.client.0.smithi005.stdout: [DEP] 2024-09-11T23:31:19.389 INFO:tasks.workunit.client.0.smithi005.stdout: [DEP] 2024-09-11T23:31:20.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:31:20 smithi159 ceph-mon[34394]: pgmap v422: 129 pgs: 129 active+clean; 110 MiB data, 758 MiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 625 KiB/s wr, 109 op/s 2024-09-11T23:31:20.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:31:20 smithi172 ceph-mon[34855]: pgmap v422: 129 pgs: 129 active+clean; 110 MiB data, 758 MiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 625 KiB/s wr, 109 op/s 2024-09-11T23:31:20.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:31:20 smithi005 ceph-mon[31201]: pgmap v422: 129 pgs: 129 active+clean; 110 MiB data, 758 MiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 625 KiB/s wr, 109 op/s 2024-09-11T23:31:20.898 INFO:tasks.workunit.client.0.smithi005.stdout:Building m4 2024-09-11T23:31:20.924 INFO:tasks.workunit.client.0.smithi005.stdout:Building common 2024-09-11T23:31:21.299 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] doio 2024-09-11T23:31:21.299 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] fsstress 2024-09-11T23:31:22.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:31:22 smithi159 ceph-mon[34394]: pgmap v423: 129 pgs: 129 active+clean; 111 MiB data, 759 MiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 473 KiB/s wr, 100 op/s 2024-09-11T23:31:22.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:31:22 smithi172 ceph-mon[34855]: pgmap v423: 129 pgs: 129 active+clean; 111 MiB data, 759 MiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 473 KiB/s wr, 100 op/s 2024-09-11T23:31:22.417 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] fsx 2024-09-11T23:31:22.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:31:22 smithi005 ceph-mon[31201]: pgmap v423: 129 pgs: 129 active+clean; 111 MiB data, 759 MiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 473 KiB/s wr, 100 op/s 2024-09-11T23:31:23.100 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] growfiles 2024-09-11T23:31:23.422 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] iogen 2024-09-11T23:31:23.523 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] aio-stress 2024-09-11T23:31:24.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:31:24 smithi159 ceph-mon[34394]: pgmap v424: 129 pgs: 129 active+clean; 116 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 652 KiB/s wr, 78 op/s 2024-09-11T23:31:24.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:31:24 smithi172 ceph-mon[34855]: pgmap v424: 129 pgs: 129 active+clean; 116 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 652 KiB/s wr, 78 op/s 2024-09-11T23:31:24.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:31:24 smithi005 ceph-mon[31201]: pgmap v424: 129 pgs: 129 active+clean; 116 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 652 KiB/s wr, 78 op/s 2024-09-11T23:31:25.922 INFO:tasks.workunit.client.0.smithi005.stdout: [DEP] 2024-09-11T23:31:25.923 INFO:tasks.workunit.client.0.smithi005.stdout: [DEP] 2024-09-11T23:31:25.924 INFO:tasks.workunit.client.0.smithi005.stdout: [DEP] 2024-09-11T23:31:25.929 INFO:tasks.workunit.client.0.smithi005.stdout: [DEP] 2024-09-11T23:31:26.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:31:26 smithi159 ceph-mon[34394]: pgmap v425: 129 pgs: 129 active+clean; 116 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 617 KiB/s wr, 44 op/s 2024-09-11T23:31:26.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:31:26 smithi172 ceph-mon[34855]: pgmap v425: 129 pgs: 129 active+clean; 116 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 617 KiB/s wr, 44 op/s 2024-09-11T23:31:26.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:31:26 smithi005 ceph-mon[31201]: pgmap v425: 129 pgs: 129 active+clean; 116 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 617 KiB/s wr, 44 op/s 2024-09-11T23:31:26.581 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] dirstress 2024-09-11T23:31:26.581 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] fill 2024-09-11T23:31:26.582 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] fill2 2024-09-11T23:31:26.585 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] getpagesize 2024-09-11T23:31:26.843 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] holes 2024-09-11T23:31:26.872 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] lstat64 2024-09-11T23:31:26.997 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] nametest 2024-09-11T23:31:27.020 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] permname 2024-09-11T23:31:27.199 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] randholes 2024-09-11T23:31:27.213 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] runas 2024-09-11T23:31:27.391 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] truncfile 2024-09-11T23:31:27.431 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] usemem 2024-09-11T23:31:27.554 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] mmapcat 2024-09-11T23:31:27.638 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] append_reader 2024-09-11T23:31:27.720 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] append_writer 2024-09-11T23:31:27.730 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] dirperf 2024-09-11T23:31:27.825 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] metaperf 2024-09-11T23:31:27.931 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] devzero 2024-09-11T23:31:28.017 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] feature 2024-09-11T23:31:28.127 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] alloc 2024-09-11T23:31:28.273 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] fault 2024-09-11T23:31:28.286 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] fstest 2024-09-11T23:31:28.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:31:28 smithi159 ceph-mon[34394]: pgmap v426: 129 pgs: 129 active+clean; 118 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 815 KiB/s wr, 46 op/s 2024-09-11T23:31:28.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:31:28 smithi172 ceph-mon[34855]: pgmap v426: 129 pgs: 129 active+clean; 118 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 815 KiB/s wr, 46 op/s 2024-09-11T23:31:28.432 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] t_access_root 2024-09-11T23:31:28.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:31:28 smithi005 ceph-mon[31201]: pgmap v426: 129 pgs: 129 active+clean; 118 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 815 KiB/s wr, 46 op/s 2024-09-11T23:31:28.522 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] godown 2024-09-11T23:31:28.599 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] resvtest 2024-09-11T23:31:28.717 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] writemod 2024-09-11T23:31:29.350 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] writev_on_pagefault 2024-09-11T23:31:29.350 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] makeextents 2024-09-11T23:31:29.350 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] itrash 2024-09-11T23:31:29.350 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] rename 2024-09-11T23:31:29.351 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] multi_open_unlink 2024-09-11T23:31:29.351 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] unwritten_sync 2024-09-11T23:31:29.351 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] genhashnames 2024-09-11T23:31:29.351 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] t_holes 2024-09-11T23:31:29.351 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] t_mmap_writev 2024-09-11T23:31:29.534 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] t_truncate_cmtime 2024-09-11T23:31:29.552 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] dirhash_collide 2024-09-11T23:31:29.569 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] t_rename_overwrite 2024-09-11T23:31:29.602 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] holetest 2024-09-11T23:31:29.827 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] t_truncate_self 2024-09-11T23:31:29.840 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] af_unix 2024-09-11T23:31:29.876 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] t_mmap_stale_pmd 2024-09-11T23:31:29.998 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] t_mmap_cow_race 2024-09-11T23:31:30.079 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] t_mmap_fallocate 2024-09-11T23:31:30.133 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] fsync-err 2024-09-11T23:31:30.170 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] t_mmap_write_ro 2024-09-11T23:31:30.313 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] t_ext4_dax_journal_corruption 2024-09-11T23:31:30.362 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] t_ext4_dax_inline_corruption 2024-09-11T23:31:30.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:31:30 smithi159 ceph-mon[34394]: pgmap v427: 129 pgs: 129 active+clean; 118 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 605 KiB/s rd, 786 KiB/s wr, 39 op/s 2024-09-11T23:31:30.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:31:30 smithi172 ceph-mon[34855]: pgmap v427: 129 pgs: 129 active+clean; 118 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 605 KiB/s rd, 786 KiB/s wr, 39 op/s 2024-09-11T23:31:30.472 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] t_ofd_locks 2024-09-11T23:31:30.472 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] t_mmap_collision 2024-09-11T23:31:30.473 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:31:30 smithi005 ceph-mon[31201]: pgmap v427: 129 pgs: 129 active+clean; 118 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 605 KiB/s rd, 786 KiB/s wr, 39 op/s 2024-09-11T23:31:30.612 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] mmap-write-concurrent 2024-09-11T23:31:30.657 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] t_get_file_time 2024-09-11T23:31:30.831 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] t_create_short_dirs 2024-09-11T23:31:30.832 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] t_create_long_dirs 2024-09-11T23:31:30.915 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] t_enospc 2024-09-11T23:31:30.932 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] t_mmap_writev_overlap 2024-09-11T23:31:31.143 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] checkpoint_journal 2024-09-11T23:31:31.144 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] mmap-rw-fault 2024-09-11T23:31:31.246 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] allocstale 2024-09-11T23:31:31.266 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] t_mmap_cow_memory_failure 2024-09-11T23:31:31.440 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] fake-dump-rootino 2024-09-11T23:31:31.477 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] dio-buf-fault 2024-09-11T23:31:31.573 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] rewinddir-test 2024-09-11T23:31:31.587 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] readdir-while-renames 2024-09-11T23:31:31.723 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] xfsctl 2024-09-11T23:31:31.762 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] bstat 2024-09-11T23:31:31.885 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] t_mtab 2024-09-11T23:31:31.891 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] getdevicesize 2024-09-11T23:31:32.072 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] preallo_rw_pattern_reader 2024-09-11T23:31:32.143 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] preallo_rw_pattern_writer 2024-09-11T23:31:32.160 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] ftrunc 2024-09-11T23:31:32.233 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] trunc 2024-09-11T23:31:32.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:31:32 smithi159 ceph-mon[34394]: pgmap v428: 129 pgs: 129 active+clean; 119 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 781 KiB/s wr, 48 op/s 2024-09-11T23:31:32.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:31:32 smithi172 ceph-mon[34855]: pgmap v428: 129 pgs: 129 active+clean; 119 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 781 KiB/s wr, 48 op/s 2024-09-11T23:31:32.393 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] fs_perms 2024-09-11T23:31:32.444 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] testx 2024-09-11T23:31:32.461 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] looptest 2024-09-11T23:31:32.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:31:32 smithi005 ceph-mon[31201]: pgmap v428: 129 pgs: 129 active+clean; 119 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 781 KiB/s wr, 48 op/s 2024-09-11T23:31:32.537 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] locktest 2024-09-11T23:31:32.690 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] unwritten_mmap 2024-09-11T23:31:32.703 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] bulkstat_unlink_test 2024-09-11T23:31:32.804 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] deduperace 2024-09-11T23:31:33.004 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] bulkstat_unlink_test_modified 2024-09-11T23:31:33.049 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] t_dir_offset 2024-09-11T23:31:33.059 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] t_futimens 2024-09-11T23:31:33.153 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] t_immutable 2024-09-11T23:31:33.339 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] stale_handle 2024-09-11T23:31:33.340 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] pwrite_mmap_blocked 2024-09-11T23:31:33.366 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] t_dir_offset2 2024-09-11T23:31:33.629 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] seek_sanity_test 2024-09-11T23:31:33.666 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] seek_copy_test 2024-09-11T23:31:33.697 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] t_readdir_1 2024-09-11T23:31:33.960 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] t_readdir_2 2024-09-11T23:31:33.961 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] fsync-tester 2024-09-11T23:31:34.103 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] nsexec 2024-09-11T23:31:34.245 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] cloner 2024-09-11T23:31:34.306 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] renameat2 2024-09-11T23:31:34.365 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] t_getcwd 2024-09-11T23:31:34.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:31:34 smithi159 ceph-mon[34394]: pgmap v429: 129 pgs: 129 active+clean; 120 MiB data, 768 MiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 808 KiB/s wr, 75 op/s 2024-09-11T23:31:34.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:31:34 smithi172 ceph-mon[34855]: pgmap v429: 129 pgs: 129 active+clean; 120 MiB data, 768 MiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 808 KiB/s wr, 75 op/s 2024-09-11T23:31:34.433 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] e4compact 2024-09-11T23:31:34.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:31:34 smithi005 ceph-mon[31201]: pgmap v429: 129 pgs: 129 active+clean; 120 MiB data, 768 MiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 808 KiB/s wr, 75 op/s 2024-09-11T23:31:34.564 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] test-nextquota 2024-09-11T23:31:34.638 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] punch-alternating 2024-09-11T23:31:34.659 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] attr-list-by-handle-cursor-test 2024-09-11T23:31:34.807 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] listxattr 2024-09-11T23:31:34.899 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] dio-interleaved 2024-09-11T23:31:34.985 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] t_dir_type 2024-09-11T23:31:34.995 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] dio-invalidate-cache 2024-09-11T23:31:35.079 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] stat_test 2024-09-11T23:31:35.203 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] t_encrypted_d_revalidate 2024-09-11T23:31:35.283 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] attr_replace_test 2024-09-11T23:31:35.358 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] swapon 2024-09-11T23:31:35.509 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] mkswap 2024-09-11T23:31:35.571 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] t_attr_corruption 2024-09-11T23:31:35.580 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] t_open_tmpfiles 2024-09-11T23:31:35.663 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] fscrypt-crypt-util 2024-09-11T23:31:35.791 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] bulkstat_null_ocount 2024-09-11T23:31:35.865 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] splice-test 2024-09-11T23:31:35.934 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] chprojid_fail 2024-09-11T23:31:36.091 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] detached_mounts_propagation 2024-09-11T23:31:36.189 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] ext4_resize 2024-09-11T23:31:36.252 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] t_readdir_3 2024-09-11T23:31:36.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:31:36 smithi159 ceph-mon[34394]: pgmap v430: 129 pgs: 129 active+clean; 120 MiB data, 768 MiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 399 KiB/s wr, 79 op/s 2024-09-11T23:31:36.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:31:36 smithi172 ceph-mon[34855]: pgmap v430: 129 pgs: 129 active+clean; 120 MiB data, 768 MiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 399 KiB/s wr, 79 op/s 2024-09-11T23:31:36.436 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] splice2pipe 2024-09-11T23:31:36.458 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] uuid_ioctl 2024-09-11T23:31:36.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:31:36 smithi005 ceph-mon[31201]: pgmap v430: 129 pgs: 129 active+clean; 120 MiB data, 768 MiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 399 KiB/s wr, 79 op/s 2024-09-11T23:31:36.584 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] t_snapshot_deleted_subvolume 2024-09-11T23:31:36.643 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] fiemap-fault 2024-09-11T23:31:36.752 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] fiemap-tester 2024-09-11T23:31:36.753 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] t_stripealign 2024-09-11T23:31:36.923 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] open_by_handle 2024-09-11T23:31:36.942 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] t_mmap_dio 2024-09-11T23:31:37.041 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] xfsfind 2024-09-11T23:31:37.202 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] t_reflink_read_race 2024-09-11T23:31:37.228 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] fssum 2024-09-11T23:31:37.346 INFO:tasks.workunit.client.0.smithi005.stdout:Building log-writes 2024-09-11T23:31:37.380 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] replay-log 2024-09-11T23:31:37.407 INFO:tasks.workunit.client.0.smithi005.stdout:Building perf 2024-09-11T23:31:37.428 INFO:tasks.workunit.client.0.smithi005.stdout:Building aio-dio-regress 2024-09-11T23:31:37.469 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] aiocp 2024-09-11T23:31:37.565 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] aio-dio-append-write-fallocate-race 2024-09-11T23:31:37.827 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] aio-dio-append-write-read-race 2024-09-11T23:31:37.839 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] aio-dio-cow-race 2024-09-11T23:31:37.904 INFO:tasks.workunit.client.0.smithi005.stdout:Building vfs 2024-09-11T23:31:37.920 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] aio-dio-cycle-write 2024-09-11T23:31:37.956 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] vfstest 2024-09-11T23:31:38.126 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] mount-idmapped 2024-09-11T23:31:38.155 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] aio-dio-eof-race 2024-09-11T23:31:38.244 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] aio-dio-extend-stat 2024-09-11T23:31:38.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:31:38 smithi159 ceph-mon[34394]: pgmap v431: 129 pgs: 129 active+clean; 121 MiB data, 770 MiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 497 KiB/s wr, 123 op/s 2024-09-11T23:31:38.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:31:38 smithi172 ceph-mon[34855]: pgmap v431: 129 pgs: 129 active+clean; 121 MiB data, 770 MiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 497 KiB/s wr, 123 op/s 2024-09-11T23:31:38.457 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] aio-dio-fcntl-race 2024-09-11T23:31:38.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:31:38 smithi005 ceph-mon[31201]: pgmap v431: 129 pgs: 129 active+clean; 121 MiB data, 770 MiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 497 KiB/s wr, 123 op/s 2024-09-11T23:31:38.534 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] aio-dio-hole-filling-race 2024-09-11T23:31:38.748 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] aio-dio-invalidate-failure 2024-09-11T23:31:38.780 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] aio-dio-invalidate-readahead 2024-09-11T23:31:38.794 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] aiodio_sparse2 2024-09-11T23:31:39.031 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] aio-dio-subblock-eof-read 2024-09-11T23:31:39.092 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] aio-dio-write-verify 2024-09-11T23:31:39.165 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2024-09-11T23:31:39.283 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2024-09-11T23:31:39.410 INFO:tasks.workunit.client.0.smithi005.stdout: [CC] aio-last-ref-held-by-io 2024-09-11T23:31:40.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:31:40 smithi159 ceph-mon[34394]: pgmap v432: 129 pgs: 129 active+clean; 122 MiB data, 771 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 341 KiB/s wr, 125 op/s 2024-09-11T23:31:40.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:31:40 smithi172 ceph-mon[34855]: pgmap v432: 129 pgs: 129 active+clean; 122 MiB data, 771 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 341 KiB/s wr, 125 op/s 2024-09-11T23:31:40.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:31:40 smithi005 ceph-mon[31201]: pgmap v432: 129 pgs: 129 active+clean; 122 MiB data, 771 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 341 KiB/s wr, 125 op/s 2024-09-11T23:31:40.518 INFO:tasks.workunit.client.0.smithi005.stderr:+ cd .. 2024-09-11T23:31:40.519 INFO:tasks.workunit.client.0.smithi005.stderr:+ cp xfstests-dev/ltp/fsx . 2024-09-11T23:31:40.525 INFO:tasks.workunit.client.0.smithi005.stderr:+ OPTIONS=-z 2024-09-11T23:31:40.525 INFO:tasks.workunit.client.0.smithi005.stderr:+ ./fsx -z 1MB -N 50000 -p 10000 -l 1048576 2024-09-11T23:31:40.525 INFO:tasks.workunit.client.0.smithi005.stdout:Seed set to 1 2024-09-11T23:31:40.560 INFO:tasks.workunit.client.0.smithi005.stderr:main: filesystem does not support fallocate mode FALLOC_FL_COLLAPSE_RANGE, disabling! 2024-09-11T23:31:40.560 INFO:tasks.workunit.client.0.smithi005.stderr:main: filesystem does not support fallocate mode FALLOC_FL_INSERT_RANGE, disabling! 2024-09-11T23:31:40.560 INFO:tasks.workunit.client.0.smithi005.stderr:main: filesystem does not support clone range, disabling! 2024-09-11T23:31:40.560 INFO:tasks.workunit.client.0.smithi005.stderr:main: filesystem does not support dedupe range, disabling! 2024-09-11T23:31:40.564 INFO:tasks.workunit.client.0.smithi005.stdout:skipping zero size read 2024-09-11T23:31:40.565 INFO:tasks.workunit.client.0.smithi005.stdout:skipping zero size read 2024-09-11T23:31:40.565 INFO:tasks.workunit.client.0.smithi005.stdout:fallocating to largest ever: 0x9abd6 2024-09-11T23:31:40.609 INFO:tasks.workunit.client.0.smithi005.stdout:truncating to largest ever: 0xaeaec 2024-09-11T23:31:40.643 INFO:tasks.workunit.client.0.smithi005.stdout:truncating to largest ever: 0xf3194 2024-09-11T23:31:40.686 INFO:tasks.workunit.client.0.smithi005.stdout:copying to largest ever: 0xf3ceb 2024-09-11T23:31:40.859 INFO:tasks.workunit.client.0.smithi005.stdout:copying to largest ever: 0xfaccc 2024-09-11T23:31:40.865 INFO:tasks.workunit.client.0.smithi005.stdout:fallocating to largest ever: 0xfbb6d 2024-09-11T23:31:41.273 INFO:tasks.workunit.client.0.smithi005.stdout:fallocating to largest ever: 0xffee7 2024-09-11T23:31:42.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:31:42 smithi159 ceph-mon[34394]: pgmap v433: 129 pgs: 129 active+clean; 122 MiB data, 772 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 357 KiB/s wr, 140 op/s 2024-09-11T23:31:42.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:31:42 smithi172 ceph-mon[34855]: pgmap v433: 129 pgs: 129 active+clean; 122 MiB data, 772 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 357 KiB/s wr, 140 op/s 2024-09-11T23:31:42.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:31:42 smithi005 ceph-mon[31201]: pgmap v433: 129 pgs: 129 active+clean; 122 MiB data, 772 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 357 KiB/s wr, 140 op/s 2024-09-11T23:31:44.184 INFO:tasks.workunit.client.0.smithi005.stdout:fallocating to largest ever: 0x100000 2024-09-11T23:31:44.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:31:44 smithi159 ceph-mon[34394]: pgmap v434: 129 pgs: 129 active+clean; 124 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 602 KiB/s wr, 186 op/s 2024-09-11T23:31:44.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:31:44 smithi172 ceph-mon[34855]: pgmap v434: 129 pgs: 129 active+clean; 124 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 602 KiB/s wr, 186 op/s 2024-09-11T23:31:44.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:31:44 smithi005 ceph-mon[31201]: pgmap v434: 129 pgs: 129 active+clean; 124 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 602 KiB/s wr, 186 op/s 2024-09-11T23:31:46.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:31:46 smithi159 ceph-mon[34394]: pgmap v435: 129 pgs: 129 active+clean; 125 MiB data, 787 MiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 604 KiB/s wr, 163 op/s 2024-09-11T23:31:46.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:31:46 smithi172 ceph-mon[34855]: pgmap v435: 129 pgs: 129 active+clean; 125 MiB data, 787 MiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 604 KiB/s wr, 163 op/s 2024-09-11T23:31:46.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:31:46 smithi005 ceph-mon[31201]: pgmap v435: 129 pgs: 129 active+clean; 125 MiB data, 787 MiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 604 KiB/s wr, 163 op/s 2024-09-11T23:31:48.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:31:48 smithi159 ceph-mon[34394]: pgmap v436: 129 pgs: 129 active+clean; 126 MiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 344 op/s 2024-09-11T23:31:48.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:31:48 smithi172 ceph-mon[34855]: pgmap v436: 129 pgs: 129 active+clean; 126 MiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 344 op/s 2024-09-11T23:31:48.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:31:48 smithi005 ceph-mon[31201]: pgmap v436: 129 pgs: 129 active+clean; 126 MiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 344 op/s 2024-09-11T23:31:49.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:31:49 smithi005 ceph-mon[31201]: pgmap v437: 129 pgs: 129 active+clean; 127 MiB data, 813 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 361 op/s 2024-09-11T23:31:49.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:31:49 smithi159 ceph-mon[34394]: pgmap v437: 129 pgs: 129 active+clean; 127 MiB data, 813 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 361 op/s 2024-09-11T23:31:49.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:31:49 smithi172 ceph-mon[34855]: pgmap v437: 129 pgs: 129 active+clean; 127 MiB data, 813 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 361 op/s 2024-09-11T23:31:51.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:31:51 smithi159 ceph-mon[34394]: pgmap v438: 129 pgs: 129 active+clean; 127 MiB data, 825 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 350 op/s 2024-09-11T23:31:51.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:31:51 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:31:51.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:31:51 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:31:51.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:31:51 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:31:51.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:31:51 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:31:51.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:31:51 smithi172 ceph-mon[34855]: pgmap v438: 129 pgs: 129 active+clean; 127 MiB data, 825 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 350 op/s 2024-09-11T23:31:51.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:31:51 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:31:51.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:31:51 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:31:51.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:31:51 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:31:51.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:31:51 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:31:51.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:31:51 smithi005 ceph-mon[31201]: pgmap v438: 129 pgs: 129 active+clean; 127 MiB data, 825 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 350 op/s 2024-09-11T23:31:51.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:31:51 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:31:51.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:31:51 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:31:51.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:31:51 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:31:51.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:31:51 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:31:52.178 INFO:tasks.workunit.client.0.smithi005.stdout:10000 punch from 0x713e to 0x9907, (0x27c9 bytes) 2024-09-11T23:31:53.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:31:53 smithi159 ceph-mon[34394]: pgmap v439: 129 pgs: 129 active+clean; 129 MiB data, 863 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 4.4 MiB/s wr, 577 op/s 2024-09-11T23:31:53.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:31:53 smithi172 ceph-mon[34855]: pgmap v439: 129 pgs: 129 active+clean; 129 MiB data, 863 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 4.4 MiB/s wr, 577 op/s 2024-09-11T23:31:53.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:31:53 smithi005 ceph-mon[31201]: pgmap v439: 129 pgs: 129 active+clean; 129 MiB data, 863 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 4.4 MiB/s wr, 577 op/s 2024-09-11T23:31:55.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:31:55 smithi159 ceph-mon[34394]: pgmap v440: 129 pgs: 129 active+clean; 129 MiB data, 871 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 4.1 MiB/s wr, 519 op/s 2024-09-11T23:31:55.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:31:55 smithi172 ceph-mon[34855]: pgmap v440: 129 pgs: 129 active+clean; 129 MiB data, 871 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 4.1 MiB/s wr, 519 op/s 2024-09-11T23:31:55.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:31:55 smithi005 ceph-mon[31201]: pgmap v440: 129 pgs: 129 active+clean; 129 MiB data, 871 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 4.1 MiB/s wr, 519 op/s 2024-09-11T23:31:57.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:31:57 smithi159 ceph-mon[34394]: pgmap v441: 129 pgs: 129 active+clean; 129 MiB data, 845 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 5.8 MiB/s wr, 700 op/s 2024-09-11T23:31:57.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:31:57 smithi172 ceph-mon[34855]: pgmap v441: 129 pgs: 129 active+clean; 129 MiB data, 845 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 5.8 MiB/s wr, 700 op/s 2024-09-11T23:31:57.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:31:57 smithi005 ceph-mon[31201]: pgmap v441: 129 pgs: 129 active+clean; 129 MiB data, 845 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 5.8 MiB/s wr, 700 op/s 2024-09-11T23:31:59.525 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:31:59 smithi005 ceph-mon[31201]: pgmap v442: 129 pgs: 129 active+clean; 130 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.0 MiB/s wr, 563 op/s 2024-09-11T23:31:59.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:31:59 smithi159 ceph-mon[34394]: pgmap v442: 129 pgs: 129 active+clean; 130 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.0 MiB/s wr, 563 op/s 2024-09-11T23:31:59.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:31:59 smithi172 ceph-mon[34855]: pgmap v442: 129 pgs: 129 active+clean; 130 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.0 MiB/s wr, 563 op/s 2024-09-11T23:32:01.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:32:01 smithi159 ceph-mon[34394]: pgmap v443: 129 pgs: 129 active+clean; 130 MiB data, 850 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 3.8 MiB/s wr, 498 op/s 2024-09-11T23:32:01.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:32:01 smithi172 ceph-mon[34855]: pgmap v443: 129 pgs: 129 active+clean; 130 MiB data, 850 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 3.8 MiB/s wr, 498 op/s 2024-09-11T23:32:01.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:32:01 smithi005 ceph-mon[31201]: pgmap v443: 129 pgs: 129 active+clean; 130 MiB data, 850 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 3.8 MiB/s wr, 498 op/s 2024-09-11T23:32:03.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:32:03 smithi159 ceph-mon[34394]: pgmap v444: 129 pgs: 129 active+clean; 131 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 5.5 MiB/s wr, 728 op/s 2024-09-11T23:32:03.640 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:32:03 smithi172 ceph-mon[34855]: pgmap v444: 129 pgs: 129 active+clean; 131 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 5.5 MiB/s wr, 728 op/s 2024-09-11T23:32:03.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:32:03 smithi005 ceph-mon[31201]: pgmap v444: 129 pgs: 129 active+clean; 131 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 5.5 MiB/s wr, 728 op/s 2024-09-11T23:32:04.789 INFO:tasks.workunit.client.0.smithi005.stdout:20000 punch from 0x9116f to 0x978af, (0x6740 bytes) 2024-09-11T23:32:05.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:32:05 smithi159 ceph-mon[34394]: pgmap v445: 129 pgs: 129 active+clean; 131 MiB data, 846 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 3.5 MiB/s wr, 482 op/s 2024-09-11T23:32:05.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:32:05 smithi172 ceph-mon[34855]: pgmap v445: 129 pgs: 129 active+clean; 131 MiB data, 846 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 3.5 MiB/s wr, 482 op/s 2024-09-11T23:32:05.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:32:05 smithi005 ceph-mon[31201]: pgmap v445: 129 pgs: 129 active+clean; 131 MiB data, 846 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 3.5 MiB/s wr, 482 op/s 2024-09-11T23:32:07.632 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:32:07 smithi159 ceph-mon[34394]: pgmap v446: 129 pgs: 129 active+clean; 131 MiB data, 870 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 5.1 MiB/s wr, 647 op/s 2024-09-11T23:32:07.650 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:32:07 smithi172 ceph-mon[34855]: pgmap v446: 129 pgs: 129 active+clean; 131 MiB data, 870 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 5.1 MiB/s wr, 647 op/s 2024-09-11T23:32:07.725 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:32:07 smithi005 ceph-mon[31201]: pgmap v446: 129 pgs: 129 active+clean; 131 MiB data, 870 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 5.1 MiB/s wr, 647 op/s 2024-09-11T23:32:09.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:32:09 smithi159 ceph-mon[34394]: pgmap v447: 129 pgs: 129 active+clean; 133 MiB data, 893 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.5 MiB/s wr, 511 op/s 2024-09-11T23:32:09.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:32:09 smithi172 ceph-mon[34855]: pgmap v447: 129 pgs: 129 active+clean; 133 MiB data, 893 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.5 MiB/s wr, 511 op/s 2024-09-11T23:32:09.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:32:09 smithi005 ceph-mon[31201]: pgmap v447: 129 pgs: 129 active+clean; 133 MiB data, 893 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.5 MiB/s wr, 511 op/s 2024-09-11T23:32:11.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:32:11 smithi159 ceph-mon[34394]: pgmap v448: 129 pgs: 129 active+clean; 133 MiB data, 930 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.4 MiB/s wr, 478 op/s 2024-09-11T23:32:11.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:32:11 smithi172 ceph-mon[34855]: pgmap v448: 129 pgs: 129 active+clean; 133 MiB data, 930 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.4 MiB/s wr, 478 op/s 2024-09-11T23:32:11.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:32:11 smithi005 ceph-mon[31201]: pgmap v448: 129 pgs: 129 active+clean; 133 MiB data, 930 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.4 MiB/s wr, 478 op/s 2024-09-11T23:32:13.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:32:13 smithi159 ceph-mon[34394]: pgmap v449: 129 pgs: 129 active+clean; 133 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 5.0 MiB/s wr, 641 op/s 2024-09-11T23:32:13.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:32:13 smithi172 ceph-mon[34855]: pgmap v449: 129 pgs: 129 active+clean; 133 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 5.0 MiB/s wr, 641 op/s 2024-09-11T23:32:13.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:32:13 smithi005 ceph-mon[31201]: pgmap v449: 129 pgs: 129 active+clean; 133 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 5.0 MiB/s wr, 641 op/s 2024-09-11T23:32:15.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:32:15 smithi159 ceph-mon[34394]: pgmap v450: 129 pgs: 129 active+clean; 133 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.4 MiB/s wr, 412 op/s 2024-09-11T23:32:15.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:32:15 smithi172 ceph-mon[34855]: pgmap v450: 129 pgs: 129 active+clean; 133 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.4 MiB/s wr, 412 op/s 2024-09-11T23:32:15.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:32:15 smithi005 ceph-mon[31201]: pgmap v450: 129 pgs: 129 active+clean; 133 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.4 MiB/s wr, 412 op/s 2024-09-11T23:32:17.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:32:17 smithi159 ceph-mon[34394]: pgmap v451: 129 pgs: 129 active+clean; 134 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 5.0 MiB/s wr, 611 op/s 2024-09-11T23:32:17.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:32:17 smithi172 ceph-mon[34855]: pgmap v451: 129 pgs: 129 active+clean; 134 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 5.0 MiB/s wr, 611 op/s 2024-09-11T23:32:17.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:32:17 smithi005 ceph-mon[31201]: pgmap v451: 129 pgs: 129 active+clean; 134 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 5.0 MiB/s wr, 611 op/s 2024-09-11T23:32:19.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:32:19 smithi159 ceph-mon[34394]: pgmap v452: 129 pgs: 129 active+clean; 134 MiB data, 1006 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.4 MiB/s wr, 446 op/s 2024-09-11T23:32:19.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:32:19 smithi172 ceph-mon[34855]: pgmap v452: 129 pgs: 129 active+clean; 134 MiB data, 1006 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.4 MiB/s wr, 446 op/s 2024-09-11T23:32:19.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:32:19 smithi005 ceph-mon[31201]: pgmap v452: 129 pgs: 129 active+clean; 134 MiB data, 1006 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.4 MiB/s wr, 446 op/s 2024-09-11T23:32:21.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:32:21 smithi159 ceph-mon[34394]: pgmap v453: 129 pgs: 129 active+clean; 135 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.4 MiB/s wr, 435 op/s 2024-09-11T23:32:21.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:32:21 smithi172 ceph-mon[34855]: pgmap v453: 129 pgs: 129 active+clean; 135 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.4 MiB/s wr, 435 op/s 2024-09-11T23:32:21.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:32:21 smithi005 ceph-mon[31201]: pgmap v453: 129 pgs: 129 active+clean; 135 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.4 MiB/s wr, 435 op/s 2024-09-11T23:32:23.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:32:23 smithi159 ceph-mon[34394]: pgmap v454: 129 pgs: 129 active+clean; 135 MiB data, 1008 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 4.9 MiB/s wr, 552 op/s 2024-09-11T23:32:23.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:32:23 smithi172 ceph-mon[34855]: pgmap v454: 129 pgs: 129 active+clean; 135 MiB data, 1008 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 4.9 MiB/s wr, 552 op/s 2024-09-11T23:32:23.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:32:23 smithi005 ceph-mon[31201]: pgmap v454: 129 pgs: 129 active+clean; 135 MiB data, 1008 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 4.9 MiB/s wr, 552 op/s 2024-09-11T23:32:25.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:32:25 smithi159 ceph-mon[34394]: pgmap v455: 129 pgs: 129 active+clean; 135 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.2 MiB/s wr, 390 op/s 2024-09-11T23:32:25.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:32:25 smithi172 ceph-mon[34855]: pgmap v455: 129 pgs: 129 active+clean; 135 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.2 MiB/s wr, 390 op/s 2024-09-11T23:32:25.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:32:25 smithi005 ceph-mon[31201]: pgmap v455: 129 pgs: 129 active+clean; 135 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.2 MiB/s wr, 390 op/s 2024-09-11T23:32:27.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:32:27 smithi159 ceph-mon[34394]: pgmap v456: 129 pgs: 129 active+clean; 137 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 4.5 MiB/s wr, 566 op/s 2024-09-11T23:32:27.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:32:27 smithi172 ceph-mon[34855]: pgmap v456: 129 pgs: 129 active+clean; 137 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 4.5 MiB/s wr, 566 op/s 2024-09-11T23:32:27.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:32:27 smithi005 ceph-mon[31201]: pgmap v456: 129 pgs: 129 active+clean; 137 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 4.5 MiB/s wr, 566 op/s 2024-09-11T23:32:29.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:32:29 smithi159 ceph-mon[34394]: pgmap v457: 129 pgs: 129 active+clean; 137 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.9 MiB/s wr, 367 op/s 2024-09-11T23:32:29.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:32:29 smithi172 ceph-mon[34855]: pgmap v457: 129 pgs: 129 active+clean; 137 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.9 MiB/s wr, 367 op/s 2024-09-11T23:32:29.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:32:29 smithi005 ceph-mon[31201]: pgmap v457: 129 pgs: 129 active+clean; 137 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.9 MiB/s wr, 367 op/s 2024-09-11T23:32:31.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:32:31 smithi159 ceph-mon[34394]: pgmap v458: 129 pgs: 129 active+clean; 137 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.9 MiB/s wr, 370 op/s 2024-09-11T23:32:31.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:32:31 smithi172 ceph-mon[34855]: pgmap v458: 129 pgs: 129 active+clean; 137 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.9 MiB/s wr, 370 op/s 2024-09-11T23:32:31.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:32:31 smithi005 ceph-mon[31201]: pgmap v458: 129 pgs: 129 active+clean; 137 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.9 MiB/s wr, 370 op/s 2024-09-11T23:32:33.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:32:33 smithi159 ceph-mon[34394]: pgmap v459: 129 pgs: 129 active+clean; 137 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 4.2 MiB/s wr, 498 op/s 2024-09-11T23:32:33.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:32:33 smithi172 ceph-mon[34855]: pgmap v459: 129 pgs: 129 active+clean; 137 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 4.2 MiB/s wr, 498 op/s 2024-09-11T23:32:33.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:32:33 smithi005 ceph-mon[31201]: pgmap v459: 129 pgs: 129 active+clean; 137 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 4.2 MiB/s wr, 498 op/s 2024-09-11T23:32:35.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:32:35 smithi159 ceph-mon[34394]: pgmap v460: 129 pgs: 129 active+clean; 137 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 2.7 MiB/s wr, 355 op/s 2024-09-11T23:32:35.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:32:35 smithi172 ceph-mon[34855]: pgmap v460: 129 pgs: 129 active+clean; 137 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 2.7 MiB/s wr, 355 op/s 2024-09-11T23:32:35.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:32:35 smithi005 ceph-mon[31201]: pgmap v460: 129 pgs: 129 active+clean; 137 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 2.7 MiB/s wr, 355 op/s 2024-09-11T23:32:37.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:32:37 smithi159 ceph-mon[34394]: pgmap v461: 129 pgs: 129 active+clean; 138 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 3.9 MiB/s wr, 513 op/s 2024-09-11T23:32:37.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:32:37 smithi172 ceph-mon[34855]: pgmap v461: 129 pgs: 129 active+clean; 138 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 3.9 MiB/s wr, 513 op/s 2024-09-11T23:32:37.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:32:37 smithi005 ceph-mon[31201]: pgmap v461: 129 pgs: 129 active+clean; 138 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 3.9 MiB/s wr, 513 op/s 2024-09-11T23:32:39.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:32:39 smithi159 ceph-mon[34394]: pgmap v462: 129 pgs: 129 active+clean; 138 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.6 MiB/s wr, 337 op/s 2024-09-11T23:32:39.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:32:39 smithi172 ceph-mon[34855]: pgmap v462: 129 pgs: 129 active+clean; 138 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.6 MiB/s wr, 337 op/s 2024-09-11T23:32:39.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:32:39 smithi005 ceph-mon[31201]: pgmap v462: 129 pgs: 129 active+clean; 138 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.6 MiB/s wr, 337 op/s 2024-09-11T23:32:41.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:32:41 smithi159 ceph-mon[34394]: pgmap v463: 129 pgs: 129 active+clean; 138 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.6 MiB/s wr, 336 op/s 2024-09-11T23:32:41.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:32:41 smithi172 ceph-mon[34855]: pgmap v463: 129 pgs: 129 active+clean; 138 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.6 MiB/s wr, 336 op/s 2024-09-11T23:32:41.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:32:41 smithi005 ceph-mon[31201]: pgmap v463: 129 pgs: 129 active+clean; 138 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.6 MiB/s wr, 336 op/s 2024-09-11T23:32:43.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:32:43 smithi159 ceph-mon[34394]: pgmap v464: 129 pgs: 129 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 3.8 MiB/s wr, 491 op/s 2024-09-11T23:32:43.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:32:43 smithi172 ceph-mon[34855]: pgmap v464: 129 pgs: 129 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 3.8 MiB/s wr, 491 op/s 2024-09-11T23:32:43.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:32:43 smithi005 ceph-mon[31201]: pgmap v464: 129 pgs: 129 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 3.8 MiB/s wr, 491 op/s 2024-09-11T23:32:45.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:32:45 smithi159 ceph-mon[34394]: pgmap v465: 129 pgs: 129 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.4 MiB/s wr, 320 op/s 2024-09-11T23:32:45.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:32:45 smithi172 ceph-mon[34855]: pgmap v465: 129 pgs: 129 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.4 MiB/s wr, 320 op/s 2024-09-11T23:32:45.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:32:45 smithi005 ceph-mon[31201]: pgmap v465: 129 pgs: 129 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.4 MiB/s wr, 320 op/s 2024-09-11T23:32:47.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:32:47 smithi159 ceph-mon[34394]: pgmap v466: 129 pgs: 129 active+clean; 140 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 3.6 MiB/s wr, 476 op/s 2024-09-11T23:32:47.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:32:47 smithi172 ceph-mon[34855]: pgmap v466: 129 pgs: 129 active+clean; 140 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 3.6 MiB/s wr, 476 op/s 2024-09-11T23:32:47.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:32:47 smithi005 ceph-mon[31201]: pgmap v466: 129 pgs: 129 active+clean; 140 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 3.6 MiB/s wr, 476 op/s 2024-09-11T23:32:49.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:32:49 smithi159 ceph-mon[34394]: pgmap v467: 129 pgs: 129 active+clean; 140 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.4 MiB/s wr, 319 op/s 2024-09-11T23:32:49.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:32:49 smithi172 ceph-mon[34855]: pgmap v467: 129 pgs: 129 active+clean; 140 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.4 MiB/s wr, 319 op/s 2024-09-11T23:32:49.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:32:49 smithi005 ceph-mon[31201]: pgmap v467: 129 pgs: 129 active+clean; 140 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.4 MiB/s wr, 319 op/s 2024-09-11T23:32:51.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:32:51 smithi159 ceph-mon[34394]: pgmap v468: 129 pgs: 129 active+clean; 140 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.4 MiB/s wr, 318 op/s 2024-09-11T23:32:51.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:32:51 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:32:51.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:32:51 smithi172 ceph-mon[34855]: pgmap v468: 129 pgs: 129 active+clean; 140 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.4 MiB/s wr, 318 op/s 2024-09-11T23:32:51.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:32:51 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:32:51.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:32:51 smithi005 ceph-mon[31201]: pgmap v468: 129 pgs: 129 active+clean; 140 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.4 MiB/s wr, 318 op/s 2024-09-11T23:32:51.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:32:51 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:32:52.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:32:52 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:32:52.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:32:52 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:32:52.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:32:52 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:32:52.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:32:52 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:32:52.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:32:52 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:32:52.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:32:52 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:32:52.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:32:52 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:32:52.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:32:52 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:32:52.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:32:52 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:32:53.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:32:53 smithi159 ceph-mon[34394]: pgmap v469: 129 pgs: 129 active+clean; 141 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.6 MiB/s wr, 476 op/s 2024-09-11T23:32:53.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:32:53 smithi172 ceph-mon[34855]: pgmap v469: 129 pgs: 129 active+clean; 141 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.6 MiB/s wr, 476 op/s 2024-09-11T23:32:53.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:32:53 smithi005 ceph-mon[31201]: pgmap v469: 129 pgs: 129 active+clean; 141 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.6 MiB/s wr, 476 op/s 2024-09-11T23:32:55.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:32:55 smithi159 ceph-mon[34394]: pgmap v470: 129 pgs: 129 active+clean; 141 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.4 MiB/s wr, 318 op/s 2024-09-11T23:32:55.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:32:55 smithi172 ceph-mon[34855]: pgmap v470: 129 pgs: 129 active+clean; 141 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.4 MiB/s wr, 318 op/s 2024-09-11T23:32:55.937 INFO:tasks.workunit.client.0.smithi005.stdout:50000 write 0x39280 thru 0x48ee3 (0xfc64 bytes) 2024-09-11T23:32:55.937 INFO:tasks.workunit.client.0.smithi005.stdout:All 50000 operations completed A-OK! 2024-09-11T23:32:55.937 INFO:tasks.workunit.client.0.smithi005.stderr:+ ./fsx -z 10MB -N 50000 -p 10000 -l 10485760 2024-09-11T23:32:55.938 INFO:tasks.workunit.client.0.smithi005.stdout:Seed set to 1 2024-09-11T23:32:55.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:32:55 smithi005 ceph-mon[31201]: pgmap v470: 129 pgs: 129 active+clean; 141 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.4 MiB/s wr, 318 op/s 2024-09-11T23:32:56.074 INFO:tasks.workunit.client.0.smithi005.stderr:main: filesystem does not support fallocate mode FALLOC_FL_COLLAPSE_RANGE, disabling! 2024-09-11T23:32:56.075 INFO:tasks.workunit.client.0.smithi005.stderr:main: filesystem does not support fallocate mode FALLOC_FL_INSERT_RANGE, disabling! 2024-09-11T23:32:56.075 INFO:tasks.workunit.client.0.smithi005.stderr:main: filesystem does not support clone range, disabling! 2024-09-11T23:32:56.075 INFO:tasks.workunit.client.0.smithi005.stderr:main: filesystem does not support dedupe range, disabling! 2024-09-11T23:32:56.077 INFO:tasks.workunit.client.0.smithi005.stdout:skipping zero length punch hole 2024-09-11T23:32:56.079 INFO:tasks.workunit.client.0.smithi005.stdout:truncating to largest ever: 0x81c806 2024-09-11T23:32:56.179 INFO:tasks.workunit.client.0.smithi005.stdout:truncating to largest ever: 0x9bc582 2024-09-11T23:32:56.198 INFO:tasks.workunit.client.0.smithi005.stdout:truncating to largest ever: 0x9eecbc 2024-09-11T23:32:57.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:32:57 smithi159 ceph-mon[34394]: pgmap v471: 129 pgs: 129 active+clean; 142 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.6 MiB/s wr, 469 op/s 2024-09-11T23:32:57.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:32:57 smithi172 ceph-mon[34855]: pgmap v471: 129 pgs: 129 active+clean; 142 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.6 MiB/s wr, 469 op/s 2024-09-11T23:32:57.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:32:57 smithi005 ceph-mon[31201]: pgmap v471: 129 pgs: 129 active+clean; 142 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.6 MiB/s wr, 469 op/s 2024-09-11T23:32:58.279 INFO:tasks.workunit.client.0.smithi005.stdout:fallocating to largest ever: 0x9f2a70 2024-09-11T23:32:59.775 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:32:59 smithi005 ceph-mon[31201]: pgmap v472: 129 pgs: 129 active+clean; 145 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.7 MiB/s wr, 339 op/s 2024-09-11T23:32:59.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:32:59 smithi159 ceph-mon[34394]: pgmap v472: 129 pgs: 129 active+clean; 145 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.7 MiB/s wr, 339 op/s 2024-09-11T23:32:59.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:32:59 smithi172 ceph-mon[34855]: pgmap v472: 129 pgs: 129 active+clean; 145 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.7 MiB/s wr, 339 op/s 2024-09-11T23:33:00.161 INFO:tasks.workunit.client.0.smithi005.stdout:copying to largest ever: 0x9fdd84 2024-09-11T23:33:01.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:33:01 smithi159 ceph-mon[34394]: pgmap v473: 129 pgs: 129 active+clean; 145 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.7 MiB/s wr, 338 op/s 2024-09-11T23:33:01.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:33:01 smithi172 ceph-mon[34855]: pgmap v473: 129 pgs: 129 active+clean; 145 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.7 MiB/s wr, 338 op/s 2024-09-11T23:33:01.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:33:01 smithi005 ceph-mon[31201]: pgmap v473: 129 pgs: 129 active+clean; 145 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.7 MiB/s wr, 338 op/s 2024-09-11T23:33:03.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:33:03 smithi159 ceph-mon[34394]: pgmap v474: 129 pgs: 129 active+clean; 147 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 3.8 MiB/s wr, 517 op/s 2024-09-11T23:33:03.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:33:03 smithi172 ceph-mon[34855]: pgmap v474: 129 pgs: 129 active+clean; 147 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 3.8 MiB/s wr, 517 op/s 2024-09-11T23:33:03.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:33:03 smithi005 ceph-mon[31201]: pgmap v474: 129 pgs: 129 active+clean; 147 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 3.8 MiB/s wr, 517 op/s 2024-09-11T23:33:05.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:33:05 smithi159 ceph-mon[34394]: pgmap v475: 129 pgs: 129 active+clean; 147 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 3.3 MiB/s wr, 458 op/s 2024-09-11T23:33:05.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:33:05 smithi172 ceph-mon[34855]: pgmap v475: 129 pgs: 129 active+clean; 147 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 3.3 MiB/s wr, 458 op/s 2024-09-11T23:33:05.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:33:05 smithi005 ceph-mon[31201]: pgmap v475: 129 pgs: 129 active+clean; 147 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 3.3 MiB/s wr, 458 op/s 2024-09-11T23:33:07.392 INFO:tasks.workunit.client.0.smithi005.stdout:truncating to largest ever: 0x9ff7e4 2024-09-11T23:33:07.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:33:07 smithi159 ceph-mon[34394]: pgmap v476: 129 pgs: 129 active+clean; 152 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 4.4 MiB/s wr, 640 op/s 2024-09-11T23:33:07.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:33:07 smithi172 ceph-mon[34855]: pgmap v476: 129 pgs: 129 active+clean; 152 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 4.4 MiB/s wr, 640 op/s 2024-09-11T23:33:07.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:33:07 smithi005 ceph-mon[31201]: pgmap v476: 129 pgs: 129 active+clean; 152 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 4.4 MiB/s wr, 640 op/s 2024-09-11T23:33:08.770 INFO:tasks.workunit.client.0.smithi005.stdout:10000 write 0x723fbd thru 0x733aaa (0xfaee bytes) 2024-09-11T23:33:09.564 INFO:tasks.workunit.client.0.smithi005.stdout:fallocating to largest ever: 0xa00000 2024-09-11T23:33:09.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:33:09 smithi159 ceph-mon[34394]: pgmap v477: 129 pgs: 129 active+clean; 152 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.0 MiB/s wr, 589 op/s 2024-09-11T23:33:09.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:33:09 smithi172 ceph-mon[34855]: pgmap v477: 129 pgs: 129 active+clean; 152 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.0 MiB/s wr, 589 op/s 2024-09-11T23:33:09.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:33:09 smithi005 ceph-mon[31201]: pgmap v477: 129 pgs: 129 active+clean; 152 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.0 MiB/s wr, 589 op/s 2024-09-11T23:33:11.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:33:11 smithi159 ceph-mon[34394]: pgmap v478: 129 pgs: 129 active+clean; 152 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 3.8 MiB/s wr, 562 op/s 2024-09-11T23:33:11.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:33:11 smithi172 ceph-mon[34855]: pgmap v478: 129 pgs: 129 active+clean; 152 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 3.8 MiB/s wr, 562 op/s 2024-09-11T23:33:11.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:33:11 smithi005 ceph-mon[31201]: pgmap v478: 129 pgs: 129 active+clean; 152 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 3.8 MiB/s wr, 562 op/s 2024-09-11T23:33:13.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:33:13 smithi159 ceph-mon[34394]: pgmap v479: 129 pgs: 129 active+clean; 154 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 4.9 MiB/s wr, 738 op/s 2024-09-11T23:33:13.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:33:13 smithi172 ceph-mon[34855]: pgmap v479: 129 pgs: 129 active+clean; 154 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 4.9 MiB/s wr, 738 op/s 2024-09-11T23:33:13.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:33:13 smithi005 ceph-mon[31201]: pgmap v479: 129 pgs: 129 active+clean; 154 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 4.9 MiB/s wr, 738 op/s 2024-09-11T23:33:15.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:33:15 smithi159 ceph-mon[34394]: pgmap v480: 129 pgs: 129 active+clean; 151 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 4.6 MiB/s wr, 662 op/s 2024-09-11T23:33:15.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:33:15 smithi172 ceph-mon[34855]: pgmap v480: 129 pgs: 129 active+clean; 151 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 4.6 MiB/s wr, 662 op/s 2024-09-11T23:33:15.973 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:33:15 smithi005 ceph-mon[31201]: pgmap v480: 129 pgs: 129 active+clean; 151 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 4.6 MiB/s wr, 662 op/s 2024-09-11T23:33:17.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:33:17 smithi159 ceph-mon[34394]: pgmap v481: 129 pgs: 129 active+clean; 150 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 4.9 MiB/s wr, 737 op/s 2024-09-11T23:33:17.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:33:17 smithi172 ceph-mon[34855]: pgmap v481: 129 pgs: 129 active+clean; 150 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 4.9 MiB/s wr, 737 op/s 2024-09-11T23:33:17.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:33:17 smithi005 ceph-mon[31201]: pgmap v481: 129 pgs: 129 active+clean; 150 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 4.9 MiB/s wr, 737 op/s 2024-09-11T23:33:19.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:33:19 smithi159 ceph-mon[34394]: pgmap v482: 129 pgs: 129 active+clean; 150 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 4.5 MiB/s wr, 650 op/s 2024-09-11T23:33:19.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:33:19 smithi172 ceph-mon[34855]: pgmap v482: 129 pgs: 129 active+clean; 150 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 4.5 MiB/s wr, 650 op/s 2024-09-11T23:33:19.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:33:19 smithi005 ceph-mon[31201]: pgmap v482: 129 pgs: 129 active+clean; 150 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 4.5 MiB/s wr, 650 op/s 2024-09-11T23:33:21.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:33:21 smithi159 ceph-mon[34394]: pgmap v483: 129 pgs: 129 active+clean; 150 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 3.8 MiB/s wr, 550 op/s 2024-09-11T23:33:21.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:33:21 smithi172 ceph-mon[34855]: pgmap v483: 129 pgs: 129 active+clean; 150 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 3.8 MiB/s wr, 550 op/s 2024-09-11T23:33:21.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:33:21 smithi005 ceph-mon[31201]: pgmap v483: 129 pgs: 129 active+clean; 150 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 3.8 MiB/s wr, 550 op/s 2024-09-11T23:33:22.357 INFO:tasks.workunit.client.0.smithi005.stdout:20000 mapread 0x1c4208 thru 0x1c56d4 (0x14cd bytes) 2024-09-11T23:33:23.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:33:23 smithi159 ceph-mon[34394]: pgmap v484: 129 pgs: 129 active+clean; 153 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 4.8 MiB/s wr, 722 op/s 2024-09-11T23:33:23.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:33:23 smithi172 ceph-mon[34855]: pgmap v484: 129 pgs: 129 active+clean; 153 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 4.8 MiB/s wr, 722 op/s 2024-09-11T23:33:23.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:33:23 smithi005 ceph-mon[31201]: pgmap v484: 129 pgs: 129 active+clean; 153 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 4.8 MiB/s wr, 722 op/s 2024-09-11T23:33:25.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:33:25 smithi159 ceph-mon[34394]: pgmap v485: 129 pgs: 129 active+clean; 154 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 4.3 MiB/s wr, 641 op/s 2024-09-11T23:33:25.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:33:25 smithi172 ceph-mon[34855]: pgmap v485: 129 pgs: 129 active+clean; 154 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 4.3 MiB/s wr, 641 op/s 2024-09-11T23:33:25.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:33:25 smithi005 ceph-mon[31201]: pgmap v485: 129 pgs: 129 active+clean; 154 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 4.3 MiB/s wr, 641 op/s 2024-09-11T23:33:27.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:33:27 smithi159 ceph-mon[34394]: pgmap v486: 129 pgs: 129 active+clean; 155 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 4.3 MiB/s wr, 667 op/s 2024-09-11T23:33:27.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:33:27 smithi172 ceph-mon[34855]: pgmap v486: 129 pgs: 129 active+clean; 155 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 4.3 MiB/s wr, 667 op/s 2024-09-11T23:33:27.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:33:27 smithi005 ceph-mon[31201]: pgmap v486: 129 pgs: 129 active+clean; 155 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 4.3 MiB/s wr, 667 op/s 2024-09-11T23:33:29.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:33:29 smithi159 ceph-mon[34394]: pgmap v487: 129 pgs: 129 active+clean; 154 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.0 MiB/s wr, 627 op/s 2024-09-11T23:33:29.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:33:29 smithi172 ceph-mon[34855]: pgmap v487: 129 pgs: 129 active+clean; 154 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.0 MiB/s wr, 627 op/s 2024-09-11T23:33:29.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:33:29 smithi005 ceph-mon[31201]: pgmap v487: 129 pgs: 129 active+clean; 154 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.0 MiB/s wr, 627 op/s 2024-09-11T23:33:31.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:33:31 smithi159 ceph-mon[34394]: pgmap v488: 129 pgs: 129 active+clean; 154 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 MiB/s rd, 3.3 MiB/s wr, 531 op/s 2024-09-11T23:33:31.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:33:31 smithi172 ceph-mon[34855]: pgmap v488: 129 pgs: 129 active+clean; 154 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 MiB/s rd, 3.3 MiB/s wr, 531 op/s 2024-09-11T23:33:31.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:33:31 smithi005 ceph-mon[31201]: pgmap v488: 129 pgs: 129 active+clean; 154 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 MiB/s rd, 3.3 MiB/s wr, 531 op/s 2024-09-11T23:33:33.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:33:33 smithi159 ceph-mon[34394]: pgmap v489: 129 pgs: 129 active+clean; 156 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.4 MiB/s wr, 692 op/s 2024-09-11T23:33:33.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:33:33 smithi172 ceph-mon[34855]: pgmap v489: 129 pgs: 129 active+clean; 156 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.4 MiB/s wr, 692 op/s 2024-09-11T23:33:33.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:33:33 smithi005 ceph-mon[31201]: pgmap v489: 129 pgs: 129 active+clean; 156 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.4 MiB/s wr, 692 op/s 2024-09-11T23:33:35.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:33:35 smithi159 ceph-mon[34394]: pgmap v490: 129 pgs: 129 active+clean; 156 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.0 MiB/s wr, 610 op/s 2024-09-11T23:33:35.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:33:35 smithi172 ceph-mon[34855]: pgmap v490: 129 pgs: 129 active+clean; 156 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.0 MiB/s wr, 610 op/s 2024-09-11T23:33:35.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:33:35 smithi005 ceph-mon[31201]: pgmap v490: 129 pgs: 129 active+clean; 156 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.0 MiB/s wr, 610 op/s 2024-09-11T23:33:37.069 INFO:tasks.workunit.client.0.smithi005.stdout:30000 mapread 0x3fc9cb thru 0x4052a3 (0x88d9 bytes) 2024-09-11T23:33:37.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:33:37 smithi159 ceph-mon[34394]: pgmap v491: 129 pgs: 129 active+clean; 153 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.2 MiB/s wr, 619 op/s 2024-09-11T23:33:37.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:33:37 smithi172 ceph-mon[34855]: pgmap v491: 129 pgs: 129 active+clean; 153 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.2 MiB/s wr, 619 op/s 2024-09-11T23:33:37.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:33:37 smithi005 ceph-mon[31201]: pgmap v491: 129 pgs: 129 active+clean; 153 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.2 MiB/s wr, 619 op/s 2024-09-11T23:33:39.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:33:39 smithi159 ceph-mon[34394]: pgmap v492: 129 pgs: 129 active+clean; 153 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.0 MiB/s wr, 624 op/s 2024-09-11T23:33:39.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:33:39 smithi172 ceph-mon[34855]: pgmap v492: 129 pgs: 129 active+clean; 153 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.0 MiB/s wr, 624 op/s 2024-09-11T23:33:39.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:33:39 smithi005 ceph-mon[31201]: pgmap v492: 129 pgs: 129 active+clean; 153 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.0 MiB/s wr, 624 op/s 2024-09-11T23:33:41.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:33:41 smithi159 ceph-mon[34394]: pgmap v493: 129 pgs: 129 active+clean; 153 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 3.2 MiB/s wr, 488 op/s 2024-09-11T23:33:41.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:33:41 smithi172 ceph-mon[34855]: pgmap v493: 129 pgs: 129 active+clean; 153 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 3.2 MiB/s wr, 488 op/s 2024-09-11T23:33:41.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:33:41 smithi005 ceph-mon[31201]: pgmap v493: 129 pgs: 129 active+clean; 153 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 3.2 MiB/s wr, 488 op/s 2024-09-11T23:33:43.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:33:43 smithi159 ceph-mon[34394]: pgmap v494: 129 pgs: 129 active+clean; 157 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.1 MiB/s wr, 631 op/s 2024-09-11T23:33:43.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:33:43 smithi172 ceph-mon[34855]: pgmap v494: 129 pgs: 129 active+clean; 157 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.1 MiB/s wr, 631 op/s 2024-09-11T23:33:43.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:33:43 smithi005 ceph-mon[31201]: pgmap v494: 129 pgs: 129 active+clean; 157 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.1 MiB/s wr, 631 op/s 2024-09-11T23:33:45.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:33:45 smithi159 ceph-mon[34394]: pgmap v495: 129 pgs: 129 active+clean; 158 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 3.7 MiB/s wr, 557 op/s 2024-09-11T23:33:45.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:33:45 smithi172 ceph-mon[34855]: pgmap v495: 129 pgs: 129 active+clean; 158 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 3.7 MiB/s wr, 557 op/s 2024-09-11T23:33:45.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:33:45 smithi005 ceph-mon[31201]: pgmap v495: 129 pgs: 129 active+clean; 158 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 3.7 MiB/s wr, 557 op/s 2024-09-11T23:33:47.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:33:47 smithi159 ceph-mon[34394]: pgmap v496: 129 pgs: 129 active+clean; 160 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.0 MiB/s wr, 603 op/s 2024-09-11T23:33:47.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:33:47 smithi172 ceph-mon[34855]: pgmap v496: 129 pgs: 129 active+clean; 160 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.0 MiB/s wr, 603 op/s 2024-09-11T23:33:47.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:33:47 smithi005 ceph-mon[31201]: pgmap v496: 129 pgs: 129 active+clean; 160 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.0 MiB/s wr, 603 op/s 2024-09-11T23:33:49.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:33:49 smithi159 ceph-mon[34394]: pgmap v497: 129 pgs: 129 active+clean; 160 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 3.9 MiB/s wr, 590 op/s 2024-09-11T23:33:49.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:33:49 smithi172 ceph-mon[34855]: pgmap v497: 129 pgs: 129 active+clean; 160 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 3.9 MiB/s wr, 590 op/s 2024-09-11T23:33:49.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:33:49 smithi005 ceph-mon[31201]: pgmap v497: 129 pgs: 129 active+clean; 160 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 3.9 MiB/s wr, 590 op/s 2024-09-11T23:33:51.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:33:51 smithi159 ceph-mon[34394]: pgmap v498: 129 pgs: 129 active+clean; 160 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 3.2 MiB/s wr, 456 op/s 2024-09-11T23:33:51.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:33:51 smithi172 ceph-mon[34855]: pgmap v498: 129 pgs: 129 active+clean; 160 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 3.2 MiB/s wr, 456 op/s 2024-09-11T23:33:51.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:33:51 smithi005 ceph-mon[31201]: pgmap v498: 129 pgs: 129 active+clean; 160 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 3.2 MiB/s wr, 456 op/s 2024-09-11T23:33:52.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:33:52 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:33:52.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:33:52 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:33:52.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:33:52 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:33:52.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:33:52 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:33:52.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:33:52 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:33:52.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:33:52 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:33:52.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:33:52 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:33:52.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:33:52 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:33:52.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:33:52 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:33:52.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:33:52 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:33:52.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:33:52 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:33:52.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:33:52 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:33:54.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:33:54 smithi005 ceph-mon[31201]: pgmap v499: 129 pgs: 129 active+clean; 161 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.1 MiB/s wr, 602 op/s 2024-09-11T23:33:54.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:33:54 smithi159 ceph-mon[34394]: pgmap v499: 129 pgs: 129 active+clean; 161 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.1 MiB/s wr, 602 op/s 2024-09-11T23:33:54.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:33:54 smithi172 ceph-mon[34855]: pgmap v499: 129 pgs: 129 active+clean; 161 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.1 MiB/s wr, 602 op/s 2024-09-11T23:33:55.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:33:55 smithi005 ceph-mon[31201]: pgmap v500: 129 pgs: 129 active+clean; 159 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 3.8 MiB/s wr, 542 op/s 2024-09-11T23:33:55.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:33:55 smithi159 ceph-mon[34394]: pgmap v500: 129 pgs: 129 active+clean; 159 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 3.8 MiB/s wr, 542 op/s 2024-09-11T23:33:55.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:33:55 smithi172 ceph-mon[34855]: pgmap v500: 129 pgs: 129 active+clean; 159 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 3.8 MiB/s wr, 542 op/s 2024-09-11T23:33:57.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:33:57 smithi159 ceph-mon[34394]: pgmap v501: 129 pgs: 129 active+clean; 156 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 MiB/s rd, 3.9 MiB/s wr, 585 op/s 2024-09-11T23:33:57.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:33:57 smithi172 ceph-mon[34855]: pgmap v501: 129 pgs: 129 active+clean; 156 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 MiB/s rd, 3.9 MiB/s wr, 585 op/s 2024-09-11T23:33:57.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:33:57 smithi005 ceph-mon[31201]: pgmap v501: 129 pgs: 129 active+clean; 156 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 MiB/s rd, 3.9 MiB/s wr, 585 op/s 2024-09-11T23:33:59.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:33:59 smithi159 ceph-mon[34394]: pgmap v502: 129 pgs: 129 active+clean; 159 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 3.6 MiB/s wr, 532 op/s 2024-09-11T23:33:59.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:33:59 smithi172 ceph-mon[34855]: pgmap v502: 129 pgs: 129 active+clean; 159 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 3.6 MiB/s wr, 532 op/s 2024-09-11T23:33:59.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:33:59 smithi005 ceph-mon[31201]: pgmap v502: 129 pgs: 129 active+clean; 159 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 3.6 MiB/s wr, 532 op/s 2024-09-11T23:34:01.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:34:01 smithi159 ceph-mon[34394]: pgmap v503: 129 pgs: 129 active+clean; 159 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 2.9 MiB/s wr, 442 op/s 2024-09-11T23:34:01.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:34:01 smithi172 ceph-mon[34855]: pgmap v503: 129 pgs: 129 active+clean; 159 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 2.9 MiB/s wr, 442 op/s 2024-09-11T23:34:01.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:34:01 smithi005 ceph-mon[31201]: pgmap v503: 129 pgs: 129 active+clean; 159 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 2.9 MiB/s wr, 442 op/s 2024-09-11T23:34:03.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:34:03 smithi159 ceph-mon[34394]: pgmap v504: 129 pgs: 129 active+clean; 164 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 3.8 MiB/s wr, 574 op/s 2024-09-11T23:34:03.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:34:03 smithi172 ceph-mon[34855]: pgmap v504: 129 pgs: 129 active+clean; 164 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 3.8 MiB/s wr, 574 op/s 2024-09-11T23:34:03.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:34:03 smithi005 ceph-mon[31201]: pgmap v504: 129 pgs: 129 active+clean; 164 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 3.8 MiB/s wr, 574 op/s 2024-09-11T23:34:05.625 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:34:05 smithi159 ceph-mon[34394]: pgmap v505: 129 pgs: 129 active+clean; 161 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 3.4 MiB/s wr, 500 op/s 2024-09-11T23:34:05.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:34:05 smithi172 ceph-mon[34855]: pgmap v505: 129 pgs: 129 active+clean; 161 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 3.4 MiB/s wr, 500 op/s 2024-09-11T23:34:05.723 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:34:05 smithi005 ceph-mon[31201]: pgmap v505: 129 pgs: 129 active+clean; 161 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 3.4 MiB/s wr, 500 op/s 2024-09-11T23:34:07.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:34:07 smithi159 ceph-mon[34394]: pgmap v506: 129 pgs: 129 active+clean; 160 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 3.8 MiB/s wr, 554 op/s 2024-09-11T23:34:07.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:34:07 smithi172 ceph-mon[34855]: pgmap v506: 129 pgs: 129 active+clean; 160 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 3.8 MiB/s wr, 554 op/s 2024-09-11T23:34:07.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:34:07 smithi005 ceph-mon[31201]: pgmap v506: 129 pgs: 129 active+clean; 160 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 3.8 MiB/s wr, 554 op/s 2024-09-11T23:34:09.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:34:09 smithi159 ceph-mon[34394]: pgmap v507: 129 pgs: 129 active+clean; 161 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 3.7 MiB/s wr, 501 op/s 2024-09-11T23:34:09.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:34:09 smithi172 ceph-mon[34855]: pgmap v507: 129 pgs: 129 active+clean; 161 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 3.7 MiB/s wr, 501 op/s 2024-09-11T23:34:09.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:34:09 smithi005 ceph-mon[31201]: pgmap v507: 129 pgs: 129 active+clean; 161 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 3.7 MiB/s wr, 501 op/s 2024-09-11T23:34:10.562 INFO:tasks.workunit.client.0.smithi005.stdout:All 50000 operations completed A-OK! 2024-09-11T23:34:10.563 INFO:tasks.workunit.client.0.smithi005.stderr:+ ./fsx -z 100MB -N 50000 -p 10000 -l 104857600 2024-09-11T23:34:10.564 INFO:tasks.workunit.client.0.smithi005.stdout:Seed set to 1 2024-09-11T23:34:11.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:34:11 smithi159 ceph-mon[34394]: pgmap v508: 129 pgs: 129 active+clean; 161 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 3.0 MiB/s wr, 418 op/s 2024-09-11T23:34:11.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:34:11 smithi172 ceph-mon[34855]: pgmap v508: 129 pgs: 129 active+clean; 161 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 3.0 MiB/s wr, 418 op/s 2024-09-11T23:34:11.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:34:11 smithi005 ceph-mon[31201]: pgmap v508: 129 pgs: 129 active+clean; 161 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 3.0 MiB/s wr, 418 op/s 2024-09-11T23:34:11.780 INFO:tasks.workunit.client.0.smithi005.stderr:main: filesystem does not support fallocate mode FALLOC_FL_COLLAPSE_RANGE, disabling! 2024-09-11T23:34:11.780 INFO:tasks.workunit.client.0.smithi005.stderr:main: filesystem does not support fallocate mode FALLOC_FL_INSERT_RANGE, disabling! 2024-09-11T23:34:11.780 INFO:tasks.workunit.client.0.smithi005.stderr:main: filesystem does not support clone range, disabling! 2024-09-11T23:34:11.780 INFO:tasks.workunit.client.0.smithi005.stderr:main: filesystem does not support dedupe range, disabling! 2024-09-11T23:34:11.784 INFO:tasks.workunit.client.0.smithi005.stdout:skipping zero size read 2024-09-11T23:34:11.796 INFO:tasks.workunit.client.0.smithi005.stdout:truncating to largest ever: 0x1c37b90 2024-09-11T23:34:11.805 INFO:tasks.workunit.client.0.smithi005.stdout:truncating to largest ever: 0x5bd330d 2024-09-11T23:34:11.824 INFO:tasks.workunit.client.0.smithi005.stdout:copying to largest ever: 0x637bf99 2024-09-11T23:34:12.120 INFO:tasks.workunit.client.0.smithi005.stdout:copying to largest ever: 0x63d9b9c 2024-09-11T23:34:13.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:34:13 smithi159 ceph-mon[34394]: pgmap v509: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 3.8 MiB/s wr, 536 op/s 2024-09-11T23:34:13.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:34:13 smithi172 ceph-mon[34855]: pgmap v509: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 3.8 MiB/s wr, 536 op/s 2024-09-11T23:34:13.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:34:13 smithi005 ceph-mon[31201]: pgmap v509: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 3.8 MiB/s wr, 536 op/s 2024-09-11T23:34:15.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:34:15 smithi159 ceph-mon[34394]: pgmap v510: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 3.4 MiB/s wr, 464 op/s 2024-09-11T23:34:15.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:34:15 smithi172 ceph-mon[34855]: pgmap v510: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 3.4 MiB/s wr, 464 op/s 2024-09-11T23:34:15.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:34:15 smithi005 ceph-mon[31201]: pgmap v510: 129 pgs: 129 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 3.4 MiB/s wr, 464 op/s 2024-09-11T23:34:17.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:34:17 smithi159 ceph-mon[34394]: pgmap v511: 129 pgs: 129 active+clean; 174 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 3.6 MiB/s wr, 594 op/s 2024-09-11T23:34:17.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:34:17 smithi172 ceph-mon[34855]: pgmap v511: 129 pgs: 129 active+clean; 174 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 3.6 MiB/s wr, 594 op/s 2024-09-11T23:34:17.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:34:17 smithi005 ceph-mon[31201]: pgmap v511: 129 pgs: 129 active+clean; 174 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 3.6 MiB/s wr, 594 op/s 2024-09-11T23:34:18.673 INFO:tasks.workunit.client.0.smithi005.stdout:copying to largest ever: 0x63ee1da 2024-09-11T23:34:19.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:34:19 smithi159 ceph-mon[34394]: pgmap v512: 129 pgs: 129 active+clean; 174 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 2.8 MiB/s wr, 481 op/s 2024-09-11T23:34:19.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:34:19 smithi172 ceph-mon[34855]: pgmap v512: 129 pgs: 129 active+clean; 174 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 2.8 MiB/s wr, 481 op/s 2024-09-11T23:34:19.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:34:19 smithi005 ceph-mon[31201]: pgmap v512: 129 pgs: 129 active+clean; 174 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 2.8 MiB/s wr, 481 op/s 2024-09-11T23:34:21.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:34:21 smithi159 ceph-mon[34394]: pgmap v513: 129 pgs: 129 active+clean; 171 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 2.4 MiB/s wr, 481 op/s 2024-09-11T23:34:21.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:34:21 smithi159 ceph-mon[34394]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T23:34:21.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:34:21 smithi172 ceph-mon[34855]: pgmap v513: 129 pgs: 129 active+clean; 171 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 2.4 MiB/s wr, 481 op/s 2024-09-11T23:34:21.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:34:21 smithi172 ceph-mon[34855]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T23:34:21.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:34:21 smithi005 ceph-mon[31201]: pgmap v513: 129 pgs: 129 active+clean; 171 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 2.4 MiB/s wr, 481 op/s 2024-09-11T23:34:21.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:34:21 smithi005 ceph-mon[31201]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T23:34:23.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:34:23 smithi159 ceph-mon[34394]: pgmap v514: 129 pgs: 129 active+clean; 187 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 3.4 MiB/s wr, 696 op/s 2024-09-11T23:34:23.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:34:23 smithi172 ceph-mon[34855]: pgmap v514: 129 pgs: 129 active+clean; 187 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 3.4 MiB/s wr, 696 op/s 2024-09-11T23:34:23.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:34:23 smithi005 ceph-mon[31201]: pgmap v514: 129 pgs: 129 active+clean; 187 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 3.4 MiB/s wr, 696 op/s 2024-09-11T23:34:25.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:34:25 smithi159 ceph-mon[34394]: pgmap v515: 129 pgs: 129 active+clean; 193 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 2.7 MiB/s wr, 609 op/s 2024-09-11T23:34:25.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:34:25 smithi172 ceph-mon[34855]: pgmap v515: 129 pgs: 129 active+clean; 193 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 2.7 MiB/s wr, 609 op/s 2024-09-11T23:34:25.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:34:25 smithi005 ceph-mon[31201]: pgmap v515: 129 pgs: 129 active+clean; 193 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 2.7 MiB/s wr, 609 op/s 2024-09-11T23:34:27.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:34:27 smithi159 ceph-mon[34394]: pgmap v516: 129 pgs: 129 active+clean; 190 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 3.4 MiB/s wr, 809 op/s 2024-09-11T23:34:27.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:34:27 smithi172 ceph-mon[34855]: pgmap v516: 129 pgs: 129 active+clean; 190 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 3.4 MiB/s wr, 809 op/s 2024-09-11T23:34:27.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:34:27 smithi005 ceph-mon[31201]: pgmap v516: 129 pgs: 129 active+clean; 190 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 3.4 MiB/s wr, 809 op/s 2024-09-11T23:34:29.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:34:29 smithi159 ceph-mon[34394]: pgmap v517: 129 pgs: 129 active+clean; 190 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 2.7 MiB/s wr, 629 op/s 2024-09-11T23:34:29.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:34:29 smithi172 ceph-mon[34855]: pgmap v517: 129 pgs: 129 active+clean; 190 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 2.7 MiB/s wr, 629 op/s 2024-09-11T23:34:29.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:34:29 smithi005 ceph-mon[31201]: pgmap v517: 129 pgs: 129 active+clean; 190 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 2.7 MiB/s wr, 629 op/s 2024-09-11T23:34:30.854 INFO:tasks.workunit.client.0.smithi005.stdout:10000 write 0x4c35901 thru 0x4c3d40f (0x7b0f bytes) 2024-09-11T23:34:31.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:34:31 smithi159 ceph-mon[34394]: pgmap v518: 129 pgs: 129 active+clean; 186 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 3.0 MiB/s wr, 702 op/s 2024-09-11T23:34:31.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:34:31 smithi159 ceph-mon[34394]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T23:34:31.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:34:31 smithi172 ceph-mon[34855]: pgmap v518: 129 pgs: 129 active+clean; 186 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 3.0 MiB/s wr, 702 op/s 2024-09-11T23:34:31.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:34:31 smithi172 ceph-mon[34855]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T23:34:31.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:34:31 smithi005 ceph-mon[31201]: pgmap v518: 129 pgs: 129 active+clean; 186 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 3.0 MiB/s wr, 702 op/s 2024-09-11T23:34:31.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:34:31 smithi005 ceph-mon[31201]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T23:34:33.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:34:33 smithi159 ceph-mon[34394]: pgmap v519: 129 pgs: 129 active+clean; 188 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 3.5 MiB/s wr, 791 op/s 2024-09-11T23:34:33.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:34:33 smithi172 ceph-mon[34855]: pgmap v519: 129 pgs: 129 active+clean; 188 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 3.5 MiB/s wr, 791 op/s 2024-09-11T23:34:33.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:34:33 smithi005 ceph-mon[31201]: pgmap v519: 129 pgs: 129 active+clean; 188 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 3.5 MiB/s wr, 791 op/s 2024-09-11T23:34:35.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:34:35 smithi159 ceph-mon[34394]: pgmap v520: 129 pgs: 129 active+clean; 191 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 2.8 MiB/s wr, 647 op/s 2024-09-11T23:34:35.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:34:35 smithi172 ceph-mon[34855]: pgmap v520: 129 pgs: 129 active+clean; 191 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 2.8 MiB/s wr, 647 op/s 2024-09-11T23:34:35.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:34:35 smithi005 ceph-mon[31201]: pgmap v520: 129 pgs: 129 active+clean; 191 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 2.8 MiB/s wr, 647 op/s 2024-09-11T23:34:37.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:34:37 smithi159 ceph-mon[34394]: pgmap v521: 129 pgs: 129 active+clean; 189 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 3.6 MiB/s wr, 840 op/s 2024-09-11T23:34:37.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:34:37 smithi172 ceph-mon[34855]: pgmap v521: 129 pgs: 129 active+clean; 189 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 3.6 MiB/s wr, 840 op/s 2024-09-11T23:34:37.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:34:37 smithi005 ceph-mon[31201]: pgmap v521: 129 pgs: 129 active+clean; 189 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 3.6 MiB/s wr, 840 op/s 2024-09-11T23:34:39.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:34:39 smithi159 ceph-mon[34394]: pgmap v522: 129 pgs: 129 active+clean; 189 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 2.6 MiB/s wr, 602 op/s 2024-09-11T23:34:39.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:34:39 smithi172 ceph-mon[34855]: pgmap v522: 129 pgs: 129 active+clean; 189 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 2.6 MiB/s wr, 602 op/s 2024-09-11T23:34:39.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:34:39 smithi005 ceph-mon[31201]: pgmap v522: 129 pgs: 129 active+clean; 189 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 2.6 MiB/s wr, 602 op/s 2024-09-11T23:34:41.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:34:41 smithi159 ceph-mon[34394]: pgmap v523: 129 pgs: 129 active+clean; 186 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 2.8 MiB/s wr, 686 op/s 2024-09-11T23:34:41.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:34:41 smithi172 ceph-mon[34855]: pgmap v523: 129 pgs: 129 active+clean; 186 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 2.8 MiB/s wr, 686 op/s 2024-09-11T23:34:41.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:34:41 smithi005 ceph-mon[31201]: pgmap v523: 129 pgs: 129 active+clean; 186 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 2.8 MiB/s wr, 686 op/s 2024-09-11T23:34:43.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:34:43 smithi159 ceph-mon[34394]: pgmap v524: 129 pgs: 129 active+clean; 186 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 3.2 MiB/s wr, 757 op/s 2024-09-11T23:34:43.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:34:43 smithi172 ceph-mon[34855]: pgmap v524: 129 pgs: 129 active+clean; 186 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 3.2 MiB/s wr, 757 op/s 2024-09-11T23:34:43.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:34:43 smithi005 ceph-mon[31201]: pgmap v524: 129 pgs: 129 active+clean; 186 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 3.2 MiB/s wr, 757 op/s 2024-09-11T23:34:45.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:34:45 smithi159 ceph-mon[34394]: pgmap v525: 129 pgs: 129 active+clean; 187 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 2.6 MiB/s wr, 654 op/s 2024-09-11T23:34:45.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:34:45 smithi172 ceph-mon[34855]: pgmap v525: 129 pgs: 129 active+clean; 187 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 2.6 MiB/s wr, 654 op/s 2024-09-11T23:34:45.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:34:45 smithi005 ceph-mon[31201]: pgmap v525: 129 pgs: 129 active+clean; 187 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 2.6 MiB/s wr, 654 op/s 2024-09-11T23:34:47.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:34:47 smithi159 ceph-mon[34394]: pgmap v526: 129 pgs: 129 active+clean; 202 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 3.5 MiB/s wr, 796 op/s 2024-09-11T23:34:47.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:34:47 smithi172 ceph-mon[34855]: pgmap v526: 129 pgs: 129 active+clean; 202 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 3.5 MiB/s wr, 796 op/s 2024-09-11T23:34:47.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:34:47 smithi005 ceph-mon[31201]: pgmap v526: 129 pgs: 129 active+clean; 202 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 3.5 MiB/s wr, 796 op/s 2024-09-11T23:34:49.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:34:49 smithi159 ceph-mon[34394]: pgmap v527: 129 pgs: 129 active+clean; 202 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 2.7 MiB/s wr, 595 op/s 2024-09-11T23:34:49.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:34:49 smithi172 ceph-mon[34855]: pgmap v527: 129 pgs: 129 active+clean; 202 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 2.7 MiB/s wr, 595 op/s 2024-09-11T23:34:49.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:34:49 smithi005 ceph-mon[31201]: pgmap v527: 129 pgs: 129 active+clean; 202 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 2.7 MiB/s wr, 595 op/s 2024-09-11T23:34:50.738 INFO:tasks.workunit.client.0.smithi005.stdout:20000 trunc from 0x62a09d3 to 0x111d204 2024-09-11T23:34:51.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:34:51 smithi159 ceph-mon[34394]: pgmap v528: 129 pgs: 129 active+clean; 199 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 3.0 MiB/s wr, 672 op/s 2024-09-11T23:34:51.636 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:34:51 smithi172 ceph-mon[34855]: pgmap v528: 129 pgs: 129 active+clean; 199 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 3.0 MiB/s wr, 672 op/s 2024-09-11T23:34:51.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:34:51 smithi005 ceph-mon[31201]: pgmap v528: 129 pgs: 129 active+clean; 199 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 3.0 MiB/s wr, 672 op/s 2024-09-11T23:34:52.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:34:52 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:34:52.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:34:52 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:34:52.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:34:52 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:34:53.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:34:53 smithi159 ceph-mon[34394]: pgmap v529: 129 pgs: 129 active+clean; 191 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 3.5 MiB/s wr, 730 op/s 2024-09-11T23:34:53.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:34:53 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:34:53.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:34:53 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:34:53.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:34:53 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:34:53.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:34:53 smithi172 ceph-mon[34855]: pgmap v529: 129 pgs: 129 active+clean; 191 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 3.5 MiB/s wr, 730 op/s 2024-09-11T23:34:53.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:34:53 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:34:53.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:34:53 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:34:53.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:34:53 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:34:53.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:34:53 smithi005 ceph-mon[31201]: pgmap v529: 129 pgs: 129 active+clean; 191 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 3.5 MiB/s wr, 730 op/s 2024-09-11T23:34:53.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:34:53 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:34:53.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:34:53 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:34:53.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:34:53 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:34:55.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:34:55 smithi159 ceph-mon[34394]: pgmap v530: 129 pgs: 129 active+clean; 195 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 2.8 MiB/s wr, 609 op/s 2024-09-11T23:34:55.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:34:55 smithi172 ceph-mon[34855]: pgmap v530: 129 pgs: 129 active+clean; 195 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 2.8 MiB/s wr, 609 op/s 2024-09-11T23:34:55.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:34:55 smithi005 ceph-mon[31201]: pgmap v530: 129 pgs: 129 active+clean; 195 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 2.8 MiB/s wr, 609 op/s 2024-09-11T23:34:57.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:34:57 smithi159 ceph-mon[34394]: pgmap v531: 129 pgs: 129 active+clean; 199 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 3.6 MiB/s wr, 744 op/s 2024-09-11T23:34:57.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:34:57 smithi172 ceph-mon[34855]: pgmap v531: 129 pgs: 129 active+clean; 199 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 3.6 MiB/s wr, 744 op/s 2024-09-11T23:34:57.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:34:57 smithi005 ceph-mon[31201]: pgmap v531: 129 pgs: 129 active+clean; 199 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 3.6 MiB/s wr, 744 op/s 2024-09-11T23:34:59.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:34:59 smithi159 ceph-mon[34394]: pgmap v532: 129 pgs: 129 active+clean; 199 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 2.6 MiB/s wr, 550 op/s 2024-09-11T23:34:59.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:34:59 smithi172 ceph-mon[34855]: pgmap v532: 129 pgs: 129 active+clean; 199 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 2.6 MiB/s wr, 550 op/s 2024-09-11T23:34:59.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:34:59 smithi005 ceph-mon[31201]: pgmap v532: 129 pgs: 129 active+clean; 199 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 2.6 MiB/s wr, 550 op/s 2024-09-11T23:35:01.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:01 smithi159 ceph-mon[34394]: pgmap v533: 129 pgs: 129 active+clean; 200 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 2.8 MiB/s wr, 590 op/s 2024-09-11T23:35:01.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:01 smithi172 ceph-mon[34855]: pgmap v533: 129 pgs: 129 active+clean; 200 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 2.8 MiB/s wr, 590 op/s 2024-09-11T23:35:01.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:01 smithi005 ceph-mon[31201]: pgmap v533: 129 pgs: 129 active+clean; 200 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 2.8 MiB/s wr, 590 op/s 2024-09-11T23:35:03.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:03 smithi172 ceph-mon[34855]: pgmap v534: 129 pgs: 129 active+clean; 181 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 3.2 MiB/s wr, 680 op/s 2024-09-11T23:35:03.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:03 smithi005 ceph-mon[31201]: pgmap v534: 129 pgs: 129 active+clean; 181 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 3.2 MiB/s wr, 680 op/s 2024-09-11T23:35:03.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:03 smithi159 ceph-mon[34394]: pgmap v534: 129 pgs: 129 active+clean; 181 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 3.2 MiB/s wr, 680 op/s 2024-09-11T23:35:06.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:06 smithi159 ceph-mon[34394]: pgmap v535: 129 pgs: 129 active+clean; 184 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.5 MiB/s wr, 547 op/s 2024-09-11T23:35:06.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:06 smithi172 ceph-mon[34855]: pgmap v535: 129 pgs: 129 active+clean; 184 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.5 MiB/s wr, 547 op/s 2024-09-11T23:35:06.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:06 smithi005 ceph-mon[31201]: pgmap v535: 129 pgs: 129 active+clean; 184 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.5 MiB/s wr, 547 op/s 2024-09-11T23:35:08.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:08 smithi159 ceph-mon[34394]: pgmap v536: 129 pgs: 129 active+clean; 187 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 3.4 MiB/s wr, 742 op/s 2024-09-11T23:35:08.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:08 smithi172 ceph-mon[34855]: pgmap v536: 129 pgs: 129 active+clean; 187 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 3.4 MiB/s wr, 742 op/s 2024-09-11T23:35:08.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:08 smithi005 ceph-mon[31201]: pgmap v536: 129 pgs: 129 active+clean; 187 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 3.4 MiB/s wr, 742 op/s 2024-09-11T23:35:10.376 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:10 smithi159 ceph-mon[34394]: pgmap v537: 129 pgs: 129 active+clean; 184 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 2.5 MiB/s wr, 567 op/s 2024-09-11T23:35:10.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:10 smithi172 ceph-mon[34855]: pgmap v537: 129 pgs: 129 active+clean; 184 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 2.5 MiB/s wr, 567 op/s 2024-09-11T23:35:10.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:10 smithi005 ceph-mon[31201]: pgmap v537: 129 pgs: 129 active+clean; 184 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 2.5 MiB/s wr, 567 op/s 2024-09-11T23:35:12.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:12 smithi172 ceph-mon[34855]: pgmap v538: 129 pgs: 129 active+clean; 181 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 2.7 MiB/s wr, 614 op/s 2024-09-11T23:35:12.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:12 smithi005 ceph-mon[31201]: pgmap v538: 129 pgs: 129 active+clean; 181 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 2.7 MiB/s wr, 614 op/s 2024-09-11T23:35:12.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:12 smithi159 ceph-mon[34394]: pgmap v538: 129 pgs: 129 active+clean; 181 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 2.7 MiB/s wr, 614 op/s 2024-09-11T23:35:14.383 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:14 smithi172 ceph-mon[34855]: pgmap v539: 129 pgs: 129 active+clean; 190 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 3.1 MiB/s wr, 743 op/s 2024-09-11T23:35:14.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:14 smithi005 ceph-mon[31201]: pgmap v539: 129 pgs: 129 active+clean; 190 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 3.1 MiB/s wr, 743 op/s 2024-09-11T23:35:14.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:14 smithi159 ceph-mon[34394]: pgmap v539: 129 pgs: 129 active+clean; 190 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 3.1 MiB/s wr, 743 op/s 2024-09-11T23:35:16.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:16 smithi005 ceph-mon[31201]: pgmap v540: 129 pgs: 129 active+clean; 190 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.3 MiB/s wr, 582 op/s 2024-09-11T23:35:16.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:16 smithi159 ceph-mon[34394]: pgmap v540: 129 pgs: 129 active+clean; 190 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.3 MiB/s wr, 582 op/s 2024-09-11T23:35:16.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:16 smithi172 ceph-mon[34855]: pgmap v540: 129 pgs: 129 active+clean; 190 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.3 MiB/s wr, 582 op/s 2024-09-11T23:35:18.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:18 smithi005 ceph-mon[31201]: pgmap v541: 129 pgs: 129 active+clean; 204 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 3.2 MiB/s wr, 780 op/s 2024-09-11T23:35:18.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:18 smithi159 ceph-mon[34394]: pgmap v541: 129 pgs: 129 active+clean; 204 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 3.2 MiB/s wr, 780 op/s 2024-09-11T23:35:18.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:18 smithi172 ceph-mon[34855]: pgmap v541: 129 pgs: 129 active+clean; 204 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 3.2 MiB/s wr, 780 op/s 2024-09-11T23:35:20.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:20 smithi005 ceph-mon[31201]: pgmap v542: 129 pgs: 129 active+clean; 204 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.2 MiB/s wr, 558 op/s 2024-09-11T23:35:20.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:20 smithi159 ceph-mon[34394]: pgmap v542: 129 pgs: 129 active+clean; 204 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.2 MiB/s wr, 558 op/s 2024-09-11T23:35:20.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:20 smithi172 ceph-mon[34855]: pgmap v542: 129 pgs: 129 active+clean; 204 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.2 MiB/s wr, 558 op/s 2024-09-11T23:35:22.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:22 smithi005 ceph-mon[31201]: pgmap v543: 129 pgs: 129 active+clean; 199 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 2.4 MiB/s wr, 601 op/s 2024-09-11T23:35:22.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:22 smithi159 ceph-mon[34394]: pgmap v543: 129 pgs: 129 active+clean; 199 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 2.4 MiB/s wr, 601 op/s 2024-09-11T23:35:22.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:22 smithi172 ceph-mon[34855]: pgmap v543: 129 pgs: 129 active+clean; 199 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 2.4 MiB/s wr, 601 op/s 2024-09-11T23:35:23.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:23 smithi005 ceph-mon[31201]: pgmap v544: 129 pgs: 129 active+clean; 196 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 2.9 MiB/s wr, 721 op/s 2024-09-11T23:35:23.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:23 smithi159 ceph-mon[34394]: pgmap v544: 129 pgs: 129 active+clean; 196 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 2.9 MiB/s wr, 721 op/s 2024-09-11T23:35:23.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:23 smithi172 ceph-mon[34855]: pgmap v544: 129 pgs: 129 active+clean; 196 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 2.9 MiB/s wr, 721 op/s 2024-09-11T23:35:23.675 INFO:tasks.workunit.client.0.smithi005.stdout:fallocating to largest ever: 0x6400000 2024-09-11T23:35:25.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:25 smithi159 ceph-mon[34394]: pgmap v545: 129 pgs: 129 active+clean; 196 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 2.3 MiB/s wr, 556 op/s 2024-09-11T23:35:25.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:25 smithi172 ceph-mon[34855]: pgmap v545: 129 pgs: 129 active+clean; 196 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 2.3 MiB/s wr, 556 op/s 2024-09-11T23:35:25.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:25 smithi005 ceph-mon[31201]: pgmap v545: 129 pgs: 129 active+clean; 196 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 2.3 MiB/s wr, 556 op/s 2024-09-11T23:35:27.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:27 smithi159 ceph-mon[34394]: pgmap v546: 129 pgs: 129 active+clean; 193 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 3.1 MiB/s wr, 753 op/s 2024-09-11T23:35:27.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:27 smithi172 ceph-mon[34855]: pgmap v546: 129 pgs: 129 active+clean; 193 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 3.1 MiB/s wr, 753 op/s 2024-09-11T23:35:27.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:27 smithi005 ceph-mon[31201]: pgmap v546: 129 pgs: 129 active+clean; 193 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 3.1 MiB/s wr, 753 op/s 2024-09-11T23:35:29.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:29 smithi159 ceph-mon[34394]: pgmap v547: 129 pgs: 129 active+clean; 193 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.3 MiB/s wr, 544 op/s 2024-09-11T23:35:29.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:29 smithi172 ceph-mon[34855]: pgmap v547: 129 pgs: 129 active+clean; 193 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.3 MiB/s wr, 544 op/s 2024-09-11T23:35:29.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:29 smithi005 ceph-mon[31201]: pgmap v547: 129 pgs: 129 active+clean; 193 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.3 MiB/s wr, 544 op/s 2024-09-11T23:35:31.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:31 smithi159 ceph-mon[34394]: pgmap v548: 129 pgs: 129 active+clean; 192 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 2.5 MiB/s wr, 590 op/s 2024-09-11T23:35:31.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:31 smithi172 ceph-mon[34855]: pgmap v548: 129 pgs: 129 active+clean; 192 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 2.5 MiB/s wr, 590 op/s 2024-09-11T23:35:31.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:31 smithi005 ceph-mon[31201]: pgmap v548: 129 pgs: 129 active+clean; 192 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 2.5 MiB/s wr, 590 op/s 2024-09-11T23:35:33.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:33 smithi159 ceph-mon[34394]: pgmap v549: 129 pgs: 129 active+clean; 213 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 3.1 MiB/s wr, 718 op/s 2024-09-11T23:35:33.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:33 smithi172 ceph-mon[34855]: pgmap v549: 129 pgs: 129 active+clean; 213 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 3.1 MiB/s wr, 718 op/s 2024-09-11T23:35:33.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:33 smithi005 ceph-mon[31201]: pgmap v549: 129 pgs: 129 active+clean; 213 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 3.1 MiB/s wr, 718 op/s 2024-09-11T23:35:34.017 INFO:tasks.workunit.client.0.smithi005.stdout:40000 falloc from 0x4cbeead to 0x4cc78f9 (0x8a4c bytes) 2024-09-11T23:35:35.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:35 smithi159 ceph-mon[34394]: pgmap v550: 129 pgs: 129 active+clean; 212 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 2.4 MiB/s wr, 561 op/s 2024-09-11T23:35:35.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:35 smithi172 ceph-mon[34855]: pgmap v550: 129 pgs: 129 active+clean; 212 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 2.4 MiB/s wr, 561 op/s 2024-09-11T23:35:35.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:35 smithi005 ceph-mon[31201]: pgmap v550: 129 pgs: 129 active+clean; 212 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 2.4 MiB/s wr, 561 op/s 2024-09-11T23:35:37.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:37 smithi159 ceph-mon[34394]: pgmap v551: 129 pgs: 129 active+clean; 196 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 3.1 MiB/s wr, 767 op/s 2024-09-11T23:35:37.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:37 smithi172 ceph-mon[34855]: pgmap v551: 129 pgs: 129 active+clean; 196 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 3.1 MiB/s wr, 767 op/s 2024-09-11T23:35:37.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:37 smithi005 ceph-mon[31201]: pgmap v551: 129 pgs: 129 active+clean; 196 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 3.1 MiB/s wr, 767 op/s 2024-09-11T23:35:39.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:39 smithi159 ceph-mon[34394]: pgmap v552: 129 pgs: 129 active+clean; 196 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.3 MiB/s wr, 561 op/s 2024-09-11T23:35:39.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:39 smithi172 ceph-mon[34855]: pgmap v552: 129 pgs: 129 active+clean; 196 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.3 MiB/s wr, 561 op/s 2024-09-11T23:35:39.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:39 smithi005 ceph-mon[31201]: pgmap v552: 129 pgs: 129 active+clean; 196 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.3 MiB/s wr, 561 op/s 2024-09-11T23:35:41.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:41 smithi159 ceph-mon[34394]: pgmap v553: 129 pgs: 129 active+clean; 191 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 2.5 MiB/s wr, 612 op/s 2024-09-11T23:35:41.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:41 smithi172 ceph-mon[34855]: pgmap v553: 129 pgs: 129 active+clean; 191 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 2.5 MiB/s wr, 612 op/s 2024-09-11T23:35:41.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:41 smithi005 ceph-mon[31201]: pgmap v553: 129 pgs: 129 active+clean; 191 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 2.5 MiB/s wr, 612 op/s 2024-09-11T23:35:43.629 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:43 smithi159 ceph-mon[34394]: pgmap v554: 129 pgs: 129 active+clean; 195 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 3.1 MiB/s wr, 739 op/s 2024-09-11T23:35:43.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:43 smithi172 ceph-mon[34855]: pgmap v554: 129 pgs: 129 active+clean; 195 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 3.1 MiB/s wr, 739 op/s 2024-09-11T23:35:43.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:43 smithi005 ceph-mon[31201]: pgmap v554: 129 pgs: 129 active+clean; 195 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 3.1 MiB/s wr, 739 op/s 2024-09-11T23:35:45.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:45 smithi159 ceph-mon[34394]: pgmap v555: 129 pgs: 129 active+clean; 199 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 2.3 MiB/s wr, 574 op/s 2024-09-11T23:35:45.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:45 smithi172 ceph-mon[34855]: pgmap v555: 129 pgs: 129 active+clean; 199 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 2.3 MiB/s wr, 574 op/s 2024-09-11T23:35:45.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:45 smithi005 ceph-mon[31201]: pgmap v555: 129 pgs: 129 active+clean; 199 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 2.3 MiB/s wr, 574 op/s 2024-09-11T23:35:47.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:47 smithi159 ceph-mon[34394]: pgmap v556: 129 pgs: 129 active+clean; 212 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 3.2 MiB/s wr, 757 op/s 2024-09-11T23:35:47.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:47 smithi172 ceph-mon[34855]: pgmap v556: 129 pgs: 129 active+clean; 212 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 3.2 MiB/s wr, 757 op/s 2024-09-11T23:35:47.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:47 smithi005 ceph-mon[31201]: pgmap v556: 129 pgs: 129 active+clean; 212 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 3.2 MiB/s wr, 757 op/s 2024-09-11T23:35:49.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:49 smithi159 ceph-mon[34394]: pgmap v557: 129 pgs: 129 active+clean; 211 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 2.4 MiB/s wr, 543 op/s 2024-09-11T23:35:49.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:49 smithi172 ceph-mon[34855]: pgmap v557: 129 pgs: 129 active+clean; 211 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 2.4 MiB/s wr, 543 op/s 2024-09-11T23:35:49.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:49 smithi005 ceph-mon[31201]: pgmap v557: 129 pgs: 129 active+clean; 211 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 2.4 MiB/s wr, 543 op/s 2024-09-11T23:35:51.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:51 smithi159 ceph-mon[34394]: pgmap v558: 129 pgs: 129 active+clean; 209 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 2.7 MiB/s wr, 607 op/s 2024-09-11T23:35:51.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:51 smithi172 ceph-mon[34855]: pgmap v558: 129 pgs: 129 active+clean; 209 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 2.7 MiB/s wr, 607 op/s 2024-09-11T23:35:51.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:51 smithi005 ceph-mon[31201]: pgmap v558: 129 pgs: 129 active+clean; 209 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 2.7 MiB/s wr, 607 op/s 2024-09-11T23:35:53.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:53 smithi159 ceph-mon[34394]: pgmap v559: 129 pgs: 129 active+clean; 206 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 3.0 MiB/s wr, 686 op/s 2024-09-11T23:35:53.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:53 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:35:53.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:53 smithi172 ceph-mon[34855]: pgmap v559: 129 pgs: 129 active+clean; 206 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 3.0 MiB/s wr, 686 op/s 2024-09-11T23:35:53.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:53 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:35:53.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:53 smithi005 ceph-mon[31201]: pgmap v559: 129 pgs: 129 active+clean; 206 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 3.0 MiB/s wr, 686 op/s 2024-09-11T23:35:53.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:53 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:35:54.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:54 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:35:54.626 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:54 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:35:54.627 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:54 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:35:54.627 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:54 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:35:54.627 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:54 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:35:54.627 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:54 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:35:54.627 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:54 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:35:54.627 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:54 smithi159 ceph-mon[34394]: Adjusting osd_memory_target on smithi159 to 176.0M 2024-09-11T23:35:54.627 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:54 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:35:54.627 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:54 smithi159 ceph-mon[34394]: Adjusting osd_memory_target on smithi172 to 176.0M 2024-09-11T23:35:54.627 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:54 smithi159 ceph-mon[34394]: Unable to set osd_memory_target on smithi159 to 184581017: error parsing value: Value '184581017' is below minimum 939524096 2024-09-11T23:35:54.627 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:54 smithi159 ceph-mon[34394]: Unable to set osd_memory_target on smithi172 to 184580300: error parsing value: Value '184580300' is below minimum 939524096 2024-09-11T23:35:54.627 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:54 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:35:54.627 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:54 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:35:54.627 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:54 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:35:54.628 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:54 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:35:54.628 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:54 smithi159 ceph-mon[34394]: Adjusting osd_memory_target on smithi005 to 177.0M 2024-09-11T23:35:54.628 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:54 smithi159 ceph-mon[34394]: Unable to set osd_memory_target on smithi005 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-11T23:35:54.628 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:54 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:35:54.628 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:54 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:35:54.628 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:54 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:35:54.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:54 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:35:54.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:54 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:35:54.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:54 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:35:54.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:54 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:35:54.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:54 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:35:54.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:54 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:35:54.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:54 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:35:54.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:54 smithi172 ceph-mon[34855]: Adjusting osd_memory_target on smithi159 to 176.0M 2024-09-11T23:35:54.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:54 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:35:54.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:54 smithi172 ceph-mon[34855]: Adjusting osd_memory_target on smithi172 to 176.0M 2024-09-11T23:35:54.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:54 smithi172 ceph-mon[34855]: Unable to set osd_memory_target on smithi159 to 184581017: error parsing value: Value '184581017' is below minimum 939524096 2024-09-11T23:35:54.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:54 smithi172 ceph-mon[34855]: Unable to set osd_memory_target on smithi172 to 184580300: error parsing value: Value '184580300' is below minimum 939524096 2024-09-11T23:35:54.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:54 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:35:54.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:54 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:35:54.635 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:54 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:35:54.635 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:54 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:35:54.635 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:54 smithi172 ceph-mon[34855]: Adjusting osd_memory_target on smithi005 to 177.0M 2024-09-11T23:35:54.635 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:54 smithi172 ceph-mon[34855]: Unable to set osd_memory_target on smithi005 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-11T23:35:54.635 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:54 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:35:54.635 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:54 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:35:54.635 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:54 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:35:54.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:54 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:35:54.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:54 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:35:54.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:54 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:35:54.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:54 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:35:54.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:54 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:35:54.725 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:54 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:35:54.725 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:54 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:35:54.725 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:54 smithi005 ceph-mon[31201]: Adjusting osd_memory_target on smithi159 to 176.0M 2024-09-11T23:35:54.725 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:54 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:35:54.725 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:54 smithi005 ceph-mon[31201]: Adjusting osd_memory_target on smithi172 to 176.0M 2024-09-11T23:35:54.725 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:54 smithi005 ceph-mon[31201]: Unable to set osd_memory_target on smithi159 to 184581017: error parsing value: Value '184581017' is below minimum 939524096 2024-09-11T23:35:54.725 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:54 smithi005 ceph-mon[31201]: Unable to set osd_memory_target on smithi172 to 184580300: error parsing value: Value '184580300' is below minimum 939524096 2024-09-11T23:35:54.725 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:54 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:35:54.725 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:54 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:35:54.725 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:54 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:35:54.725 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:54 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:35:54.725 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:54 smithi005 ceph-mon[31201]: Adjusting osd_memory_target on smithi005 to 177.0M 2024-09-11T23:35:54.726 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:54 smithi005 ceph-mon[31201]: Unable to set osd_memory_target on smithi005 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-11T23:35:54.726 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:54 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:35:54.726 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:54 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:35:54.726 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:54 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:35:55.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:55 smithi005 ceph-mon[31201]: pgmap v560: 129 pgs: 129 active+clean; 206 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 2.3 MiB/s wr, 523 op/s 2024-09-11T23:35:55.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:55 smithi159 ceph-mon[34394]: pgmap v560: 129 pgs: 129 active+clean; 206 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 2.3 MiB/s wr, 523 op/s 2024-09-11T23:35:55.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:55 smithi172 ceph-mon[34855]: pgmap v560: 129 pgs: 129 active+clean; 206 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 2.3 MiB/s wr, 523 op/s 2024-09-11T23:35:56.005 INFO:tasks.workunit.client.0.smithi005.stdout:All 50000 operations completed A-OK! 2024-09-11T23:35:56.008 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-11T23:35:56.008 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-11T23:35:57.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:57 smithi005 ceph-mon[31201]: pgmap v561: 129 pgs: 129 active+clean; 209 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 3.2 MiB/s wr, 704 op/s 2024-09-11T23:35:57.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:57 smithi159 ceph-mon[34394]: pgmap v561: 129 pgs: 129 active+clean; 209 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 3.2 MiB/s wr, 704 op/s 2024-09-11T23:35:57.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:57 smithi172 ceph-mon[34855]: pgmap v561: 129 pgs: 129 active+clean; 209 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 3.2 MiB/s wr, 704 op/s 2024-09-11T23:35:59.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:59 smithi005 ceph-mon[31201]: pgmap v562: 129 pgs: 129 active+clean; 209 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 2.3 MiB/s wr, 508 op/s 2024-09-11T23:35:59.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:35:59 smithi005 ceph-mon[31201]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T23:35:59.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:59 smithi159 ceph-mon[34394]: pgmap v562: 129 pgs: 129 active+clean; 209 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 2.3 MiB/s wr, 508 op/s 2024-09-11T23:35:59.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:35:59 smithi159 ceph-mon[34394]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T23:35:59.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:59 smithi172 ceph-mon[34855]: pgmap v562: 129 pgs: 129 active+clean; 209 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 2.3 MiB/s wr, 508 op/s 2024-09-11T23:35:59.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:35:59 smithi172 ceph-mon[34855]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T23:36:01.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:01 smithi005 ceph-mon[31201]: pgmap v563: 129 pgs: 129 active+clean; 199 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 2.3 MiB/s wr, 519 op/s 2024-09-11T23:36:01.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:01 smithi159 ceph-mon[34394]: pgmap v563: 129 pgs: 129 active+clean; 199 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 2.3 MiB/s wr, 519 op/s 2024-09-11T23:36:01.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:01 smithi172 ceph-mon[34855]: pgmap v563: 129 pgs: 129 active+clean; 199 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 2.3 MiB/s wr, 519 op/s 2024-09-11T23:36:03.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:03 smithi159 ceph-mon[34394]: pgmap v564: 129 pgs: 129 active+clean; 205 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 2.1 MiB/s wr, 474 op/s 2024-09-11T23:36:03.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:03 smithi172 ceph-mon[34855]: pgmap v564: 129 pgs: 129 active+clean; 205 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 2.1 MiB/s wr, 474 op/s 2024-09-11T23:36:03.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:03 smithi005 ceph-mon[31201]: pgmap v564: 129 pgs: 129 active+clean; 205 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 2.1 MiB/s wr, 474 op/s 2024-09-11T23:36:04.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:04 smithi159 ceph-mon[34394]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T23:36:04.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:04 smithi172 ceph-mon[34855]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T23:36:04.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:04 smithi005 ceph-mon[31201]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T23:36:05.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:05 smithi159 ceph-mon[34394]: pgmap v565: 129 pgs: 129 active+clean; 207 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.7 MiB/s wr, 339 op/s 2024-09-11T23:36:05.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:05 smithi172 ceph-mon[34855]: pgmap v565: 129 pgs: 129 active+clean; 207 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.7 MiB/s wr, 339 op/s 2024-09-11T23:36:05.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:05 smithi005 ceph-mon[31201]: pgmap v565: 129 pgs: 129 active+clean; 207 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.7 MiB/s wr, 339 op/s 2024-09-11T23:36:07.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:07 smithi159 ceph-mon[34394]: pgmap v566: 129 pgs: 129 active+clean; 203 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.8 MiB/s wr, 423 op/s 2024-09-11T23:36:07.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:07 smithi172 ceph-mon[34855]: pgmap v566: 129 pgs: 129 active+clean; 203 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.8 MiB/s wr, 423 op/s 2024-09-11T23:36:07.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:07 smithi005 ceph-mon[31201]: pgmap v566: 129 pgs: 129 active+clean; 203 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.8 MiB/s wr, 423 op/s 2024-09-11T23:36:09.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:09 smithi159 ceph-mon[34394]: pgmap v567: 129 pgs: 129 active+clean; 200 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 922 KiB/s rd, 895 KiB/s wr, 237 op/s 2024-09-11T23:36:09.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:09 smithi172 ceph-mon[34855]: pgmap v567: 129 pgs: 129 active+clean; 200 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 922 KiB/s rd, 895 KiB/s wr, 237 op/s 2024-09-11T23:36:09.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:09 smithi005 ceph-mon[31201]: pgmap v567: 129 pgs: 129 active+clean; 200 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 922 KiB/s rd, 895 KiB/s wr, 237 op/s 2024-09-11T23:36:11.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:11 smithi159 ceph-mon[34394]: pgmap v568: 129 pgs: 129 active+clean; 204 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 263 op/s 2024-09-11T23:36:11.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:11 smithi172 ceph-mon[34855]: pgmap v568: 129 pgs: 129 active+clean; 204 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 263 op/s 2024-09-11T23:36:11.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:11 smithi005 ceph-mon[31201]: pgmap v568: 129 pgs: 129 active+clean; 204 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 263 op/s 2024-09-11T23:36:12.749 INFO:tasks.workunit:Stopping ['suites/fsx.sh'] on client.0... 2024-09-11T23:36:12.750 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-11T23:36:13.069 DEBUG:teuthology.parallel:result is None 2024-09-11T23:36:13.070 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-11T23:36:13.105 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-11T23:36:13.106 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-11T23:36:13.116 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:36:13.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.251+0000 7f845ba8d640 1 -- 172.21.15.5:0/744205780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8454104ee0 msgr2=0x7f84541072d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:13.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.251+0000 7f845ba8d640 1 --2- 172.21.15.5:0/744205780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8454104ee0 0x7f84541072d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f8448009900 tx=0x7f844802a410 comp rx=0 tx=0).stop 2024-09-11T23:36:13.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.251+0000 7f845ba8d640 1 -- 172.21.15.5:0/744205780 shutdown_connections 2024-09-11T23:36:13.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.251+0000 7f845ba8d640 1 --2- 172.21.15.5:0/744205780 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8454107810 0x7f8454109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:13.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.251+0000 7f845ba8d640 1 --2- 172.21.15.5:0/744205780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8454104ee0 0x7f84541072d0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:13.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.251+0000 7f845ba8d640 1 --2- 172.21.15.5:0/744205780 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84541025b0 0x7f84541049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:13.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.251+0000 7f845ba8d640 1 -- 172.21.15.5:0/744205780 >> 172.21.15.5:0/744205780 conn(0x7f84540fc1b0 msgr2=0x7f84540fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:36:13.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.252+0000 7f845ba8d640 1 -- 172.21.15.5:0/744205780 shutdown_connections 2024-09-11T23:36:13.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.252+0000 7f845ba8d640 1 -- 172.21.15.5:0/744205780 wait complete. 2024-09-11T23:36:13.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.252+0000 7f845ba8d640 1 Processor -- start 2024-09-11T23:36:13.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.252+0000 7f845ba8d640 1 -- start start 2024-09-11T23:36:13.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.252+0000 7f845ba8d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84541025b0 0x7f8454197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:13.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.252+0000 7f845ba8d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8454104ee0 0x7f8454198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:13.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.252+0000 7f845ba8d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8454107810 0x7f845419f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:13.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.252+0000 7f845ba8d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f845410d6c0 con 0x7f84541025b0 2024-09-11T23:36:13.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.252+0000 7f845ba8d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f845410d540 con 0x7f8454104ee0 2024-09-11T23:36:13.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.252+0000 7f845ba8d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f845410d840 con 0x7f8454107810 2024-09-11T23:36:13.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.252+0000 7f8459829640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84541025b0 0x7f8454197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:13.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.252+0000 7f8459829640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84541025b0 0x7f8454197e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60296/0 (socket says 172.21.15.5:60296) 2024-09-11T23:36:13.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.252+0000 7f8459829640 1 -- 172.21.15.5:0/2954632805 learned_addr learned my addr 172.21.15.5:0/2954632805 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:36:13.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.253+0000 7f8459028640 1 --2- 172.21.15.5:0/2954632805 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8454104ee0 0x7f8454198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:13.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.253+0000 7f8459829640 1 -- 172.21.15.5:0/2954632805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8454107810 msgr2=0x7f845419f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:13.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.253+0000 7f845a02a640 1 --2- 172.21.15.5:0/2954632805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8454107810 0x7f845419f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:13.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.253+0000 7f8459829640 1 --2- 172.21.15.5:0/2954632805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8454107810 0x7f845419f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:13.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.253+0000 7f8459829640 1 -- 172.21.15.5:0/2954632805 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8454104ee0 msgr2=0x7f8454198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:13.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.253+0000 7f8459829640 1 --2- 172.21.15.5:0/2954632805 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8454104ee0 0x7f8454198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:13.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.253+0000 7f8459829640 1 -- 172.21.15.5:0/2954632805 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f845419fa60 con 0x7f84541025b0 2024-09-11T23:36:13.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.253+0000 7f8459028640 1 --2- 172.21.15.5:0/2954632805 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8454104ee0 0x7f8454198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:36:13.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.253+0000 7f8459829640 1 --2- 172.21.15.5:0/2954632805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84541025b0 0x7f8454197e40 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f844400d950 tx=0x7f844400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:36:13.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.253+0000 7f8452ffd640 1 -- 172.21.15.5:0/2954632805 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8444017070 con 0x7f84541025b0 2024-09-11T23:36:13.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.253+0000 7f8452ffd640 1 -- 172.21.15.5:0/2954632805 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8444009c30 con 0x7f84541025b0 2024-09-11T23:36:13.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.253+0000 7f845ba8d640 1 -- 172.21.15.5:0/2954632805 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f845419fd50 con 0x7f84541025b0 2024-09-11T23:36:13.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.253+0000 7f8452ffd640 1 -- 172.21.15.5:0/2954632805 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f844400f620 con 0x7f84541025b0 2024-09-11T23:36:13.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.253+0000 7f845ba8d640 1 -- 172.21.15.5:0/2954632805 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84541a0200 con 0x7f84541025b0 2024-09-11T23:36:13.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.254+0000 7f845ba8d640 1 -- 172.21.15.5:0/2954632805 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84540fdca0 con 0x7f84541025b0 2024-09-11T23:36:13.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.256+0000 7f8452ffd640 1 -- 172.21.15.5:0/2954632805 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f84440109a0 con 0x7f84541025b0 2024-09-11T23:36:13.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.256+0000 7f8452ffd640 1 --2- 172.21.15.5:0/2954632805 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f843c0a2c10 0x7f843c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:13.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.256+0000 7f8459028640 1 --2- 172.21.15.5:0/2954632805 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f843c0a2c10 0x7f843c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:13.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.256+0000 7f8452ffd640 1 -- 172.21.15.5:0/2954632805 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7f84440cf020 con 0x7f84541025b0 2024-09-11T23:36:13.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.257+0000 7f8459028640 1 --2- 172.21.15.5:0/2954632805 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f843c0a2c10 0x7f843c0a50d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8448006010 tx=0x7f8448000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:36:13.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.260+0000 7f8452ffd640 1 -- 172.21.15.5:0/2954632805 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8444009de0 con 0x7f84541025b0 2024-09-11T23:36:13.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.437+0000 7f845ba8d640 1 -- 172.21.15.5:0/2954632805 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8454062ef0 con 0x7f84541025b0 2024-09-11T23:36:13.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.439+0000 7f8452ffd640 1 -- 172.21.15.5:0/2954632805 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24843 (secure 0 0 0) 0x7f844409bc40 con 0x7f84541025b0 2024-09-11T23:36:13.438 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:36:13.439 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":88,"fsid":"1f5284d2-7094-11ef-bcea-c7b262605968","created":"2024-09-11T23:19:00.051813+0000","modified":"2024-09-11T23:27:52.098396+0000","last_up_change":"2024-09-11T23:25:53.433445+0000","last_in_change":"2024-09-11T23:25:29.443287+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:22:04.534014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:26:41.220887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:26:43.664094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T23:26:50.471521+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bf95ced0-780b-482f-87da-0b5e61de62ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6803","nonce":624761084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6805","nonce":624761084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6809","nonce":624761084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6807","nonce":624761084}]},"public_addr":"172.21.15.5:6803/624761084","cluster_addr":"172.21.15.5:6805/624761084","heartbeat_back_addr":"172.21.15.5:6809/624761084","heartbeat_front_addr":"172.21.15.5:6807/624761084","state":["exists","up"]},{"osd":1,"uuid":"d926484f-78a6-497b-843d-f2db54ade4a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6801","nonce":2111290186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6803","nonce":2111290186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6807","nonce":2111290186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6805","nonce":2111290186}]},"public_addr":"172.21.15.159:6801/2111290186","cluster_addr":"172.21.15.159:6803/2111290186","heartbeat_back_addr":"172.21.15.159:6807/2111290186","heartbeat_front_addr":"172.21.15.159:6805/2111290186","state":["exists","up"]},{"osd":2,"uuid":"d92cd431-0ba7-4171-82b8-60fa3d63a64b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6801","nonce":299915717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6803","nonce":299915717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6807","nonce":299915717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6805","nonce":299915717}]},"public_addr":"172.21.15.172:6801/299915717","cluster_addr":"172.21.15.172:6803/299915717","heartbeat_back_addr":"172.21.15.172:6807/299915717","heartbeat_front_addr":"172.21.15.172:6805/299915717","state":["exists","up"]},{"osd":3,"uuid":"0521043b-559c-4671-b11e-9117871cff49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6811","nonce":2080498921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6813","nonce":2080498921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6817","nonce":2080498921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6815","nonce":2080498921}]},"public_addr":"172.21.15.5:6811/2080498921","cluster_addr":"172.21.15.5:6813/2080498921","heartbeat_back_addr":"172.21.15.5:6817/2080498921","heartbeat_front_addr":"172.21.15.5:6815/2080498921","state":["exists","up"]},{"osd":4,"uuid":"b968d762-a46e-4ae2-b19d-8225f82de613","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6809","nonce":4185908786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6811","nonce":4185908786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6815","nonce":4185908786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6813","nonce":4185908786}]},"public_addr":"172.21.15.159:6809/4185908786","cluster_addr":"172.21.15.159:6811/4185908786","heartbeat_back_addr":"172.21.15.159:6815/4185908786","heartbeat_front_addr":"172.21.15.159:6813/4185908786","state":["exists","up"]},{"osd":5,"uuid":"1b0a518a-3d17-4635-81da-52f9ef83a574","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6809","nonce":3742759000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6811","nonce":3742759000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6815","nonce":3742759000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6813","nonce":3742759000}]},"public_addr":"172.21.15.172:6809/3742759000","cluster_addr":"172.21.15.172:6811/3742759000","heartbeat_back_addr":"172.21.15.172:6815/3742759000","heartbeat_front_addr":"172.21.15.172:6813/3742759000","state":["exists","up"]},{"osd":6,"uuid":"c3a2db6c-9189-4e42-aa1e-52189a9c4291","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6819","nonce":4156823423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6821","nonce":4156823423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6825","nonce":4156823423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6823","nonce":4156823423}]},"public_addr":"172.21.15.5:6819/4156823423","cluster_addr":"172.21.15.5:6821/4156823423","heartbeat_back_addr":"172.21.15.5:6825/4156823423","heartbeat_front_addr":"172.21.15.5:6823/4156823423","state":["exists","up"]},{"osd":7,"uuid":"dfaadf28-74ab-4cda-8647-dcb58beb7cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6817","nonce":4222571927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6819","nonce":4222571927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6823","nonce":4222571927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6821","nonce":4222571927}]},"public_addr":"172.21.15.159:6817/4222571927","cluster_addr":"172.21.15.159:6819/4222571927","heartbeat_back_addr":"172.21.15.159:6823/4222571927","heartbeat_front_addr":"172.21.15.159:6821/4222571927","state":["exists","up"]},{"osd":8,"uuid":"47f66651-614c-4613-9793-69c140dbf705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6817","nonce":3661505951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6819","nonce":3661505951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6823","nonce":3661505951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6821","nonce":3661505951}]},"public_addr":"172.21.15.172:6817/3661505951","cluster_addr":"172.21.15.172:6819/3661505951","heartbeat_back_addr":"172.21.15.172:6823/3661505951","heartbeat_front_addr":"172.21.15.172:6821/3661505951","state":["exists","up"]},{"osd":9,"uuid":"c97b8221-8cf9-4fab-9e27-ff7f3bd98152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6827","nonce":72036667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6829","nonce":72036667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6833","nonce":72036667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6831","nonce":72036667}]},"public_addr":"172.21.15.5:6827/72036667","cluster_addr":"172.21.15.5:6829/72036667","heartbeat_back_addr":"172.21.15.5:6833/72036667","heartbeat_front_addr":"172.21.15.5:6831/72036667","state":["exists","up"]},{"osd":10,"uuid":"143376c1-f3f1-4df4-bcd3-a9b46fad8c1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6825","nonce":3334483164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6827","nonce":3334483164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6831","nonce":3334483164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6829","nonce":3334483164}]},"public_addr":"172.21.15.159:6825/3334483164","cluster_addr":"172.21.15.159:6827/3334483164","heartbeat_back_addr":"172.21.15.159:6831/3334483164","heartbeat_front_addr":"172.21.15.159:6829/3334483164","state":["exists","up"]},{"osd":11,"uuid":"5cc91ff9-fc0f-4e7a-8e4d-87df0e7efbeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6825","nonce":1965415663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6827","nonce":1965415663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6831","nonce":1965415663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6829","nonce":1965415663}]},"public_addr":"172.21.15.172:6825/1965415663","cluster_addr":"172.21.15.172:6827/1965415663","heartbeat_back_addr":"172.21.15.172:6831/1965415663","heartbeat_front_addr":"172.21.15.172:6829/1965415663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:21:13.024707+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:21:38.063741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:22:02.221583+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:22:27.919711+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:22:53.870543+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:23:18.539905+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:23:43.694229+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:24:08.984704+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:24:34.378582+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:25:00.102231+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:25:25.367178+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:25:51.439033+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":10}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/2713701762":"2024-09-12T23:19:50.031855+0000","172.21.15.5:0/3135835713":"2024-09-12T23:19:50.031855+0000","172.21.15.5:0/3935034940":"2024-09-12T23:19:50.031855+0000","172.21.15.5:6801/1790126649":"2024-09-12T23:19:50.031855+0000","172.21.15.5:6801/1358356358":"2024-09-12T23:19:26.149011+0000","172.21.15.5:6800/1790126649":"2024-09-12T23:19:50.031855+0000","172.21.15.5:6800/1358356358":"2024-09-12T23:19:26.149011+0000","172.21.15.5:0/2243688290":"2024-09-12T23:19:26.149011+0000","172.21.15.5:0/1493331899":"2024-09-12T23:19:26.149011+0000","172.21.15.5:0/2329812802":"2024-09-12T23:19:26.149011+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:36:13.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.441+0000 7f845ba8d640 1 -- 172.21.15.5:0/2954632805 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f843c0a2c10 msgr2=0x7f843c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:13.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.441+0000 7f845ba8d640 1 --2- 172.21.15.5:0/2954632805 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f843c0a2c10 0x7f843c0a50d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8448006010 tx=0x7f8448000bc0 comp rx=0 tx=0).stop 2024-09-11T23:36:13.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.441+0000 7f845ba8d640 1 -- 172.21.15.5:0/2954632805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84541025b0 msgr2=0x7f8454197e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:13.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.441+0000 7f845ba8d640 1 --2- 172.21.15.5:0/2954632805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84541025b0 0x7f8454197e40 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f844400d950 tx=0x7f844400de10 comp rx=0 tx=0).stop 2024-09-11T23:36:13.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.441+0000 7f845ba8d640 1 -- 172.21.15.5:0/2954632805 shutdown_connections 2024-09-11T23:36:13.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.441+0000 7f845ba8d640 1 --2- 172.21.15.5:0/2954632805 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f843c0a2c10 0x7f843c0a50d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:13.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.441+0000 7f845ba8d640 1 --2- 172.21.15.5:0/2954632805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8454107810 0x7f845419f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:13.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.441+0000 7f845ba8d640 1 --2- 172.21.15.5:0/2954632805 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8454104ee0 0x7f8454198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:13.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.441+0000 7f845ba8d640 1 --2- 172.21.15.5:0/2954632805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84541025b0 0x7f8454197e40 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:13.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.441+0000 7f845ba8d640 1 -- 172.21.15.5:0/2954632805 >> 172.21.15.5:0/2954632805 conn(0x7f84540fc1b0 msgr2=0x7f8454102f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:36:13.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.441+0000 7f845ba8d640 1 -- 172.21.15.5:0/2954632805 shutdown_connections 2024-09-11T23:36:13.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.441+0000 7f845ba8d640 1 -- 172.21.15.5:0/2954632805 wait complete. 2024-09-11T23:36:13.452 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T23:22:04.534014+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-11T23:26:41.220887+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-11T23:26:43.664094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-11T23:26:50.471521+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-11T23:36:13.452 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T23:36:13.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.561+0000 7faa8c45e640 1 -- 172.21.15.5:0/2776076998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa84102d00 msgr2=0x7faa84103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:13.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.561+0000 7faa8c45e640 1 --2- 172.21.15.5:0/2776076998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa84102d00 0x7faa84103180 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7faa74009900 tx=0x7faa7402a410 comp rx=0 tx=0).stop 2024-09-11T23:36:13.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.561+0000 7faa8c45e640 1 -- 172.21.15.5:0/2776076998 shutdown_connections 2024-09-11T23:36:13.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.561+0000 7faa8c45e640 1 --2- 172.21.15.5:0/2776076998 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa841036c0 0x7faa84109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:13.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.561+0000 7faa8c45e640 1 --2- 172.21.15.5:0/2776076998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa84102d00 0x7faa84103180 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:13.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.561+0000 7faa8c45e640 1 --2- 172.21.15.5:0/2776076998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa84101b10 0x7faa84101f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:13.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.561+0000 7faa8c45e640 1 -- 172.21.15.5:0/2776076998 >> 172.21.15.5:0/2776076998 conn(0x7faa840fd2b0 msgr2=0x7faa840ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:36:13.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.561+0000 7faa8c45e640 1 -- 172.21.15.5:0/2776076998 shutdown_connections 2024-09-11T23:36:13.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.562+0000 7faa8c45e640 1 -- 172.21.15.5:0/2776076998 wait complete. 2024-09-11T23:36:13.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.562+0000 7faa8c45e640 1 Processor -- start 2024-09-11T23:36:13.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.562+0000 7faa8c45e640 1 -- start start 2024-09-11T23:36:13.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.562+0000 7faa8c45e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa84101b10 0x7faa84075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:13.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.562+0000 7faa8c45e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa84102d00 0x7faa840745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:13.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.562+0000 7faa8c45e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa841036c0 0x7faa84074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:13.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.562+0000 7faa8c45e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7faa8410d690 con 0x7faa84101b10 2024-09-11T23:36:13.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.562+0000 7faa8c45e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7faa8410d510 con 0x7faa841036c0 2024-09-11T23:36:13.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.562+0000 7faa8c45e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7faa8410d810 con 0x7faa84102d00 2024-09-11T23:36:13.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.562+0000 7faa8a1fa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa84101b10 0x7faa84075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:13.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.562+0000 7faa8a1fa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa84101b10 0x7faa84075fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40946/0 (socket says 172.21.15.5:40946) 2024-09-11T23:36:13.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.562+0000 7faa8a1fa640 1 -- 172.21.15.5:0/430252802 learned_addr learned my addr 172.21.15.5:0/430252802 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:36:13.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.563+0000 7faa899f9640 1 --2- 172.21.15.5:0/430252802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa84102d00 0x7faa840745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:13.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.563+0000 7faa8a9fb640 1 --2- 172.21.15.5:0/430252802 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa841036c0 0x7faa84074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:13.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.563+0000 7faa8a1fa640 1 -- 172.21.15.5:0/430252802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa84102d00 msgr2=0x7faa840745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:13.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.563+0000 7faa8a1fa640 1 --2- 172.21.15.5:0/430252802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa84102d00 0x7faa840745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:13.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.563+0000 7faa8a1fa640 1 -- 172.21.15.5:0/430252802 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa841036c0 msgr2=0x7faa84074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:13.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.563+0000 7faa8a1fa640 1 --2- 172.21.15.5:0/430252802 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa841036c0 0x7faa84074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:13.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.563+0000 7faa8a1fa640 1 -- 172.21.15.5:0/430252802 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa840753b0 con 0x7faa84101b10 2024-09-11T23:36:13.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.563+0000 7faa8a1fa640 1 --2- 172.21.15.5:0/430252802 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa84101b10 0x7faa84075fa0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7faa8000c970 tx=0x7faa8000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:36:13.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.563+0000 7faa7b7fe640 1 -- 172.21.15.5:0/430252802 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa80004220 con 0x7faa84101b10 2024-09-11T23:36:13.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.563+0000 7faa7b7fe640 1 -- 172.21.15.5:0/430252802 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7faa800043c0 con 0x7faa84101b10 2024-09-11T23:36:13.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.563+0000 7faa8c45e640 1 -- 172.21.15.5:0/430252802 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa841a1ef0 con 0x7faa84101b10 2024-09-11T23:36:13.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.563+0000 7faa7b7fe640 1 -- 172.21.15.5:0/430252802 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa80004a00 con 0x7faa84101b10 2024-09-11T23:36:13.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.563+0000 7faa8c45e640 1 -- 172.21.15.5:0/430252802 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa841a22a0 con 0x7faa84101b10 2024-09-11T23:36:13.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.564+0000 7faa8c45e640 1 -- 172.21.15.5:0/430252802 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa84109040 con 0x7faa84101b10 2024-09-11T23:36:13.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.566+0000 7faa7b7fe640 1 -- 172.21.15.5:0/430252802 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7faa800079b0 con 0x7faa84101b10 2024-09-11T23:36:13.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.567+0000 7faa7b7fe640 1 --2- 172.21.15.5:0/430252802 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7faa700a2b90 0x7faa700a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:13.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.567+0000 7faa899f9640 1 --2- 172.21.15.5:0/430252802 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7faa700a2b90 0x7faa700a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:13.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.567+0000 7faa7b7fe640 1 -- 172.21.15.5:0/430252802 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7faa800cf4c0 con 0x7faa84101b10 2024-09-11T23:36:13.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.567+0000 7faa899f9640 1 --2- 172.21.15.5:0/430252802 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7faa700a2b90 0x7faa700a5050 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7faa740314e0 tx=0x7faa74005a20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:36:13.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.570+0000 7faa7b7fe640 1 -- 172.21.15.5:0/430252802 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faa80014030 con 0x7faa84101b10 2024-09-11T23:36:13.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:13 smithi005 ceph-mon[31201]: pgmap v569: 129 pgs: 129 active+clean; 205 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 346 op/s 2024-09-11T23:36:13.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:13 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/2954632805' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:36:13.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.746+0000 7faa8c45e640 1 -- 172.21.15.5:0/430252802 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7faa84062e90 con 0x7faa84101b10 2024-09-11T23:36:13.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.747+0000 7faa7b7fe640 1 -- 172.21.15.5:0/430252802 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) ==== 93+0+10 (secure 0 0 0) 0x7faa8009ba10 con 0x7faa84101b10 2024-09-11T23:36:13.747 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-11T23:36:13.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.749+0000 7faa8c45e640 1 -- 172.21.15.5:0/430252802 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7faa700a2b90 msgr2=0x7faa700a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:13.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.749+0000 7faa8c45e640 1 --2- 172.21.15.5:0/430252802 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7faa700a2b90 0x7faa700a5050 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7faa740314e0 tx=0x7faa74005a20 comp rx=0 tx=0).stop 2024-09-11T23:36:13.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.749+0000 7faa8c45e640 1 -- 172.21.15.5:0/430252802 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa84101b10 msgr2=0x7faa84075fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:13.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.749+0000 7faa8c45e640 1 --2- 172.21.15.5:0/430252802 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa84101b10 0x7faa84075fa0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7faa8000c970 tx=0x7faa8000ce30 comp rx=0 tx=0).stop 2024-09-11T23:36:13.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.749+0000 7faa8c45e640 1 -- 172.21.15.5:0/430252802 shutdown_connections 2024-09-11T23:36:13.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.749+0000 7faa8c45e640 1 --2- 172.21.15.5:0/430252802 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7faa700a2b90 0x7faa700a5050 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:13.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.749+0000 7faa8c45e640 1 --2- 172.21.15.5:0/430252802 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa841036c0 0x7faa84074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:13.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.749+0000 7faa8c45e640 1 --2- 172.21.15.5:0/430252802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa84102d00 0x7faa840745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:13.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.749+0000 7faa8c45e640 1 --2- 172.21.15.5:0/430252802 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa84101b10 0x7faa84075fa0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:13.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.749+0000 7faa8c45e640 1 -- 172.21.15.5:0/430252802 >> 172.21.15.5:0/430252802 conn(0x7faa840fd2b0 msgr2=0x7faa84106210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:36:13.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.749+0000 7faa8c45e640 1 -- 172.21.15.5:0/430252802 shutdown_connections 2024-09-11T23:36:13.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.749+0000 7faa8c45e640 1 -- 172.21.15.5:0/430252802 wait complete. 2024-09-11T23:36:13.760 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-11T23:36:13.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.867+0000 7f5dd14d7640 1 -- 172.21.15.5:0/88045038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5dcc1025c0 msgr2=0x7f5dcc108e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:13.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.867+0000 7f5dd14d7640 1 --2- 172.21.15.5:0/88045038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5dcc1025c0 0x7f5dcc108e50 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4009ca0 tx=0x7f5dc402a8c0 comp rx=0 tx=0).stop 2024-09-11T23:36:13.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.867+0000 7f5dd14d7640 1 -- 172.21.15.5:0/88045038 shutdown_connections 2024-09-11T23:36:13.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.867+0000 7f5dd14d7640 1 --2- 172.21.15.5:0/88045038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5dcc1025c0 0x7f5dcc108e50 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:13.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.867+0000 7f5dd14d7640 1 --2- 172.21.15.5:0/88045038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5dcc101c00 0x7f5dcc102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:13.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.867+0000 7f5dd14d7640 1 --2- 172.21.15.5:0/88045038 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5dcc100a10 0x7f5dcc100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:13.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.867+0000 7f5dd14d7640 1 -- 172.21.15.5:0/88045038 >> 172.21.15.5:0/88045038 conn(0x7f5dcc0fc190 msgr2=0x7f5dcc0fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:36:13.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.867+0000 7f5dd14d7640 1 -- 172.21.15.5:0/88045038 shutdown_connections 2024-09-11T23:36:13.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.867+0000 7f5dd14d7640 1 -- 172.21.15.5:0/88045038 wait complete. 2024-09-11T23:36:13.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.868+0000 7f5dd14d7640 1 Processor -- start 2024-09-11T23:36:13.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.868+0000 7f5dd14d7640 1 -- start start 2024-09-11T23:36:13.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.868+0000 7f5dd14d7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5dcc100a10 0x7f5dcc06af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:13.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.868+0000 7f5dd14d7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5dcc101c00 0x7f5dcc19ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:13.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.868+0000 7f5dd14d7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5dcc1025c0 0x7f5dcc19f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:13.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.868+0000 7f5dd14d7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5dcc10c520 con 0x7f5dcc100a10 2024-09-11T23:36:13.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.868+0000 7f5dd14d7640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5dcc10c3a0 con 0x7f5dcc1025c0 2024-09-11T23:36:13.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.868+0000 7f5dd14d7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5dcc10c6a0 con 0x7f5dcc101c00 2024-09-11T23:36:13.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.868+0000 7f5dcaffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5dcc100a10 0x7f5dcc06af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:13.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.868+0000 7f5dcaffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5dcc100a10 0x7f5dcc06af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40962/0 (socket says 172.21.15.5:40962) 2024-09-11T23:36:13.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.868+0000 7f5dcaffd640 1 -- 172.21.15.5:0/1561627419 learned_addr learned my addr 172.21.15.5:0/1561627419 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:36:13.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.869+0000 7f5dca7fc640 1 --2- 172.21.15.5:0/1561627419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5dcc101c00 0x7f5dcc19ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:13.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.869+0000 7f5dcaffd640 1 -- 172.21.15.5:0/1561627419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5dcc101c00 msgr2=0x7f5dcc19ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:13.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.869+0000 7f5dcaffd640 1 --2- 172.21.15.5:0/1561627419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5dcc101c00 0x7f5dcc19ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:13.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.869+0000 7f5dcaffd640 1 -- 172.21.15.5:0/1561627419 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5dcc1025c0 msgr2=0x7f5dcc19f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:13.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.869+0000 7f5dcb7fe640 1 --2- 172.21.15.5:0/1561627419 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5dcc1025c0 0x7f5dcc19f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:13.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.869+0000 7f5dcaffd640 1 --2- 172.21.15.5:0/1561627419 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5dcc1025c0 0x7f5dcc19f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:13.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.869+0000 7f5dcaffd640 1 -- 172.21.15.5:0/1561627419 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dcc19f930 con 0x7f5dcc100a10 2024-09-11T23:36:13.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.869+0000 7f5dcaffd640 1 --2- 172.21.15.5:0/1561627419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5dcc100a10 0x7f5dcc06af10 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc00e9c0 tx=0x7f5dbc00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:36:13.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.869+0000 7f5db3fff640 1 -- 172.21.15.5:0/1561627419 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc00cd80 con 0x7f5dcc100a10 2024-09-11T23:36:13.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.869+0000 7f5dd14d7640 1 -- 172.21.15.5:0/1561627419 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dcc19fc20 con 0x7f5dcc100a10 2024-09-11T23:36:13.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.869+0000 7f5db3fff640 1 -- 172.21.15.5:0/1561627419 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5dbc0035f0 con 0x7f5dcc100a10 2024-09-11T23:36:13.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.869+0000 7f5db3fff640 1 -- 172.21.15.5:0/1561627419 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc010690 con 0x7f5dcc100a10 2024-09-11T23:36:13.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.869+0000 7f5dd14d7640 1 -- 172.21.15.5:0/1561627419 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dcc1a01c0 con 0x7f5dcc100a10 2024-09-11T23:36:13.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.870+0000 7f5dd14d7640 1 -- 172.21.15.5:0/1561627419 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dcc107e20 con 0x7f5dcc100a10 2024-09-11T23:36:13.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.872+0000 7f5db3fff640 1 -- 172.21.15.5:0/1561627419 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f5dbc0037a0 con 0x7f5dcc100a10 2024-09-11T23:36:13.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.873+0000 7f5db3fff640 1 --2- 172.21.15.5:0/1561627419 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f5db40a2b90 0x7f5db40a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:13.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.873+0000 7f5db3fff640 1 -- 172.21.15.5:0/1561627419 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7f5dbc0cfa20 con 0x7f5dcc100a10 2024-09-11T23:36:13.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.873+0000 7f5dca7fc640 1 --2- 172.21.15.5:0/1561627419 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f5db40a2b90 0x7f5db40a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:13.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.873+0000 7f5dca7fc640 1 --2- 172.21.15.5:0/1561627419 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f5db40a2b90 0x7f5db40a5050 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc06ac80 tx=0x7f5dc0005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:36:13.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:13.876+0000 7f5db3fff640 1 -- 172.21.15.5:0/1561627419 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5dbc09c560 con 0x7f5dcc100a10 2024-09-11T23:36:13.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:13 smithi159 ceph-mon[34394]: pgmap v569: 129 pgs: 129 active+clean; 205 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 346 op/s 2024-09-11T23:36:13.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:13 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/2954632805' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:36:13.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:13 smithi172 ceph-mon[34855]: pgmap v569: 129 pgs: 129 active+clean; 205 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 346 op/s 2024-09-11T23:36:13.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:13 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/2954632805' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:36:14.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.051+0000 7f5dd14d7640 1 -- 172.21.15.5:0/1561627419 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f5dcc02da10 con 0x7f5dcc100a10 2024-09-11T23:36:14.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.051+0000 7f5db3fff640 1 -- 172.21.15.5:0/1561627419 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) ==== 104+0+11 (secure 0 0 0) 0x7f5dbc09be60 con 0x7f5dcc100a10 2024-09-11T23:36:14.051 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-11T23:36:14.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.053+0000 7f5dd14d7640 1 -- 172.21.15.5:0/1561627419 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f5db40a2b90 msgr2=0x7f5db40a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:14.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.053+0000 7f5dd14d7640 1 --2- 172.21.15.5:0/1561627419 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f5db40a2b90 0x7f5db40a5050 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc06ac80 tx=0x7f5dc0005f90 comp rx=0 tx=0).stop 2024-09-11T23:36:14.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.053+0000 7f5dd14d7640 1 -- 172.21.15.5:0/1561627419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5dcc100a10 msgr2=0x7f5dcc06af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:14.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.053+0000 7f5dd14d7640 1 --2- 172.21.15.5:0/1561627419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5dcc100a10 0x7f5dcc06af10 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc00e9c0 tx=0x7f5dbc00ee80 comp rx=0 tx=0).stop 2024-09-11T23:36:14.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.053+0000 7f5dd14d7640 1 -- 172.21.15.5:0/1561627419 shutdown_connections 2024-09-11T23:36:14.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.053+0000 7f5dd14d7640 1 --2- 172.21.15.5:0/1561627419 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f5db40a2b90 0x7f5db40a5050 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:14.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.053+0000 7f5dd14d7640 1 --2- 172.21.15.5:0/1561627419 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5dcc1025c0 0x7f5dcc19f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:14.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.053+0000 7f5dd14d7640 1 --2- 172.21.15.5:0/1561627419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5dcc101c00 0x7f5dcc19ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:14.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.053+0000 7f5dd14d7640 1 --2- 172.21.15.5:0/1561627419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5dcc100a10 0x7f5dcc06af10 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:14.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.053+0000 7f5dd14d7640 1 -- 172.21.15.5:0/1561627419 >> 172.21.15.5:0/1561627419 conn(0x7f5dcc0fc190 msgr2=0x7f5dcc104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:36:14.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.054+0000 7f5dd14d7640 1 -- 172.21.15.5:0/1561627419 shutdown_connections 2024-09-11T23:36:14.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.054+0000 7f5dd14d7640 1 -- 172.21.15.5:0/1561627419 wait complete. 2024-09-11T23:36:14.064 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-11T23:36:14.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.171+0000 7ff254931640 1 -- 172.21.15.5:0/3320029327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2501025b0 msgr2=0x7ff250108e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:14.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.171+0000 7ff254931640 1 --2- 172.21.15.5:0/3320029327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2501025b0 0x7ff250108e40 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff248009ca0 tx=0x7ff24802a8c0 comp rx=0 tx=0).stop 2024-09-11T23:36:14.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.171+0000 7ff254931640 1 -- 172.21.15.5:0/3320029327 shutdown_connections 2024-09-11T23:36:14.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.171+0000 7ff254931640 1 --2- 172.21.15.5:0/3320029327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2501025b0 0x7ff250108e40 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:14.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.171+0000 7ff254931640 1 --2- 172.21.15.5:0/3320029327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff250101bf0 0x7ff250102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:14.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.171+0000 7ff254931640 1 --2- 172.21.15.5:0/3320029327 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff250100a00 0x7ff250100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:14.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.171+0000 7ff254931640 1 -- 172.21.15.5:0/3320029327 >> 172.21.15.5:0/3320029327 conn(0x7ff2500fc160 msgr2=0x7ff2500fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:36:14.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.171+0000 7ff254931640 1 -- 172.21.15.5:0/3320029327 shutdown_connections 2024-09-11T23:36:14.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.171+0000 7ff254931640 1 -- 172.21.15.5:0/3320029327 wait complete. 2024-09-11T23:36:14.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.172+0000 7ff254931640 1 Processor -- start 2024-09-11T23:36:14.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.172+0000 7ff254931640 1 -- start start 2024-09-11T23:36:14.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.172+0000 7ff254931640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff250100a00 0x7ff25006aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:14.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.172+0000 7ff254931640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff250101bf0 0x7ff25019ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:14.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.172+0000 7ff254931640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2501025b0 0x7ff25019f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:14.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.172+0000 7ff254931640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff25010c530 con 0x7ff2501025b0 2024-09-11T23:36:14.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.172+0000 7ff254931640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff25010c3b0 con 0x7ff250101bf0 2024-09-11T23:36:14.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.172+0000 7ff254931640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff25010c6b0 con 0x7ff250100a00 2024-09-11T23:36:14.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.172+0000 7ff24ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2501025b0 0x7ff25019f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:14.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.173+0000 7ff24ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2501025b0 0x7ff25019f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40990/0 (socket says 172.21.15.5:40990) 2024-09-11T23:36:14.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.173+0000 7ff24ed9d640 1 -- 172.21.15.5:0/3846491956 learned_addr learned my addr 172.21.15.5:0/3846491956 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:36:14.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.173+0000 7ff24e59c640 1 --2- 172.21.15.5:0/3846491956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff250100a00 0x7ff25006aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:14.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.173+0000 7ff24dd9b640 1 --2- 172.21.15.5:0/3846491956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff250101bf0 0x7ff25019ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:14.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.173+0000 7ff24ed9d640 1 -- 172.21.15.5:0/3846491956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff250100a00 msgr2=0x7ff25006aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:14.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.173+0000 7ff24ed9d640 1 --2- 172.21.15.5:0/3846491956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff250100a00 0x7ff25006aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:14.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.173+0000 7ff24ed9d640 1 -- 172.21.15.5:0/3846491956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff250101bf0 msgr2=0x7ff25019ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:14.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.173+0000 7ff24ed9d640 1 --2- 172.21.15.5:0/3846491956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff250101bf0 0x7ff25019ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:14.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.173+0000 7ff24ed9d640 1 -- 172.21.15.5:0/3846491956 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff25019f9c0 con 0x7ff2501025b0 2024-09-11T23:36:14.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.173+0000 7ff24dd9b640 1 --2- 172.21.15.5:0/3846491956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff250101bf0 0x7ff25019ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:36:14.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.173+0000 7ff24ed9d640 1 --2- 172.21.15.5:0/3846491956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2501025b0 0x7ff25019f0b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff248031970 tx=0x7ff248003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:36:14.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.173+0000 7ff23f7fe640 1 -- 172.21.15.5:0/3846491956 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff248004040 con 0x7ff2501025b0 2024-09-11T23:36:14.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.173+0000 7ff254931640 1 -- 172.21.15.5:0/3846491956 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff25019fbf0 con 0x7ff2501025b0 2024-09-11T23:36:14.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.173+0000 7ff23f7fe640 1 -- 172.21.15.5:0/3846491956 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff248004690 con 0x7ff2501025b0 2024-09-11T23:36:14.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.173+0000 7ff254931640 1 -- 172.21.15.5:0/3846491956 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2501a0190 con 0x7ff2501025b0 2024-09-11T23:36:14.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.173+0000 7ff23f7fe640 1 -- 172.21.15.5:0/3846491956 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff248030c40 con 0x7ff2501025b0 2024-09-11T23:36:14.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.174+0000 7ff254931640 1 -- 172.21.15.5:0/3846491956 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff250107ee0 con 0x7ff2501025b0 2024-09-11T23:36:14.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.175+0000 7ff23f7fe640 1 -- 172.21.15.5:0/3846491956 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7ff2480041e0 con 0x7ff2501025b0 2024-09-11T23:36:14.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.176+0000 7ff23f7fe640 1 --2- 172.21.15.5:0/3846491956 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7ff2380a2b90 0x7ff2380a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:14.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.176+0000 7ff24e59c640 1 --2- 172.21.15.5:0/3846491956 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7ff2380a2b90 0x7ff2380a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:14.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.176+0000 7ff23f7fe640 1 -- 172.21.15.5:0/3846491956 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7ff2480f0cf0 con 0x7ff2501025b0 2024-09-11T23:36:14.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.177+0000 7ff24e59c640 1 --2- 172.21.15.5:0/3846491956 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7ff2380a2b90 0x7ff2380a5050 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff250101a50 tx=0x7ff240005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:36:14.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.179+0000 7ff23f7fe640 1 -- 172.21.15.5:0/3846491956 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff2480bd890 con 0x7ff2501025b0 2024-09-11T23:36:14.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.365+0000 7ff254931640 1 -- 172.21.15.5:0/3846491956 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff25002da10 con 0x7ff2501025b0 2024-09-11T23:36:14.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.367+0000 7ff23f7fe640 1 -- 172.21.15.5:0/3846491956 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) ==== 100+0+11 (secure 0 0 0) 0x7ff2480bd190 con 0x7ff2501025b0 2024-09-11T23:36:14.366 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-11T23:36:14.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.371+0000 7ff254931640 1 -- 172.21.15.5:0/3846491956 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7ff2380a2b90 msgr2=0x7ff2380a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:14.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.371+0000 7ff254931640 1 --2- 172.21.15.5:0/3846491956 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7ff2380a2b90 0x7ff2380a5050 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff250101a50 tx=0x7ff240005f90 comp rx=0 tx=0).stop 2024-09-11T23:36:14.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.371+0000 7ff254931640 1 -- 172.21.15.5:0/3846491956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2501025b0 msgr2=0x7ff25019f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:14.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.371+0000 7ff254931640 1 --2- 172.21.15.5:0/3846491956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2501025b0 0x7ff25019f0b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff248031970 tx=0x7ff248003ba0 comp rx=0 tx=0).stop 2024-09-11T23:36:14.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.372+0000 7ff254931640 1 -- 172.21.15.5:0/3846491956 shutdown_connections 2024-09-11T23:36:14.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.372+0000 7ff254931640 1 --2- 172.21.15.5:0/3846491956 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7ff2380a2b90 0x7ff2380a5050 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:14.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.372+0000 7ff254931640 1 --2- 172.21.15.5:0/3846491956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2501025b0 0x7ff25019f0b0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:14.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.372+0000 7ff254931640 1 --2- 172.21.15.5:0/3846491956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff250101bf0 0x7ff25019ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:14.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.372+0000 7ff254931640 1 --2- 172.21.15.5:0/3846491956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff250100a00 0x7ff25006aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:14.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.372+0000 7ff254931640 1 -- 172.21.15.5:0/3846491956 >> 172.21.15.5:0/3846491956 conn(0x7ff2500fc160 msgr2=0x7ff2501050b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:36:14.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.372+0000 7ff254931640 1 -- 172.21.15.5:0/3846491956 shutdown_connections 2024-09-11T23:36:14.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.372+0000 7ff254931640 1 -- 172.21.15.5:0/3846491956 wait complete. 2024-09-11T23:36:14.389 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-11T23:36:14.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.537+0000 7f456b15b640 1 -- 172.21.15.5:0/490783275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4564102600 msgr2=0x7f45641049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:14.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.537+0000 7f456b15b640 1 --2- 172.21.15.5:0/490783275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4564102600 0x7f45641049f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4560009900 tx=0x7f456002a410 comp rx=0 tx=0).stop 2024-09-11T23:36:14.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.537+0000 7f456b15b640 1 -- 172.21.15.5:0/490783275 shutdown_connections 2024-09-11T23:36:14.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.537+0000 7f456b15b640 1 --2- 172.21.15.5:0/490783275 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4564107860 0x7f4564109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:14.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.537+0000 7f456b15b640 1 --2- 172.21.15.5:0/490783275 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4564104f30 0x7f4564107320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:14.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.537+0000 7f456b15b640 1 --2- 172.21.15.5:0/490783275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4564102600 0x7f45641049f0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:14.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.537+0000 7f456b15b640 1 -- 172.21.15.5:0/490783275 >> 172.21.15.5:0/490783275 conn(0x7f45640fc140 msgr2=0x7f45640fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:36:14.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.537+0000 7f456b15b640 1 -- 172.21.15.5:0/490783275 shutdown_connections 2024-09-11T23:36:14.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.537+0000 7f456b15b640 1 -- 172.21.15.5:0/490783275 wait complete. 2024-09-11T23:36:14.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.538+0000 7f456b15b640 1 Processor -- start 2024-09-11T23:36:14.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.538+0000 7f456b15b640 1 -- start start 2024-09-11T23:36:14.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.538+0000 7f456b15b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4564102600 0x7f4564197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:14.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.538+0000 7f456b15b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4564104f30 0x7f4564198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:14.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.538+0000 7f456b15b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4564107860 0x7f456419f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:14.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.538+0000 7f456b15b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f456410d6a0 con 0x7f4564107860 2024-09-11T23:36:14.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.538+0000 7f456b15b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f456410d520 con 0x7f4564102600 2024-09-11T23:36:14.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.538+0000 7f456b15b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f456410d820 con 0x7f4564104f30 2024-09-11T23:36:14.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.538+0000 7f45696f8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4564107860 0x7f456419f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:14.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.538+0000 7f45696f8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4564107860 0x7f456419f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41018/0 (socket says 172.21.15.5:41018) 2024-09-11T23:36:14.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.538+0000 7f45696f8640 1 -- 172.21.15.5:0/2315535785 learned_addr learned my addr 172.21.15.5:0/2315535785 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:36:14.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.538+0000 7f4568ef7640 1 --2- 172.21.15.5:0/2315535785 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4564102600 0x7f4564197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:14.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.539+0000 7f455bfff640 1 --2- 172.21.15.5:0/2315535785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4564104f30 0x7f4564198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:14.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.539+0000 7f45696f8640 1 -- 172.21.15.5:0/2315535785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4564104f30 msgr2=0x7f4564198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:14.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.539+0000 7f45696f8640 1 --2- 172.21.15.5:0/2315535785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4564104f30 0x7f4564198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:14.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.539+0000 7f45696f8640 1 -- 172.21.15.5:0/2315535785 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4564102600 msgr2=0x7f4564197e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:14.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.539+0000 7f45696f8640 1 --2- 172.21.15.5:0/2315535785 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4564102600 0x7f4564197e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:14.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.539+0000 7f45696f8640 1 -- 172.21.15.5:0/2315535785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f456419fa70 con 0x7f4564107860 2024-09-11T23:36:14.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.539+0000 7f45696f8640 1 --2- 172.21.15.5:0/2315535785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4564107860 0x7f456419f400 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f455c00eb40 tx=0x7f455c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:36:14.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.539+0000 7f4559ffb640 1 -- 172.21.15.5:0/2315535785 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455c004b20 con 0x7f4564107860 2024-09-11T23:36:14.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.539+0000 7f4559ffb640 1 -- 172.21.15.5:0/2315535785 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f455c004cc0 con 0x7f4564107860 2024-09-11T23:36:14.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.539+0000 7f456b15b640 1 -- 172.21.15.5:0/2315535785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f456419fd60 con 0x7f4564107860 2024-09-11T23:36:14.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.539+0000 7f4559ffb640 1 -- 172.21.15.5:0/2315535785 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455c0107b0 con 0x7f4564107860 2024-09-11T23:36:14.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.539+0000 7f456b15b640 1 -- 172.21.15.5:0/2315535785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45641a0250 con 0x7f4564107860 2024-09-11T23:36:14.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.540+0000 7f456b15b640 1 -- 172.21.15.5:0/2315535785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45640fdc30 con 0x7f4564107860 2024-09-11T23:36:14.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.541+0000 7f4559ffb640 1 -- 172.21.15.5:0/2315535785 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f455c005020 con 0x7f4564107860 2024-09-11T23:36:14.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.542+0000 7f4559ffb640 1 --2- 172.21.15.5:0/2315535785 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f454c0a2b90 0x7f454c0a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:14.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.542+0000 7f4559ffb640 1 -- 172.21.15.5:0/2315535785 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7f455c0cfbe0 con 0x7f4564107860 2024-09-11T23:36:14.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.542+0000 7f4568ef7640 1 --2- 172.21.15.5:0/2315535785 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f454c0a2b90 0x7f454c0a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:14.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.542+0000 7f4568ef7640 1 --2- 172.21.15.5:0/2315535785 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f454c0a2b90 0x7f454c0a5050 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4560006010 tx=0x7f4560000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:36:14.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.546+0000 7f4559ffb640 1 -- 172.21.15.5:0/2315535785 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f455c09c720 con 0x7f4564107860 2024-09-11T23:36:14.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:14 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/430252802' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T23:36:14.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:14 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/1561627419' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-11T23:36:14.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:14 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/3846491956' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-11T23:36:14.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.728+0000 7f456b15b640 1 -- 172.21.15.5:0/2315535785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f4564062e90 con 0x7f4564107860 2024-09-11T23:36:14.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.728+0000 7f4559ffb640 1 -- 172.21.15.5:0/2315535785 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v88) ==== 103+0+11 (secure 0 0 0) 0x7f455c09c020 con 0x7f4564107860 2024-09-11T23:36:14.728 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-11T23:36:14.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.731+0000 7f456b15b640 1 -- 172.21.15.5:0/2315535785 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f454c0a2b90 msgr2=0x7f454c0a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:14.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.731+0000 7f456b15b640 1 --2- 172.21.15.5:0/2315535785 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f454c0a2b90 0x7f454c0a5050 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4560006010 tx=0x7f4560000bc0 comp rx=0 tx=0).stop 2024-09-11T23:36:14.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.731+0000 7f456b15b640 1 -- 172.21.15.5:0/2315535785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4564107860 msgr2=0x7f456419f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:14.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.731+0000 7f456b15b640 1 --2- 172.21.15.5:0/2315535785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4564107860 0x7f456419f400 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f455c00eb40 tx=0x7f455c00c2d0 comp rx=0 tx=0).stop 2024-09-11T23:36:14.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.731+0000 7f456b15b640 1 -- 172.21.15.5:0/2315535785 shutdown_connections 2024-09-11T23:36:14.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.731+0000 7f456b15b640 1 --2- 172.21.15.5:0/2315535785 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f454c0a2b90 0x7f454c0a5050 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:14.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.731+0000 7f456b15b640 1 --2- 172.21.15.5:0/2315535785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4564107860 0x7f456419f400 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:14.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.731+0000 7f456b15b640 1 --2- 172.21.15.5:0/2315535785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4564104f30 0x7f4564198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:14.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.731+0000 7f456b15b640 1 --2- 172.21.15.5:0/2315535785 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4564102600 0x7f4564197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:14.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.731+0000 7f456b15b640 1 -- 172.21.15.5:0/2315535785 >> 172.21.15.5:0/2315535785 conn(0x7f45640fc140 msgr2=0x7f4564102ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:36:14.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.731+0000 7f456b15b640 1 -- 172.21.15.5:0/2315535785 shutdown_connections 2024-09-11T23:36:14.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.731+0000 7f456b15b640 1 -- 172.21.15.5:0/2315535785 wait complete. 2024-09-11T23:36:14.741 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-11T23:36:14.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.845+0000 7f7ae63d8640 1 -- 172.21.15.5:0/2938531099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ae0100a10 msgr2=0x7f7ae0100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:14.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.845+0000 7f7ae63d8640 1 --2- 172.21.15.5:0/2938531099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ae0100a10 0x7f7ae0100e10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0009900 tx=0x7f7ad002a410 comp rx=0 tx=0).stop 2024-09-11T23:36:14.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.845+0000 7f7ae63d8640 1 -- 172.21.15.5:0/2938531099 shutdown_connections 2024-09-11T23:36:14.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.845+0000 7f7ae63d8640 1 --2- 172.21.15.5:0/2938531099 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ae01025c0 0x7f7ae0108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:14.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.845+0000 7f7ae63d8640 1 --2- 172.21.15.5:0/2938531099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ae0101c00 0x7f7ae0102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:14.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.845+0000 7f7ae63d8640 1 --2- 172.21.15.5:0/2938531099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ae0100a10 0x7f7ae0100e10 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:14.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.845+0000 7f7ae63d8640 1 -- 172.21.15.5:0/2938531099 >> 172.21.15.5:0/2938531099 conn(0x7f7ae00fc170 msgr2=0x7f7ae00fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:36:14.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.845+0000 7f7ae63d8640 1 -- 172.21.15.5:0/2938531099 shutdown_connections 2024-09-11T23:36:14.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.845+0000 7f7ae63d8640 1 -- 172.21.15.5:0/2938531099 wait complete. 2024-09-11T23:36:14.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.845+0000 7f7ae63d8640 1 Processor -- start 2024-09-11T23:36:14.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.845+0000 7f7ae63d8640 1 -- start start 2024-09-11T23:36:14.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.846+0000 7f7ae63d8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ae0100a10 0x7f7ae0069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:14.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.846+0000 7f7ae63d8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ae0101c00 0x7f7ae019caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:14.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.846+0000 7f7ae63d8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ae01025c0 0x7f7ae019f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:14.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.846+0000 7f7ae63d8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae010c520 con 0x7f7ae01025c0 2024-09-11T23:36:14.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.846+0000 7f7ae63d8640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae010c3a0 con 0x7f7ae0101c00 2024-09-11T23:36:14.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.846+0000 7f7ae63d8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae010c6a0 con 0x7f7ae0100a10 2024-09-11T23:36:14.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.846+0000 7f7ae4975640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ae01025c0 0x7f7ae019f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:14.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.846+0000 7f7ae4975640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ae01025c0 0x7f7ae019f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41026/0 (socket says 172.21.15.5:41026) 2024-09-11T23:36:14.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.846+0000 7f7ae4975640 1 -- 172.21.15.5:0/2757297838 learned_addr learned my addr 172.21.15.5:0/2757297838 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:36:14.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.846+0000 7f7adf7fe640 1 --2- 172.21.15.5:0/2757297838 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ae0101c00 0x7f7ae019caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:14.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.846+0000 7f7adffff640 1 --2- 172.21.15.5:0/2757297838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ae0100a10 0x7f7ae0069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:14.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.846+0000 7f7ae4975640 1 -- 172.21.15.5:0/2757297838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ae0100a10 msgr2=0x7f7ae0069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:14.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.846+0000 7f7ae4975640 1 --2- 172.21.15.5:0/2757297838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ae0100a10 0x7f7ae0069ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:14.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.846+0000 7f7ae4975640 1 -- 172.21.15.5:0/2757297838 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ae0101c00 msgr2=0x7f7ae019caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:14.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.846+0000 7f7ae4975640 1 --2- 172.21.15.5:0/2757297838 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ae0101c00 0x7f7ae019caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:14.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.846+0000 7f7ae4975640 1 -- 172.21.15.5:0/2757297838 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ae019f9d0 con 0x7f7ae01025c0 2024-09-11T23:36:14.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.846+0000 7f7adffff640 1 --2- 172.21.15.5:0/2757297838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ae0100a10 0x7f7ae0069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:36:14.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.846+0000 7f7ae4975640 1 --2- 172.21.15.5:0/2757297838 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ae01025c0 0x7f7ae019f0c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7ad800eb10 tx=0x7f7ad800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:36:14.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.847+0000 7f7add7fa640 1 -- 172.21.15.5:0/2757297838 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad8004b20 con 0x7f7ae01025c0 2024-09-11T23:36:14.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.847+0000 7f7add7fa640 1 -- 172.21.15.5:0/2757297838 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7ad8004cc0 con 0x7f7ae01025c0 2024-09-11T23:36:14.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.847+0000 7f7ae63d8640 1 -- 172.21.15.5:0/2757297838 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ae019fc60 con 0x7f7ae01025c0 2024-09-11T23:36:14.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.847+0000 7f7add7fa640 1 -- 172.21.15.5:0/2757297838 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad8010690 con 0x7f7ae01025c0 2024-09-11T23:36:14.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.847+0000 7f7ae63d8640 1 -- 172.21.15.5:0/2757297838 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ae01a0160 con 0x7f7ae01025c0 2024-09-11T23:36:14.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.848+0000 7f7ae63d8640 1 -- 172.21.15.5:0/2757297838 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ae0107e90 con 0x7f7ae01025c0 2024-09-11T23:36:14.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.850+0000 7f7add7fa640 1 -- 172.21.15.5:0/2757297838 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f7ad8005000 con 0x7f7ae01025c0 2024-09-11T23:36:14.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.850+0000 7f7add7fa640 1 --2- 172.21.15.5:0/2757297838 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f7ac80a2b90 0x7f7ac80a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:14.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.850+0000 7f7adffff640 1 --2- 172.21.15.5:0/2757297838 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f7ac80a2b90 0x7f7ac80a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:14.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.850+0000 7f7add7fa640 1 -- 172.21.15.5:0/2757297838 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7f7ad80cfb90 con 0x7f7ae01025c0 2024-09-11T23:36:14.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.851+0000 7f7adffff640 1 --2- 172.21.15.5:0/2757297838 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f7ac80a2b90 0x7f7ac80a5050 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0000c00 tx=0x7f7ad0032c40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:36:14.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:14.854+0000 7f7add7fa640 1 -- 172.21.15.5:0/2757297838 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7ad80541b0 con 0x7f7ae01025c0 2024-09-11T23:36:14.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:14 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/430252802' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T23:36:14.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:14 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/1561627419' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-11T23:36:14.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:14 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/3846491956' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-11T23:36:14.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:14 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/430252802' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T23:36:14.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:14 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/1561627419' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-11T23:36:14.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:14 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/3846491956' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-11T23:36:15.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:15.079+0000 7f7ae63d8640 1 -- 172.21.15.5:0/2757297838 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f7ae002da10 con 0x7f7ae01025c0 2024-09-11T23:36:15.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:15.087+0000 7f7add7fa640 1 -- 172.21.15.5:0/2757297838 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+740362 (secure 0 0 0) 0x7f7ad809c730 con 0x7f7ae01025c0 2024-09-11T23:36:15.097 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:36:15.098 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-11T23:36:15.098 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 18, 2024-09-11T23:36:15.098 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.098 INFO:teuthology.orchestra.run.smithi005.stdout: "active_gid": 14148, 2024-09-11T23:36:15.098 INFO:teuthology.orchestra.run.smithi005.stdout: "active_name": "x", 2024-09-11T23:36:15.098 INFO:teuthology.orchestra.run.smithi005.stdout: "active_addrs": { 2024-09-11T23:36:15.098 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-11T23:36:15.098 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.098 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-11T23:36:15.098 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6800", 2024-09-11T23:36:15.098 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2285128668 2024-09-11T23:36:15.099 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.099 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.099 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-11T23:36:15.099 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6801", 2024-09-11T23:36:15.099 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2285128668 2024-09-11T23:36:15.099 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.099 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-11T23:36:15.099 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.099 INFO:teuthology.orchestra.run.smithi005.stdout: "active_addr": "172.21.15.5:6801/2285128668", 2024-09-11T23:36:15.099 INFO:teuthology.orchestra.run.smithi005.stdout: "active_change": "2024-09-11T23:19:50.032000+0000", 2024-09-11T23:36:15.099 INFO:teuthology.orchestra.run.smithi005.stdout: "active_mgr_features": 4540701547738038271, 2024-09-11T23:36:15.099 INFO:teuthology.orchestra.run.smithi005.stdout: "available": true, 2024-09-11T23:36:15.099 INFO:teuthology.orchestra.run.smithi005.stdout: "standbys": [ 2024-09-11T23:36:15.100 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.100 INFO:teuthology.orchestra.run.smithi005.stdout: "gid": 24109, 2024-09-11T23:36:15.100 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "z", 2024-09-11T23:36:15.100 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_features": 4540701547738038271, 2024-09-11T23:36:15.100 INFO:teuthology.orchestra.run.smithi005.stdout: "available_modules": [ 2024-09-11T23:36:15.100 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.100 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "alerts", 2024-09-11T23:36:15.100 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.100 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.100 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.100 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2024-09-11T23:36:15.100 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2024-09-11T23:36:15.101 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:15.101 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.101 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.101 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2024-09-11T23:36:15.101 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.101 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.101 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.101 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How frequently to reexamine health status", 2024-09-11T23:36:15.101 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.101 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.101 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.101 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.101 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.102 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.102 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.102 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.102 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.102 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.102 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.102 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.102 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.102 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.102 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.102 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.102 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.103 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.103 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.103 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.103 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.103 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.103 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.103 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.103 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.103 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.103 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.103 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.103 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.103 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.103 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.104 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.104 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.104 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.104 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.104 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.104 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.104 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.104 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.104 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.104 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.104 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.104 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.105 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.105 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.105 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.105 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.105 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.105 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.105 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.105 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.105 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.105 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.105 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.105 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.105 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.106 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.106 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.106 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.106 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.106 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.106 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.106 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.106 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.106 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.106 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.106 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.106 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.107 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.107 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.107 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.107 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.107 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.107 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.107 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_destination": { 2024-09-11T23:36:15.107 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_destination", 2024-09-11T23:36:15.107 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.108 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.108 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.108 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.108 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.108 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.108 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.108 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Email address to send alerts to", 2024-09-11T23:36:15.108 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.108 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.108 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.108 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.108 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_from_name": { 2024-09-11T23:36:15.109 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_from_name", 2024-09-11T23:36:15.109 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.109 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.109 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.109 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "Ceph", 2024-09-11T23:36:15.109 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.109 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.109 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.109 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Email From: name", 2024-09-11T23:36:15.109 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.109 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.109 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.109 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.110 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_host": { 2024-09-11T23:36:15.110 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_host", 2024-09-11T23:36:15.110 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.110 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.110 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.110 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.110 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.110 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.110 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.110 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP server", 2024-09-11T23:36:15.110 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.111 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.111 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.111 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.111 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_password": { 2024-09-11T23:36:15.111 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_password", 2024-09-11T23:36:15.111 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.111 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.111 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.111 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.111 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.111 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.111 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.112 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Password to authenticate with", 2024-09-11T23:36:15.112 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.112 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.112 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.112 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.112 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_port": { 2024-09-11T23:36:15.112 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_port", 2024-09-11T23:36:15.112 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.112 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.112 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.112 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "465", 2024-09-11T23:36:15.112 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.112 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.113 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.113 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP port", 2024-09-11T23:36:15.113 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.113 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.113 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.113 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.113 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_sender": { 2024-09-11T23:36:15.113 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_sender", 2024-09-11T23:36:15.113 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.113 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.113 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.113 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.114 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.114 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.114 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.114 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP envelope sender", 2024-09-11T23:36:15.114 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.114 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.114 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.114 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.114 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_ssl": { 2024-09-11T23:36:15.114 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_ssl", 2024-09-11T23:36:15.114 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.114 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.115 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.115 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.115 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.115 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.115 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.115 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-11T23:36:15.115 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.115 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.115 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.115 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.115 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_user": { 2024-09-11T23:36:15.115 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_user", 2024-09-11T23:36:15.115 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.116 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.116 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.116 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.116 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.116 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.116 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.116 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "User to authenticate as", 2024-09-11T23:36:15.116 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.116 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.116 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.116 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.116 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.117 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.117 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.117 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "balancer", 2024-09-11T23:36:15.117 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.117 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.117 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.117 INFO:teuthology.orchestra.run.smithi005.stdout: "active": { 2024-09-11T23:36:15.117 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "active", 2024-09-11T23:36:15.117 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.117 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.117 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.117 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.117 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.118 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.118 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.118 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "automatically balance PGs across cluster", 2024-09-11T23:36:15.118 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.118 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.118 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.118 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.118 INFO:teuthology.orchestra.run.smithi005.stdout: "begin_time": { 2024-09-11T23:36:15.118 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "begin_time", 2024-09-11T23:36:15.118 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.118 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.118 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.119 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0000", 2024-09-11T23:36:15.119 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.119 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.119 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.119 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "beginning time of day to automatically balance", 2024-09-11T23:36:15.119 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T23:36:15.119 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.119 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.119 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.119 INFO:teuthology.orchestra.run.smithi005.stdout: "begin_weekday": { 2024-09-11T23:36:15.119 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "begin_weekday", 2024-09-11T23:36:15.119 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2024-09-11T23:36:15.119 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.120 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.120 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-11T23:36:15.120 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0", 2024-09-11T23:36:15.120 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "6", 2024-09-11T23:36:15.120 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.120 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-11T23:36:15.120 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T23:36:15.120 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.120 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.120 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.120 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_max_iterations": { 2024-09-11T23:36:15.120 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_max_iterations", 2024-09-11T23:36:15.120 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2024-09-11T23:36:15.121 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.121 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.121 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "25", 2024-09-11T23:36:15.121 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2024-09-11T23:36:15.121 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "250", 2024-09-11T23:36:15.121 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.121 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-11T23:36:15.121 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.121 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.121 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.121 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.121 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_metrics": { 2024-09-11T23:36:15.121 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_metrics", 2024-09-11T23:36:15.122 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.122 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.122 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.122 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "pgs,objects,bytes", 2024-09-11T23:36:15.122 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.122 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.122 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.122 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-11T23:36:15.122 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-11T23:36:15.122 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.122 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.122 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.122 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_step": { 2024-09-11T23:36:15.123 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_step", 2024-09-11T23:36:15.123 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-09-11T23:36:15.123 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.123 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.123 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0.5", 2024-09-11T23:36:15.123 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0.001", 2024-09-11T23:36:15.123 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "0.999", 2024-09-11T23:36:15.123 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.123 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "aggressiveness of optimization", 2024-09-11T23:36:15.123 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-11T23:36:15.123 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.123 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.123 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.124 INFO:teuthology.orchestra.run.smithi005.stdout: "end_time": { 2024-09-11T23:36:15.124 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "end_time", 2024-09-11T23:36:15.124 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.124 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.124 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.124 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "2359", 2024-09-11T23:36:15.124 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.124 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.124 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.124 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "ending time of day to automatically balance", 2024-09-11T23:36:15.124 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T23:36:15.124 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.124 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.125 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.125 INFO:teuthology.orchestra.run.smithi005.stdout: "end_weekday": { 2024-09-11T23:36:15.125 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "end_weekday", 2024-09-11T23:36:15.125 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2024-09-11T23:36:15.125 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.125 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.125 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-11T23:36:15.125 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0", 2024-09-11T23:36:15.125 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "6", 2024-09-11T23:36:15.125 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.125 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-11T23:36:15.125 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T23:36:15.126 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.126 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.126 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.126 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.126 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.126 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.126 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.126 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.126 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.126 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.126 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.126 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.126 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.127 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.127 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.127 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.127 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.127 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.127 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.127 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.127 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.127 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.127 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.127 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.127 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.127 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.127 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.128 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.128 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.128 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.128 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.128 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.128 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.128 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.128 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.128 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.128 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.128 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.129 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.129 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.129 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.129 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.129 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.129 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.129 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.129 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.129 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.129 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.130 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.130 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.130 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.130 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.130 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.130 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.130 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.130 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.130 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.130 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.130 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.131 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.131 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.131 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.131 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.131 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.131 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.131 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.131 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.131 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.131 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.131 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.131 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.131 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.131 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.132 INFO:teuthology.orchestra.run.smithi005.stdout: "min_score": { 2024-09-11T23:36:15.132 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "min_score", 2024-09-11T23:36:15.132 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-09-11T23:36:15.132 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.132 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.132 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-11T23:36:15.132 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.132 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.132 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.132 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-11T23:36:15.132 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.132 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.133 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.133 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.133 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": { 2024-09-11T23:36:15.133 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mode", 2024-09-11T23:36:15.133 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.133 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.133 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.133 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "upmap", 2024-09-11T23:36:15.133 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.133 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.133 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.133 INFO:teuthology.orchestra.run.smithi005.stdout: "crush-compat", 2024-09-11T23:36:15.133 INFO:teuthology.orchestra.run.smithi005.stdout: "none", 2024-09-11T23:36:15.133 INFO:teuthology.orchestra.run.smithi005.stdout: "read", 2024-09-11T23:36:15.134 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap", 2024-09-11T23:36:15.134 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap-read" 2024-09-11T23:36:15.134 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.134 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Balancer mode", 2024-09-11T23:36:15.134 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.134 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.134 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.134 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.134 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_ids": { 2024-09-11T23:36:15.134 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pool_ids", 2024-09-11T23:36:15.134 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.134 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.134 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.135 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.135 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.135 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.135 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.135 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-11T23:36:15.135 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.135 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.135 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.135 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.135 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2024-09-11T23:36:15.135 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2024-09-11T23:36:15.135 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:15.135 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.136 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.136 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2024-09-11T23:36:15.136 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.136 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.136 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.136 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-11T23:36:15.136 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.136 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.136 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.136 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.136 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap_max_deviation": { 2024-09-11T23:36:15.136 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "upmap_max_deviation", 2024-09-11T23:36:15.136 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.137 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.137 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.137 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2024-09-11T23:36:15.137 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2024-09-11T23:36:15.137 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.137 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.137 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-11T23:36:15.137 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-11T23:36:15.137 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.137 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.137 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.137 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap_max_optimizations": { 2024-09-11T23:36:15.137 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "upmap_max_optimizations", 2024-09-11T23:36:15.137 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2024-09-11T23:36:15.138 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.138 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.138 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-09-11T23:36:15.138 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.138 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.138 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.138 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-11T23:36:15.138 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.138 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.138 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.138 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.138 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.138 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.139 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.139 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephadm", 2024-09-11T23:36:15.139 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.139 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.139 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.139 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_down_multiplier": { 2024-09-11T23:36:15.139 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_down_multiplier", 2024-09-11T23:36:15.139 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-09-11T23:36:15.139 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.139 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.139 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3.0", 2024-09-11T23:36:15.139 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.140 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.140 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.140 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-11T23:36:15.140 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.140 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.140 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.140 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.140 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_refresh_rate": { 2024-09-11T23:36:15.140 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_refresh_rate", 2024-09-11T23:36:15.140 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:15.140 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.141 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.141 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "20", 2024-09-11T23:36:15.141 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.141 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.141 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.141 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-11T23:36:15.141 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.141 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.141 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.141 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.141 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_starting_port": { 2024-09-11T23:36:15.141 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_starting_port", 2024-09-11T23:36:15.141 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.142 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.142 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.142 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "4721", 2024-09-11T23:36:15.142 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.142 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.142 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.142 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-11T23:36:15.142 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.142 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.142 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.142 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.143 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_ptrace": { 2024-09-11T23:36:15.143 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_ptrace", 2024-09-11T23:36:15.143 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.143 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.143 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.143 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.143 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.143 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.143 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.143 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-11T23:36:15.143 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-11T23:36:15.143 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.144 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.144 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.144 INFO:teuthology.orchestra.run.smithi005.stdout: "autotune_interval": { 2024-09-11T23:36:15.144 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "autotune_interval", 2024-09-11T23:36:15.144 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:15.144 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.144 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.144 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2024-09-11T23:36:15.144 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.144 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.144 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.144 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-11T23:36:15.144 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.145 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.145 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.145 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.145 INFO:teuthology.orchestra.run.smithi005.stdout: "autotune_memory_target_ratio": { 2024-09-11T23:36:15.145 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "autotune_memory_target_ratio", 2024-09-11T23:36:15.145 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-09-11T23:36:15.145 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.145 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.145 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0.7", 2024-09-11T23:36:15.145 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.145 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.145 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.146 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-11T23:36:15.146 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.146 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.146 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.146 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.146 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm_log_destination": { 2024-09-11T23:36:15.146 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephadm_log_destination", 2024-09-11T23:36:15.146 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.146 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.146 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.146 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.146 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.147 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.147 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.147 INFO:teuthology.orchestra.run.smithi005.stdout: "file", 2024-09-11T23:36:15.147 INFO:teuthology.orchestra.run.smithi005.stdout: "file,syslog", 2024-09-11T23:36:15.147 INFO:teuthology.orchestra.run.smithi005.stdout: "syslog" 2024-09-11T23:36:15.147 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.147 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-11T23:36:15.147 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.147 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.147 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.147 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.147 INFO:teuthology.orchestra.run.smithi005.stdout: "cgroups_split": { 2024-09-11T23:36:15.148 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cgroups_split", 2024-09-11T23:36:15.148 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.148 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.148 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.148 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.148 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.148 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.148 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.148 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-11T23:36:15.148 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.148 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.148 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.148 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.149 INFO:teuthology.orchestra.run.smithi005.stdout: "config_checks_enabled": { 2024-09-11T23:36:15.149 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "config_checks_enabled", 2024-09-11T23:36:15.149 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.149 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.149 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.149 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.149 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.149 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.149 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.149 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-11T23:36:15.149 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.149 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.149 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.150 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.150 INFO:teuthology.orchestra.run.smithi005.stdout: "config_dashboard": { 2024-09-11T23:36:15.150 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "config_dashboard", 2024-09-11T23:36:15.150 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.150 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.150 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.150 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.150 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.150 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.150 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.150 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-11T23:36:15.150 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.150 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.151 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.151 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.151 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_alertmanager": { 2024-09-11T23:36:15.151 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_alertmanager", 2024-09-11T23:36:15.151 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.151 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.151 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.151 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-11T23:36:15.151 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.151 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.151 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.151 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2024-09-11T23:36:15.151 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.152 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.152 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.152 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.152 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_base": { 2024-09-11T23:36:15.152 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_base", 2024-09-11T23:36:15.152 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.152 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.152 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.152 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-11T23:36:15.152 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.152 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.152 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.152 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Container image name, without the tag", 2024-09-11T23:36:15.153 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.153 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.153 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.153 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.153 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_elasticsearch": { 2024-09-11T23:36:15.153 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_elasticsearch", 2024-09-11T23:36:15.153 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.153 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.153 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.153 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-11T23:36:15.153 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.153 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.153 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.154 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "elasticsearch container image", 2024-09-11T23:36:15.154 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.154 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.154 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.154 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.154 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_grafana": { 2024-09-11T23:36:15.154 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_grafana", 2024-09-11T23:36:15.154 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.154 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.154 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.154 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-11T23:36:15.154 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.154 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.154 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.155 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2024-09-11T23:36:15.155 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.155 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.155 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.155 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.155 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_haproxy": { 2024-09-11T23:36:15.155 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_haproxy", 2024-09-11T23:36:15.155 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.155 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.155 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.155 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-11T23:36:15.155 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.156 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.156 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.156 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "HAproxy container image", 2024-09-11T23:36:15.156 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.156 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.156 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.156 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.156 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_agent": { 2024-09-11T23:36:15.156 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_agent", 2024-09-11T23:36:15.156 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.156 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.156 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.157 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-11T23:36:15.157 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.157 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.157 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.157 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger agent container image", 2024-09-11T23:36:15.157 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.157 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.157 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.157 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.157 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_collector": { 2024-09-11T23:36:15.157 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_collector", 2024-09-11T23:36:15.157 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.158 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.158 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.158 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-11T23:36:15.158 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.158 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.158 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.158 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger collector container image", 2024-09-11T23:36:15.158 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.158 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.158 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.158 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.158 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_query": { 2024-09-11T23:36:15.158 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_query", 2024-09-11T23:36:15.159 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.159 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.159 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.159 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-11T23:36:15.159 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.159 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.159 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.159 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger query container image", 2024-09-11T23:36:15.159 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.159 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.159 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.159 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.159 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_keepalived": { 2024-09-11T23:36:15.160 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_keepalived", 2024-09-11T23:36:15.160 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.160 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.160 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.160 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-11T23:36:15.160 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.160 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.160 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.160 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Keepalived container image", 2024-09-11T23:36:15.160 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.160 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.160 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.160 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.161 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_loki": { 2024-09-11T23:36:15.161 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_loki", 2024-09-11T23:36:15.161 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.161 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.161 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.161 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-11T23:36:15.161 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.161 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.161 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.161 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Loki container image", 2024-09-11T23:36:15.161 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.161 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.161 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.162 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.162 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_node_exporter": { 2024-09-11T23:36:15.162 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_node_exporter", 2024-09-11T23:36:15.162 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.162 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.162 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.162 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-11T23:36:15.162 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.162 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.162 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.162 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2024-09-11T23:36:15.162 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.162 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.163 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.163 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.163 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_nvmeof": { 2024-09-11T23:36:15.163 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_nvmeof", 2024-09-11T23:36:15.163 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.163 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.163 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.163 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-11T23:36:15.163 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.163 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.163 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.163 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Nvme-of container image", 2024-09-11T23:36:15.163 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.164 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.164 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.164 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.164 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_prometheus": { 2024-09-11T23:36:15.164 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_prometheus", 2024-09-11T23:36:15.164 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.164 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.164 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.164 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-11T23:36:15.164 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.164 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.164 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.164 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2024-09-11T23:36:15.165 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.165 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.165 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.165 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.165 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_promtail": { 2024-09-11T23:36:15.165 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_promtail", 2024-09-11T23:36:15.165 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.165 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.165 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.165 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-11T23:36:15.165 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.165 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.165 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.165 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Promtail container image", 2024-09-11T23:36:15.166 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.166 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.166 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.166 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.166 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_samba": { 2024-09-11T23:36:15.166 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_samba", 2024-09-11T23:36:15.166 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.166 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.166 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.166 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-11T23:36:15.166 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.166 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.166 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.167 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Samba/SMB container image", 2024-09-11T23:36:15.167 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.167 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.167 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.167 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.167 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_snmp_gateway": { 2024-09-11T23:36:15.167 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_snmp_gateway", 2024-09-11T23:36:15.167 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.167 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.167 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.167 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-11T23:36:15.167 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.167 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.167 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.168 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SNMP Gateway container image", 2024-09-11T23:36:15.168 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.168 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.168 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.168 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.168 INFO:teuthology.orchestra.run.smithi005.stdout: "container_init": { 2024-09-11T23:36:15.168 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_init", 2024-09-11T23:36:15.168 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.168 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.168 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.168 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.168 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.169 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.169 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.169 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Run podman/docker with `--init`", 2024-09-11T23:36:15.169 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.169 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.169 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.169 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.169 INFO:teuthology.orchestra.run.smithi005.stdout: "daemon_cache_timeout": { 2024-09-11T23:36:15.169 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "daemon_cache_timeout", 2024-09-11T23:36:15.169 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:15.169 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.169 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.169 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2024-09-11T23:36:15.170 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.170 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.170 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.170 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-11T23:36:15.170 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.170 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.170 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.170 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.170 INFO:teuthology.orchestra.run.smithi005.stdout: "default_cephadm_command_timeout": { 2024-09-11T23:36:15.170 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "default_cephadm_command_timeout", 2024-09-11T23:36:15.170 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.170 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.170 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.171 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "900", 2024-09-11T23:36:15.171 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.171 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.171 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.171 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-11T23:36:15.171 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.171 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.171 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.171 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.171 INFO:teuthology.orchestra.run.smithi005.stdout: "default_registry": { 2024-09-11T23:36:15.171 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "default_registry", 2024-09-11T23:36:15.171 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.171 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.172 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.172 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io", 2024-09-11T23:36:15.172 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.172 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.172 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.172 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-11T23:36:15.172 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.172 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.172 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.172 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.172 INFO:teuthology.orchestra.run.smithi005.stdout: "device_cache_timeout": { 2024-09-11T23:36:15.172 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_cache_timeout", 2024-09-11T23:36:15.172 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:15.173 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.173 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.173 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1800", 2024-09-11T23:36:15.173 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.173 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.173 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.173 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache device inventory", 2024-09-11T23:36:15.173 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.173 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.173 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.173 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.173 INFO:teuthology.orchestra.run.smithi005.stdout: "device_enhanced_scan": { 2024-09-11T23:36:15.174 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_enhanced_scan", 2024-09-11T23:36:15.174 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.174 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.174 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.174 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.174 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.174 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.174 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.174 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-11T23:36:15.174 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.174 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.174 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.174 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.175 INFO:teuthology.orchestra.run.smithi005.stdout: "facts_cache_timeout": { 2024-09-11T23:36:15.175 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "facts_cache_timeout", 2024-09-11T23:36:15.175 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:15.175 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.175 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.175 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2024-09-11T23:36:15.175 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.175 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.175 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.175 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache host facts data", 2024-09-11T23:36:15.175 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.175 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.176 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.176 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.176 INFO:teuthology.orchestra.run.smithi005.stdout: "grafana_dashboards_path": { 2024-09-11T23:36:15.176 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "grafana_dashboards_path", 2024-09-11T23:36:15.176 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.176 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.176 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.176 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-11T23:36:15.176 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.176 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.176 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.176 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-11T23:36:15.176 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.177 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.177 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.177 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.177 INFO:teuthology.orchestra.run.smithi005.stdout: "host_check_interval": { 2024-09-11T23:36:15.177 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "host_check_interval", 2024-09-11T23:36:15.177 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:15.177 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.177 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.177 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2024-09-11T23:36:15.177 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.177 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.177 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.177 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to perform a host check", 2024-09-11T23:36:15.177 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.178 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.178 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.178 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.178 INFO:teuthology.orchestra.run.smithi005.stdout: "hw_monitoring": { 2024-09-11T23:36:15.178 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "hw_monitoring", 2024-09-11T23:36:15.178 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.178 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.178 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.178 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.178 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.178 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.178 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.179 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-11T23:36:15.179 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.179 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.179 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.179 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.179 INFO:teuthology.orchestra.run.smithi005.stdout: "inventory_list_all": { 2024-09-11T23:36:15.179 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "inventory_list_all", 2024-09-11T23:36:15.179 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.179 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.179 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.179 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.179 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.179 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.180 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.180 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-11T23:36:15.180 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.180 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.180 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.180 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.180 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.180 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.180 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.180 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.180 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.180 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.180 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.180 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.181 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.181 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.181 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.181 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.181 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.181 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.181 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.181 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.181 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.181 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.181 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.181 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.181 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.182 INFO:teuthology.orchestra.run.smithi005.stdout: "log_refresh_metadata": { 2024-09-11T23:36:15.182 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_refresh_metadata", 2024-09-11T23:36:15.182 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.182 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.182 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.182 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.182 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.182 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.182 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.182 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-11T23:36:15.182 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.182 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.182 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.183 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.183 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.183 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.183 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.183 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.183 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.183 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.183 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.183 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.183 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.183 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-11T23:36:15.183 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.183 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.184 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.184 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.184 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.184 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.184 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.184 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.184 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.184 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.184 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.184 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.184 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.184 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.184 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.185 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.185 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.185 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.185 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.185 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.185 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.185 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.185 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.185 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.185 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.186 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.186 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.186 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.186 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.186 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.186 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.186 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.186 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.186 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.186 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.186 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.186 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.187 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.187 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.187 INFO:teuthology.orchestra.run.smithi005.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-11T23:36:15.187 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-11T23:36:15.187 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.187 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.187 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.187 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.187 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.187 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.187 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.187 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-11T23:36:15.187 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.188 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.188 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.188 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.188 INFO:teuthology.orchestra.run.smithi005.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-11T23:36:15.188 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-11T23:36:15.188 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.188 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.188 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.188 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "*", 2024-09-11T23:36:15.188 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.188 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.188 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.188 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-11T23:36:15.189 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.189 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.189 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.189 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.189 INFO:teuthology.orchestra.run.smithi005.stdout: "max_count_per_host": { 2024-09-11T23:36:15.189 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_count_per_host", 2024-09-11T23:36:15.189 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.189 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.189 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.189 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-09-11T23:36:15.189 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.189 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.189 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.189 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "max number of daemons per service per host", 2024-09-11T23:36:15.190 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.190 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.190 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.190 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.190 INFO:teuthology.orchestra.run.smithi005.stdout: "max_osd_draining_count": { 2024-09-11T23:36:15.190 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_osd_draining_count", 2024-09-11T23:36:15.190 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.190 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.190 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.190 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-09-11T23:36:15.190 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.190 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.190 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.191 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-11T23:36:15.191 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.191 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.191 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.191 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.191 INFO:teuthology.orchestra.run.smithi005.stdout: "migration_current": { 2024-09-11T23:36:15.191 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "migration_current", 2024-09-11T23:36:15.191 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.191 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.191 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.191 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.191 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.191 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.192 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.192 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "internal - do not modify", 2024-09-11T23:36:15.192 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.192 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.192 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.192 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.192 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": { 2024-09-11T23:36:15.192 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mode", 2024-09-11T23:36:15.192 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.192 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.192 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.192 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "root", 2024-09-11T23:36:15.192 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.193 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.193 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.193 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm-package", 2024-09-11T23:36:15.193 INFO:teuthology.orchestra.run.smithi005.stdout: "root" 2024-09-11T23:36:15.193 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.193 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "mode for remote execution of cephadm", 2024-09-11T23:36:15.193 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.193 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.193 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.193 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.193 INFO:teuthology.orchestra.run.smithi005.stdout: "oob_default_addr": { 2024-09-11T23:36:15.193 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "oob_default_addr", 2024-09-11T23:36:15.194 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.194 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.194 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.194 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "169.254.1.1", 2024-09-11T23:36:15.194 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.194 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.194 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.194 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-11T23:36:15.194 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.194 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.194 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.194 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.195 INFO:teuthology.orchestra.run.smithi005.stdout: "prometheus_alerts_path": { 2024-09-11T23:36:15.195 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prometheus_alerts_path", 2024-09-11T23:36:15.195 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.195 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.195 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.195 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-11T23:36:15.195 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.195 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.195 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.195 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-11T23:36:15.195 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.195 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.195 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.195 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.196 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_insecure": { 2024-09-11T23:36:15.196 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_insecure", 2024-09-11T23:36:15.196 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.196 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.196 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.196 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.196 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.196 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.197 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.197 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-11T23:36:15.197 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.197 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.197 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.197 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.197 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_password": { 2024-09-11T23:36:15.197 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_password", 2024-09-11T23:36:15.197 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.197 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.198 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.198 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.198 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.198 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.198 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.198 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-11T23:36:15.198 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.198 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.198 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.198 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.198 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_url": { 2024-09-11T23:36:15.198 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_url", 2024-09-11T23:36:15.198 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.199 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.199 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.199 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.199 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.199 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.199 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.199 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-11T23:36:15.199 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.199 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.199 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.199 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.199 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_username": { 2024-09-11T23:36:15.200 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_username", 2024-09-11T23:36:15.200 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.200 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.200 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.200 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.200 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.200 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.200 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.200 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-11T23:36:15.200 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.200 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.200 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.200 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.201 INFO:teuthology.orchestra.run.smithi005.stdout: "secure_monitoring_stack": { 2024-09-11T23:36:15.201 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "secure_monitoring_stack", 2024-09-11T23:36:15.201 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.201 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.201 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.201 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.201 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.201 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.201 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.201 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-11T23:36:15.201 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.201 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.201 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.202 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.202 INFO:teuthology.orchestra.run.smithi005.stdout: "service_discovery_port": { 2024-09-11T23:36:15.202 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "service_discovery_port", 2024-09-11T23:36:15.202 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.202 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.202 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.202 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8765", 2024-09-11T23:36:15.202 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.202 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.202 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.202 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "cephadm service discovery port", 2024-09-11T23:36:15.202 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.202 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.203 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.203 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.203 INFO:teuthology.orchestra.run.smithi005.stdout: "ssh_config_file": { 2024-09-11T23:36:15.203 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssh_config_file", 2024-09-11T23:36:15.203 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.203 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.203 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.203 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.203 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.203 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.203 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.203 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-11T23:36:15.203 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.204 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.204 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.204 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.204 INFO:teuthology.orchestra.run.smithi005.stdout: "use_agent": { 2024-09-11T23:36:15.204 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "use_agent", 2024-09-11T23:36:15.204 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.204 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.204 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.204 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.204 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.204 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.204 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.204 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-11T23:36:15.205 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.205 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.205 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.205 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.205 INFO:teuthology.orchestra.run.smithi005.stdout: "use_repo_digest": { 2024-09-11T23:36:15.205 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "use_repo_digest", 2024-09-11T23:36:15.205 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.205 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.205 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.205 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.205 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.205 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.205 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.206 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-11T23:36:15.206 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.206 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.206 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.206 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.206 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_failed_host_check": { 2024-09-11T23:36:15.206 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_failed_host_check", 2024-09-11T23:36:15.206 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.206 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.206 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.206 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.206 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.206 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.207 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.207 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if the host check fails", 2024-09-11T23:36:15.207 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.207 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.207 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.207 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.207 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_stray_daemons": { 2024-09-11T23:36:15.207 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_stray_daemons", 2024-09-11T23:36:15.207 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.207 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.207 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.207 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.207 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.208 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.208 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.208 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-11T23:36:15.208 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.208 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.208 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.208 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.208 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_stray_hosts": { 2024-09-11T23:36:15.208 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_stray_hosts", 2024-09-11T23:36:15.209 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.209 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.209 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.209 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.209 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.209 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.209 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.209 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-11T23:36:15.209 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.209 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.209 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.209 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.209 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.209 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.210 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.210 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crash", 2024-09-11T23:36:15.210 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.212 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.212 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.212 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.212 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.212 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.213 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.213 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.213 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.213 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.213 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.213 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.213 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.213 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.213 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.213 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.213 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.213 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.213 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.214 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.214 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.214 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.214 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.214 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.214 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.214 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.214 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.214 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.214 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.214 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.214 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.214 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.214 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.215 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.215 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.215 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.215 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.215 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.215 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.215 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.215 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.215 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.215 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.215 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.215 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.215 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.216 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.216 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.216 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.216 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.216 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.216 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.216 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.216 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.216 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.216 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.216 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.216 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.217 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.217 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.217 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.217 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.217 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.217 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.217 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.217 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.217 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.217 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.217 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.217 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.217 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.218 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.218 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.218 INFO:teuthology.orchestra.run.smithi005.stdout: "retain_interval": { 2024-09-11T23:36:15.218 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "retain_interval", 2024-09-11T23:36:15.218 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:15.218 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.218 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.218 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "31536000", 2024-09-11T23:36:15.218 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.218 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.218 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.218 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-11T23:36:15.218 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.219 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.219 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.219 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.219 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_recent_interval": { 2024-09-11T23:36:15.219 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_recent_interval", 2024-09-11T23:36:15.219 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:15.219 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.219 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.219 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1209600", 2024-09-11T23:36:15.219 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.219 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.219 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.219 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-11T23:36:15.219 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.220 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.220 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.220 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.220 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.220 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.220 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.220 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "dashboard", 2024-09-11T23:36:15.220 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.220 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.220 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.220 INFO:teuthology.orchestra.run.smithi005.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-11T23:36:15.220 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-11T23:36:15.221 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.221 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.221 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.221 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-09-11T23:36:15.221 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.221 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.221 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.221 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.221 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.221 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.221 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.221 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.221 INFO:teuthology.orchestra.run.smithi005.stdout: "ALERTMANAGER_API_HOST": { 2024-09-11T23:36:15.222 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-11T23:36:15.222 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.222 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.222 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.222 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.222 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.222 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.222 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.222 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.222 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.222 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.222 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.223 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.223 INFO:teuthology.orchestra.run.smithi005.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-11T23:36:15.223 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-11T23:36:15.223 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.223 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.223 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.223 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.223 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.223 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.223 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.223 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.223 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.223 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.224 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.224 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.224 INFO:teuthology.orchestra.run.smithi005.stdout: "AUDIT_API_ENABLED": { 2024-09-11T23:36:15.224 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "AUDIT_API_ENABLED", 2024-09-11T23:36:15.224 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.224 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.224 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.224 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.224 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.224 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.224 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.224 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.224 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.225 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.225 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.225 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.225 INFO:teuthology.orchestra.run.smithi005.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-11T23:36:15.225 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-11T23:36:15.225 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.225 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.225 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.225 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.225 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.225 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.225 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.225 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.226 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.226 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.226 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.226 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.226 INFO:teuthology.orchestra.run.smithi005.stdout: "ENABLE_BROWSABLE_API": { 2024-09-11T23:36:15.226 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-11T23:36:15.226 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.226 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.226 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.226 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.226 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.226 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.227 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.227 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.227 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.227 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.227 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.227 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.227 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-11T23:36:15.227 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-11T23:36:15.227 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.227 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.227 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.228 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.228 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.228 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.228 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.228 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.228 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.228 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.228 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.228 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.228 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-11T23:36:15.228 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-11T23:36:15.228 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.228 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.229 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.229 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.229 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.229 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.229 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.229 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.229 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.229 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.229 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.230 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.230 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-11T23:36:15.230 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-11T23:36:15.230 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.230 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.230 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.230 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.230 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.230 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.230 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.230 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.230 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.230 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.231 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.231 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.231 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-11T23:36:15.231 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-11T23:36:15.231 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.231 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.231 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.231 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.231 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.231 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.231 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.231 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.232 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.232 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.232 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.232 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.232 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-11T23:36:15.232 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-11T23:36:15.232 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.232 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.232 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.232 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.232 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.232 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.232 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.233 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.233 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.233 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.233 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.233 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.233 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-11T23:36:15.233 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-11T23:36:15.233 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.233 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.233 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.233 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.233 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.233 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.234 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.234 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.234 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.234 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.234 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.234 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.234 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-11T23:36:15.234 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-11T23:36:15.234 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.234 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.234 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.234 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.234 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.235 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.235 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.235 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.235 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.235 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.235 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.235 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.235 INFO:teuthology.orchestra.run.smithi005.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-11T23:36:15.235 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-11T23:36:15.235 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.235 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.235 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.235 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.236 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.236 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.236 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.236 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.236 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.236 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.236 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.236 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.236 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_PASSWORD": { 2024-09-11T23:36:15.236 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-11T23:36:15.236 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.236 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.236 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.237 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2024-09-11T23:36:15.237 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.237 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.237 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.237 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.237 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.237 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.237 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.237 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.237 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-11T23:36:15.237 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-11T23:36:15.237 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.237 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.237 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.238 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.238 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.238 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.238 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.238 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.238 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.238 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.238 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.238 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.238 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_URL": { 2024-09-11T23:36:15.238 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_URL", 2024-09-11T23:36:15.238 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.238 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.239 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.239 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.239 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.239 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.239 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.239 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.239 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.239 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.239 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.239 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.239 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_USERNAME": { 2024-09-11T23:36:15.239 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-11T23:36:15.239 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.240 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.240 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.240 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2024-09-11T23:36:15.240 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.240 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.240 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.240 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.240 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.240 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.240 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.240 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.240 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-11T23:36:15.240 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-11T23:36:15.241 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.241 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.241 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.241 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.241 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.241 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.241 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.241 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.241 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.241 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.241 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.241 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.241 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-11T23:36:15.242 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-11T23:36:15.242 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.242 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.242 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.242 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.242 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.242 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.242 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.242 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.242 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.242 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.242 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.242 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.243 INFO:teuthology.orchestra.run.smithi005.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-11T23:36:15.243 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-11T23:36:15.243 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.243 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.243 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.243 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.243 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.243 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.243 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.243 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.243 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.243 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.243 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.244 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.244 INFO:teuthology.orchestra.run.smithi005.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-11T23:36:15.244 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-11T23:36:15.244 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.244 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.244 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.244 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.244 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.244 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.244 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.244 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.244 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.244 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.245 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.245 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.245 INFO:teuthology.orchestra.run.smithi005.stdout: "PROMETHEUS_API_HOST": { 2024-09-11T23:36:15.245 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-11T23:36:15.245 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.245 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.245 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.245 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.245 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.245 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.245 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.245 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.245 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.246 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.246 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.246 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.246 INFO:teuthology.orchestra.run.smithi005.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-11T23:36:15.246 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-11T23:36:15.246 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.246 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.246 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.246 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.246 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.246 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.246 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.246 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.247 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.247 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.247 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.247 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.247 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-11T23:36:15.247 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-11T23:36:15.247 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.247 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.247 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.247 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.247 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.247 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.247 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.248 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.248 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.248 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.248 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.248 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.248 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-11T23:36:15.248 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-11T23:36:15.248 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.248 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.248 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.248 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.248 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.249 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.249 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.249 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.249 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.249 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.249 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.249 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.249 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-11T23:36:15.249 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-11T23:36:15.249 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.249 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.249 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.249 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.250 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.250 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.250 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.250 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.250 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.250 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.250 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.250 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.250 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-11T23:36:15.250 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-11T23:36:15.250 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.250 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.250 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.251 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.251 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.251 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.251 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.251 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.251 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.251 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.251 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.251 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.251 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-11T23:36:15.251 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-11T23:36:15.251 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.251 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.251 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.252 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.252 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.252 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.252 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.252 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.252 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.252 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.252 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.252 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.252 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-11T23:36:15.252 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-11T23:36:15.252 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.252 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.253 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.253 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.253 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.253 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.253 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.253 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.253 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.253 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.253 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.253 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.253 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-11T23:36:15.253 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-11T23:36:15.253 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.254 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.254 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.254 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.254 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.254 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.254 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.254 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.254 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.254 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.254 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.254 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.254 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_ENABLED": { 2024-09-11T23:36:15.254 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-11T23:36:15.254 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.255 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.255 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.255 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.255 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.255 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.255 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.255 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.255 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.255 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.255 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.255 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.255 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-11T23:36:15.256 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-11T23:36:15.256 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.256 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.256 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.256 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-11T23:36:15.256 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.256 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.256 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.256 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.256 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.256 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.256 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.256 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.257 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-11T23:36:15.257 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-11T23:36:15.257 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.257 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.257 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.257 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-09-11T23:36:15.257 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.257 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.257 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.257 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.257 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.257 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.257 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.258 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.258 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-11T23:36:15.258 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-11T23:36:15.258 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.258 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.258 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.258 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8", 2024-09-11T23:36:15.258 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.258 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.258 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.258 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.258 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.258 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.259 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.259 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.259 INFO:teuthology.orchestra.run.smithi005.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-11T23:36:15.259 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-11T23:36:15.259 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.259 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.259 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.259 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "45", 2024-09-11T23:36:15.259 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.259 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.259 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.259 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.260 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.260 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.260 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.260 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.260 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_ACCESS_KEY": { 2024-09-11T23:36:15.260 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-11T23:36:15.260 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.260 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.260 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.260 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.260 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.260 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.260 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.261 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.261 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.261 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.261 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.261 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.261 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-11T23:36:15.261 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-11T23:36:15.261 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.261 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.261 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.261 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2024-09-11T23:36:15.261 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.262 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.262 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.262 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.262 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.262 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.262 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.262 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.262 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_SECRET_KEY": { 2024-09-11T23:36:15.262 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-11T23:36:15.262 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.262 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.262 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.262 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.263 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.263 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.263 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.263 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.263 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.263 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.263 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.263 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.263 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_SSL_VERIFY": { 2024-09-11T23:36:15.263 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-11T23:36:15.263 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.263 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.263 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.264 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.264 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.264 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.264 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.264 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.264 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.264 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.264 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.264 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.264 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-11T23:36:15.264 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-11T23:36:15.264 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.264 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.265 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.265 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-11T23:36:15.265 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.265 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.265 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.265 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.265 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.265 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.265 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.265 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.265 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-11T23:36:15.265 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-11T23:36:15.266 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.266 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.266 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.266 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-09-11T23:36:15.266 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.266 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.266 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.266 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.266 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.266 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.266 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.266 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.266 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-11T23:36:15.267 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-11T23:36:15.267 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.267 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.267 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.267 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2024-09-11T23:36:15.267 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.267 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.267 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.267 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.267 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.267 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.267 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.267 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.268 INFO:teuthology.orchestra.run.smithi005.stdout: "cross_origin_url": { 2024-09-11T23:36:15.268 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cross_origin_url", 2024-09-11T23:36:15.268 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.268 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.268 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.268 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.268 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.268 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.268 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.268 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.268 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.268 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.269 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.269 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.269 INFO:teuthology.orchestra.run.smithi005.stdout: "crt_file": { 2024-09-11T23:36:15.269 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crt_file", 2024-09-11T23:36:15.269 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.269 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.269 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.269 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.269 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.269 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.269 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.269 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.269 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.270 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.270 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.270 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.270 INFO:teuthology.orchestra.run.smithi005.stdout: "debug": { 2024-09-11T23:36:15.270 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "debug", 2024-09-11T23:36:15.270 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.270 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.270 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.270 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.270 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.270 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.270 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.271 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable/disable debug options", 2024-09-11T23:36:15.271 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.271 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.271 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.271 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.271 INFO:teuthology.orchestra.run.smithi005.stdout: "jwt_token_ttl": { 2024-09-11T23:36:15.271 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "jwt_token_ttl", 2024-09-11T23:36:15.271 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.271 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.271 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.271 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "28800", 2024-09-11T23:36:15.271 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.271 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.272 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.272 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.272 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.272 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.272 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.272 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.272 INFO:teuthology.orchestra.run.smithi005.stdout: "key_file": { 2024-09-11T23:36:15.272 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "key_file", 2024-09-11T23:36:15.272 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.272 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.272 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.272 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.273 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.273 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.273 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.273 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.273 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.273 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.273 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.273 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.273 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.273 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.273 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.273 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.274 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.274 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.274 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.274 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.274 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.274 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.274 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.274 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.274 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.274 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.274 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.274 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.274 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.275 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.275 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.275 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.275 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.275 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.275 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.275 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.275 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.275 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.275 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.275 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.275 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.275 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.276 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.276 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.276 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.276 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.276 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.276 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.276 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.276 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.276 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.276 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.276 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.276 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.277 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.277 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.277 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.277 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.277 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.277 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.277 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.277 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.277 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.277 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.277 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.277 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.278 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.278 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.278 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.278 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.278 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.278 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.278 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.278 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.278 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.278 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.278 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.278 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.278 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.279 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.279 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.279 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.279 INFO:teuthology.orchestra.run.smithi005.stdout: "motd": { 2024-09-11T23:36:15.279 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "motd", 2024-09-11T23:36:15.279 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.279 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.279 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.279 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.279 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.279 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.279 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.279 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "The message of the day", 2024-09-11T23:36:15.280 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.280 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.280 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.280 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.280 INFO:teuthology.orchestra.run.smithi005.stdout: "redirect_resolve_ip_addr": { 2024-09-11T23:36:15.280 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "redirect_resolve_ip_addr", 2024-09-11T23:36:15.280 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.280 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.280 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.280 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.280 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.280 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.280 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.281 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.281 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.281 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.281 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.281 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.281 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2024-09-11T23:36:15.281 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2024-09-11T23:36:15.281 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.281 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.281 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.281 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "::", 2024-09-11T23:36:15.281 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.281 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.282 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.282 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.282 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.282 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.282 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.282 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.282 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2024-09-11T23:36:15.282 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2024-09-11T23:36:15.282 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.282 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.282 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.282 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8080", 2024-09-11T23:36:15.282 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.283 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.283 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.283 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.283 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.283 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.283 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.283 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.283 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl": { 2024-09-11T23:36:15.283 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl", 2024-09-11T23:36:15.283 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.283 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.283 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.283 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.283 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.284 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.284 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.284 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.284 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.284 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.284 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.284 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.284 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl_server_port": { 2024-09-11T23:36:15.284 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl_server_port", 2024-09-11T23:36:15.284 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.284 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.284 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.284 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8443", 2024-09-11T23:36:15.285 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.285 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.285 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.285 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.285 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.285 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.285 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.285 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.285 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_behaviour": { 2024-09-11T23:36:15.285 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_behaviour", 2024-09-11T23:36:15.285 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.285 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.286 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.286 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "redirect", 2024-09-11T23:36:15.286 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.286 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.286 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.286 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.286 INFO:teuthology.orchestra.run.smithi005.stdout: "redirect" 2024-09-11T23:36:15.286 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.286 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.286 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.286 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.286 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.286 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.287 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_error_status_code": { 2024-09-11T23:36:15.287 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_error_status_code", 2024-09-11T23:36:15.287 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.287 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.287 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.287 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "500", 2024-09-11T23:36:15.287 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "400", 2024-09-11T23:36:15.287 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "599", 2024-09-11T23:36:15.287 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.287 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.287 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.287 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.287 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.288 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.288 INFO:teuthology.orchestra.run.smithi005.stdout: "url_prefix": { 2024-09-11T23:36:15.288 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "url_prefix", 2024-09-11T23:36:15.288 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.288 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.288 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.288 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.288 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.288 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.288 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.288 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.288 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.289 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.289 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.289 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.289 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.289 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.289 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.289 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "devicehealth", 2024-09-11T23:36:15.289 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.289 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.289 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.289 INFO:teuthology.orchestra.run.smithi005.stdout: "enable_monitoring": { 2024-09-11T23:36:15.289 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enable_monitoring", 2024-09-11T23:36:15.289 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.290 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.290 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.290 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.290 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.290 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.290 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.290 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "monitor device health metrics", 2024-09-11T23:36:15.290 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.290 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.290 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.290 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.290 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.290 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.291 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.291 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.291 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.291 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.291 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.291 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.291 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.291 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.291 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.291 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.291 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.291 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.291 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.292 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.292 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.292 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.292 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.292 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.292 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.292 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.292 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.292 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.292 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.292 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.292 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.292 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.293 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.293 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.293 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.293 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.293 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.293 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.293 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.293 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.293 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.293 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.293 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.293 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.293 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.294 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.294 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.294 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.294 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.294 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.294 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.294 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.294 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.294 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.294 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.294 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.294 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.294 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.295 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.295 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.295 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.295 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.295 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.295 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.295 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.295 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.295 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.295 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.295 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.295 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.295 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.296 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.296 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.296 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.296 INFO:teuthology.orchestra.run.smithi005.stdout: "mark_out_threshold": { 2024-09-11T23:36:15.296 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mark_out_threshold", 2024-09-11T23:36:15.296 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:15.296 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.296 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.296 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "2419200", 2024-09-11T23:36:15.296 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.296 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.296 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.297 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-11T23:36:15.297 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.297 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.297 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.297 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.297 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_name": { 2024-09-11T23:36:15.297 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pool_name", 2024-09-11T23:36:15.297 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.297 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.297 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.297 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "device_health_metrics", 2024-09-11T23:36:15.297 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.297 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.298 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.298 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-11T23:36:15.298 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.298 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.298 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.298 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.298 INFO:teuthology.orchestra.run.smithi005.stdout: "retention_period": { 2024-09-11T23:36:15.298 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "retention_period", 2024-09-11T23:36:15.298 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:15.298 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.298 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.299 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15552000", 2024-09-11T23:36:15.299 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.299 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.299 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.299 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long to retain device health metrics", 2024-09-11T23:36:15.299 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.299 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.299 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.299 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.299 INFO:teuthology.orchestra.run.smithi005.stdout: "scrape_frequency": { 2024-09-11T23:36:15.299 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "scrape_frequency", 2024-09-11T23:36:15.299 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:15.299 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.300 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.300 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "86400", 2024-09-11T23:36:15.300 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.300 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.300 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.300 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-11T23:36:15.300 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.300 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.300 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.300 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.300 INFO:teuthology.orchestra.run.smithi005.stdout: "self_heal": { 2024-09-11T23:36:15.301 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "self_heal", 2024-09-11T23:36:15.301 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.301 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.301 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.301 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.301 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.301 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.301 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.301 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-11T23:36:15.301 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.301 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.301 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.302 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.302 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2024-09-11T23:36:15.302 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2024-09-11T23:36:15.302 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:15.302 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.302 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.302 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2024-09-11T23:36:15.302 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.302 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.302 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.302 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to wake up and check device health", 2024-09-11T23:36:15.302 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.303 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.303 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.303 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.303 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_threshold": { 2024-09-11T23:36:15.303 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_threshold", 2024-09-11T23:36:15.303 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:15.303 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.303 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.303 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "7257600", 2024-09-11T23:36:15.303 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.303 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.303 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.303 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-11T23:36:15.304 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.304 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.304 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.304 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.304 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.304 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.304 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.304 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "diskprediction_local", 2024-09-11T23:36:15.304 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.304 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.304 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.304 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.305 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.305 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.305 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.305 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.305 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.305 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.305 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.305 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.305 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.305 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.305 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.305 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.305 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.306 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.306 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.306 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.306 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.306 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.306 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.306 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.306 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.306 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.306 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.306 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.306 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.306 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.307 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.307 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.307 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.307 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.307 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.307 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.307 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.307 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.307 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.307 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.307 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.307 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.308 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.308 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.308 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.308 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.308 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.308 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.308 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.308 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.308 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.308 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.308 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.309 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.309 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.309 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.309 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.309 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.309 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.309 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.309 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.309 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.309 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.309 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.309 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.309 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.310 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.310 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.310 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.310 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.310 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.310 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.310 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.310 INFO:teuthology.orchestra.run.smithi005.stdout: "predict_interval": { 2024-09-11T23:36:15.310 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "predict_interval", 2024-09-11T23:36:15.310 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.310 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.310 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.311 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "86400", 2024-09-11T23:36:15.311 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.311 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.311 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.311 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.311 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.311 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.311 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.311 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.311 INFO:teuthology.orchestra.run.smithi005.stdout: "predictor_model": { 2024-09-11T23:36:15.311 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "predictor_model", 2024-09-11T23:36:15.311 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.311 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.312 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.312 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "prophetstor", 2024-09-11T23:36:15.312 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.312 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.312 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.312 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.312 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.312 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.312 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.312 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.312 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2024-09-11T23:36:15.312 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2024-09-11T23:36:15.313 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.313 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.313 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.313 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2024-09-11T23:36:15.313 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.313 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.313 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.313 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.313 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.313 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.313 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.313 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.313 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.314 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.314 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.314 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "influx", 2024-09-11T23:36:15.314 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": false, 2024-09-11T23:36:15.314 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "influxdb python module not found", 2024-09-11T23:36:15.314 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.314 INFO:teuthology.orchestra.run.smithi005.stdout: "batch_size": { 2024-09-11T23:36:15.314 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "batch_size", 2024-09-11T23:36:15.314 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.314 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.314 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.314 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5000", 2024-09-11T23:36:15.314 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.314 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.315 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.315 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-11T23:36:15.315 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.315 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.315 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.315 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.315 INFO:teuthology.orchestra.run.smithi005.stdout: "database": { 2024-09-11T23:36:15.315 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "database", 2024-09-11T23:36:15.315 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.315 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.315 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.316 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "ceph", 2024-09-11T23:36:15.316 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.316 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.316 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.316 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-11T23:36:15.316 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.316 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.316 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.316 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.316 INFO:teuthology.orchestra.run.smithi005.stdout: "hostname": { 2024-09-11T23:36:15.316 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "hostname", 2024-09-11T23:36:15.316 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.317 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.317 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.317 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.317 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.317 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.317 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.317 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB server hostname", 2024-09-11T23:36:15.317 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.317 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.317 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.317 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.317 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2024-09-11T23:36:15.317 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2024-09-11T23:36:15.318 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:15.318 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.318 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.318 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "30", 2024-09-11T23:36:15.318 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "5", 2024-09-11T23:36:15.318 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.318 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.318 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-11T23:36:15.318 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.318 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.318 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.318 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.318 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.319 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.319 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.319 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.319 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.319 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.319 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.319 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.319 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.319 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.319 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.319 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.319 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.320 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.320 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.320 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.320 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.320 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.320 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.320 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.320 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.320 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.320 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.320 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.320 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.320 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.321 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.321 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.321 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.321 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.321 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.321 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.321 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.321 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.321 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.321 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.321 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.321 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.322 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.322 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.322 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.322 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.322 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.322 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.322 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.322 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.322 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.322 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.322 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.322 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.322 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.323 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.323 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.323 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.323 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.323 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.323 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.323 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.323 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.323 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.323 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.323 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.324 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.324 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.324 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.324 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.324 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.324 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.324 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.324 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.324 INFO:teuthology.orchestra.run.smithi005.stdout: "password": { 2024-09-11T23:36:15.324 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "password", 2024-09-11T23:36:15.324 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.324 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.325 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.325 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.325 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.325 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.325 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.325 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "password of InfluxDB server user", 2024-09-11T23:36:15.325 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.325 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.325 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.325 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.325 INFO:teuthology.orchestra.run.smithi005.stdout: "port": { 2024-09-11T23:36:15.325 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "port", 2024-09-11T23:36:15.326 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.326 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.326 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.326 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8086", 2024-09-11T23:36:15.326 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.326 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.326 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.326 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB server port", 2024-09-11T23:36:15.326 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.326 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.326 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.326 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.327 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl": { 2024-09-11T23:36:15.327 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl", 2024-09-11T23:36:15.327 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.327 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.327 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.327 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "false", 2024-09-11T23:36:15.327 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.327 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.327 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.327 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T23:36:15.327 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.327 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.327 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.327 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.328 INFO:teuthology.orchestra.run.smithi005.stdout: "threads": { 2024-09-11T23:36:15.328 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "threads", 2024-09-11T23:36:15.328 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.328 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.328 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.328 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2024-09-11T23:36:15.328 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2024-09-11T23:36:15.328 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "32", 2024-09-11T23:36:15.328 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.328 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-11T23:36:15.328 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.328 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.329 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.329 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.329 INFO:teuthology.orchestra.run.smithi005.stdout: "username": { 2024-09-11T23:36:15.329 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "username", 2024-09-11T23:36:15.329 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.329 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.329 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.329 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.329 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.329 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.329 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.329 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "username of InfluxDB server user", 2024-09-11T23:36:15.329 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.330 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.330 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.330 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.330 INFO:teuthology.orchestra.run.smithi005.stdout: "verify_ssl": { 2024-09-11T23:36:15.330 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "verify_ssl", 2024-09-11T23:36:15.330 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.330 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.330 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.330 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "true", 2024-09-11T23:36:15.330 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.330 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.330 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.331 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T23:36:15.331 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.331 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.331 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.331 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.331 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.331 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.331 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.331 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "insights", 2024-09-11T23:36:15.331 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.331 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.331 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.331 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.331 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.332 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.332 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.332 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.332 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.332 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.332 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.332 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.332 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.332 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.332 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.332 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.332 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.333 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.333 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.333 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.333 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.333 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.333 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.333 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.333 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.333 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.333 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.333 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.333 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.333 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.334 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.334 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.334 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.334 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.334 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.334 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.334 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.334 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.334 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.334 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.334 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.334 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.334 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.335 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.335 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.335 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.335 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.335 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.335 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.335 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.335 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.335 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.335 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.335 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.335 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.335 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.336 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.336 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.336 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.336 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.336 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.336 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.336 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.336 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.336 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.336 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.336 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.336 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.336 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.337 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.337 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.337 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.337 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.337 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.337 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.337 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.337 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "iostat", 2024-09-11T23:36:15.337 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.337 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.337 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.337 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.337 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.338 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.338 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.338 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.338 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.338 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.338 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.338 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.338 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.338 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.338 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.338 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.338 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.338 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.339 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.339 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.339 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.339 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.339 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.339 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.339 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.339 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.339 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.339 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.339 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.339 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.339 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.340 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.340 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.340 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.340 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.340 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.340 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.340 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.340 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.340 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.340 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.340 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.340 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.341 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.341 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.341 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.341 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.341 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.341 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.341 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.341 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.341 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.341 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.341 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.341 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.341 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.342 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.342 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.342 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.342 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.342 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.342 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.342 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.342 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.342 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.342 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.342 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.342 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.342 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.343 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.343 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.343 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.343 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.343 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.343 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.343 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.343 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "k8sevents", 2024-09-11T23:36:15.343 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.343 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.343 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.343 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_event_retention_days": { 2024-09-11T23:36:15.343 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ceph_event_retention_days", 2024-09-11T23:36:15.343 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.344 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.344 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.344 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "7", 2024-09-11T23:36:15.344 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.344 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.344 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.344 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-11T23:36:15.344 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.344 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.344 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.344 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.344 INFO:teuthology.orchestra.run.smithi005.stdout: "config_check_secs": { 2024-09-11T23:36:15.344 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "config_check_secs", 2024-09-11T23:36:15.345 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.345 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.345 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.345 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-09-11T23:36:15.345 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "10", 2024-09-11T23:36:15.345 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.345 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.345 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-11T23:36:15.345 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.345 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.345 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.345 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.346 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.346 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.346 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.346 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.346 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.346 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.346 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.346 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.346 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.346 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.346 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.346 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.346 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.347 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.347 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.347 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.347 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.347 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.347 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.347 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.347 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.347 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.347 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.347 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.347 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.347 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.348 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.348 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.348 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.348 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.348 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.348 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.348 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.348 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.348 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.348 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.348 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.348 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.349 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.349 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.349 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.349 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.349 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.349 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.349 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.349 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.349 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.349 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.349 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.349 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.349 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.350 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.350 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.350 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.350 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.350 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.350 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.350 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.350 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.350 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.350 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.350 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.350 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.350 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.351 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.351 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.351 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.351 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.351 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.351 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.351 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.351 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.351 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.351 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "localpool", 2024-09-11T23:36:15.351 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.351 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.351 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.351 INFO:teuthology.orchestra.run.smithi005.stdout: "failure_domain": { 2024-09-11T23:36:15.352 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "failure_domain", 2024-09-11T23:36:15.352 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.352 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.352 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.352 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "host", 2024-09-11T23:36:15.352 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.352 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.352 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.352 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "failure domain for any created local pool", 2024-09-11T23:36:15.352 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-11T23:36:15.352 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.352 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.352 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.353 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.353 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.353 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.353 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.353 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.353 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.353 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.353 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.353 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.353 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.353 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.353 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.353 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.354 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.354 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.354 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.354 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.354 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.354 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.354 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.354 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.354 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.354 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.354 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.354 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.354 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.355 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.355 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.355 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.355 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.355 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.355 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.355 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.355 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.355 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.355 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.355 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.355 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.355 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.355 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.356 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.356 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.356 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.356 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.356 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.356 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.356 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.356 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.356 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.356 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.356 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.356 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.356 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.357 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.357 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.357 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.357 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.357 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.357 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.357 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.357 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.357 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.357 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.357 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.357 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.357 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.358 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.358 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.358 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.358 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.358 INFO:teuthology.orchestra.run.smithi005.stdout: "min_size": { 2024-09-11T23:36:15.358 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "min_size", 2024-09-11T23:36:15.358 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.358 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.358 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.358 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.358 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.358 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.358 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.359 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default min_size for any created local pool", 2024-09-11T23:36:15.359 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-11T23:36:15.359 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.359 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.359 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.359 INFO:teuthology.orchestra.run.smithi005.stdout: "num_rep": { 2024-09-11T23:36:15.359 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "num_rep", 2024-09-11T23:36:15.359 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.359 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.359 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.359 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3", 2024-09-11T23:36:15.359 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.359 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.360 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.360 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default replica count for any created local pool", 2024-09-11T23:36:15.360 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.360 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.360 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.360 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.360 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num": { 2024-09-11T23:36:15.360 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pg_num", 2024-09-11T23:36:15.360 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.360 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.360 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.360 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "128", 2024-09-11T23:36:15.360 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.361 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.361 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.361 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default pg_num for any created local pool", 2024-09-11T23:36:15.361 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.361 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.361 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.361 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.361 INFO:teuthology.orchestra.run.smithi005.stdout: "prefix": { 2024-09-11T23:36:15.361 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prefix", 2024-09-11T23:36:15.361 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.361 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.361 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.362 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.362 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.362 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.362 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.362 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "name prefix for any created local pool", 2024-09-11T23:36:15.362 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.362 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.362 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.362 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.362 INFO:teuthology.orchestra.run.smithi005.stdout: "subtree": { 2024-09-11T23:36:15.362 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "subtree", 2024-09-11T23:36:15.362 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.362 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.363 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.363 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "rack", 2024-09-11T23:36:15.363 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.363 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.363 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.363 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-11T23:36:15.363 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-11T23:36:15.363 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.363 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.363 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.363 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.363 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.363 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.364 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mds_autoscaler", 2024-09-11T23:36:15.364 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.364 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.364 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.364 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.364 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.364 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.364 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.364 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.364 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.364 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.364 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.364 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.365 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.365 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.365 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.365 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.365 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.365 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.365 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.365 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.365 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.365 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.365 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.365 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.366 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.366 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.366 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.366 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.366 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.366 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.366 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.366 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.366 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.366 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.366 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.366 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.366 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.367 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.367 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.367 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.367 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.367 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.367 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.367 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.367 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.367 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.367 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.367 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.367 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.367 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.368 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.368 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.368 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.368 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.368 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.368 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.368 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.368 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.368 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.368 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.368 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.368 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.369 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.369 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.369 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.369 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.369 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.369 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.369 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.369 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.369 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.369 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.369 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.369 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.369 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.370 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.370 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mirroring", 2024-09-11T23:36:15.370 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.370 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.370 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.370 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.370 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.370 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.370 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.370 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.370 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.370 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.370 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.371 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.371 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.371 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.371 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.371 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.371 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.371 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.371 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.371 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.371 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.371 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.371 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.371 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.372 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.372 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.372 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.372 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.372 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.372 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.372 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.372 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.372 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.372 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.372 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.372 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.372 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.373 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.373 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.373 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.373 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.373 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.373 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.373 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.373 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.373 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.373 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.373 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.373 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.373 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.373 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.374 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.374 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.374 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.374 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.374 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.374 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.374 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.374 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.374 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.374 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.374 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.374 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.375 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.375 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.375 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.375 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.375 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.375 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.375 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.375 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.375 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.375 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.375 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.375 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.375 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.376 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "nfs", 2024-09-11T23:36:15.376 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.376 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.376 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.376 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.376 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.376 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.376 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.376 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.376 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.376 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.376 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.376 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.377 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.377 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.377 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.377 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.377 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.377 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.377 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.377 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.377 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.377 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.377 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.377 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.378 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.378 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.378 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.378 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.378 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.378 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.378 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.378 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.378 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.378 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.378 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.378 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.378 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.379 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.379 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.379 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.379 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.379 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.379 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.379 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.379 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.379 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.379 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.379 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.379 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.380 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.380 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.380 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.380 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.380 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.380 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.380 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.380 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.380 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.380 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.380 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.380 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.380 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.381 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.381 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.381 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.381 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.381 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.381 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.381 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.381 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.381 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.381 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.381 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.381 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.381 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.382 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.382 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "orchestrator", 2024-09-11T23:36:15.382 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.382 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.382 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.382 INFO:teuthology.orchestra.run.smithi005.stdout: "fail_fs": { 2024-09-11T23:36:15.382 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "fail_fs", 2024-09-11T23:36:15.382 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.382 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.382 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.382 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.382 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.382 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.383 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.383 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-11T23:36:15.383 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.383 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.383 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.383 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.383 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.383 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.383 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.383 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.383 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.383 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.383 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.383 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.384 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.384 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.384 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.384 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.384 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.384 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.384 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.384 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.384 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.384 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.384 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.384 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.384 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.385 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.385 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.385 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.385 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.385 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.385 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.385 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.385 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.385 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.385 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.385 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.385 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.385 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.386 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.386 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.386 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.386 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.386 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.386 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.386 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.386 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.386 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.386 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.386 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.386 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.386 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.387 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.387 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.387 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.387 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.387 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.387 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.387 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.387 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.387 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.387 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.387 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.387 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.387 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.387 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.388 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.388 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.388 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.388 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.388 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.388 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.388 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.388 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.388 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.388 INFO:teuthology.orchestra.run.smithi005.stdout: "orchestrator": { 2024-09-11T23:36:15.388 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "orchestrator", 2024-09-11T23:36:15.388 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.389 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.389 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.389 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.389 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.389 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.389 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.389 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm", 2024-09-11T23:36:15.389 INFO:teuthology.orchestra.run.smithi005.stdout: "rook", 2024-09-11T23:36:15.389 INFO:teuthology.orchestra.run.smithi005.stdout: "test_orchestrator" 2024-09-11T23:36:15.389 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.389 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Orchestrator backend", 2024-09-11T23:36:15.389 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.389 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.390 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.390 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.390 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.390 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.390 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.390 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "osd_perf_query", 2024-09-11T23:36:15.390 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.390 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.390 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.390 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.390 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.390 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.391 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.391 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.391 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.391 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.391 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.391 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.391 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.391 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.391 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.391 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.391 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.391 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.391 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.392 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.392 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.392 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.392 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.392 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.392 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.392 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.392 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.392 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.392 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.392 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.392 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.392 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.393 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.393 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.393 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.393 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.393 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.393 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.393 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.393 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.393 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.393 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.393 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.393 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.394 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.394 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.394 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.394 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.394 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.394 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.394 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.394 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.394 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.394 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.394 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.394 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.394 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.394 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.395 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.395 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.395 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.395 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.395 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.395 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.395 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.395 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.395 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.395 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.395 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.395 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.395 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.396 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.396 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.396 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.396 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.396 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.396 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "osd_support", 2024-09-11T23:36:15.396 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.396 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.396 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.396 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.396 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.396 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.397 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.397 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.397 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.397 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.397 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.397 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.397 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.397 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.397 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.397 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.397 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.397 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.397 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.397 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.398 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.398 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.398 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.398 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.398 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.398 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.398 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.398 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.398 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.398 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.398 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.398 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.398 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.399 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.399 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.399 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.399 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.399 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.399 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.399 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.399 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.399 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.399 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.399 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.399 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.399 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.400 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.400 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.400 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.400 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.400 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.400 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.400 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.400 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.400 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.400 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.400 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.400 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.400 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.401 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.401 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.401 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.401 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.401 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.401 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.401 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.401 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.401 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.401 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.401 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.401 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.401 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.402 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.402 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.402 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.402 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.402 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pg_autoscaler", 2024-09-11T23:36:15.402 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.402 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.402 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.402 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.402 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.402 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.402 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.402 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.402 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.403 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.403 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.403 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.403 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.403 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.403 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.403 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.403 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.403 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.403 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.403 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.403 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.403 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.404 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.404 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.404 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.404 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.404 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.404 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.404 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.404 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.404 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.404 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.404 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.404 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.404 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.404 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.405 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.405 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.405 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.405 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.405 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.405 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.405 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.405 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.405 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.405 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.405 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.405 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.406 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.406 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.406 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.406 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.406 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.406 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.406 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.406 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.406 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.406 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.406 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.406 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.406 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.407 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.407 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.407 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.407 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.407 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.407 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.407 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.407 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.407 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.407 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.407 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.407 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.407 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2024-09-11T23:36:15.408 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2024-09-11T23:36:15.408 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:15.408 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.408 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.408 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2024-09-11T23:36:15.408 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.408 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.408 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.408 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.408 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.408 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.408 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.409 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.409 INFO:teuthology.orchestra.run.smithi005.stdout: "threshold": { 2024-09-11T23:36:15.409 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "threshold", 2024-09-11T23:36:15.409 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-09-11T23:36:15.409 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.409 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.409 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3.0", 2024-09-11T23:36:15.409 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1.0", 2024-09-11T23:36:15.409 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.409 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.409 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "scaling threshold", 2024-09-11T23:36:15.409 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-11T23:36:15.409 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.410 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.410 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.410 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.410 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.410 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.410 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "progress", 2024-09-11T23:36:15.410 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.410 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.410 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.410 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_pg_recovery_event": { 2024-09-11T23:36:15.410 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_pg_recovery_event", 2024-09-11T23:36:15.410 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.411 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.411 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.411 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.411 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.411 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.411 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.411 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-11T23:36:15.411 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.411 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.411 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.411 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.411 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": { 2024-09-11T23:36:15.412 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enabled", 2024-09-11T23:36:15.412 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.412 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.412 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.412 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.412 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.412 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.412 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.412 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.412 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.412 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.412 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.412 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.413 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.413 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.413 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.413 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.413 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.413 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.413 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.413 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.413 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.413 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.413 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.413 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.413 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.414 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.414 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.414 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.414 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.414 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.414 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.414 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.414 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.414 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.414 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.414 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.414 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.414 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.415 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.415 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.415 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.415 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.415 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.415 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.415 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.415 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.415 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.415 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.415 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.415 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.415 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.415 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.416 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.416 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.416 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.416 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.416 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.416 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.416 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.416 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.416 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.416 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.416 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.416 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.417 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.417 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.417 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.417 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.417 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.417 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.417 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.417 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.417 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.417 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.417 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.417 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.417 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.417 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.418 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.418 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.418 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.418 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.418 INFO:teuthology.orchestra.run.smithi005.stdout: "max_completed_events": { 2024-09-11T23:36:15.418 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_completed_events", 2024-09-11T23:36:15.418 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.418 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.418 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.418 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "50", 2024-09-11T23:36:15.418 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.418 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.418 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.419 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "number of past completed events to remember", 2024-09-11T23:36:15.419 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.419 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.419 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.419 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.419 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2024-09-11T23:36:15.419 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2024-09-11T23:36:15.419 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:15.419 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.419 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.419 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2024-09-11T23:36:15.419 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.419 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.420 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.420 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long the module is going to sleep", 2024-09-11T23:36:15.420 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.420 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.420 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.420 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.420 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.420 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.420 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.420 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prometheus", 2024-09-11T23:36:15.420 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.421 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.421 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.421 INFO:teuthology.orchestra.run.smithi005.stdout: "cache": { 2024-09-11T23:36:15.421 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cache", 2024-09-11T23:36:15.421 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.421 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.421 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.421 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.421 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.421 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.421 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.422 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.422 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.422 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.422 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.422 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.422 INFO:teuthology.orchestra.run.smithi005.stdout: "exclude_perf_counters": { 2024-09-11T23:36:15.422 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "exclude_perf_counters", 2024-09-11T23:36:15.422 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.422 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.422 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.422 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.422 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.422 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.423 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.423 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-11T23:36:15.423 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-11T23:36:15.423 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.423 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.423 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.423 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.423 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.423 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.423 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.423 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.423 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.423 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.424 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.424 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.424 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.424 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.424 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.424 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.424 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.424 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.424 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.424 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.424 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.424 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.424 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.425 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.425 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.425 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.425 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.425 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.425 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.425 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.425 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.425 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.425 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.425 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.425 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.426 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.426 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.426 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.426 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.426 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.426 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.426 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.426 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.426 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.426 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.426 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.426 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.426 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.427 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.427 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.427 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.427 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.427 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.427 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.427 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.427 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.427 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.427 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.427 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.427 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.427 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.428 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.428 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.428 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.428 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.428 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.428 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.428 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.428 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.428 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.428 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.428 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.428 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.428 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_stats_pools": { 2024-09-11T23:36:15.429 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_stats_pools", 2024-09-11T23:36:15.429 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.429 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.429 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.429 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.429 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.429 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.429 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.429 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.429 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.429 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.429 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.429 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.430 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-11T23:36:15.430 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-11T23:36:15.430 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.430 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.430 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.430 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "300", 2024-09-11T23:36:15.430 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.430 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.430 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.430 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.430 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.430 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.431 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.431 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.431 INFO:teuthology.orchestra.run.smithi005.stdout: "scrape_interval": { 2024-09-11T23:36:15.431 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "scrape_interval", 2024-09-11T23:36:15.431 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-09-11T23:36:15.431 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.431 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.431 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15.0", 2024-09-11T23:36:15.431 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.431 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.431 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.431 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.431 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.431 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.432 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.432 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.432 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2024-09-11T23:36:15.432 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2024-09-11T23:36:15.432 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.432 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.432 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.432 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "::", 2024-09-11T23:36:15.432 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.432 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.432 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.432 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-11T23:36:15.432 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.433 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.433 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.433 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.433 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2024-09-11T23:36:15.433 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2024-09-11T23:36:15.433 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.433 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.433 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.433 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "9283", 2024-09-11T23:36:15.433 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.433 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.433 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.433 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-11T23:36:15.434 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.434 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.434 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.434 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.434 INFO:teuthology.orchestra.run.smithi005.stdout: "stale_cache_strategy": { 2024-09-11T23:36:15.434 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "stale_cache_strategy", 2024-09-11T23:36:15.434 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.434 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.434 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.434 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "log", 2024-09-11T23:36:15.434 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.434 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.435 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.435 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.435 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.435 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.435 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.435 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.435 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_behaviour": { 2024-09-11T23:36:15.435 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_behaviour", 2024-09-11T23:36:15.435 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.435 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.435 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.435 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "default", 2024-09-11T23:36:15.435 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.436 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.436 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.436 INFO:teuthology.orchestra.run.smithi005.stdout: "default", 2024-09-11T23:36:15.436 INFO:teuthology.orchestra.run.smithi005.stdout: "error" 2024-09-11T23:36:15.436 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.436 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.436 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.436 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.436 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.436 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.436 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_error_status_code": { 2024-09-11T23:36:15.436 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_error_status_code", 2024-09-11T23:36:15.437 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.437 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.437 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.437 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "500", 2024-09-11T23:36:15.437 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "400", 2024-09-11T23:36:15.437 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "599", 2024-09-11T23:36:15.437 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.437 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.437 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.437 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.437 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.437 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.437 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.438 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.438 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.438 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_support", 2024-09-11T23:36:15.438 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.438 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.438 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.438 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.438 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.438 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.438 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.438 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.438 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.439 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.439 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.439 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.439 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.439 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.439 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.439 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.439 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.439 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.439 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.439 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.439 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.439 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.440 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.440 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.440 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.440 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.440 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.440 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.440 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.440 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.440 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.440 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.440 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.440 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.441 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.441 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.441 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.441 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.441 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.441 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.441 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.441 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.441 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.441 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.441 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.441 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.441 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.442 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.442 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.442 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.442 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.442 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.442 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.442 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.442 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.442 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.442 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.442 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.442 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.442 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.442 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.443 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.443 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.443 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.443 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.443 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.443 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.443 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.443 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.443 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.443 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.443 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.443 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.443 INFO:teuthology.orchestra.run.smithi005.stdout: "max_concurrent_snap_create": { 2024-09-11T23:36:15.444 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_concurrent_snap_create", 2024-09-11T23:36:15.444 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.444 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.444 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.444 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-09-11T23:36:15.444 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.444 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.444 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.444 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.444 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.444 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.444 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.445 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.445 INFO:teuthology.orchestra.run.smithi005.stdout: "mirror_snapshot_schedule": { 2024-09-11T23:36:15.445 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mirror_snapshot_schedule", 2024-09-11T23:36:15.445 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.445 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.445 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.445 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.445 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.445 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.445 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.445 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.445 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.445 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.446 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.446 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.446 INFO:teuthology.orchestra.run.smithi005.stdout: "trash_purge_schedule": { 2024-09-11T23:36:15.446 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "trash_purge_schedule", 2024-09-11T23:36:15.446 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.446 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.446 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.446 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.446 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.446 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.446 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.446 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.446 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.447 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.447 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.447 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.447 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.447 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.447 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.447 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "restful", 2024-09-11T23:36:15.447 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.447 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.447 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.447 INFO:teuthology.orchestra.run.smithi005.stdout: "enable_auth": { 2024-09-11T23:36:15.447 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enable_auth", 2024-09-11T23:36:15.447 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.448 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.448 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.448 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.448 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.448 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.448 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.448 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.448 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.448 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.448 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.448 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.448 INFO:teuthology.orchestra.run.smithi005.stdout: "key_file": { 2024-09-11T23:36:15.448 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "key_file", 2024-09-11T23:36:15.449 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.449 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.449 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.449 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.449 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.449 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.449 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.449 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.449 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.449 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.451 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.451 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.451 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.451 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.451 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.451 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.451 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.451 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.451 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.451 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.451 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.451 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.452 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.452 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.452 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.452 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.452 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.452 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.452 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.452 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.452 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.452 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.452 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.452 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.452 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.453 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.453 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.453 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.453 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.453 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.453 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.453 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.453 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.453 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.453 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.453 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.453 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.454 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.454 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.454 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.454 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.454 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.454 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.454 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.454 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.454 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.454 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.454 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.454 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.454 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.455 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.455 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.455 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.455 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.455 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.455 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.455 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.455 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.455 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.455 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.455 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2024-09-11T23:36:15.455 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2024-09-11T23:36:15.455 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.456 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.456 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.456 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.456 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.456 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.456 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.456 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.456 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.456 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.456 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.456 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.456 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2024-09-11T23:36:15.457 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2024-09-11T23:36:15.457 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.457 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.457 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.457 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.457 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.457 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.457 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.457 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.457 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.457 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.457 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.457 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.457 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.458 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.458 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.458 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rgw", 2024-09-11T23:36:15.458 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.458 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.458 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.458 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.458 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.458 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.458 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.458 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.458 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.458 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.459 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.459 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.459 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.459 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.459 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.459 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.459 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.459 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.459 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.459 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.459 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.459 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.459 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.460 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.460 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.460 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.460 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.460 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.460 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.460 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.460 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.460 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.460 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.460 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.460 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.460 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.461 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.461 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.461 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.461 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.461 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.461 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.461 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.461 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.461 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.461 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.461 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.461 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.461 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.462 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.462 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.462 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.462 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.462 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.462 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.462 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.462 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.462 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.462 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.462 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.462 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.463 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.463 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.463 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.463 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.463 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.463 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.463 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.463 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.463 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.463 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.463 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.463 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.463 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.464 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.464 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.464 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rook", 2024-09-11T23:36:15.464 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.464 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.464 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.464 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.464 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.464 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.464 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.464 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.464 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.464 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.465 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.465 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.465 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.465 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.465 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.465 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.465 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.465 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.465 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.465 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.465 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.465 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.466 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.466 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.466 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.466 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.466 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.466 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.466 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.466 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.466 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.466 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.466 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.466 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.466 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.467 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.467 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.467 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.467 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.467 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.467 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.467 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.467 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.467 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.467 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.468 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.468 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.468 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.468 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.468 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.468 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.468 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.468 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.468 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.468 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.468 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.469 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.469 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.469 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.469 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.469 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.469 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.469 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.469 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.469 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.469 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.469 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.469 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.469 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.470 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.470 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.470 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.470 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.470 INFO:teuthology.orchestra.run.smithi005.stdout: "storage_class": { 2024-09-11T23:36:15.470 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "storage_class", 2024-09-11T23:36:15.470 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.470 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.470 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.470 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "local", 2024-09-11T23:36:15.470 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.470 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.470 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.471 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-11T23:36:15.471 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.471 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.471 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.471 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.471 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.471 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.471 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.471 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "selftest", 2024-09-11T23:36:15.471 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.471 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.471 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.471 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.472 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.472 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.472 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.472 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.472 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.472 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.472 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.472 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.472 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.472 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.472 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.472 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.472 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.473 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.473 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.473 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.473 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.473 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.473 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.473 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.473 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.473 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.473 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.473 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.473 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.473 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.474 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.474 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.474 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.474 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.474 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.474 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.474 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.474 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.474 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.474 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.474 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.474 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.474 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.474 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.475 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.475 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.475 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.475 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.475 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.475 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.475 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.475 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.475 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.475 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.475 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.475 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.475 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.476 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.476 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.476 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.476 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.476 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.476 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.476 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.476 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.476 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.476 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.476 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.476 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.476 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.477 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.477 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.477 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.477 INFO:teuthology.orchestra.run.smithi005.stdout: "roption1": { 2024-09-11T23:36:15.477 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "roption1", 2024-09-11T23:36:15.477 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.477 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.477 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.477 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.477 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.477 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.477 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.478 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.478 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.478 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.478 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.478 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.478 INFO:teuthology.orchestra.run.smithi005.stdout: "roption2": { 2024-09-11T23:36:15.478 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "roption2", 2024-09-11T23:36:15.478 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.478 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.478 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.479 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "xyz", 2024-09-11T23:36:15.479 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.479 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.479 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.479 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.479 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.479 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.479 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.479 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.479 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption1": { 2024-09-11T23:36:15.479 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption1", 2024-09-11T23:36:15.479 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.479 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.480 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.480 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.480 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.480 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.480 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.480 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.480 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.480 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.480 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.480 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.480 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption2": { 2024-09-11T23:36:15.481 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption2", 2024-09-11T23:36:15.481 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.481 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.481 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.481 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.481 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.481 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.481 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.481 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.481 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.481 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.482 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.482 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.482 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption3": { 2024-09-11T23:36:15.482 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption3", 2024-09-11T23:36:15.482 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-09-11T23:36:15.482 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.482 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.482 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.482 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.482 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.482 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.482 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.483 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.483 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.483 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.483 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.483 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption4": { 2024-09-11T23:36:15.483 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption4", 2024-09-11T23:36:15.483 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.483 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.483 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.483 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.483 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.483 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.483 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.484 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.484 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.484 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.484 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.484 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.484 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption5": { 2024-09-11T23:36:15.484 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption5", 2024-09-11T23:36:15.484 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.484 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.484 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.484 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.484 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.484 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.485 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.485 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.485 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.485 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.485 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.485 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.485 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption6": { 2024-09-11T23:36:15.485 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption6", 2024-09-11T23:36:15.485 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.485 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.485 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.485 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.486 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.486 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.486 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.486 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.486 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.486 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.486 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.486 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.486 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption7": { 2024-09-11T23:36:15.486 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption7", 2024-09-11T23:36:15.486 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.486 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.486 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.487 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.487 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2024-09-11T23:36:15.487 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "42", 2024-09-11T23:36:15.487 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.487 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.487 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.487 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.487 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.487 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.487 INFO:teuthology.orchestra.run.smithi005.stdout: "testkey": { 2024-09-11T23:36:15.487 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testkey", 2024-09-11T23:36:15.488 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.488 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.488 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.488 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.488 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.488 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.488 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.488 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.488 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.488 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.488 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.488 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.489 INFO:teuthology.orchestra.run.smithi005.stdout: "testlkey": { 2024-09-11T23:36:15.489 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testlkey", 2024-09-11T23:36:15.489 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.489 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.489 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.489 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.489 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.489 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.489 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.489 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.489 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.489 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.489 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.490 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.490 INFO:teuthology.orchestra.run.smithi005.stdout: "testnewline": { 2024-09-11T23:36:15.490 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testnewline", 2024-09-11T23:36:15.490 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.490 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.490 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.490 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.490 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.490 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.490 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.490 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.490 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.490 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.490 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.491 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.491 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.491 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.491 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.491 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "snap_schedule", 2024-09-11T23:36:15.491 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.491 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.491 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.491 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_m_granularity": { 2024-09-11T23:36:15.491 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_m_granularity", 2024-09-11T23:36:15.491 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.491 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.491 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.491 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.492 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.492 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.492 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.492 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow minute scheduled snapshots", 2024-09-11T23:36:15.492 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.492 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.492 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.492 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.492 INFO:teuthology.orchestra.run.smithi005.stdout: "dump_on_update": { 2024-09-11T23:36:15.492 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "dump_on_update", 2024-09-11T23:36:15.492 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.492 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.492 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.493 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.493 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.493 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.493 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.493 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "dump database to debug log on update", 2024-09-11T23:36:15.493 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.493 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.493 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.493 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.493 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.493 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.493 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.493 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.494 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.494 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.494 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.494 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.494 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.494 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.494 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.494 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.494 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.494 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.494 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.494 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.494 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.494 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.495 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.495 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.495 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.495 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.495 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.495 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.495 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.495 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.495 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.495 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.495 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.495 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.495 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.496 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.496 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.496 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.496 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.496 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.496 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.496 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.496 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.496 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.496 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.496 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.496 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.497 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.497 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.497 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.497 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.497 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.497 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.497 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.497 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.497 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.497 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.497 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.497 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.497 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.498 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.498 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.498 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.498 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.498 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.498 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.498 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.498 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.498 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.498 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.498 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.498 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.498 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.499 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.499 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.499 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.499 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.499 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "stats", 2024-09-11T23:36:15.499 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.499 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.499 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.499 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.499 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.499 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.499 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.500 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.500 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.500 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.500 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.500 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.500 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.500 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.500 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.500 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.500 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.500 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.500 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.500 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.501 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.501 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.501 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.501 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.501 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.501 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.501 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.501 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.501 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.501 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.501 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.501 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.501 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.502 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.502 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.502 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.502 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.502 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.502 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.502 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.502 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.502 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.502 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.502 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.502 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.502 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.503 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.503 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.503 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.503 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.503 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.503 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.503 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.503 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.503 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.503 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.503 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.503 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.503 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.504 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.504 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.504 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.504 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.504 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.504 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.504 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.504 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.504 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.504 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.504 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.504 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.504 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.505 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.505 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.505 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.505 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.505 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "status", 2024-09-11T23:36:15.505 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.505 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.505 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.505 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.505 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.505 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.505 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.505 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.506 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.506 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.506 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.506 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.506 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.506 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.506 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.506 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.506 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.506 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.506 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.506 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.506 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.507 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.507 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.507 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.507 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.507 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.507 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.507 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.507 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.507 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.507 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.507 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.507 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.508 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.508 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.508 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.508 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.508 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.508 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.508 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.508 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.508 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.508 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.508 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.508 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.509 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.509 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.509 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.509 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.509 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.509 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.509 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.509 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.509 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.509 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.509 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.509 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.510 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.510 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.510 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.510 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.510 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.510 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.510 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.510 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.510 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.510 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.510 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.510 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.510 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.511 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.511 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.511 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.511 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.511 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.511 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.511 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "telegraf", 2024-09-11T23:36:15.511 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.511 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.511 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.511 INFO:teuthology.orchestra.run.smithi005.stdout: "address": { 2024-09-11T23:36:15.511 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "address", 2024-09-11T23:36:15.511 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.512 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.512 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.512 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-11T23:36:15.512 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.512 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.512 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.512 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.512 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.512 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.512 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.512 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.513 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2024-09-11T23:36:15.513 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2024-09-11T23:36:15.513 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:15.513 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.513 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.513 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15", 2024-09-11T23:36:15.513 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.513 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.513 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.513 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.513 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.513 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.513 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.514 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.514 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.514 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.514 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.514 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.514 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.514 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.514 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.514 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.514 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.514 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.514 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.514 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.515 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.515 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.515 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.515 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.515 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.515 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.515 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.515 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.515 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.515 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.515 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.515 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.515 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.516 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.516 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.516 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.516 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.516 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.516 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.516 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.516 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.516 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.516 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.516 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.516 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.516 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.517 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.517 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.517 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.517 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.517 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.517 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.517 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.517 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.517 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.517 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.517 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.517 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.517 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.518 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.518 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.518 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.518 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.518 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.518 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.518 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.518 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.518 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.518 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.518 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.518 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.518 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.519 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.519 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.519 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.519 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.519 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.519 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.519 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.519 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.519 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.519 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "telemetry", 2024-09-11T23:36:15.519 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.519 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.519 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.520 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_basic": { 2024-09-11T23:36:15.520 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_basic", 2024-09-11T23:36:15.520 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.520 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.520 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.520 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.520 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.520 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.520 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.520 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-11T23:36:15.520 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.520 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.520 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.521 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.521 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_crash": { 2024-09-11T23:36:15.521 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_crash", 2024-09-11T23:36:15.521 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.521 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.521 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.521 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.521 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.521 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.521 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.521 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-11T23:36:15.521 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.521 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.522 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.522 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.522 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_device": { 2024-09-11T23:36:15.522 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_device", 2024-09-11T23:36:15.522 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.522 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.522 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.522 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.522 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.522 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.522 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.522 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-11T23:36:15.522 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.523 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.523 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.523 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.523 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_ident": { 2024-09-11T23:36:15.523 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_ident", 2024-09-11T23:36:15.523 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.523 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.523 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.523 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.523 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.523 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.523 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.523 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-11T23:36:15.524 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.524 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.524 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.524 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.524 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_perf": { 2024-09-11T23:36:15.524 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_perf", 2024-09-11T23:36:15.524 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.524 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.524 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.524 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.524 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.524 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.524 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.525 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-11T23:36:15.525 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.525 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.525 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.525 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.525 INFO:teuthology.orchestra.run.smithi005.stdout: "contact": { 2024-09-11T23:36:15.525 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "contact", 2024-09-11T23:36:15.525 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.525 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.525 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.525 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.525 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.525 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.526 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.526 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.526 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.526 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.526 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.526 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.526 INFO:teuthology.orchestra.run.smithi005.stdout: "description": { 2024-09-11T23:36:15.526 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "description", 2024-09-11T23:36:15.526 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.526 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.526 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.526 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.527 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.527 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.527 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.527 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.527 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.527 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.527 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.527 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.527 INFO:teuthology.orchestra.run.smithi005.stdout: "device_url": { 2024-09-11T23:36:15.527 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_url", 2024-09-11T23:36:15.527 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.527 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.527 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.528 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-11T23:36:15.528 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.528 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.528 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.528 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.528 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.528 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.528 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.528 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.528 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": { 2024-09-11T23:36:15.528 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enabled", 2024-09-11T23:36:15.528 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.529 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.529 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.529 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.529 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.529 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.529 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.529 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.529 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.529 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.529 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.530 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.530 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2024-09-11T23:36:15.530 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2024-09-11T23:36:15.530 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.530 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.530 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.530 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "24", 2024-09-11T23:36:15.530 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "8", 2024-09-11T23:36:15.530 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.530 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.530 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.530 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.530 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.531 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.531 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.531 INFO:teuthology.orchestra.run.smithi005.stdout: "last_opt_revision": { 2024-09-11T23:36:15.531 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "last_opt_revision", 2024-09-11T23:36:15.531 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.531 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.531 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.531 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1", 2024-09-11T23:36:15.531 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.531 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.531 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.531 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.531 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.532 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.532 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.532 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.532 INFO:teuthology.orchestra.run.smithi005.stdout: "leaderboard": { 2024-09-11T23:36:15.532 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "leaderboard", 2024-09-11T23:36:15.532 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.532 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.532 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.532 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.532 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.533 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.533 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.533 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.533 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.533 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.533 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.533 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.533 INFO:teuthology.orchestra.run.smithi005.stdout: "leaderboard_description": { 2024-09-11T23:36:15.533 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "leaderboard_description", 2024-09-11T23:36:15.533 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.533 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.533 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.533 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.534 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.534 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.534 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.534 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.534 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.534 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.534 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.534 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.534 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.534 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.534 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.534 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.535 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.535 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.535 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.535 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.535 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.535 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.535 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.535 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.535 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.535 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.535 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.535 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.535 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.535 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.536 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.536 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.536 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.536 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.536 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.536 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.536 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.536 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.536 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.536 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.536 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.537 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.537 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.537 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.537 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.537 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.537 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.537 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.537 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.537 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.537 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.537 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.537 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.537 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.537 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.538 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.538 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.538 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.538 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.538 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.538 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.538 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.538 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.538 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.538 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.538 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.538 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.539 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.539 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.539 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.539 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.539 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.539 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.539 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.539 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.539 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.539 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.539 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.539 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.539 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.540 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.540 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.540 INFO:teuthology.orchestra.run.smithi005.stdout: "organization": { 2024-09-11T23:36:15.540 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "organization", 2024-09-11T23:36:15.540 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.540 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.540 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.540 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.540 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.540 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.540 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.540 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.540 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.541 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.541 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.541 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.541 INFO:teuthology.orchestra.run.smithi005.stdout: "proxy": { 2024-09-11T23:36:15.541 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "proxy", 2024-09-11T23:36:15.541 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.541 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.541 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.541 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.541 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.541 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.541 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.541 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.542 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.542 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.542 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.542 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.542 INFO:teuthology.orchestra.run.smithi005.stdout: "url": { 2024-09-11T23:36:15.542 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "url", 2024-09-11T23:36:15.542 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.542 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.542 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.542 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-11T23:36:15.542 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.542 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.542 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.543 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.543 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.543 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.543 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.543 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.543 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.543 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.543 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.543 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "test_orchestrator", 2024-09-11T23:36:15.543 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.543 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.543 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.543 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.544 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.544 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.544 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.544 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.544 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.544 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.544 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.544 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.544 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.544 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.544 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.544 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.544 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.545 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.545 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.545 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.545 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.545 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.545 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.545 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.545 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.545 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.545 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.545 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.545 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.546 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.546 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.546 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.546 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.546 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.546 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.546 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.546 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.546 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.546 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.546 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.546 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.546 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.546 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.547 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.547 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.547 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.547 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.547 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.547 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.547 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.547 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.547 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.547 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.547 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.547 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.547 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.548 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.548 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.548 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.548 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.548 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.548 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.548 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.548 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.548 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.548 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.548 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.549 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.549 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.549 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.549 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.549 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.549 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.549 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.549 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.549 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.549 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "volumes", 2024-09-11T23:36:15.549 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.549 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.549 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.550 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.550 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.550 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.550 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.550 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.550 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.550 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.550 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.550 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.550 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.550 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.550 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.550 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.551 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.551 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.551 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.551 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.551 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.551 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.551 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.551 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.551 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.551 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.551 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.551 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.552 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.552 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.552 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.552 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.552 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.552 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.552 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.552 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.552 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.552 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.552 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.552 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.553 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.553 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.553 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.553 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.553 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.553 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.553 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.553 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.553 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.553 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.553 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.553 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.554 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.554 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.554 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.554 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.554 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.554 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.554 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.554 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.554 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.554 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.554 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.554 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.554 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.554 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.555 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.555 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.555 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.555 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.555 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.555 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.555 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.555 INFO:teuthology.orchestra.run.smithi005.stdout: "max_concurrent_clones": { 2024-09-11T23:36:15.555 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_concurrent_clones", 2024-09-11T23:36:15.555 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.555 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.555 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.555 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "4", 2024-09-11T23:36:15.556 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.556 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.556 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.556 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-11T23:36:15.556 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.556 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.556 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.556 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.556 INFO:teuthology.orchestra.run.smithi005.stdout: "periodic_async_work": { 2024-09-11T23:36:15.556 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "periodic_async_work", 2024-09-11T23:36:15.556 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.556 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.556 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.557 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.557 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.557 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.557 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.557 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Periodically check for async work", 2024-09-11T23:36:15.557 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.557 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.557 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.557 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.557 INFO:teuthology.orchestra.run.smithi005.stdout: "snapshot_clone_delay": { 2024-09-11T23:36:15.557 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "snapshot_clone_delay", 2024-09-11T23:36:15.557 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.557 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.558 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.558 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-11T23:36:15.558 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.558 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.558 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.558 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-11T23:36:15.558 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.558 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.558 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.558 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.558 INFO:teuthology.orchestra.run.smithi005.stdout: "snapshot_clone_no_wait": { 2024-09-11T23:36:15.558 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "snapshot_clone_no_wait", 2024-09-11T23:36:15.559 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.559 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.559 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.559 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.559 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.559 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.559 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.559 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-11T23:36:15.559 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.559 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.559 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.559 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.559 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.560 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.560 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.560 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix", 2024-09-11T23:36:15.560 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.560 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.560 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.560 INFO:teuthology.orchestra.run.smithi005.stdout: "discovery_interval": { 2024-09-11T23:36:15.560 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "discovery_interval", 2024-09-11T23:36:15.560 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2024-09-11T23:36:15.560 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.560 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.560 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "100", 2024-09-11T23:36:15.560 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.561 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.561 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.561 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.561 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.561 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.561 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.561 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.561 INFO:teuthology.orchestra.run.smithi005.stdout: "identifier": { 2024-09-11T23:36:15.561 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "identifier", 2024-09-11T23:36:15.561 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.561 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.561 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.561 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.562 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.562 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.562 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.562 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.562 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.562 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.562 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.562 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.562 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2024-09-11T23:36:15.562 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2024-09-11T23:36:15.562 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:15.562 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.562 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.563 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2024-09-11T23:36:15.563 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.563 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.563 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.563 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.563 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.563 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.563 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.563 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.563 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.563 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.563 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.563 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.564 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.564 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.564 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.564 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.564 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.564 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.564 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.564 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.564 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.564 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.564 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.564 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.564 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.565 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.565 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.565 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.565 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.565 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.565 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.565 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.565 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.565 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.565 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.565 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.565 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.565 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.566 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.566 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.566 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.566 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.566 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.566 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.566 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.566 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.566 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.566 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.566 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.566 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.566 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.567 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.567 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.567 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.567 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.567 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.567 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.567 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.567 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.567 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.567 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.567 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.567 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.567 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.568 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.568 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.568 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.568 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.568 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.568 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.568 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.568 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.568 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.568 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.568 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.568 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.569 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.569 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.569 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_host": { 2024-09-11T23:36:15.569 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_host", 2024-09-11T23:36:15.569 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.569 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.569 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.569 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.569 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.569 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.569 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.569 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.569 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.570 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.570 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.570 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.570 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_port": { 2024-09-11T23:36:15.570 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_port", 2024-09-11T23:36:15.570 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.570 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.570 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.570 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10051", 2024-09-11T23:36:15.570 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.570 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.570 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.570 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.570 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.571 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.571 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.571 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.571 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_sender": { 2024-09-11T23:36:15.571 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_sender", 2024-09-11T23:36:15.571 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.571 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.571 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.571 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-11T23:36:15.571 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.571 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.571 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.571 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.571 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.572 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.572 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.572 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.572 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.572 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.572 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-11T23:36:15.572 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.572 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.572 INFO:teuthology.orchestra.run.smithi005.stdout: "gid": 24110, 2024-09-11T23:36:15.572 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "y", 2024-09-11T23:36:15.572 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_features": 4540701547738038271, 2024-09-11T23:36:15.573 INFO:teuthology.orchestra.run.smithi005.stdout: "available_modules": [ 2024-09-11T23:36:15.573 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.573 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "alerts", 2024-09-11T23:36:15.573 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.573 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.573 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.573 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2024-09-11T23:36:15.573 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2024-09-11T23:36:15.573 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:15.573 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.573 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.573 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2024-09-11T23:36:15.573 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.574 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.574 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.574 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How frequently to reexamine health status", 2024-09-11T23:36:15.574 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.574 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.574 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.574 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.574 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.574 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.574 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.574 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.574 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.574 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.575 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.575 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.575 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.575 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.575 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.575 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.575 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.575 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.575 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.575 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.575 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.575 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.575 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.576 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.576 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.576 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.576 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.576 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.576 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.576 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.576 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.576 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.576 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.576 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.576 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.576 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.577 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.577 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.577 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.577 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.577 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.577 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.577 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.577 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.577 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.577 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.577 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.577 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.578 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.578 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.578 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.578 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.578 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.578 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.578 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.578 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.578 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.578 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.578 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.578 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.578 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.579 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.579 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.579 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.579 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.579 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.579 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.579 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.579 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.579 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.579 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.579 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.579 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.579 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.580 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_destination": { 2024-09-11T23:36:15.580 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_destination", 2024-09-11T23:36:15.580 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.580 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.580 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.580 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.580 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.580 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.580 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.581 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Email address to send alerts to", 2024-09-11T23:36:15.581 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.581 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.581 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.581 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.581 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_from_name": { 2024-09-11T23:36:15.581 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_from_name", 2024-09-11T23:36:15.581 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.581 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.581 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.581 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "Ceph", 2024-09-11T23:36:15.581 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.581 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.582 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.582 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Email From: name", 2024-09-11T23:36:15.582 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.582 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.582 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.582 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.582 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_host": { 2024-09-11T23:36:15.582 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_host", 2024-09-11T23:36:15.582 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.582 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.582 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.582 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.582 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.583 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.583 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.583 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP server", 2024-09-11T23:36:15.583 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.583 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.583 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.583 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.583 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_password": { 2024-09-11T23:36:15.583 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_password", 2024-09-11T23:36:15.583 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.583 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.584 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.584 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.584 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.584 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.584 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.584 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Password to authenticate with", 2024-09-11T23:36:15.584 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.584 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.584 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.584 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.585 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_port": { 2024-09-11T23:36:15.585 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_port", 2024-09-11T23:36:15.585 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.585 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.585 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.585 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "465", 2024-09-11T23:36:15.585 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.585 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.585 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.585 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP port", 2024-09-11T23:36:15.585 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.585 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.585 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.585 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.586 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_sender": { 2024-09-11T23:36:15.586 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_sender", 2024-09-11T23:36:15.586 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.586 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.586 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.586 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.586 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.586 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.586 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.586 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP envelope sender", 2024-09-11T23:36:15.586 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.586 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.586 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.586 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.587 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_ssl": { 2024-09-11T23:36:15.587 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_ssl", 2024-09-11T23:36:15.587 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.587 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.587 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.587 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.587 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.587 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.587 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.587 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-11T23:36:15.587 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.588 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.588 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.588 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.588 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_user": { 2024-09-11T23:36:15.588 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_user", 2024-09-11T23:36:15.588 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.588 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.588 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.588 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.588 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.588 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.588 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.589 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "User to authenticate as", 2024-09-11T23:36:15.589 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.589 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.589 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.589 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.589 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.589 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.589 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.589 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "balancer", 2024-09-11T23:36:15.589 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.589 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.589 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.589 INFO:teuthology.orchestra.run.smithi005.stdout: "active": { 2024-09-11T23:36:15.590 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "active", 2024-09-11T23:36:15.590 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.590 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.590 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.590 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.590 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.590 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.590 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.590 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "automatically balance PGs across cluster", 2024-09-11T23:36:15.590 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.590 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.590 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.591 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.591 INFO:teuthology.orchestra.run.smithi005.stdout: "begin_time": { 2024-09-11T23:36:15.591 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "begin_time", 2024-09-11T23:36:15.591 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.591 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.591 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.591 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0000", 2024-09-11T23:36:15.591 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.591 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.591 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.591 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "beginning time of day to automatically balance", 2024-09-11T23:36:15.591 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T23:36:15.591 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.592 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.592 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.592 INFO:teuthology.orchestra.run.smithi005.stdout: "begin_weekday": { 2024-09-11T23:36:15.592 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "begin_weekday", 2024-09-11T23:36:15.592 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2024-09-11T23:36:15.592 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.592 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.592 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-11T23:36:15.592 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0", 2024-09-11T23:36:15.592 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "6", 2024-09-11T23:36:15.592 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.592 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-11T23:36:15.593 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T23:36:15.593 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.593 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.593 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.593 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_max_iterations": { 2024-09-11T23:36:15.593 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_max_iterations", 2024-09-11T23:36:15.593 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2024-09-11T23:36:15.593 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.593 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.593 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "25", 2024-09-11T23:36:15.593 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2024-09-11T23:36:15.593 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "250", 2024-09-11T23:36:15.593 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.594 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-11T23:36:15.594 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.594 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.594 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.594 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.594 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_metrics": { 2024-09-11T23:36:15.594 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_metrics", 2024-09-11T23:36:15.594 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.594 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.594 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.594 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "pgs,objects,bytes", 2024-09-11T23:36:15.594 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.594 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.595 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.595 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-11T23:36:15.595 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-11T23:36:15.595 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.595 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.595 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.595 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_step": { 2024-09-11T23:36:15.595 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_step", 2024-09-11T23:36:15.595 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-09-11T23:36:15.595 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.595 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.595 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0.5", 2024-09-11T23:36:15.595 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0.001", 2024-09-11T23:36:15.596 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "0.999", 2024-09-11T23:36:15.596 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.596 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "aggressiveness of optimization", 2024-09-11T23:36:15.596 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-11T23:36:15.596 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.596 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.596 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.596 INFO:teuthology.orchestra.run.smithi005.stdout: "end_time": { 2024-09-11T23:36:15.596 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "end_time", 2024-09-11T23:36:15.596 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.596 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.596 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.596 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "2359", 2024-09-11T23:36:15.597 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.597 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.597 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.597 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "ending time of day to automatically balance", 2024-09-11T23:36:15.597 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T23:36:15.597 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.597 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.597 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.597 INFO:teuthology.orchestra.run.smithi005.stdout: "end_weekday": { 2024-09-11T23:36:15.597 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "end_weekday", 2024-09-11T23:36:15.597 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2024-09-11T23:36:15.597 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.597 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.598 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-11T23:36:15.598 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0", 2024-09-11T23:36:15.598 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "6", 2024-09-11T23:36:15.598 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.598 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-11T23:36:15.598 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T23:36:15.598 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.598 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.598 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.598 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.598 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.598 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.599 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.599 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.599 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.599 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.599 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.599 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.599 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.599 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.599 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.599 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.599 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.599 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.599 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.600 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.600 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.600 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.600 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.600 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.600 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.600 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.600 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.600 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.600 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.600 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.600 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.600 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.601 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.601 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.601 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.601 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.601 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.601 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.601 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.601 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.601 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.601 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.601 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.601 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.602 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.602 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.602 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.602 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.602 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.602 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.602 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.602 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.602 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.602 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.602 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.602 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.602 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.603 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.603 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.603 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.603 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.603 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.603 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.603 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.603 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.603 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.603 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.603 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.603 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.603 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.604 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.604 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.604 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.604 INFO:teuthology.orchestra.run.smithi005.stdout: "min_score": { 2024-09-11T23:36:15.604 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "min_score", 2024-09-11T23:36:15.604 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-09-11T23:36:15.604 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.604 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.604 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-11T23:36:15.604 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.604 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.604 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.604 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-11T23:36:15.605 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.605 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.605 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.605 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.605 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": { 2024-09-11T23:36:15.605 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mode", 2024-09-11T23:36:15.605 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.605 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.605 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.605 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "upmap", 2024-09-11T23:36:15.605 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.605 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.606 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.606 INFO:teuthology.orchestra.run.smithi005.stdout: "crush-compat", 2024-09-11T23:36:15.606 INFO:teuthology.orchestra.run.smithi005.stdout: "none", 2024-09-11T23:36:15.606 INFO:teuthology.orchestra.run.smithi005.stdout: "read", 2024-09-11T23:36:15.606 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap", 2024-09-11T23:36:15.606 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap-read" 2024-09-11T23:36:15.606 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.606 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Balancer mode", 2024-09-11T23:36:15.606 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.606 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.607 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.607 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.607 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_ids": { 2024-09-11T23:36:15.607 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pool_ids", 2024-09-11T23:36:15.607 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.607 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.607 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.607 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.607 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.607 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.607 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.607 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-11T23:36:15.607 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.608 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.608 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.608 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.608 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2024-09-11T23:36:15.608 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2024-09-11T23:36:15.608 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:15.608 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.608 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.608 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2024-09-11T23:36:15.608 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.608 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.608 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.608 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-11T23:36:15.609 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.609 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.609 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.609 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.609 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap_max_deviation": { 2024-09-11T23:36:15.609 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "upmap_max_deviation", 2024-09-11T23:36:15.609 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.609 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.609 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.610 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2024-09-11T23:36:15.610 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2024-09-11T23:36:15.610 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.610 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.610 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-11T23:36:15.610 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-11T23:36:15.610 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.610 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.610 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.610 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap_max_optimizations": { 2024-09-11T23:36:15.610 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "upmap_max_optimizations", 2024-09-11T23:36:15.610 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2024-09-11T23:36:15.610 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.611 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.611 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-09-11T23:36:15.611 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.611 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.611 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.611 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-11T23:36:15.611 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.611 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.611 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.611 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.611 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.611 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.612 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.612 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephadm", 2024-09-11T23:36:15.612 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.612 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.612 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.612 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_down_multiplier": { 2024-09-11T23:36:15.612 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_down_multiplier", 2024-09-11T23:36:15.612 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-09-11T23:36:15.612 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.612 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.612 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3.0", 2024-09-11T23:36:15.612 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.613 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.613 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.613 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-11T23:36:15.613 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.613 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.613 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.613 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.613 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_refresh_rate": { 2024-09-11T23:36:15.613 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_refresh_rate", 2024-09-11T23:36:15.613 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:15.613 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.613 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.613 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "20", 2024-09-11T23:36:15.613 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.614 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.614 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.614 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-11T23:36:15.614 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.614 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.614 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.614 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.614 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_starting_port": { 2024-09-11T23:36:15.614 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_starting_port", 2024-09-11T23:36:15.614 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.614 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.614 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.614 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "4721", 2024-09-11T23:36:15.615 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.615 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.615 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.615 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-11T23:36:15.615 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.615 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.615 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.615 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.615 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_ptrace": { 2024-09-11T23:36:15.615 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_ptrace", 2024-09-11T23:36:15.615 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.615 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.615 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.615 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.616 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.616 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.616 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.616 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-11T23:36:15.616 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-11T23:36:15.616 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.616 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.616 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.616 INFO:teuthology.orchestra.run.smithi005.stdout: "autotune_interval": { 2024-09-11T23:36:15.616 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "autotune_interval", 2024-09-11T23:36:15.616 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:15.617 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.617 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.617 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2024-09-11T23:36:15.617 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.617 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.617 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.617 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-11T23:36:15.617 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.617 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.617 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.617 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.617 INFO:teuthology.orchestra.run.smithi005.stdout: "autotune_memory_target_ratio": { 2024-09-11T23:36:15.617 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "autotune_memory_target_ratio", 2024-09-11T23:36:15.617 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-09-11T23:36:15.618 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.618 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.618 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0.7", 2024-09-11T23:36:15.618 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.618 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.618 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.618 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-11T23:36:15.618 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.618 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.618 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.618 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.618 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm_log_destination": { 2024-09-11T23:36:15.619 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephadm_log_destination", 2024-09-11T23:36:15.619 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.619 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.619 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.619 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.619 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.619 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.619 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.619 INFO:teuthology.orchestra.run.smithi005.stdout: "file", 2024-09-11T23:36:15.619 INFO:teuthology.orchestra.run.smithi005.stdout: "file,syslog", 2024-09-11T23:36:15.619 INFO:teuthology.orchestra.run.smithi005.stdout: "syslog" 2024-09-11T23:36:15.619 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.619 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-11T23:36:15.620 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.620 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.620 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.620 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.620 INFO:teuthology.orchestra.run.smithi005.stdout: "cgroups_split": { 2024-09-11T23:36:15.620 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cgroups_split", 2024-09-11T23:36:15.620 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.620 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.620 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.620 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.620 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.620 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.620 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.621 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-11T23:36:15.621 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.621 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.621 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.621 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.621 INFO:teuthology.orchestra.run.smithi005.stdout: "config_checks_enabled": { 2024-09-11T23:36:15.621 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "config_checks_enabled", 2024-09-11T23:36:15.621 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.621 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.621 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.621 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.621 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.621 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.622 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.622 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-11T23:36:15.622 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.622 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.622 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.622 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.622 INFO:teuthology.orchestra.run.smithi005.stdout: "config_dashboard": { 2024-09-11T23:36:15.622 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "config_dashboard", 2024-09-11T23:36:15.622 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.622 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.622 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.622 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.622 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.623 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.623 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.623 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-11T23:36:15.623 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.623 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.623 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.623 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.623 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_alertmanager": { 2024-09-11T23:36:15.623 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_alertmanager", 2024-09-11T23:36:15.623 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.623 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.623 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.623 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-11T23:36:15.624 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.624 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.624 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.624 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2024-09-11T23:36:15.624 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.624 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.624 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.624 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.624 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_base": { 2024-09-11T23:36:15.624 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_base", 2024-09-11T23:36:15.624 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.624 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.625 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.625 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-11T23:36:15.625 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.625 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.625 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.625 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Container image name, without the tag", 2024-09-11T23:36:15.625 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.625 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.625 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.625 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.625 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_elasticsearch": { 2024-09-11T23:36:15.625 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_elasticsearch", 2024-09-11T23:36:15.626 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.626 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.626 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.626 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-11T23:36:15.626 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.626 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.626 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.626 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "elasticsearch container image", 2024-09-11T23:36:15.626 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.626 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.626 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.626 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.626 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_grafana": { 2024-09-11T23:36:15.627 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_grafana", 2024-09-11T23:36:15.627 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.627 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.627 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.627 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-11T23:36:15.627 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.627 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.627 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.627 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2024-09-11T23:36:15.627 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.627 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.627 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.628 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.628 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_haproxy": { 2024-09-11T23:36:15.628 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_haproxy", 2024-09-11T23:36:15.628 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.628 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.628 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.628 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-11T23:36:15.628 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.628 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.628 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.628 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "HAproxy container image", 2024-09-11T23:36:15.628 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.629 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.629 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.629 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.629 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_agent": { 2024-09-11T23:36:15.629 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_agent", 2024-09-11T23:36:15.629 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.629 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.629 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.629 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-11T23:36:15.629 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.629 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.630 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.630 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger agent container image", 2024-09-11T23:36:15.630 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.630 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.630 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.630 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.630 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_collector": { 2024-09-11T23:36:15.630 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_collector", 2024-09-11T23:36:15.630 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.630 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.630 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.630 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-11T23:36:15.630 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.631 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.631 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.631 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger collector container image", 2024-09-11T23:36:15.631 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.631 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.631 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.631 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.631 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_query": { 2024-09-11T23:36:15.631 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_query", 2024-09-11T23:36:15.631 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.631 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.631 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.631 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-11T23:36:15.632 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.632 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.632 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.632 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger query container image", 2024-09-11T23:36:15.632 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.632 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.632 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.632 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.632 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_keepalived": { 2024-09-11T23:36:15.632 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_keepalived", 2024-09-11T23:36:15.632 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.632 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.633 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.633 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-11T23:36:15.633 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.633 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.633 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.633 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Keepalived container image", 2024-09-11T23:36:15.633 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.633 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.633 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.633 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.633 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_loki": { 2024-09-11T23:36:15.633 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_loki", 2024-09-11T23:36:15.633 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.634 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.634 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.634 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-11T23:36:15.634 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.634 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.634 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.634 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Loki container image", 2024-09-11T23:36:15.634 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.634 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.634 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.634 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.634 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_node_exporter": { 2024-09-11T23:36:15.634 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_node_exporter", 2024-09-11T23:36:15.635 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.635 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.635 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.635 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-11T23:36:15.635 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.635 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.635 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.635 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2024-09-11T23:36:15.635 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.635 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.635 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.635 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.635 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_nvmeof": { 2024-09-11T23:36:15.636 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_nvmeof", 2024-09-11T23:36:15.636 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.636 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.636 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.636 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-11T23:36:15.636 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.636 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.636 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.636 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Nvme-of container image", 2024-09-11T23:36:15.636 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.636 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.636 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.637 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.637 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_prometheus": { 2024-09-11T23:36:15.637 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_prometheus", 2024-09-11T23:36:15.637 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.637 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.637 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.637 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-11T23:36:15.637 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.637 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.637 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.637 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2024-09-11T23:36:15.637 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.637 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.638 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.638 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.638 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_promtail": { 2024-09-11T23:36:15.638 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_promtail", 2024-09-11T23:36:15.638 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.638 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.638 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.638 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-11T23:36:15.638 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.638 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.638 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.638 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Promtail container image", 2024-09-11T23:36:15.638 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.639 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.639 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.639 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.639 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_samba": { 2024-09-11T23:36:15.639 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_samba", 2024-09-11T23:36:15.639 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.639 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.639 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.639 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-11T23:36:15.639 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.639 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.639 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.639 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Samba/SMB container image", 2024-09-11T23:36:15.640 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.640 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.640 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.640 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.640 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_snmp_gateway": { 2024-09-11T23:36:15.640 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_snmp_gateway", 2024-09-11T23:36:15.640 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.640 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.640 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.640 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-11T23:36:15.640 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.640 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.640 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.641 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SNMP Gateway container image", 2024-09-11T23:36:15.641 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.641 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.641 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.641 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.641 INFO:teuthology.orchestra.run.smithi005.stdout: "container_init": { 2024-09-11T23:36:15.641 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_init", 2024-09-11T23:36:15.641 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.641 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.641 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.641 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.641 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.641 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.641 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.642 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Run podman/docker with `--init`", 2024-09-11T23:36:15.642 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.642 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.642 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.642 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.642 INFO:teuthology.orchestra.run.smithi005.stdout: "daemon_cache_timeout": { 2024-09-11T23:36:15.642 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "daemon_cache_timeout", 2024-09-11T23:36:15.642 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:15.642 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.642 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.642 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2024-09-11T23:36:15.642 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.642 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.643 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.643 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-11T23:36:15.643 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.643 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.643 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.643 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.643 INFO:teuthology.orchestra.run.smithi005.stdout: "default_cephadm_command_timeout": { 2024-09-11T23:36:15.643 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "default_cephadm_command_timeout", 2024-09-11T23:36:15.643 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.643 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.643 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.643 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "900", 2024-09-11T23:36:15.643 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.644 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.644 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.644 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-11T23:36:15.644 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.644 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.644 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.644 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.644 INFO:teuthology.orchestra.run.smithi005.stdout: "default_registry": { 2024-09-11T23:36:15.644 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "default_registry", 2024-09-11T23:36:15.644 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.644 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.644 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.644 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io", 2024-09-11T23:36:15.645 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.645 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.645 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.645 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-11T23:36:15.645 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.645 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.645 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.645 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.645 INFO:teuthology.orchestra.run.smithi005.stdout: "device_cache_timeout": { 2024-09-11T23:36:15.645 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_cache_timeout", 2024-09-11T23:36:15.645 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:15.645 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.646 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.646 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1800", 2024-09-11T23:36:15.646 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.646 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.646 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.646 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache device inventory", 2024-09-11T23:36:15.646 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.646 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.646 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.646 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.646 INFO:teuthology.orchestra.run.smithi005.stdout: "device_enhanced_scan": { 2024-09-11T23:36:15.646 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_enhanced_scan", 2024-09-11T23:36:15.646 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.647 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.647 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.647 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.647 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.647 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.647 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.647 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-11T23:36:15.647 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.647 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.647 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.647 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.647 INFO:teuthology.orchestra.run.smithi005.stdout: "facts_cache_timeout": { 2024-09-11T23:36:15.648 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "facts_cache_timeout", 2024-09-11T23:36:15.648 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:15.648 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.648 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.648 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2024-09-11T23:36:15.648 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.648 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.648 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.648 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache host facts data", 2024-09-11T23:36:15.648 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.648 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.648 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.649 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.649 INFO:teuthology.orchestra.run.smithi005.stdout: "grafana_dashboards_path": { 2024-09-11T23:36:15.649 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "grafana_dashboards_path", 2024-09-11T23:36:15.649 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.649 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.649 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.649 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-11T23:36:15.649 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.649 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.649 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.649 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-11T23:36:15.649 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.649 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.650 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.650 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.650 INFO:teuthology.orchestra.run.smithi005.stdout: "host_check_interval": { 2024-09-11T23:36:15.650 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "host_check_interval", 2024-09-11T23:36:15.650 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:15.650 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.650 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.650 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2024-09-11T23:36:15.650 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.650 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.650 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.650 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to perform a host check", 2024-09-11T23:36:15.650 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.651 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.651 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.651 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.651 INFO:teuthology.orchestra.run.smithi005.stdout: "hw_monitoring": { 2024-09-11T23:36:15.651 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "hw_monitoring", 2024-09-11T23:36:15.651 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.651 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.651 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.651 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.651 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.651 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.651 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.651 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-11T23:36:15.651 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.652 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.652 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.652 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.652 INFO:teuthology.orchestra.run.smithi005.stdout: "inventory_list_all": { 2024-09-11T23:36:15.652 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "inventory_list_all", 2024-09-11T23:36:15.652 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.652 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.652 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.652 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.652 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.652 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.652 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.652 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-11T23:36:15.653 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.653 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.653 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.653 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.653 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.653 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.653 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.653 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.653 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.653 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.653 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.653 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.653 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.654 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.654 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.654 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.654 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.654 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.654 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.654 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.654 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.654 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.654 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.654 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.654 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.654 INFO:teuthology.orchestra.run.smithi005.stdout: "log_refresh_metadata": { 2024-09-11T23:36:15.655 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_refresh_metadata", 2024-09-11T23:36:15.655 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.655 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.655 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.655 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.655 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.655 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.655 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.655 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-11T23:36:15.655 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.655 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.655 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.655 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.656 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.656 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.656 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.656 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.656 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.656 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.656 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.656 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.656 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.656 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-11T23:36:15.656 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.656 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.657 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.657 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.657 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.657 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.657 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.657 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.657 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.657 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.657 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.657 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.657 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.657 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.658 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.658 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.658 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.658 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.658 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.658 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.658 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.658 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.658 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.658 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.658 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.658 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.658 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.659 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.659 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.659 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.659 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.659 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.659 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.659 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.659 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.659 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.659 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.659 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.659 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.660 INFO:teuthology.orchestra.run.smithi005.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-11T23:36:15.660 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-11T23:36:15.660 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.660 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.660 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.660 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.660 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.660 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.660 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.660 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-11T23:36:15.660 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.660 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.660 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.661 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.661 INFO:teuthology.orchestra.run.smithi005.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-11T23:36:15.661 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-11T23:36:15.661 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.661 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.661 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.661 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "*", 2024-09-11T23:36:15.661 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.661 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.661 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.661 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-11T23:36:15.661 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.662 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.662 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.662 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.662 INFO:teuthology.orchestra.run.smithi005.stdout: "max_count_per_host": { 2024-09-11T23:36:15.662 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_count_per_host", 2024-09-11T23:36:15.662 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.662 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.662 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.662 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-09-11T23:36:15.662 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.662 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.662 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.662 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "max number of daemons per service per host", 2024-09-11T23:36:15.663 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.663 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.663 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.663 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.663 INFO:teuthology.orchestra.run.smithi005.stdout: "max_osd_draining_count": { 2024-09-11T23:36:15.663 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_osd_draining_count", 2024-09-11T23:36:15.663 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.663 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.663 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.663 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-09-11T23:36:15.663 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.663 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.664 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.664 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-11T23:36:15.664 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.664 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.664 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.664 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.664 INFO:teuthology.orchestra.run.smithi005.stdout: "migration_current": { 2024-09-11T23:36:15.664 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "migration_current", 2024-09-11T23:36:15.664 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.664 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.664 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.664 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.664 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.665 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.665 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.665 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "internal - do not modify", 2024-09-11T23:36:15.665 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.665 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.665 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.665 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.665 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": { 2024-09-11T23:36:15.665 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mode", 2024-09-11T23:36:15.665 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.665 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.665 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.665 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "root", 2024-09-11T23:36:15.666 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.666 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.666 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.666 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm-package", 2024-09-11T23:36:15.666 INFO:teuthology.orchestra.run.smithi005.stdout: "root" 2024-09-11T23:36:15.666 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.666 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "mode for remote execution of cephadm", 2024-09-11T23:36:15.666 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.666 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.666 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.666 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.666 INFO:teuthology.orchestra.run.smithi005.stdout: "oob_default_addr": { 2024-09-11T23:36:15.666 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "oob_default_addr", 2024-09-11T23:36:15.667 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.667 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.667 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.667 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "169.254.1.1", 2024-09-11T23:36:15.667 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.667 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.667 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.667 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-11T23:36:15.667 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.667 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.667 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.667 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.667 INFO:teuthology.orchestra.run.smithi005.stdout: "prometheus_alerts_path": { 2024-09-11T23:36:15.668 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prometheus_alerts_path", 2024-09-11T23:36:15.668 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.668 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.668 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.668 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-11T23:36:15.668 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.668 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.668 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.668 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-11T23:36:15.668 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.668 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.668 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.668 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.669 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_insecure": { 2024-09-11T23:36:15.669 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_insecure", 2024-09-11T23:36:15.669 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.669 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.669 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.669 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.669 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.669 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.669 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.669 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-11T23:36:15.669 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.669 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.670 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.670 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.670 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_password": { 2024-09-11T23:36:15.670 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_password", 2024-09-11T23:36:15.670 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.670 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.670 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.670 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.670 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.670 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.670 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.670 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-11T23:36:15.670 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.671 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.671 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.671 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.671 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_url": { 2024-09-11T23:36:15.671 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_url", 2024-09-11T23:36:15.671 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.671 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.671 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.671 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.671 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.671 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.671 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.671 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-11T23:36:15.672 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.672 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.672 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.672 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.672 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_username": { 2024-09-11T23:36:15.672 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_username", 2024-09-11T23:36:15.672 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.672 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.672 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.672 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.672 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.672 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.673 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.673 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-11T23:36:15.673 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.673 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.673 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.673 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.673 INFO:teuthology.orchestra.run.smithi005.stdout: "secure_monitoring_stack": { 2024-09-11T23:36:15.673 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "secure_monitoring_stack", 2024-09-11T23:36:15.673 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.673 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.673 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.673 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.674 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.674 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.674 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.674 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-11T23:36:15.674 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.674 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.674 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.674 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.674 INFO:teuthology.orchestra.run.smithi005.stdout: "service_discovery_port": { 2024-09-11T23:36:15.674 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "service_discovery_port", 2024-09-11T23:36:15.674 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.674 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.674 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.675 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8765", 2024-09-11T23:36:15.675 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.675 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.675 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.675 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "cephadm service discovery port", 2024-09-11T23:36:15.675 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.675 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.675 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.675 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.675 INFO:teuthology.orchestra.run.smithi005.stdout: "ssh_config_file": { 2024-09-11T23:36:15.675 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssh_config_file", 2024-09-11T23:36:15.675 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.675 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.676 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.676 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.676 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.676 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.676 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.676 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-11T23:36:15.676 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.676 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.676 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.676 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.676 INFO:teuthology.orchestra.run.smithi005.stdout: "use_agent": { 2024-09-11T23:36:15.676 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "use_agent", 2024-09-11T23:36:15.676 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.677 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.677 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.677 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.677 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.677 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.677 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.677 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-11T23:36:15.677 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.677 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.677 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.677 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.677 INFO:teuthology.orchestra.run.smithi005.stdout: "use_repo_digest": { 2024-09-11T23:36:15.677 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "use_repo_digest", 2024-09-11T23:36:15.678 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.678 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.678 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.678 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.678 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.678 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.678 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.678 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-11T23:36:15.678 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.678 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.678 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.678 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.679 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_failed_host_check": { 2024-09-11T23:36:15.679 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_failed_host_check", 2024-09-11T23:36:15.679 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.679 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.679 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.679 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.679 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.679 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.679 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.679 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if the host check fails", 2024-09-11T23:36:15.679 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.679 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.679 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.680 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.680 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_stray_daemons": { 2024-09-11T23:36:15.680 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_stray_daemons", 2024-09-11T23:36:15.680 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.680 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.680 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.680 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.680 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.680 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.680 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.680 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-11T23:36:15.680 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.681 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.681 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.681 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.681 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_stray_hosts": { 2024-09-11T23:36:15.681 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_stray_hosts", 2024-09-11T23:36:15.681 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.681 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.681 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.681 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.681 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.681 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.681 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.681 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-11T23:36:15.682 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.682 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.682 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.682 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.682 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.682 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.682 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.682 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crash", 2024-09-11T23:36:15.682 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.682 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.682 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.682 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.682 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.682 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.683 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.683 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.683 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.683 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.683 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.683 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.683 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.683 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.683 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.683 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.683 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.684 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.684 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.684 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.684 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.684 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.684 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.684 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.684 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.684 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.684 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.684 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.684 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.684 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.684 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.685 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.685 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.685 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.685 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.685 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.685 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.685 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.685 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.685 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.685 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.685 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.685 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.685 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.686 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.686 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.686 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.686 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.686 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.686 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.686 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.686 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.686 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.686 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.686 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.686 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.687 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.687 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.687 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.687 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.687 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.687 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.687 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.687 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.687 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.687 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.687 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.687 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.688 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.688 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.688 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.688 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.688 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.688 INFO:teuthology.orchestra.run.smithi005.stdout: "retain_interval": { 2024-09-11T23:36:15.688 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "retain_interval", 2024-09-11T23:36:15.688 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:15.688 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.688 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.688 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "31536000", 2024-09-11T23:36:15.688 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.689 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.689 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.689 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-11T23:36:15.689 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.689 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.689 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.689 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.689 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_recent_interval": { 2024-09-11T23:36:15.689 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_recent_interval", 2024-09-11T23:36:15.689 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:15.689 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.689 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.689 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1209600", 2024-09-11T23:36:15.690 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.690 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.690 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.690 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-11T23:36:15.690 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.690 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.690 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.690 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.690 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.690 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.690 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.690 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "dashboard", 2024-09-11T23:36:15.690 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.691 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.691 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.691 INFO:teuthology.orchestra.run.smithi005.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-11T23:36:15.691 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-11T23:36:15.691 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.691 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.691 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.691 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-09-11T23:36:15.691 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.691 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.691 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.691 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.691 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.692 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.692 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.692 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.692 INFO:teuthology.orchestra.run.smithi005.stdout: "ALERTMANAGER_API_HOST": { 2024-09-11T23:36:15.692 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-11T23:36:15.692 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.692 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.692 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.692 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.692 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.692 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.692 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.693 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.693 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.693 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.693 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.693 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.693 INFO:teuthology.orchestra.run.smithi005.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-11T23:36:15.693 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-11T23:36:15.693 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.693 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.693 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.693 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.693 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.693 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.694 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.694 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.694 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.694 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.694 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.694 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.694 INFO:teuthology.orchestra.run.smithi005.stdout: "AUDIT_API_ENABLED": { 2024-09-11T23:36:15.694 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "AUDIT_API_ENABLED", 2024-09-11T23:36:15.694 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.694 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.694 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.694 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.694 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.695 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.695 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.695 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.695 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.695 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.695 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.695 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.695 INFO:teuthology.orchestra.run.smithi005.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-11T23:36:15.695 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-11T23:36:15.695 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.695 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.695 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.695 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.696 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.696 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.696 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.696 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.696 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.696 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.696 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.696 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.696 INFO:teuthology.orchestra.run.smithi005.stdout: "ENABLE_BROWSABLE_API": { 2024-09-11T23:36:15.696 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-11T23:36:15.696 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.696 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.696 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.697 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.697 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.697 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.697 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.697 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.697 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.697 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.697 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.697 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.697 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-11T23:36:15.697 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-11T23:36:15.697 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.697 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.697 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.698 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.698 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.698 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.698 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.698 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.698 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.698 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.698 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.698 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.698 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-11T23:36:15.698 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-11T23:36:15.699 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.699 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.699 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.699 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.699 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.699 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.699 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.699 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.699 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.699 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.699 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.699 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.699 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-11T23:36:15.700 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-11T23:36:15.700 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.700 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.700 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.700 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.700 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.700 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.700 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.700 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.700 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.700 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.700 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.701 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.701 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-11T23:36:15.701 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-11T23:36:15.701 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.701 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.701 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.701 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.701 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.701 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.701 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.701 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.701 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.701 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.702 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.702 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.702 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-11T23:36:15.702 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-11T23:36:15.702 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.702 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.702 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.702 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.702 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.702 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.702 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.702 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.702 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.703 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.703 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.703 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.703 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-11T23:36:15.703 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-11T23:36:15.703 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.703 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.703 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.703 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.703 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.703 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.703 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.704 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.704 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.704 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.704 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.704 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.704 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-11T23:36:15.704 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-11T23:36:15.704 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.704 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.704 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.704 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.704 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.704 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.705 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.705 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.705 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.705 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.705 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.705 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.705 INFO:teuthology.orchestra.run.smithi005.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-11T23:36:15.705 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-11T23:36:15.705 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.705 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.705 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.705 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.705 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.706 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.706 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.706 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.706 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.706 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.706 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.706 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.706 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_PASSWORD": { 2024-09-11T23:36:15.706 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-11T23:36:15.706 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.706 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.706 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.706 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2024-09-11T23:36:15.707 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.707 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.707 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.707 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.707 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.707 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.707 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.707 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.707 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-11T23:36:15.707 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-11T23:36:15.707 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.707 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.707 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.708 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.708 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.708 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.708 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.708 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.708 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.708 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.708 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.708 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.708 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_URL": { 2024-09-11T23:36:15.708 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_URL", 2024-09-11T23:36:15.708 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.709 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.709 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.709 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.709 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.709 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.709 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.709 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.709 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.709 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.709 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.709 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.709 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_USERNAME": { 2024-09-11T23:36:15.709 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-11T23:36:15.710 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.710 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.710 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.710 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2024-09-11T23:36:15.710 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.710 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.710 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.710 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.710 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.710 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.710 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.710 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.710 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-11T23:36:15.710 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-11T23:36:15.711 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.711 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.711 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.711 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.711 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.711 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.711 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.711 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.711 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.711 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.711 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.711 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.711 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-11T23:36:15.712 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-11T23:36:15.712 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.712 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.712 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.712 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.712 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.712 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.712 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.712 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.712 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.712 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.712 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.712 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.713 INFO:teuthology.orchestra.run.smithi005.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-11T23:36:15.713 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-11T23:36:15.713 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.713 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.713 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.713 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.713 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.713 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.713 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.713 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.713 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.713 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.713 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.714 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.714 INFO:teuthology.orchestra.run.smithi005.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-11T23:36:15.714 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-11T23:36:15.714 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.714 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.714 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.714 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.714 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.714 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.714 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.714 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.714 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.714 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.715 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.715 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.715 INFO:teuthology.orchestra.run.smithi005.stdout: "PROMETHEUS_API_HOST": { 2024-09-11T23:36:15.715 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-11T23:36:15.715 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.715 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.715 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.715 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.715 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.715 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.715 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.715 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.715 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.716 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.716 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.716 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.716 INFO:teuthology.orchestra.run.smithi005.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-11T23:36:15.716 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-11T23:36:15.716 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.716 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.716 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.716 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.716 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.716 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.716 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.716 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.717 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.717 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.717 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.717 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.717 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-11T23:36:15.717 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-11T23:36:15.717 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.717 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.717 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.717 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.717 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.717 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.718 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.718 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.718 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.718 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.718 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.718 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.718 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-11T23:36:15.718 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-11T23:36:15.718 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.718 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.718 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.718 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.718 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.719 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.719 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.719 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.719 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.719 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.719 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.719 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.719 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-11T23:36:15.719 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-11T23:36:15.719 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.719 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.719 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.719 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.720 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.720 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.720 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.720 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.720 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.720 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.720 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.720 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.720 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-11T23:36:15.720 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-11T23:36:15.720 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.720 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.720 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.721 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.721 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.721 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.721 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.721 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.721 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.721 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.721 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.721 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.721 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-11T23:36:15.721 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-11T23:36:15.721 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.721 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.722 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.722 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.722 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.722 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.722 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.722 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.722 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.722 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.722 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.722 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.722 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-11T23:36:15.722 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-11T23:36:15.722 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.722 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.723 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.723 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.723 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.723 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.723 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.723 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.723 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.723 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.723 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.723 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.723 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-11T23:36:15.723 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-11T23:36:15.723 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.724 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.724 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.724 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.724 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.724 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.724 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.724 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.724 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.724 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.724 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.724 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.724 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_ENABLED": { 2024-09-11T23:36:15.724 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-11T23:36:15.725 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.725 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.725 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.725 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.725 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.725 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.725 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.725 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.725 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.725 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.725 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.725 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.725 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-11T23:36:15.725 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-11T23:36:15.726 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.726 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.726 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.726 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-11T23:36:15.726 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.726 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.726 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.726 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.726 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.726 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.726 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.726 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.726 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-11T23:36:15.727 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-11T23:36:15.727 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.727 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.727 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.727 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-09-11T23:36:15.727 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.727 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.727 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.727 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.727 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.727 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.727 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.728 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.728 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-11T23:36:15.728 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-11T23:36:15.728 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.728 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.728 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.728 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8", 2024-09-11T23:36:15.728 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.728 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.728 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.728 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.728 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.728 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.729 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.729 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.729 INFO:teuthology.orchestra.run.smithi005.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-11T23:36:15.729 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-11T23:36:15.729 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.729 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.729 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.729 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "45", 2024-09-11T23:36:15.729 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.729 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.729 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.729 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.729 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.730 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.730 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.730 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.730 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_ACCESS_KEY": { 2024-09-11T23:36:15.730 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-11T23:36:15.730 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.730 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.730 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.730 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.730 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.730 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.730 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.731 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.731 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.731 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.731 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.731 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.731 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-11T23:36:15.731 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-11T23:36:15.731 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.731 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.731 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.731 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2024-09-11T23:36:15.731 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.731 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.731 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.732 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.732 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.732 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.732 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.732 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.732 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_SECRET_KEY": { 2024-09-11T23:36:15.732 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-11T23:36:15.732 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.732 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.732 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.732 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.732 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.733 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.733 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.733 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.733 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.733 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.733 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.733 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.733 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_SSL_VERIFY": { 2024-09-11T23:36:15.733 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-11T23:36:15.733 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.733 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.733 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.733 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.734 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.734 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.734 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.734 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.734 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.734 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.734 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.734 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.734 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-11T23:36:15.734 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-11T23:36:15.734 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.734 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.734 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.734 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-11T23:36:15.735 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.735 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.735 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.735 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.735 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.735 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.735 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.735 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.735 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-11T23:36:15.735 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-11T23:36:15.735 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.735 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.735 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.736 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-09-11T23:36:15.736 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.736 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.736 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.736 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.736 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.736 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.736 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.736 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.736 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-11T23:36:15.736 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-11T23:36:15.736 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.736 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.737 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.737 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2024-09-11T23:36:15.737 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.737 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.737 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.737 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.737 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.737 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.737 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.737 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.737 INFO:teuthology.orchestra.run.smithi005.stdout: "cross_origin_url": { 2024-09-11T23:36:15.737 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cross_origin_url", 2024-09-11T23:36:15.737 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.738 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.738 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.738 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.738 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.738 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.738 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.738 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.738 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.738 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.738 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.738 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.738 INFO:teuthology.orchestra.run.smithi005.stdout: "crt_file": { 2024-09-11T23:36:15.738 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crt_file", 2024-09-11T23:36:15.739 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.739 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.739 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.739 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.739 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.739 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.739 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.739 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.739 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.739 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.739 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.739 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.739 INFO:teuthology.orchestra.run.smithi005.stdout: "debug": { 2024-09-11T23:36:15.739 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "debug", 2024-09-11T23:36:15.740 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.740 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.740 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.740 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.740 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.740 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.740 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.740 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable/disable debug options", 2024-09-11T23:36:15.740 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.740 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.740 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.740 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.740 INFO:teuthology.orchestra.run.smithi005.stdout: "jwt_token_ttl": { 2024-09-11T23:36:15.741 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "jwt_token_ttl", 2024-09-11T23:36:15.741 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.741 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.741 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.741 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "28800", 2024-09-11T23:36:15.741 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.741 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.741 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.741 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.741 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.741 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.741 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.741 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.742 INFO:teuthology.orchestra.run.smithi005.stdout: "key_file": { 2024-09-11T23:36:15.742 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "key_file", 2024-09-11T23:36:15.742 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.742 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.742 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.742 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.742 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.742 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.742 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.742 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.742 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.742 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.742 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.743 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.743 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.743 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.743 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.743 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.743 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.743 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.743 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.743 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.743 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.743 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.743 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.743 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.744 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.744 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.744 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.744 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.744 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.744 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.744 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.744 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.744 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.744 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.744 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.744 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.744 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.745 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.745 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.745 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.745 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.745 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.745 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.745 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.745 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.745 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.745 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.745 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.745 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.745 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.746 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.746 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.746 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.746 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.746 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.746 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.746 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.746 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.746 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.746 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.746 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.746 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.746 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.747 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.747 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.747 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.747 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.747 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.747 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.747 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.747 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.747 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.747 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.747 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.747 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.747 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.748 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.748 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.748 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.748 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.748 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.748 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.748 INFO:teuthology.orchestra.run.smithi005.stdout: "motd": { 2024-09-11T23:36:15.748 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "motd", 2024-09-11T23:36:15.748 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.748 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.748 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.748 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.749 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.749 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.749 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.749 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "The message of the day", 2024-09-11T23:36:15.749 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.749 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.749 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.749 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.749 INFO:teuthology.orchestra.run.smithi005.stdout: "redirect_resolve_ip_addr": { 2024-09-11T23:36:15.749 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "redirect_resolve_ip_addr", 2024-09-11T23:36:15.749 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.749 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.749 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.750 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.750 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.750 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.750 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.750 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.750 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.750 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.750 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.750 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.750 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2024-09-11T23:36:15.750 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2024-09-11T23:36:15.750 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.750 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.751 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.751 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "::", 2024-09-11T23:36:15.751 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.751 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.751 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.751 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.751 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.751 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.751 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.751 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.751 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2024-09-11T23:36:15.751 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2024-09-11T23:36:15.751 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.752 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.752 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.752 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8080", 2024-09-11T23:36:15.752 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.752 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.752 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.752 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.752 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.752 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.752 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.752 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.752 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl": { 2024-09-11T23:36:15.752 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl", 2024-09-11T23:36:15.753 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.753 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.753 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.753 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.753 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.753 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.753 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.753 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.753 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.753 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.753 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.753 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.753 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl_server_port": { 2024-09-11T23:36:15.754 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl_server_port", 2024-09-11T23:36:15.754 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.754 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.754 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.754 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8443", 2024-09-11T23:36:15.754 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.754 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.754 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.754 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.754 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.754 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.754 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.754 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.754 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_behaviour": { 2024-09-11T23:36:15.755 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_behaviour", 2024-09-11T23:36:15.755 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.755 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.755 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.755 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "redirect", 2024-09-11T23:36:15.755 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.755 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.755 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.755 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.755 INFO:teuthology.orchestra.run.smithi005.stdout: "redirect" 2024-09-11T23:36:15.755 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.755 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.756 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.756 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.756 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.756 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.756 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_error_status_code": { 2024-09-11T23:36:15.756 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_error_status_code", 2024-09-11T23:36:15.756 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.756 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.756 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.756 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "500", 2024-09-11T23:36:15.756 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "400", 2024-09-11T23:36:15.756 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "599", 2024-09-11T23:36:15.756 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.757 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.757 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.757 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.757 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.757 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.757 INFO:teuthology.orchestra.run.smithi005.stdout: "url_prefix": { 2024-09-11T23:36:15.757 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "url_prefix", 2024-09-11T23:36:15.757 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.757 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.757 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.757 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.757 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.757 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.758 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.758 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.758 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.758 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.758 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.758 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.758 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.758 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.758 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.758 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "devicehealth", 2024-09-11T23:36:15.758 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.758 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.759 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.759 INFO:teuthology.orchestra.run.smithi005.stdout: "enable_monitoring": { 2024-09-11T23:36:15.759 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enable_monitoring", 2024-09-11T23:36:15.759 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.759 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.759 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.759 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.759 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.759 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.759 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.759 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "monitor device health metrics", 2024-09-11T23:36:15.759 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.759 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.760 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.760 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.760 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.760 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.760 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.760 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.760 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.760 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.760 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.760 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.760 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.760 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.760 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.761 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.761 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.761 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.761 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.761 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.761 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.761 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.761 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.761 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.761 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.761 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.761 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.762 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.762 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.762 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.762 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.762 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.762 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.762 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.762 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.762 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.762 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.762 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.762 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.762 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.762 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.763 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.763 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.763 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.763 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.763 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.763 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.763 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.763 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.763 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.763 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.763 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.763 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.764 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.764 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.764 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.764 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.764 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.764 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.764 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.764 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.764 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.764 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.764 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.764 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.764 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.765 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.765 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.765 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.765 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.765 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.765 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.765 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.765 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.765 INFO:teuthology.orchestra.run.smithi005.stdout: "mark_out_threshold": { 2024-09-11T23:36:15.765 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mark_out_threshold", 2024-09-11T23:36:15.765 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:15.765 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.765 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.766 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "2419200", 2024-09-11T23:36:15.766 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.766 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.766 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.766 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-11T23:36:15.766 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.766 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.766 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.766 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.766 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_name": { 2024-09-11T23:36:15.766 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pool_name", 2024-09-11T23:36:15.766 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.766 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.767 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.767 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "device_health_metrics", 2024-09-11T23:36:15.767 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.767 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.767 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.767 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-11T23:36:15.767 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.767 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.767 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.767 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.767 INFO:teuthology.orchestra.run.smithi005.stdout: "retention_period": { 2024-09-11T23:36:15.767 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "retention_period", 2024-09-11T23:36:15.768 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:15.768 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.768 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.768 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15552000", 2024-09-11T23:36:15.768 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.768 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.768 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.768 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long to retain device health metrics", 2024-09-11T23:36:15.768 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.768 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.768 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.768 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.768 INFO:teuthology.orchestra.run.smithi005.stdout: "scrape_frequency": { 2024-09-11T23:36:15.769 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "scrape_frequency", 2024-09-11T23:36:15.769 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:15.769 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.769 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.769 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "86400", 2024-09-11T23:36:15.769 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.769 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.769 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.769 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-11T23:36:15.769 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.769 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.769 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.769 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.770 INFO:teuthology.orchestra.run.smithi005.stdout: "self_heal": { 2024-09-11T23:36:15.770 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "self_heal", 2024-09-11T23:36:15.770 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.770 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.770 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.770 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.770 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.770 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.770 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.770 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-11T23:36:15.770 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.770 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.771 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.771 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.771 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2024-09-11T23:36:15.771 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2024-09-11T23:36:15.771 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:15.771 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.771 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.771 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2024-09-11T23:36:15.771 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.771 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.771 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.771 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to wake up and check device health", 2024-09-11T23:36:15.771 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.772 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.772 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.772 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.772 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_threshold": { 2024-09-11T23:36:15.772 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_threshold", 2024-09-11T23:36:15.772 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:15.772 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.772 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.772 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "7257600", 2024-09-11T23:36:15.772 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.772 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.772 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.772 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-11T23:36:15.773 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.773 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.773 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.773 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.773 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.773 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.773 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.773 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "diskprediction_local", 2024-09-11T23:36:15.773 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.773 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.773 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.773 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.773 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.774 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.774 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.774 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.774 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.774 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.774 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.774 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.774 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.774 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.774 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.774 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.774 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.775 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.775 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.775 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.775 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.775 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.775 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.775 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.775 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.775 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.775 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.775 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.775 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.775 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.775 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.776 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.776 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.776 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.776 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.776 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.776 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.776 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.776 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.776 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.776 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.776 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.776 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.776 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.777 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.777 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.777 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.777 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.777 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.777 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.777 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.777 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.777 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.777 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.777 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.777 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.777 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.778 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.778 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.778 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.778 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.778 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.778 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.778 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.778 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.778 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.778 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.778 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.778 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.778 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.779 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.779 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.779 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.779 INFO:teuthology.orchestra.run.smithi005.stdout: "predict_interval": { 2024-09-11T23:36:15.779 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "predict_interval", 2024-09-11T23:36:15.779 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.779 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.779 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.779 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "86400", 2024-09-11T23:36:15.779 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.779 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.779 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.779 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.780 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.780 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.780 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.780 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.780 INFO:teuthology.orchestra.run.smithi005.stdout: "predictor_model": { 2024-09-11T23:36:15.780 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "predictor_model", 2024-09-11T23:36:15.780 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.780 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.780 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.780 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "prophetstor", 2024-09-11T23:36:15.780 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.780 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.781 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.781 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.781 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.781 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.781 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.781 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.781 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2024-09-11T23:36:15.781 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2024-09-11T23:36:15.781 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.781 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.781 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.781 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2024-09-11T23:36:15.781 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.781 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.782 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.782 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.782 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.782 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.782 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.782 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.782 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.782 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.782 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.782 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "influx", 2024-09-11T23:36:15.782 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": false, 2024-09-11T23:36:15.782 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "influxdb python module not found", 2024-09-11T23:36:15.782 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.783 INFO:teuthology.orchestra.run.smithi005.stdout: "batch_size": { 2024-09-11T23:36:15.783 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "batch_size", 2024-09-11T23:36:15.783 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.783 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.783 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.783 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5000", 2024-09-11T23:36:15.783 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.783 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.783 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.783 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-11T23:36:15.783 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.783 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.783 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.783 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.784 INFO:teuthology.orchestra.run.smithi005.stdout: "database": { 2024-09-11T23:36:15.784 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "database", 2024-09-11T23:36:15.784 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.784 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.784 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.784 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "ceph", 2024-09-11T23:36:15.784 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.784 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.784 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.784 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-11T23:36:15.784 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.784 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.784 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.785 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.785 INFO:teuthology.orchestra.run.smithi005.stdout: "hostname": { 2024-09-11T23:36:15.785 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "hostname", 2024-09-11T23:36:15.785 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.785 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.785 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.785 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.785 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.785 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.785 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.785 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB server hostname", 2024-09-11T23:36:15.785 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.786 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.786 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.786 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.786 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2024-09-11T23:36:15.786 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2024-09-11T23:36:15.786 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:15.786 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.786 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.786 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "30", 2024-09-11T23:36:15.786 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "5", 2024-09-11T23:36:15.786 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.786 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.786 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-11T23:36:15.786 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.787 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.787 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.787 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.787 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.787 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.787 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.787 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.787 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.787 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.787 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.787 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.787 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.787 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.788 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.788 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.788 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.788 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.788 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.788 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.788 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.788 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.788 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.788 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.788 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.788 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.788 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.789 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.789 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.789 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.789 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.789 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.789 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.789 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.789 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.789 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.789 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.789 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.789 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.790 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.790 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.790 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.790 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.790 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.790 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.790 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.790 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.790 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.790 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.790 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.790 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.790 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.791 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.791 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.791 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.791 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.791 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.791 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.791 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.791 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.791 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.791 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.791 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.791 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.791 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.792 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.792 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.792 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.792 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.792 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.792 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.792 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.792 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.792 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.792 INFO:teuthology.orchestra.run.smithi005.stdout: "password": { 2024-09-11T23:36:15.792 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "password", 2024-09-11T23:36:15.792 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.792 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.793 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.793 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.793 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.793 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.793 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.793 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "password of InfluxDB server user", 2024-09-11T23:36:15.793 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.793 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.793 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.793 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.793 INFO:teuthology.orchestra.run.smithi005.stdout: "port": { 2024-09-11T23:36:15.793 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "port", 2024-09-11T23:36:15.793 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.794 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.794 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.794 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8086", 2024-09-11T23:36:15.794 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.794 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.794 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.794 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB server port", 2024-09-11T23:36:15.794 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.794 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.794 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.794 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.794 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl": { 2024-09-11T23:36:15.794 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl", 2024-09-11T23:36:15.795 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.795 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.795 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.795 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "false", 2024-09-11T23:36:15.795 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.795 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.795 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.795 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T23:36:15.795 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.795 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.795 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.795 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.795 INFO:teuthology.orchestra.run.smithi005.stdout: "threads": { 2024-09-11T23:36:15.796 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "threads", 2024-09-11T23:36:15.796 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.796 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.796 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.796 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2024-09-11T23:36:15.796 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2024-09-11T23:36:15.796 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "32", 2024-09-11T23:36:15.796 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.796 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-11T23:36:15.796 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.796 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.796 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.796 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.797 INFO:teuthology.orchestra.run.smithi005.stdout: "username": { 2024-09-11T23:36:15.797 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "username", 2024-09-11T23:36:15.797 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.797 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.797 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.797 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.797 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.797 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.797 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.797 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "username of InfluxDB server user", 2024-09-11T23:36:15.797 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.797 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.797 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.798 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.798 INFO:teuthology.orchestra.run.smithi005.stdout: "verify_ssl": { 2024-09-11T23:36:15.798 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "verify_ssl", 2024-09-11T23:36:15.798 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.798 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.798 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.798 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "true", 2024-09-11T23:36:15.798 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.798 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.798 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.798 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T23:36:15.798 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.798 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.799 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.799 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.799 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.799 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.799 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.799 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "insights", 2024-09-11T23:36:15.799 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.799 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.799 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.799 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.799 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.799 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.799 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.800 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.800 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.800 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.800 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.800 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.800 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.800 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.800 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.800 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.800 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.800 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.800 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.801 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.801 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.801 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.801 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.801 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.801 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.801 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.801 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.801 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.801 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.801 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.801 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.801 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.802 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.802 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.802 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.802 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.802 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.802 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.802 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.802 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.802 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.802 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.802 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.802 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.802 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.803 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.803 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.803 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.803 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.803 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.803 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.803 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.803 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.803 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.803 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.803 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.803 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.803 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.803 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.804 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.804 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.804 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.804 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.804 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.804 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.804 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.804 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.804 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.804 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.804 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.805 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.805 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.805 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.805 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.805 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.805 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.805 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "iostat", 2024-09-11T23:36:15.805 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.805 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.805 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.805 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.805 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.805 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.806 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.806 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.806 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.806 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.806 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.806 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.806 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.806 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.806 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.806 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.806 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.806 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.806 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.807 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.807 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.807 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.807 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.807 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.807 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.807 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.807 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.807 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.807 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.807 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.807 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.808 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.808 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.808 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.808 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.808 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.808 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.808 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.808 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.808 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.808 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.808 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.808 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.809 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.809 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.809 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.809 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.809 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.809 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.809 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.809 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.809 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.809 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.809 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.809 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.809 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.810 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.810 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.810 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.810 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.810 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.810 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.810 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.810 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.810 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.810 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.810 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.810 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.810 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.811 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.811 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.811 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.811 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.811 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.811 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.811 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.811 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "k8sevents", 2024-09-11T23:36:15.811 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.811 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.811 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.811 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_event_retention_days": { 2024-09-11T23:36:15.811 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ceph_event_retention_days", 2024-09-11T23:36:15.812 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.812 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.812 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.812 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "7", 2024-09-11T23:36:15.812 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.812 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.812 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.812 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-11T23:36:15.812 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.812 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.812 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.812 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.812 INFO:teuthology.orchestra.run.smithi005.stdout: "config_check_secs": { 2024-09-11T23:36:15.813 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "config_check_secs", 2024-09-11T23:36:15.813 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.813 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.813 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.813 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-09-11T23:36:15.813 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "10", 2024-09-11T23:36:15.813 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.813 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.813 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-11T23:36:15.813 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.813 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.813 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.814 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.814 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.814 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.814 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.814 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.814 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.814 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.814 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.814 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.814 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.814 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.814 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.815 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.815 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.815 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.815 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.815 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.815 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.815 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.815 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.815 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.815 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.815 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.815 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.815 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.816 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.816 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.816 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.816 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.816 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.816 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.816 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.816 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.816 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.816 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.816 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.816 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.817 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.817 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.817 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.817 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.817 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.817 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.817 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.817 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.817 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.817 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.817 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.817 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.817 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.818 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.818 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.818 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.818 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.818 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.818 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.818 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.818 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.818 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.818 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.818 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.818 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.818 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.819 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.819 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.819 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.819 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.819 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.819 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.819 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.819 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.819 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.819 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.819 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.819 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "localpool", 2024-09-11T23:36:15.819 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.820 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.820 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.820 INFO:teuthology.orchestra.run.smithi005.stdout: "failure_domain": { 2024-09-11T23:36:15.820 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "failure_domain", 2024-09-11T23:36:15.820 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.820 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.820 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.820 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "host", 2024-09-11T23:36:15.820 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.820 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.820 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.820 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "failure domain for any created local pool", 2024-09-11T23:36:15.821 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-11T23:36:15.821 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.821 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.821 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.821 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.821 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.821 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.821 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.821 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.821 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.821 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.821 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.821 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.822 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.822 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.822 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.822 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.822 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.822 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.822 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.822 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.822 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.822 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.822 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.822 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.822 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.823 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.823 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.823 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.823 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.823 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.823 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.823 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.823 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.823 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.823 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.823 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.823 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.823 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.823 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.824 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.824 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.824 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.824 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.824 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.824 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.824 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.824 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.824 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.824 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.824 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.824 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.825 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.825 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.825 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.825 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.825 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.825 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.825 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.825 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.825 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.825 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.825 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.825 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.825 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.825 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.826 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.826 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.826 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.826 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.826 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.826 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.826 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.826 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.826 INFO:teuthology.orchestra.run.smithi005.stdout: "min_size": { 2024-09-11T23:36:15.826 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "min_size", 2024-09-11T23:36:15.826 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.826 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.826 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.827 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.827 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.827 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.827 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.827 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default min_size for any created local pool", 2024-09-11T23:36:15.827 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-11T23:36:15.827 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.827 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.827 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.827 INFO:teuthology.orchestra.run.smithi005.stdout: "num_rep": { 2024-09-11T23:36:15.827 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "num_rep", 2024-09-11T23:36:15.827 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.827 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.828 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.828 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3", 2024-09-11T23:36:15.828 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.828 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.830 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.830 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default replica count for any created local pool", 2024-09-11T23:36:15.830 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.830 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.830 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.830 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.830 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num": { 2024-09-11T23:36:15.830 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pg_num", 2024-09-11T23:36:15.830 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.830 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.830 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.831 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "128", 2024-09-11T23:36:15.831 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.831 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.831 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.831 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default pg_num for any created local pool", 2024-09-11T23:36:15.831 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.831 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.831 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.831 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.832 INFO:teuthology.orchestra.run.smithi005.stdout: "prefix": { 2024-09-11T23:36:15.832 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prefix", 2024-09-11T23:36:15.832 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.832 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.832 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.832 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.832 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.832 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.832 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.832 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "name prefix for any created local pool", 2024-09-11T23:36:15.832 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.832 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.832 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.833 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.833 INFO:teuthology.orchestra.run.smithi005.stdout: "subtree": { 2024-09-11T23:36:15.833 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "subtree", 2024-09-11T23:36:15.833 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.833 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.833 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.833 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "rack", 2024-09-11T23:36:15.833 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.833 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.833 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.833 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-11T23:36:15.833 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-11T23:36:15.833 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.834 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.834 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.834 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.834 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.834 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.834 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mds_autoscaler", 2024-09-11T23:36:15.834 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.834 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.834 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.834 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.834 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.834 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.834 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.835 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.835 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.835 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.835 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.835 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.835 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.835 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.835 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.835 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.835 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.835 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.835 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.835 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.836 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.836 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.836 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.836 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.836 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.836 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.836 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.836 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.836 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.836 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.836 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.836 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.836 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.837 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.837 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.837 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.837 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.837 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.837 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.837 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.837 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.837 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.837 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.837 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.837 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.837 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.838 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.838 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.838 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.838 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.838 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.838 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.838 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.838 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.838 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.838 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.838 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.838 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.839 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.839 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.839 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.839 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.839 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.839 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.839 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.839 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.839 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.839 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.839 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.839 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.840 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.840 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.840 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.840 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.840 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.840 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.840 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mirroring", 2024-09-11T23:36:15.840 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.840 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.840 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.840 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.840 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.840 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.841 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.841 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.841 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.841 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.841 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.841 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.841 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.841 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.841 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.841 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.841 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.841 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.841 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.842 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.842 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.842 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.842 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.842 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.842 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.842 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.842 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.842 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.842 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.842 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.842 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.843 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.843 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.843 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.843 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.843 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.843 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.843 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.843 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.843 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.843 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.843 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.843 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.843 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.843 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.844 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.844 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.844 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.844 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.844 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.844 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.844 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.844 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.844 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.844 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.844 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.844 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.844 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.845 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.845 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.845 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.845 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.845 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.845 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.845 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.845 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.845 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.845 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.845 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.845 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.845 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.846 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.846 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.846 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.846 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.846 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.846 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "nfs", 2024-09-11T23:36:15.846 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.846 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.846 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.846 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.846 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.846 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.847 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.847 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.847 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.847 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.847 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.847 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.847 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.847 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.847 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.847 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.847 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.847 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.847 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.848 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.848 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.848 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.848 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.848 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.848 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.848 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.848 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.848 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.848 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.848 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.848 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.849 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.849 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.849 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.849 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.849 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.849 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.849 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.849 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.849 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.849 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.849 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.849 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.850 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.850 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.850 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.850 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.850 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.850 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.850 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.850 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.850 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.850 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.850 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.850 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.851 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.851 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.851 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.851 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.851 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.851 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.851 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.851 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.851 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.851 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.851 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.851 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.851 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.852 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.852 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.852 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.852 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.852 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.852 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.852 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.852 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.852 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "orchestrator", 2024-09-11T23:36:15.852 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.852 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.852 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.853 INFO:teuthology.orchestra.run.smithi005.stdout: "fail_fs": { 2024-09-11T23:36:15.853 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "fail_fs", 2024-09-11T23:36:15.853 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.853 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.853 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.853 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.853 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.853 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.853 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.853 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-11T23:36:15.853 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.853 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.853 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.854 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.854 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.854 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.854 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.854 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.854 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.854 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.854 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.854 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.854 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.854 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.854 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.854 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.855 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.855 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.855 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.855 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.855 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.855 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.855 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.855 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.855 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.855 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.855 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.855 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.856 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.856 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.856 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.856 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.856 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.856 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.856 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.856 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.856 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.856 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.856 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.856 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.856 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.857 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.857 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.857 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.857 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.857 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.857 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.857 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.857 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.857 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.857 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.857 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.857 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.858 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.858 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.858 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.858 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.858 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.858 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.858 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.858 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.858 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.858 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.858 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.858 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.859 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.859 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.859 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.859 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.859 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.859 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.859 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.859 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.859 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.859 INFO:teuthology.orchestra.run.smithi005.stdout: "orchestrator": { 2024-09-11T23:36:15.859 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "orchestrator", 2024-09-11T23:36:15.859 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.859 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.860 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.860 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.860 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.860 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.860 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.860 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm", 2024-09-11T23:36:15.860 INFO:teuthology.orchestra.run.smithi005.stdout: "rook", 2024-09-11T23:36:15.860 INFO:teuthology.orchestra.run.smithi005.stdout: "test_orchestrator" 2024-09-11T23:36:15.860 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.860 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Orchestrator backend", 2024-09-11T23:36:15.860 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.860 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.860 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.860 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.861 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.861 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.861 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.861 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "osd_perf_query", 2024-09-11T23:36:15.861 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.861 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.861 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.861 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.861 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.861 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.861 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.861 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.861 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.862 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.862 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.862 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.862 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.862 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.862 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.862 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.862 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.862 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.862 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.862 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.862 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.863 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.863 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.863 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.863 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.863 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.863 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.863 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.863 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.863 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.863 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.863 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.863 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.863 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.864 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.864 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.864 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.864 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.864 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.864 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.864 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.864 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.864 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.864 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.864 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.864 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.865 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.865 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.865 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.865 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.865 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.865 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.865 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.865 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.865 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.865 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.865 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.865 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.865 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.866 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.866 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.866 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.866 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.866 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.866 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.866 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.866 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.866 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.866 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.866 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.866 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.867 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.867 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.867 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.867 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.867 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.867 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "osd_support", 2024-09-11T23:36:15.867 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.867 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.867 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.867 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.867 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.867 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.868 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.868 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.868 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.868 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.868 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.868 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.868 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.868 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.868 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.868 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.868 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.869 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.869 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.869 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.869 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.869 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.869 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.869 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.869 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.869 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.869 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.869 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.869 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.869 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.870 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.870 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.870 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.870 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.870 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.870 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.870 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.870 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.870 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.870 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.870 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.870 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.870 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.871 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.871 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.871 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.871 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.871 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.871 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.871 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.871 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.871 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.871 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.871 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.871 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.871 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.872 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.872 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.872 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.872 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.872 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.872 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.872 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.872 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.872 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.872 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.872 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.872 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.873 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.873 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.873 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.873 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.873 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.873 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.873 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.873 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.873 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pg_autoscaler", 2024-09-11T23:36:15.873 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.873 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.873 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.873 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.874 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.874 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.874 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.874 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.874 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.874 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.874 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.874 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.874 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.874 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.874 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.874 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.874 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.874 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.875 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.875 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.875 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.875 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.875 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.875 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.875 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.875 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.875 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.875 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.875 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.875 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.875 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.876 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.876 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.876 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.876 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.876 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.876 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.876 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.876 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.876 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.876 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.876 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.876 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.876 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.877 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.877 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.877 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.877 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.877 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.877 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.877 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.877 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.877 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.877 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.877 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.877 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.878 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.878 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.878 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.878 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.878 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.878 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.878 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.878 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.878 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.878 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.878 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.879 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.879 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.879 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.879 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.879 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.879 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.879 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2024-09-11T23:36:15.879 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2024-09-11T23:36:15.879 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:15.879 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.879 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.879 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2024-09-11T23:36:15.880 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.880 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.880 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.880 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.880 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.880 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.880 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.880 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.880 INFO:teuthology.orchestra.run.smithi005.stdout: "threshold": { 2024-09-11T23:36:15.880 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "threshold", 2024-09-11T23:36:15.880 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-09-11T23:36:15.880 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.880 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.881 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3.0", 2024-09-11T23:36:15.881 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1.0", 2024-09-11T23:36:15.881 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.881 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.881 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "scaling threshold", 2024-09-11T23:36:15.881 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-11T23:36:15.881 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.881 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.881 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.881 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.881 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.882 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.882 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "progress", 2024-09-11T23:36:15.882 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.882 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.882 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.882 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_pg_recovery_event": { 2024-09-11T23:36:15.882 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_pg_recovery_event", 2024-09-11T23:36:15.882 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.882 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.882 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.882 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.882 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.882 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.883 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.883 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-11T23:36:15.883 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.883 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.883 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.883 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.883 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": { 2024-09-11T23:36:15.883 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enabled", 2024-09-11T23:36:15.883 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.883 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.883 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.883 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.884 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.884 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.884 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.884 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.884 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.884 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.884 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.884 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.884 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.884 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.884 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.884 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.885 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.885 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.885 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.885 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.885 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.885 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.885 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.885 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.885 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.885 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.885 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.885 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.885 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.886 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.886 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.886 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.886 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.886 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.886 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.886 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.886 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.886 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.886 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.886 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.886 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.886 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.887 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.887 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.887 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.887 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.887 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.887 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.887 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.887 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.887 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.887 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.887 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.887 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.888 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.888 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.888 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.888 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.888 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.888 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.888 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.888 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.888 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.888 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.888 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.889 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.889 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.889 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.889 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.889 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.889 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.889 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.889 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.889 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.889 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.889 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.889 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.890 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.890 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.890 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.890 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.890 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.890 INFO:teuthology.orchestra.run.smithi005.stdout: "max_completed_events": { 2024-09-11T23:36:15.890 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_completed_events", 2024-09-11T23:36:15.890 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.890 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.890 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.890 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "50", 2024-09-11T23:36:15.890 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.891 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.891 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.891 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "number of past completed events to remember", 2024-09-11T23:36:15.891 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.891 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.891 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.891 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.891 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2024-09-11T23:36:15.891 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2024-09-11T23:36:15.891 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:15.891 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.891 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.891 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2024-09-11T23:36:15.892 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.892 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.892 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.892 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long the module is going to sleep", 2024-09-11T23:36:15.892 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.892 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.892 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.892 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.892 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.892 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.892 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.892 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prometheus", 2024-09-11T23:36:15.892 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.893 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.893 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.893 INFO:teuthology.orchestra.run.smithi005.stdout: "cache": { 2024-09-11T23:36:15.893 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cache", 2024-09-11T23:36:15.893 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.893 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.893 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.893 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.893 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.893 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.894 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.894 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.894 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.894 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.894 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.894 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.894 INFO:teuthology.orchestra.run.smithi005.stdout: "exclude_perf_counters": { 2024-09-11T23:36:15.894 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "exclude_perf_counters", 2024-09-11T23:36:15.894 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.894 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.894 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.894 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.894 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.895 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.895 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.895 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-11T23:36:15.895 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-11T23:36:15.895 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.895 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.895 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.895 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.895 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.895 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.895 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.895 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.896 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.896 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.896 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.896 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.896 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.896 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.896 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.896 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.896 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.896 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.896 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.896 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.897 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.897 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.897 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.897 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.897 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.897 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.897 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.897 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.897 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.897 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.897 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.897 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.897 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.898 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.898 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.898 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.898 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.898 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.898 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.898 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.898 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.898 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.898 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.898 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.898 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.899 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.899 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.899 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.899 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.899 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.899 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.899 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.899 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.899 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.899 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.899 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.899 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.899 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.900 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.900 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.900 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.900 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.900 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.900 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.900 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.900 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.900 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.900 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.900 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.900 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.900 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.901 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.901 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.901 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_stats_pools": { 2024-09-11T23:36:15.901 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_stats_pools", 2024-09-11T23:36:15.901 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.901 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.901 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.901 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.901 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.901 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.901 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.901 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.902 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.902 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.902 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.902 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.902 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-11T23:36:15.902 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-11T23:36:15.902 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.902 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.902 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.902 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "300", 2024-09-11T23:36:15.902 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.902 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.903 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.903 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.903 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.903 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.903 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.903 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.903 INFO:teuthology.orchestra.run.smithi005.stdout: "scrape_interval": { 2024-09-11T23:36:15.903 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "scrape_interval", 2024-09-11T23:36:15.903 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-09-11T23:36:15.903 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.903 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.903 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15.0", 2024-09-11T23:36:15.903 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.904 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.904 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.904 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.904 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.904 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.904 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.904 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.904 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2024-09-11T23:36:15.904 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2024-09-11T23:36:15.904 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.904 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.904 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.905 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "::", 2024-09-11T23:36:15.905 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.905 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.905 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.905 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-11T23:36:15.905 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.905 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.905 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.905 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.905 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2024-09-11T23:36:15.905 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2024-09-11T23:36:15.905 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.906 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.906 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.906 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "9283", 2024-09-11T23:36:15.906 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.906 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.906 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.906 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-11T23:36:15.906 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.906 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.906 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.906 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.906 INFO:teuthology.orchestra.run.smithi005.stdout: "stale_cache_strategy": { 2024-09-11T23:36:15.907 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "stale_cache_strategy", 2024-09-11T23:36:15.907 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.907 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.907 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.907 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "log", 2024-09-11T23:36:15.907 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.907 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.907 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.907 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.907 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.907 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.907 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.908 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.908 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_behaviour": { 2024-09-11T23:36:15.908 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_behaviour", 2024-09-11T23:36:15.908 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.908 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.908 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.908 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "default", 2024-09-11T23:36:15.908 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.908 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.908 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.908 INFO:teuthology.orchestra.run.smithi005.stdout: "default", 2024-09-11T23:36:15.908 INFO:teuthology.orchestra.run.smithi005.stdout: "error" 2024-09-11T23:36:15.909 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.909 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.909 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.909 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.909 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.909 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.909 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_error_status_code": { 2024-09-11T23:36:15.909 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_error_status_code", 2024-09-11T23:36:15.909 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.909 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.909 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.910 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "500", 2024-09-11T23:36:15.910 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "400", 2024-09-11T23:36:15.910 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "599", 2024-09-11T23:36:15.910 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.910 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.910 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.910 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.910 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.910 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.910 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.910 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.910 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.910 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_support", 2024-09-11T23:36:15.911 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.911 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.911 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.911 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.911 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.911 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.911 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.911 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.911 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.911 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.911 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.911 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.911 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.912 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.912 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.912 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.912 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.912 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.912 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.912 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.912 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.912 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.912 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.912 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.912 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.912 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.913 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.913 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.913 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.913 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.913 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.913 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.913 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.913 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.913 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.913 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.913 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.913 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.914 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.914 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.914 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.914 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.914 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.914 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.914 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.914 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.914 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.914 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.914 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.914 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.915 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.915 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.915 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.915 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.915 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.915 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.915 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.915 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.915 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.915 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.915 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.915 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.915 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.916 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.916 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.916 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.916 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.916 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.916 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.916 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.916 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.916 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.916 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.916 INFO:teuthology.orchestra.run.smithi005.stdout: "max_concurrent_snap_create": { 2024-09-11T23:36:15.916 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_concurrent_snap_create", 2024-09-11T23:36:15.916 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.917 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.917 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.917 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-09-11T23:36:15.917 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.917 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.917 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.917 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.917 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.917 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.917 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.917 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.917 INFO:teuthology.orchestra.run.smithi005.stdout: "mirror_snapshot_schedule": { 2024-09-11T23:36:15.918 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mirror_snapshot_schedule", 2024-09-11T23:36:15.918 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.918 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.918 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.918 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.918 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.918 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.918 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.918 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.918 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.918 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.918 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.919 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.919 INFO:teuthology.orchestra.run.smithi005.stdout: "trash_purge_schedule": { 2024-09-11T23:36:15.919 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "trash_purge_schedule", 2024-09-11T23:36:15.919 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.919 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.919 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.919 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.919 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.919 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.919 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.919 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.920 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.920 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.920 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.920 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.920 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.920 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.920 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.920 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "restful", 2024-09-11T23:36:15.920 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.920 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.920 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.920 INFO:teuthology.orchestra.run.smithi005.stdout: "enable_auth": { 2024-09-11T23:36:15.920 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enable_auth", 2024-09-11T23:36:15.921 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.921 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.921 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.921 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.921 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.921 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.921 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.921 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.921 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.921 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.921 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.921 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.922 INFO:teuthology.orchestra.run.smithi005.stdout: "key_file": { 2024-09-11T23:36:15.922 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "key_file", 2024-09-11T23:36:15.922 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.922 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.922 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.922 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.922 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.922 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.922 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.922 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.922 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.922 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.922 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.923 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.923 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.923 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.923 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.923 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.923 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.923 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.923 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.923 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.923 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.923 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.923 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.923 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.924 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.924 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.924 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.924 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.924 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.924 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.924 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.924 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.924 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.924 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.924 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.924 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.924 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.925 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.925 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.925 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.925 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.925 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.925 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.925 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.925 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.925 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.925 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.925 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.925 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.926 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.926 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.926 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.926 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.926 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.926 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.926 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.926 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.926 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.926 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.926 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.926 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.926 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.927 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.927 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.927 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.927 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.927 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.927 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.927 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.927 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.927 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.927 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.927 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.927 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.927 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.927 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.927 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.928 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.928 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.928 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.928 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.928 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.928 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2024-09-11T23:36:15.928 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2024-09-11T23:36:15.928 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.928 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.928 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.928 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.928 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.928 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.929 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.929 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.929 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.929 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.929 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.929 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.929 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2024-09-11T23:36:15.929 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2024-09-11T23:36:15.929 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.929 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.929 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.929 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.929 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.930 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.930 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.930 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.930 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.930 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.930 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.930 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.930 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.930 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.930 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.930 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rgw", 2024-09-11T23:36:15.931 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.931 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.931 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.931 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.931 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.931 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.931 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.931 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.931 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.931 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.931 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.931 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.931 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.931 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.932 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.932 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.932 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.932 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.932 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.932 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.932 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.932 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.932 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.932 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.932 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.932 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.932 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.932 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.933 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.933 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.933 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.933 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.933 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.933 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.933 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.933 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.933 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.933 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.933 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.933 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.933 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.934 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.934 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.934 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.934 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.934 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.934 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.934 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.934 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.934 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.934 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.934 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.934 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.934 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.935 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.935 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.935 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.935 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.935 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.935 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.935 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.935 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.935 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.935 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.935 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.935 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.935 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.936 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.936 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.936 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.936 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.936 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.936 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.936 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.936 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.936 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.936 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rook", 2024-09-11T23:36:15.936 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.936 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.937 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.937 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.937 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.937 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.937 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.937 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.937 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.937 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.937 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.937 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.937 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.937 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.937 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.937 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.938 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.938 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.938 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.938 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.938 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.938 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.938 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.938 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.938 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.938 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.938 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.938 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.938 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.939 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.939 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.939 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.939 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.939 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.939 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.939 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.939 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.939 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.939 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.939 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.939 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.940 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.940 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.940 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.940 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.940 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.940 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.940 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.940 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.940 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.940 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.940 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.940 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.940 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.941 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.941 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.941 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.941 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.941 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.941 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.941 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.941 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.941 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.941 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.941 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.941 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.942 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.942 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.942 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.942 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.942 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.942 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.942 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.942 INFO:teuthology.orchestra.run.smithi005.stdout: "storage_class": { 2024-09-11T23:36:15.942 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "storage_class", 2024-09-11T23:36:15.942 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.942 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.942 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.943 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "local", 2024-09-11T23:36:15.943 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.943 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.943 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.943 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-11T23:36:15.943 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.943 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.943 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.943 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.943 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.943 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.943 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.943 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "selftest", 2024-09-11T23:36:15.943 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.944 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.944 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.944 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.944 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.944 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.944 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.944 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.944 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.944 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.944 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.944 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.945 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.945 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.945 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.945 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.945 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.945 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.945 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.945 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.945 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.945 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.945 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.945 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.945 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.946 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.946 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.946 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.946 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.946 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.946 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.946 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.946 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.946 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.946 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.946 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.946 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.946 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.947 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.947 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.947 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.947 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.947 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.947 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.947 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.947 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.947 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.947 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.947 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.947 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.947 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.948 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.948 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.948 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.948 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.948 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.948 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.948 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.948 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.948 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.948 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.948 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.948 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.949 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.949 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.949 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.949 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.949 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.949 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.949 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.949 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.949 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.949 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.949 INFO:teuthology.orchestra.run.smithi005.stdout: "roption1": { 2024-09-11T23:36:15.949 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "roption1", 2024-09-11T23:36:15.949 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.950 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.950 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.950 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.950 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.950 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.950 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.950 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.950 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.950 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.950 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.950 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.950 INFO:teuthology.orchestra.run.smithi005.stdout: "roption2": { 2024-09-11T23:36:15.950 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "roption2", 2024-09-11T23:36:15.950 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.951 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.951 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.951 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "xyz", 2024-09-11T23:36:15.951 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.951 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.951 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.951 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.951 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.951 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.951 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.951 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.951 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption1": { 2024-09-11T23:36:15.951 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption1", 2024-09-11T23:36:15.952 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.952 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.952 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.952 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.952 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.952 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.952 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.952 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.952 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.952 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.952 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.952 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.952 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption2": { 2024-09-11T23:36:15.953 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption2", 2024-09-11T23:36:15.953 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.953 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.953 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.953 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.953 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.953 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.953 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.953 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.953 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.953 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.953 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.953 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.954 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption3": { 2024-09-11T23:36:15.954 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption3", 2024-09-11T23:36:15.954 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-09-11T23:36:15.954 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.954 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.954 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.954 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.954 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.954 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.954 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.954 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.954 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.955 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.955 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.955 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption4": { 2024-09-11T23:36:15.955 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption4", 2024-09-11T23:36:15.955 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.955 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.955 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.955 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.955 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.955 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.955 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.955 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.955 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.956 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.956 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.956 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.956 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption5": { 2024-09-11T23:36:15.956 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption5", 2024-09-11T23:36:15.956 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.956 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.956 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.956 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.956 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.956 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.956 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.957 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.957 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.957 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.957 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.957 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.957 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption6": { 2024-09-11T23:36:15.957 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption6", 2024-09-11T23:36:15.957 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.957 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.957 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.957 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.957 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.957 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.958 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.958 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.958 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.958 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.958 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.958 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.958 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption7": { 2024-09-11T23:36:15.958 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption7", 2024-09-11T23:36:15.958 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:15.958 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.958 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.958 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.959 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2024-09-11T23:36:15.959 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "42", 2024-09-11T23:36:15.959 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.959 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.959 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.959 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.959 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.959 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.959 INFO:teuthology.orchestra.run.smithi005.stdout: "testkey": { 2024-09-11T23:36:15.959 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testkey", 2024-09-11T23:36:15.959 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.959 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.960 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.960 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.960 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.960 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.960 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.960 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.960 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.960 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.960 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.960 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.960 INFO:teuthology.orchestra.run.smithi005.stdout: "testlkey": { 2024-09-11T23:36:15.960 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testlkey", 2024-09-11T23:36:15.961 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.961 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.961 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.961 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.961 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.961 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.961 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.961 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.961 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.961 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.961 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.961 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.961 INFO:teuthology.orchestra.run.smithi005.stdout: "testnewline": { 2024-09-11T23:36:15.962 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testnewline", 2024-09-11T23:36:15.962 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.962 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.962 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.962 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.962 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.962 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.962 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.962 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.962 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.962 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.962 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.963 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.963 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.963 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.963 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.963 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "snap_schedule", 2024-09-11T23:36:15.963 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.963 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.963 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.963 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_m_granularity": { 2024-09-11T23:36:15.963 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_m_granularity", 2024-09-11T23:36:15.963 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.963 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.963 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.964 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.964 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.964 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.964 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.964 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow minute scheduled snapshots", 2024-09-11T23:36:15.964 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.964 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.964 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.964 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.964 INFO:teuthology.orchestra.run.smithi005.stdout: "dump_on_update": { 2024-09-11T23:36:15.964 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "dump_on_update", 2024-09-11T23:36:15.964 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.965 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.965 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.965 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.965 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.965 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.965 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.965 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "dump database to debug log on update", 2024-09-11T23:36:15.965 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.965 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.965 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.965 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.965 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.965 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.966 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.966 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.966 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.966 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.966 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.966 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.966 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.966 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.966 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.966 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.966 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.966 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.966 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.967 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.967 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.967 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.967 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.967 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.967 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.967 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.967 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.967 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.967 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.967 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.967 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.968 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.968 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.968 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.968 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.968 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.968 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.968 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.968 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.968 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.968 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.968 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.968 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.968 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.969 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.969 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.969 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.969 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.969 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.969 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.969 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.969 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.969 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.969 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.969 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.969 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.969 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.970 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.970 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.970 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.970 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.970 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.970 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.970 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.970 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.970 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.970 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.970 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.970 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.971 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.971 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.971 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.971 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.971 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.971 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.971 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.971 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.971 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "stats", 2024-09-11T23:36:15.971 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.971 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.971 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.971 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.971 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.972 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.972 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.972 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.972 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.972 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.972 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.972 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.972 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.972 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.972 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.972 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.972 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.973 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.973 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.973 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.973 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.973 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.973 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.973 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.973 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.973 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.973 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.973 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.973 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.974 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.974 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.974 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.974 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.974 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.974 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.974 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.974 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.974 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.974 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.974 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.974 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.974 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.975 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.975 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.975 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.975 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.975 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.975 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.975 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.975 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.975 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.975 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.975 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.975 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.976 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.976 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.976 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.976 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.976 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.976 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.976 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.976 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.976 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.976 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.976 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.976 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.977 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.977 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.977 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.977 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.977 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.977 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.977 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.977 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.977 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.977 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.977 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "status", 2024-09-11T23:36:15.977 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.977 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.978 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.978 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.978 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.978 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.978 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.978 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.978 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.978 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.978 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.978 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.978 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.978 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.979 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.979 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.979 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.979 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.979 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.979 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.979 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.979 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.979 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.979 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.979 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.979 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.979 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.980 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.980 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.980 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.980 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.980 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.980 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.980 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.980 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.980 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.980 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.980 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.980 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.981 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.981 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.981 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.981 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.981 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.981 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.981 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.981 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.981 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.981 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.981 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.981 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.981 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.982 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.982 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.982 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.982 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.982 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.982 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.982 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.982 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.982 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.982 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.982 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.982 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.983 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.983 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.983 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.983 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.983 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.983 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.983 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.983 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.983 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.983 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.983 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.983 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.983 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "telegraf", 2024-09-11T23:36:15.984 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.984 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.984 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.984 INFO:teuthology.orchestra.run.smithi005.stdout: "address": { 2024-09-11T23:36:15.984 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "address", 2024-09-11T23:36:15.984 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.984 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.984 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.984 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-11T23:36:15.984 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.984 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.984 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.984 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.984 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.985 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.985 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.985 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.985 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2024-09-11T23:36:15.985 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2024-09-11T23:36:15.985 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:15.985 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.985 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.985 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15", 2024-09-11T23:36:15.985 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.985 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.985 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.986 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.986 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.986 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.986 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.986 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.986 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:15.986 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:15.986 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.986 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.986 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.986 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.986 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.986 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.987 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.987 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.987 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.987 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.987 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.987 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.987 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.987 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.987 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.987 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.987 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.987 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.987 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.988 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:15.988 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:15.988 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.988 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.988 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.988 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.988 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.988 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.988 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.988 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.988 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.989 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.989 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.989 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.989 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:15.989 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:15.989 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.989 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.989 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.989 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:15.989 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.989 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.989 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:15.989 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:15.990 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:15.990 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:15.990 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:15.990 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:15.990 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:15.990 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:15.990 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.990 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.990 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.990 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.990 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.990 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:15.990 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:15.991 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.991 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.991 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:15.991 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.991 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.991 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.991 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.991 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.991 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.991 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.991 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.991 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.991 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:15.992 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.992 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:15.992 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "telemetry", 2024-09-11T23:36:15.992 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:15.992 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:15.992 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:15.992 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_basic": { 2024-09-11T23:36:15.992 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_basic", 2024-09-11T23:36:15.992 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.992 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.992 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.992 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.992 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.993 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.993 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.993 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-11T23:36:15.993 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.993 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.993 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.993 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.993 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_crash": { 2024-09-11T23:36:15.993 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_crash", 2024-09-11T23:36:15.993 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.993 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.993 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.993 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.994 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.994 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.994 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.994 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-11T23:36:15.994 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.994 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.994 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.994 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.994 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_device": { 2024-09-11T23:36:15.994 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_device", 2024-09-11T23:36:15.994 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.994 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.994 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.995 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:15.995 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.995 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.995 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.995 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-11T23:36:15.995 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.995 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.995 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.995 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.995 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_ident": { 2024-09-11T23:36:15.995 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_ident", 2024-09-11T23:36:15.995 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.996 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.996 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.996 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.996 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.996 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.996 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.996 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-11T23:36:15.996 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.996 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.996 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.996 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.996 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_perf": { 2024-09-11T23:36:15.996 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_perf", 2024-09-11T23:36:15.997 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:15.997 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.997 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.997 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:15.997 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.997 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.997 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.997 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-11T23:36:15.997 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.997 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.997 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.997 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.997 INFO:teuthology.orchestra.run.smithi005.stdout: "contact": { 2024-09-11T23:36:15.998 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "contact", 2024-09-11T23:36:15.998 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.998 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.998 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.998 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.998 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.998 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.998 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.998 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.998 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.998 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.998 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.998 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:15.999 INFO:teuthology.orchestra.run.smithi005.stdout: "description": { 2024-09-11T23:36:15.999 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "description", 2024-09-11T23:36:15.999 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:15.999 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:15.999 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:15.999 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:15.999 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:15.999 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:15.999 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:15.999 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:15.999 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:15.999 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:15.999 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:15.999 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.000 INFO:teuthology.orchestra.run.smithi005.stdout: "device_url": { 2024-09-11T23:36:16.000 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_url", 2024-09-11T23:36:16.000 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.000 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.000 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.000 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-11T23:36:16.000 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.000 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.000 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.000 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.000 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.000 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.001 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.001 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.001 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": { 2024-09-11T23:36:16.001 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enabled", 2024-09-11T23:36:16.001 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.001 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.001 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.001 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.001 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.001 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.001 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.001 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.001 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.002 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.002 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.002 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.002 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2024-09-11T23:36:16.002 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2024-09-11T23:36:16.002 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:16.002 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.002 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.002 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "24", 2024-09-11T23:36:16.002 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "8", 2024-09-11T23:36:16.002 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.002 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.002 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.003 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.003 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.003 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.003 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.003 INFO:teuthology.orchestra.run.smithi005.stdout: "last_opt_revision": { 2024-09-11T23:36:16.003 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "last_opt_revision", 2024-09-11T23:36:16.003 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:16.003 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.003 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.003 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1", 2024-09-11T23:36:16.003 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.003 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.003 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.004 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.004 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.004 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.004 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.004 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.004 INFO:teuthology.orchestra.run.smithi005.stdout: "leaderboard": { 2024-09-11T23:36:16.004 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "leaderboard", 2024-09-11T23:36:16.004 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.004 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.004 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.004 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.004 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.004 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.005 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.005 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.005 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.005 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.005 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.005 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.005 INFO:teuthology.orchestra.run.smithi005.stdout: "leaderboard_description": { 2024-09-11T23:36:16.005 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "leaderboard_description", 2024-09-11T23:36:16.005 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.005 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.005 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.005 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.006 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.006 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.006 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.006 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.006 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.006 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.006 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.006 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.006 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:16.006 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:16.006 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.006 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.006 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.006 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.007 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.007 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.007 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.007 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.007 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.007 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.007 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.007 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.007 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.007 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.007 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.007 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.008 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.008 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.008 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.008 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:16.008 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:16.008 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.008 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.008 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.008 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.008 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.008 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.008 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.008 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.009 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.009 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.009 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.009 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.009 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:16.009 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:16.009 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.009 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.009 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.009 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:16.009 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.009 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.010 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.010 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.010 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.010 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.010 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.010 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.010 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.010 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.010 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.010 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.010 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.010 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.011 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.011 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:16.011 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:16.011 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.011 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.011 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.011 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.011 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.011 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.011 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.011 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.011 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.011 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.012 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.012 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.012 INFO:teuthology.orchestra.run.smithi005.stdout: "organization": { 2024-09-11T23:36:16.012 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "organization", 2024-09-11T23:36:16.012 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.012 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.012 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.012 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.012 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.012 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.012 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.012 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.012 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.012 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.013 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.013 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.013 INFO:teuthology.orchestra.run.smithi005.stdout: "proxy": { 2024-09-11T23:36:16.013 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "proxy", 2024-09-11T23:36:16.013 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.013 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.013 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.013 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.013 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.013 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.013 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.013 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.013 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.014 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.014 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.014 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.014 INFO:teuthology.orchestra.run.smithi005.stdout: "url": { 2024-09-11T23:36:16.014 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "url", 2024-09-11T23:36:16.014 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.014 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.014 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.014 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-11T23:36:16.014 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.014 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.014 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.014 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.015 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.015 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.015 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.015 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.015 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.015 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.015 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:16.015 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "test_orchestrator", 2024-09-11T23:36:16.015 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:16.015 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:16.015 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:16.015 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:16.015 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:16.016 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.016 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.016 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.016 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.016 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.016 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.016 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.016 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.016 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.016 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.016 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.016 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.017 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.017 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.017 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.017 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.017 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.017 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.017 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.017 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:16.017 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:16.017 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.017 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.017 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.017 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.018 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.018 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.018 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.018 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.018 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.018 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.018 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.018 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.018 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:16.018 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:16.018 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.018 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.018 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.019 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:16.019 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.019 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.019 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.019 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.019 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.019 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.019 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.019 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.019 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.019 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.019 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.020 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.020 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.020 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.020 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.020 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:16.020 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:16.020 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.020 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.020 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.020 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.020 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.020 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.020 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.021 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.021 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.021 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.021 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.021 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.021 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.021 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.021 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:16.021 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "volumes", 2024-09-11T23:36:16.021 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:16.021 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:16.021 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:16.021 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:16.022 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:16.022 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.022 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.022 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.022 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.022 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.022 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.022 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.022 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.022 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.022 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.022 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.022 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.023 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.023 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.023 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.023 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.023 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.023 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.023 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.023 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:16.023 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:16.023 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.023 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.023 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.023 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.023 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.024 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.024 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.024 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.024 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.024 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.024 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.024 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.024 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:16.024 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:16.024 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.024 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.024 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.025 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:16.025 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.025 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.025 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.025 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.025 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.025 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.025 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.025 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.025 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.025 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.025 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.025 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.025 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.026 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.026 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.026 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:16.026 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:16.026 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.026 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.026 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.026 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.026 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.026 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.026 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.026 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.026 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.027 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.027 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.027 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.027 INFO:teuthology.orchestra.run.smithi005.stdout: "max_concurrent_clones": { 2024-09-11T23:36:16.027 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_concurrent_clones", 2024-09-11T23:36:16.027 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:16.027 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.027 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.027 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "4", 2024-09-11T23:36:16.027 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.027 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.027 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.028 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-11T23:36:16.028 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.028 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.028 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.028 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.028 INFO:teuthology.orchestra.run.smithi005.stdout: "periodic_async_work": { 2024-09-11T23:36:16.028 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "periodic_async_work", 2024-09-11T23:36:16.028 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.028 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.028 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.028 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.028 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.028 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.029 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.029 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Periodically check for async work", 2024-09-11T23:36:16.029 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.029 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.029 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.029 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.029 INFO:teuthology.orchestra.run.smithi005.stdout: "snapshot_clone_delay": { 2024-09-11T23:36:16.029 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "snapshot_clone_delay", 2024-09-11T23:36:16.029 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:16.029 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.029 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.029 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-11T23:36:16.029 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.030 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.030 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.030 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-11T23:36:16.030 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.030 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.030 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.030 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.030 INFO:teuthology.orchestra.run.smithi005.stdout: "snapshot_clone_no_wait": { 2024-09-11T23:36:16.030 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "snapshot_clone_no_wait", 2024-09-11T23:36:16.030 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.030 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.030 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.031 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:16.031 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.031 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.031 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.031 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-11T23:36:16.031 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.031 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.031 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.031 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.031 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.031 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.031 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:16.031 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix", 2024-09-11T23:36:16.032 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:16.032 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:16.032 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:16.032 INFO:teuthology.orchestra.run.smithi005.stdout: "discovery_interval": { 2024-09-11T23:36:16.032 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "discovery_interval", 2024-09-11T23:36:16.032 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2024-09-11T23:36:16.032 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.032 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.032 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "100", 2024-09-11T23:36:16.032 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.032 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.032 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.032 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.033 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.033 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.033 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.033 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.033 INFO:teuthology.orchestra.run.smithi005.stdout: "identifier": { 2024-09-11T23:36:16.033 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "identifier", 2024-09-11T23:36:16.033 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.033 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.033 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.033 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.033 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.033 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.033 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.034 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.034 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.034 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.034 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.034 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.034 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2024-09-11T23:36:16.034 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2024-09-11T23:36:16.034 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:16.034 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.034 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.034 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2024-09-11T23:36:16.034 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.034 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.035 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.035 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.035 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.035 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.035 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.035 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.035 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:16.035 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:16.035 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.035 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.035 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.035 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.035 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.036 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.036 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.036 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.036 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.036 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.036 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.036 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.036 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.036 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.036 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.036 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.036 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.036 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.037 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.037 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:16.037 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:16.037 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.037 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.037 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.037 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.037 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.037 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.037 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.037 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.037 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.038 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.038 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.038 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.038 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:16.038 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:16.038 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.038 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.038 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.038 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:16.038 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.038 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.038 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.038 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.039 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.039 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.039 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.039 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.039 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.039 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.039 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.039 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.039 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.039 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.039 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.039 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:16.040 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:16.040 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.040 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.040 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.040 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.040 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.040 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.040 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.040 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.040 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.040 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.040 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.040 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.041 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_host": { 2024-09-11T23:36:16.041 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_host", 2024-09-11T23:36:16.041 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.041 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.041 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.041 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.041 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.041 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.041 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.041 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.041 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.042 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.042 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.042 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.042 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_port": { 2024-09-11T23:36:16.042 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_port", 2024-09-11T23:36:16.042 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:16.042 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.042 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.042 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10051", 2024-09-11T23:36:16.042 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.042 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.042 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.042 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.042 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.043 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.043 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.043 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.043 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_sender": { 2024-09-11T23:36:16.043 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_sender", 2024-09-11T23:36:16.043 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.043 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.043 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.043 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-11T23:36:16.043 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.043 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.043 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.043 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.043 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.044 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.044 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.044 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.044 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.044 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.044 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-11T23:36:16.044 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.044 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.044 INFO:teuthology.orchestra.run.smithi005.stdout: "modules": [ 2024-09-11T23:36:16.044 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm", 2024-09-11T23:36:16.044 INFO:teuthology.orchestra.run.smithi005.stdout: "dashboard", 2024-09-11T23:36:16.044 INFO:teuthology.orchestra.run.smithi005.stdout: "iostat", 2024-09-11T23:36:16.044 INFO:teuthology.orchestra.run.smithi005.stdout: "nfs", 2024-09-11T23:36:16.045 INFO:teuthology.orchestra.run.smithi005.stdout: "restful" 2024-09-11T23:36:16.045 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.045 INFO:teuthology.orchestra.run.smithi005.stdout: "available_modules": [ 2024-09-11T23:36:16.045 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:16.045 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "alerts", 2024-09-11T23:36:16.045 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:16.045 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:16.045 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:16.045 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2024-09-11T23:36:16.045 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2024-09-11T23:36:16.045 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:16.045 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.045 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.046 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2024-09-11T23:36:16.046 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.046 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.046 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.046 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How frequently to reexamine health status", 2024-09-11T23:36:16.046 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.046 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.046 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.046 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.046 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:16.046 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:16.046 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.047 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.047 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.047 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.047 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.047 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.047 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.047 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.047 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.047 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.047 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.047 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.047 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.048 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.048 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.048 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.048 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.048 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.048 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.048 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:16.048 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:16.048 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.048 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.048 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.048 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.049 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.049 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.049 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.049 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.049 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.049 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.049 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.049 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.049 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:16.049 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:16.049 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.049 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.049 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.050 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:16.050 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.050 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.050 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.050 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.050 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.050 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.050 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.050 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.050 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.050 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.050 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.050 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.051 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.051 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.051 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.051 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:16.051 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:16.051 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.051 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.051 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.051 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.051 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.051 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.051 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.051 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.052 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.052 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.052 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.052 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.052 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_destination": { 2024-09-11T23:36:16.052 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_destination", 2024-09-11T23:36:16.052 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.052 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.052 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.052 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.052 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.052 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.052 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.053 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Email address to send alerts to", 2024-09-11T23:36:16.053 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.053 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.053 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.053 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.053 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_from_name": { 2024-09-11T23:36:16.053 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_from_name", 2024-09-11T23:36:16.053 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.053 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.053 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.053 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "Ceph", 2024-09-11T23:36:16.053 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.054 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.054 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.054 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Email From: name", 2024-09-11T23:36:16.054 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.054 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.054 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.054 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.054 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_host": { 2024-09-11T23:36:16.054 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_host", 2024-09-11T23:36:16.054 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.054 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.054 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.054 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.054 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.055 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.055 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.055 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP server", 2024-09-11T23:36:16.055 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.055 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.055 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.055 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.055 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_password": { 2024-09-11T23:36:16.055 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_password", 2024-09-11T23:36:16.055 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.055 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.055 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.055 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.056 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.056 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.056 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.056 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Password to authenticate with", 2024-09-11T23:36:16.056 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.056 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.056 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.056 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.056 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_port": { 2024-09-11T23:36:16.056 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_port", 2024-09-11T23:36:16.056 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:16.057 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.057 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.057 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "465", 2024-09-11T23:36:16.057 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.057 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.057 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.057 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP port", 2024-09-11T23:36:16.057 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.057 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.057 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.057 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.057 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_sender": { 2024-09-11T23:36:16.057 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_sender", 2024-09-11T23:36:16.058 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.058 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.058 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.058 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.058 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.058 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.058 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.058 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP envelope sender", 2024-09-11T23:36:16.058 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.058 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.058 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.058 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.058 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_ssl": { 2024-09-11T23:36:16.059 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_ssl", 2024-09-11T23:36:16.059 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.059 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.059 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.059 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:16.059 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.059 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.059 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.059 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-11T23:36:16.059 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.059 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.059 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.059 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.060 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_user": { 2024-09-11T23:36:16.060 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_user", 2024-09-11T23:36:16.060 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.060 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.060 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.060 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.060 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.060 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.060 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.060 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "User to authenticate as", 2024-09-11T23:36:16.060 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.060 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.060 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.061 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.061 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.061 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.061 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:16.061 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "balancer", 2024-09-11T23:36:16.061 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:16.061 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:16.061 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:16.061 INFO:teuthology.orchestra.run.smithi005.stdout: "active": { 2024-09-11T23:36:16.061 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "active", 2024-09-11T23:36:16.061 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.061 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.061 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.062 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:16.062 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.062 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.062 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.062 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "automatically balance PGs across cluster", 2024-09-11T23:36:16.062 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.062 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.062 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.062 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.062 INFO:teuthology.orchestra.run.smithi005.stdout: "begin_time": { 2024-09-11T23:36:16.062 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "begin_time", 2024-09-11T23:36:16.062 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.062 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.063 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.063 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0000", 2024-09-11T23:36:16.063 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.063 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.063 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.063 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "beginning time of day to automatically balance", 2024-09-11T23:36:16.063 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T23:36:16.063 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.063 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.063 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.063 INFO:teuthology.orchestra.run.smithi005.stdout: "begin_weekday": { 2024-09-11T23:36:16.063 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "begin_weekday", 2024-09-11T23:36:16.063 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2024-09-11T23:36:16.064 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.064 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.064 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-11T23:36:16.064 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0", 2024-09-11T23:36:16.064 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "6", 2024-09-11T23:36:16.064 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.064 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-11T23:36:16.064 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T23:36:16.064 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.064 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.064 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.064 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_max_iterations": { 2024-09-11T23:36:16.065 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_max_iterations", 2024-09-11T23:36:16.065 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2024-09-11T23:36:16.065 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.065 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.065 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "25", 2024-09-11T23:36:16.065 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2024-09-11T23:36:16.065 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "250", 2024-09-11T23:36:16.065 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.065 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-11T23:36:16.065 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.065 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.065 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.066 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.066 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_metrics": { 2024-09-11T23:36:16.066 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_metrics", 2024-09-11T23:36:16.066 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.066 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.066 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.066 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "pgs,objects,bytes", 2024-09-11T23:36:16.066 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.066 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.066 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.066 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-11T23:36:16.066 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-11T23:36:16.066 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.067 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.067 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.067 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_step": { 2024-09-11T23:36:16.067 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_step", 2024-09-11T23:36:16.067 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-09-11T23:36:16.067 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.067 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.067 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0.5", 2024-09-11T23:36:16.067 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0.001", 2024-09-11T23:36:16.067 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "0.999", 2024-09-11T23:36:16.067 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.067 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "aggressiveness of optimization", 2024-09-11T23:36:16.067 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-11T23:36:16.068 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.068 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.068 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.068 INFO:teuthology.orchestra.run.smithi005.stdout: "end_time": { 2024-09-11T23:36:16.068 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "end_time", 2024-09-11T23:36:16.068 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.068 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.068 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.068 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "2359", 2024-09-11T23:36:16.068 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.068 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.068 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.069 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "ending time of day to automatically balance", 2024-09-11T23:36:16.069 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T23:36:16.069 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.069 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.069 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.069 INFO:teuthology.orchestra.run.smithi005.stdout: "end_weekday": { 2024-09-11T23:36:16.069 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "end_weekday", 2024-09-11T23:36:16.069 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2024-09-11T23:36:16.069 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.069 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.069 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-11T23:36:16.069 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0", 2024-09-11T23:36:16.070 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "6", 2024-09-11T23:36:16.070 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.070 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-11T23:36:16.070 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T23:36:16.070 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.070 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.070 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.070 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:16.070 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:16.070 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.070 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.070 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.070 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.071 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.071 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.071 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.071 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.071 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.071 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.071 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.071 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.071 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.071 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.071 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.071 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.071 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.072 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.072 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.072 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:16.072 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:16.072 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.072 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.072 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.072 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.072 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.072 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.072 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.072 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.073 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.073 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.073 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.073 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.073 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:16.073 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:16.073 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.073 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.073 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.073 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:16.073 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.073 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.073 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.074 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.074 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.074 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.074 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.074 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.074 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.074 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.074 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.074 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.074 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.074 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.074 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.074 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:16.075 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:16.075 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.075 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.075 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.075 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.075 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.075 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.075 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.075 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.075 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.075 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.075 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.075 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.076 INFO:teuthology.orchestra.run.smithi005.stdout: "min_score": { 2024-09-11T23:36:16.076 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "min_score", 2024-09-11T23:36:16.076 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-09-11T23:36:16.076 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.076 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.076 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-11T23:36:16.076 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.076 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.076 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.076 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-11T23:36:16.076 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.076 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.077 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.077 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.077 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": { 2024-09-11T23:36:16.077 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mode", 2024-09-11T23:36:16.077 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.077 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.077 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.077 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "upmap", 2024-09-11T23:36:16.077 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.077 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.077 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.077 INFO:teuthology.orchestra.run.smithi005.stdout: "crush-compat", 2024-09-11T23:36:16.077 INFO:teuthology.orchestra.run.smithi005.stdout: "none", 2024-09-11T23:36:16.078 INFO:teuthology.orchestra.run.smithi005.stdout: "read", 2024-09-11T23:36:16.078 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap", 2024-09-11T23:36:16.078 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap-read" 2024-09-11T23:36:16.078 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.078 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Balancer mode", 2024-09-11T23:36:16.078 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.078 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.078 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.078 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.078 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_ids": { 2024-09-11T23:36:16.078 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pool_ids", 2024-09-11T23:36:16.078 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.078 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.078 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.079 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.079 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.079 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.079 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.079 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-11T23:36:16.079 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.079 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.079 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.079 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.079 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2024-09-11T23:36:16.079 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2024-09-11T23:36:16.079 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:16.079 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.080 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.080 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2024-09-11T23:36:16.080 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.080 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.080 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.080 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-11T23:36:16.080 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.080 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.080 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.080 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.080 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap_max_deviation": { 2024-09-11T23:36:16.080 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "upmap_max_deviation", 2024-09-11T23:36:16.080 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:16.081 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.081 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.081 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2024-09-11T23:36:16.081 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2024-09-11T23:36:16.081 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.081 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.081 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-11T23:36:16.081 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-11T23:36:16.081 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.081 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.081 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.081 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap_max_optimizations": { 2024-09-11T23:36:16.081 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "upmap_max_optimizations", 2024-09-11T23:36:16.082 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2024-09-11T23:36:16.082 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.082 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.082 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-09-11T23:36:16.082 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.082 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.082 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.082 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-11T23:36:16.082 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.082 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.082 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.082 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.082 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.083 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.083 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:16.083 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephadm", 2024-09-11T23:36:16.083 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:16.083 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:16.083 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:16.083 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_down_multiplier": { 2024-09-11T23:36:16.083 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_down_multiplier", 2024-09-11T23:36:16.083 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-09-11T23:36:16.083 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.083 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.083 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3.0", 2024-09-11T23:36:16.083 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.084 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.084 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.084 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-11T23:36:16.084 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.084 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.084 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.084 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.084 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_refresh_rate": { 2024-09-11T23:36:16.084 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_refresh_rate", 2024-09-11T23:36:16.084 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:16.084 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.084 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.084 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "20", 2024-09-11T23:36:16.085 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.085 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.085 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.085 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-11T23:36:16.085 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.085 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.085 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.085 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.085 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_starting_port": { 2024-09-11T23:36:16.085 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_starting_port", 2024-09-11T23:36:16.085 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:16.085 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.085 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.086 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "4721", 2024-09-11T23:36:16.086 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.086 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.086 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.086 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-11T23:36:16.086 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.086 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.086 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.086 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.086 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_ptrace": { 2024-09-11T23:36:16.086 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_ptrace", 2024-09-11T23:36:16.086 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.087 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.087 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.087 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.087 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.087 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.087 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.087 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-11T23:36:16.087 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-11T23:36:16.087 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.087 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.087 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.087 INFO:teuthology.orchestra.run.smithi005.stdout: "autotune_interval": { 2024-09-11T23:36:16.087 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "autotune_interval", 2024-09-11T23:36:16.088 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:16.088 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.088 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.088 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2024-09-11T23:36:16.088 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.088 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.088 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.088 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-11T23:36:16.088 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.088 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.088 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.088 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.089 INFO:teuthology.orchestra.run.smithi005.stdout: "autotune_memory_target_ratio": { 2024-09-11T23:36:16.089 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "autotune_memory_target_ratio", 2024-09-11T23:36:16.089 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-09-11T23:36:16.089 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.089 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.089 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0.7", 2024-09-11T23:36:16.089 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.089 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.089 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.089 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-11T23:36:16.089 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.089 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.089 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.090 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.090 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm_log_destination": { 2024-09-11T23:36:16.090 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephadm_log_destination", 2024-09-11T23:36:16.090 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.090 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.090 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.090 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.090 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.090 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.090 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.090 INFO:teuthology.orchestra.run.smithi005.stdout: "file", 2024-09-11T23:36:16.090 INFO:teuthology.orchestra.run.smithi005.stdout: "file,syslog", 2024-09-11T23:36:16.090 INFO:teuthology.orchestra.run.smithi005.stdout: "syslog" 2024-09-11T23:36:16.090 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.091 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-11T23:36:16.091 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.091 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.091 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.091 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.091 INFO:teuthology.orchestra.run.smithi005.stdout: "cgroups_split": { 2024-09-11T23:36:16.091 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cgroups_split", 2024-09-11T23:36:16.091 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.091 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.091 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.091 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:16.091 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.092 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.092 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.092 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-11T23:36:16.092 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.092 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.092 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.092 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.092 INFO:teuthology.orchestra.run.smithi005.stdout: "config_checks_enabled": { 2024-09-11T23:36:16.092 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "config_checks_enabled", 2024-09-11T23:36:16.092 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.092 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.092 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.092 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.093 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.093 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.093 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.093 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-11T23:36:16.093 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.093 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.093 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.093 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.093 INFO:teuthology.orchestra.run.smithi005.stdout: "config_dashboard": { 2024-09-11T23:36:16.093 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "config_dashboard", 2024-09-11T23:36:16.093 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.093 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.093 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.094 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:16.094 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.094 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.094 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.094 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-11T23:36:16.094 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.094 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.094 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.094 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.094 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_alertmanager": { 2024-09-11T23:36:16.094 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_alertmanager", 2024-09-11T23:36:16.094 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.095 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.095 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.095 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-11T23:36:16.095 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.095 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.095 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.095 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2024-09-11T23:36:16.095 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.095 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.095 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.095 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.095 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_base": { 2024-09-11T23:36:16.095 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_base", 2024-09-11T23:36:16.095 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.096 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.096 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.096 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-11T23:36:16.096 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.096 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.096 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.096 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Container image name, without the tag", 2024-09-11T23:36:16.096 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.096 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.096 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.096 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.096 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_elasticsearch": { 2024-09-11T23:36:16.096 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_elasticsearch", 2024-09-11T23:36:16.097 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.097 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.097 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.097 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-11T23:36:16.097 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.097 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.097 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.097 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "elasticsearch container image", 2024-09-11T23:36:16.097 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.097 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.097 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.097 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.098 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_grafana": { 2024-09-11T23:36:16.098 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_grafana", 2024-09-11T23:36:16.098 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.098 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.098 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.098 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-11T23:36:16.098 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.098 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.098 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.098 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2024-09-11T23:36:16.098 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.098 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.098 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.099 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.099 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_haproxy": { 2024-09-11T23:36:16.099 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_haproxy", 2024-09-11T23:36:16.099 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.099 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.099 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.099 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-11T23:36:16.099 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.099 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.099 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.099 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "HAproxy container image", 2024-09-11T23:36:16.099 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.099 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.100 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.100 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.100 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_agent": { 2024-09-11T23:36:16.100 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_agent", 2024-09-11T23:36:16.100 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.100 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.100 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.100 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-11T23:36:16.100 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.100 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.100 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.100 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger agent container image", 2024-09-11T23:36:16.101 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.101 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.101 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.101 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.101 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_collector": { 2024-09-11T23:36:16.101 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_collector", 2024-09-11T23:36:16.101 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.101 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.101 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.101 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-11T23:36:16.101 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.101 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.101 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.102 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger collector container image", 2024-09-11T23:36:16.102 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.102 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.102 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.102 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.102 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_query": { 2024-09-11T23:36:16.102 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_query", 2024-09-11T23:36:16.102 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.102 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.102 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.102 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-11T23:36:16.102 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.102 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.103 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.103 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger query container image", 2024-09-11T23:36:16.103 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.103 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.103 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.103 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.103 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_keepalived": { 2024-09-11T23:36:16.103 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_keepalived", 2024-09-11T23:36:16.103 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.103 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.103 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.103 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-11T23:36:16.103 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.104 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.104 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.104 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Keepalived container image", 2024-09-11T23:36:16.104 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.104 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.104 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.104 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.104 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_loki": { 2024-09-11T23:36:16.104 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_loki", 2024-09-11T23:36:16.104 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.104 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.104 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.105 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-11T23:36:16.105 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.105 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.105 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.105 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Loki container image", 2024-09-11T23:36:16.105 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.105 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.105 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.105 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.105 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_node_exporter": { 2024-09-11T23:36:16.105 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_node_exporter", 2024-09-11T23:36:16.105 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.105 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.106 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.106 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-11T23:36:16.106 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.106 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.106 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.106 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2024-09-11T23:36:16.106 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.106 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.106 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.106 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.106 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_nvmeof": { 2024-09-11T23:36:16.106 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_nvmeof", 2024-09-11T23:36:16.106 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.106 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.107 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.107 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-11T23:36:16.107 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.107 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.107 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.107 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Nvme-of container image", 2024-09-11T23:36:16.107 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.107 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.107 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.107 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.107 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_prometheus": { 2024-09-11T23:36:16.107 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_prometheus", 2024-09-11T23:36:16.107 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.108 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.108 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.108 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-11T23:36:16.108 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.108 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.108 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.108 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2024-09-11T23:36:16.108 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.108 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.108 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.108 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.108 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_promtail": { 2024-09-11T23:36:16.108 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_promtail", 2024-09-11T23:36:16.109 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.109 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.109 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.109 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-11T23:36:16.109 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.109 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.109 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.109 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Promtail container image", 2024-09-11T23:36:16.109 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.109 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.109 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.109 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.109 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_samba": { 2024-09-11T23:36:16.110 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_samba", 2024-09-11T23:36:16.110 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.110 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.110 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.110 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-11T23:36:16.110 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.110 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.110 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.110 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Samba/SMB container image", 2024-09-11T23:36:16.110 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.110 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.110 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.110 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.110 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_snmp_gateway": { 2024-09-11T23:36:16.111 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_snmp_gateway", 2024-09-11T23:36:16.111 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.111 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.111 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.111 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-11T23:36:16.111 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.111 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.111 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.111 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SNMP Gateway container image", 2024-09-11T23:36:16.111 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.111 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.111 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.111 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.112 INFO:teuthology.orchestra.run.smithi005.stdout: "container_init": { 2024-09-11T23:36:16.112 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_init", 2024-09-11T23:36:16.112 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.112 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.112 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.112 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:16.112 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.112 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.112 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.112 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Run podman/docker with `--init`", 2024-09-11T23:36:16.112 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.112 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.112 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.113 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.113 INFO:teuthology.orchestra.run.smithi005.stdout: "daemon_cache_timeout": { 2024-09-11T23:36:16.113 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "daemon_cache_timeout", 2024-09-11T23:36:16.113 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:16.113 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.113 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.113 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2024-09-11T23:36:16.113 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.113 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.113 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.113 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-11T23:36:16.113 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.113 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.114 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.114 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.114 INFO:teuthology.orchestra.run.smithi005.stdout: "default_cephadm_command_timeout": { 2024-09-11T23:36:16.114 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "default_cephadm_command_timeout", 2024-09-11T23:36:16.114 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:16.114 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.114 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.114 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "900", 2024-09-11T23:36:16.114 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.114 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.114 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.114 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-11T23:36:16.115 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.115 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.115 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.115 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.115 INFO:teuthology.orchestra.run.smithi005.stdout: "default_registry": { 2024-09-11T23:36:16.115 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "default_registry", 2024-09-11T23:36:16.115 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.115 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.115 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.115 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io", 2024-09-11T23:36:16.115 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.115 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.115 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.116 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-11T23:36:16.116 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.116 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.116 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.116 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.116 INFO:teuthology.orchestra.run.smithi005.stdout: "device_cache_timeout": { 2024-09-11T23:36:16.116 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_cache_timeout", 2024-09-11T23:36:16.116 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:16.116 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.116 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.116 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1800", 2024-09-11T23:36:16.116 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.116 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.117 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.117 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache device inventory", 2024-09-11T23:36:16.117 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.117 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.117 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.117 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.117 INFO:teuthology.orchestra.run.smithi005.stdout: "device_enhanced_scan": { 2024-09-11T23:36:16.117 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_enhanced_scan", 2024-09-11T23:36:16.117 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.117 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.117 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.117 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.118 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.118 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.118 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.118 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-11T23:36:16.118 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.118 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.118 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.118 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.118 INFO:teuthology.orchestra.run.smithi005.stdout: "facts_cache_timeout": { 2024-09-11T23:36:16.118 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "facts_cache_timeout", 2024-09-11T23:36:16.118 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:16.118 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.118 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.119 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2024-09-11T23:36:16.119 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.119 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.119 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.119 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache host facts data", 2024-09-11T23:36:16.119 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.119 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.119 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.119 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.119 INFO:teuthology.orchestra.run.smithi005.stdout: "grafana_dashboards_path": { 2024-09-11T23:36:16.119 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "grafana_dashboards_path", 2024-09-11T23:36:16.119 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.120 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.120 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.120 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-11T23:36:16.120 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.120 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.120 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.120 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-11T23:36:16.120 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.120 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.120 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.120 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.120 INFO:teuthology.orchestra.run.smithi005.stdout: "host_check_interval": { 2024-09-11T23:36:16.121 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "host_check_interval", 2024-09-11T23:36:16.121 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:16.121 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.121 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.121 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2024-09-11T23:36:16.121 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.121 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.121 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.121 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to perform a host check", 2024-09-11T23:36:16.121 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.121 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.121 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.121 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.122 INFO:teuthology.orchestra.run.smithi005.stdout: "hw_monitoring": { 2024-09-11T23:36:16.122 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "hw_monitoring", 2024-09-11T23:36:16.122 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.122 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.122 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.122 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.122 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.122 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.122 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.122 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-11T23:36:16.122 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.122 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.122 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.123 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.123 INFO:teuthology.orchestra.run.smithi005.stdout: "inventory_list_all": { 2024-09-11T23:36:16.123 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "inventory_list_all", 2024-09-11T23:36:16.123 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.123 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.123 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.123 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.123 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.123 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.123 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.123 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-11T23:36:16.123 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.123 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.124 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.124 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.124 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:16.124 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:16.124 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.124 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.124 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.124 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.124 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.124 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.124 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.124 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.124 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.125 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.125 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.125 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.125 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.125 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.125 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.125 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.125 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.125 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.125 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.125 INFO:teuthology.orchestra.run.smithi005.stdout: "log_refresh_metadata": { 2024-09-11T23:36:16.125 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_refresh_metadata", 2024-09-11T23:36:16.125 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.126 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.126 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.126 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.126 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.126 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.126 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.126 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-11T23:36:16.126 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.126 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.126 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.126 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.126 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:16.126 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:16.127 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.127 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.127 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.127 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:16.127 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.127 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.127 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.127 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-11T23:36:16.127 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.127 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.127 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.127 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.127 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:16.127 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:16.128 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.128 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.128 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.128 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:16.128 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.128 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.128 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.128 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.128 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.128 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.128 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.128 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.129 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.129 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.129 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.129 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.129 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.129 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.129 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.129 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:16.129 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:16.129 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.129 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.129 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.130 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.130 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.130 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.130 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.130 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.130 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.130 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.130 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.130 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.130 INFO:teuthology.orchestra.run.smithi005.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-11T23:36:16.130 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-11T23:36:16.130 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.131 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.131 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.131 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.131 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.131 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.131 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.131 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-11T23:36:16.131 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.131 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.131 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.131 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.131 INFO:teuthology.orchestra.run.smithi005.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-11T23:36:16.131 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-11T23:36:16.132 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.132 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.132 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.132 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "*", 2024-09-11T23:36:16.132 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.132 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.132 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.132 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-11T23:36:16.132 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.132 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.132 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.132 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.132 INFO:teuthology.orchestra.run.smithi005.stdout: "max_count_per_host": { 2024-09-11T23:36:16.133 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_count_per_host", 2024-09-11T23:36:16.133 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:16.133 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.133 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.133 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-09-11T23:36:16.133 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.133 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.133 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.133 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "max number of daemons per service per host", 2024-09-11T23:36:16.133 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.133 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.133 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.133 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.134 INFO:teuthology.orchestra.run.smithi005.stdout: "max_osd_draining_count": { 2024-09-11T23:36:16.134 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_osd_draining_count", 2024-09-11T23:36:16.134 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:16.134 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.134 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.134 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-09-11T23:36:16.134 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.134 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.134 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.134 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-11T23:36:16.134 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.134 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.135 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.135 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.135 INFO:teuthology.orchestra.run.smithi005.stdout: "migration_current": { 2024-09-11T23:36:16.135 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "migration_current", 2024-09-11T23:36:16.135 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:16.135 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.135 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.135 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.135 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.135 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.135 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.135 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "internal - do not modify", 2024-09-11T23:36:16.136 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.136 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.136 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.136 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.136 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": { 2024-09-11T23:36:16.136 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mode", 2024-09-11T23:36:16.136 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.136 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.136 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.136 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "root", 2024-09-11T23:36:16.136 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.136 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.136 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.137 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm-package", 2024-09-11T23:36:16.137 INFO:teuthology.orchestra.run.smithi005.stdout: "root" 2024-09-11T23:36:16.137 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.137 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "mode for remote execution of cephadm", 2024-09-11T23:36:16.137 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.137 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.137 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.137 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.137 INFO:teuthology.orchestra.run.smithi005.stdout: "oob_default_addr": { 2024-09-11T23:36:16.137 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "oob_default_addr", 2024-09-11T23:36:16.137 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.137 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.137 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.138 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "169.254.1.1", 2024-09-11T23:36:16.138 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.138 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.138 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.138 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-11T23:36:16.138 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.138 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.138 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.138 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.138 INFO:teuthology.orchestra.run.smithi005.stdout: "prometheus_alerts_path": { 2024-09-11T23:36:16.138 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prometheus_alerts_path", 2024-09-11T23:36:16.138 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.139 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.139 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.139 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-11T23:36:16.139 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.139 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.139 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.139 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-11T23:36:16.139 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.139 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.139 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.139 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.139 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_insecure": { 2024-09-11T23:36:16.139 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_insecure", 2024-09-11T23:36:16.140 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.140 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.140 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.140 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.140 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.140 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.140 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.140 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-11T23:36:16.140 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.140 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.140 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.140 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.140 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_password": { 2024-09-11T23:36:16.141 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_password", 2024-09-11T23:36:16.141 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.141 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.141 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.141 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.141 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.141 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.141 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.141 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-11T23:36:16.141 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.141 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.141 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.141 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.141 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_url": { 2024-09-11T23:36:16.142 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_url", 2024-09-11T23:36:16.142 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.142 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.142 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.142 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.142 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.142 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.142 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.142 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-11T23:36:16.142 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.142 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.142 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.142 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.143 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_username": { 2024-09-11T23:36:16.143 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_username", 2024-09-11T23:36:16.143 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.143 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.143 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.143 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.143 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.143 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.143 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.143 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-11T23:36:16.143 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.143 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.143 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.143 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.144 INFO:teuthology.orchestra.run.smithi005.stdout: "secure_monitoring_stack": { 2024-09-11T23:36:16.144 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "secure_monitoring_stack", 2024-09-11T23:36:16.144 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.144 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.144 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.144 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.144 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.144 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.144 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.144 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-11T23:36:16.144 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.144 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.145 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.145 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.145 INFO:teuthology.orchestra.run.smithi005.stdout: "service_discovery_port": { 2024-09-11T23:36:16.145 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "service_discovery_port", 2024-09-11T23:36:16.145 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:16.145 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.145 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.145 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8765", 2024-09-11T23:36:16.145 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.145 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.145 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.145 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "cephadm service discovery port", 2024-09-11T23:36:16.145 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.146 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.146 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.146 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.146 INFO:teuthology.orchestra.run.smithi005.stdout: "ssh_config_file": { 2024-09-11T23:36:16.146 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssh_config_file", 2024-09-11T23:36:16.146 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.146 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.146 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.146 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.146 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.146 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.146 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.146 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-11T23:36:16.147 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.147 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.147 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.147 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.147 INFO:teuthology.orchestra.run.smithi005.stdout: "use_agent": { 2024-09-11T23:36:16.147 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "use_agent", 2024-09-11T23:36:16.147 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.147 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.147 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.147 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.147 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.147 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.148 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.148 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-11T23:36:16.148 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.148 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.148 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.148 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.148 INFO:teuthology.orchestra.run.smithi005.stdout: "use_repo_digest": { 2024-09-11T23:36:16.148 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "use_repo_digest", 2024-09-11T23:36:16.148 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.148 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.148 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.148 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:16.149 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.149 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.149 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.149 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-11T23:36:16.149 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.149 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.149 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.149 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.149 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_failed_host_check": { 2024-09-11T23:36:16.149 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_failed_host_check", 2024-09-11T23:36:16.149 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.149 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.149 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.150 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:16.150 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.150 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.150 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.150 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if the host check fails", 2024-09-11T23:36:16.150 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.150 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.150 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.150 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.150 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_stray_daemons": { 2024-09-11T23:36:16.150 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_stray_daemons", 2024-09-11T23:36:16.150 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.151 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.151 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.151 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:16.151 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.151 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.151 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.151 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-11T23:36:16.151 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.151 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.151 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.151 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.151 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_stray_hosts": { 2024-09-11T23:36:16.151 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_stray_hosts", 2024-09-11T23:36:16.152 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.152 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.152 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.152 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:16.152 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.152 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.152 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.152 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-11T23:36:16.152 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.152 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.152 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.152 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.153 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.153 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.153 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:16.153 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crash", 2024-09-11T23:36:16.153 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:16.153 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:16.153 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:16.153 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:16.153 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:16.153 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.153 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.153 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.153 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.154 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.154 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.154 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.154 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.154 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.154 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.154 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.154 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.154 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.154 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.154 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.154 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.154 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.155 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.155 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.155 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:16.155 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:16.155 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.155 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.155 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.155 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.155 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.155 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.155 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.155 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.155 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.156 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.156 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.156 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.156 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:16.156 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:16.156 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.156 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.156 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.156 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:16.156 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.156 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.156 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.156 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.157 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.157 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.157 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.157 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.157 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.157 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.157 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.157 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.157 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.157 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.157 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.157 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:16.158 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:16.158 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.158 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.158 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.158 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.158 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.158 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.158 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.158 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.158 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.158 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.158 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.159 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.159 INFO:teuthology.orchestra.run.smithi005.stdout: "retain_interval": { 2024-09-11T23:36:16.159 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "retain_interval", 2024-09-11T23:36:16.159 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:16.159 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.159 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.159 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "31536000", 2024-09-11T23:36:16.159 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.159 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.159 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.159 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-11T23:36:16.159 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.159 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.159 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.160 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.160 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_recent_interval": { 2024-09-11T23:36:16.160 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_recent_interval", 2024-09-11T23:36:16.160 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:16.160 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.160 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.160 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1209600", 2024-09-11T23:36:16.160 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.160 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.160 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.160 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-11T23:36:16.160 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.161 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.161 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.161 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.161 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.161 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.161 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:16.161 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "dashboard", 2024-09-11T23:36:16.161 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:16.161 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:16.161 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:16.161 INFO:teuthology.orchestra.run.smithi005.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-11T23:36:16.161 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-11T23:36:16.161 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:16.161 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.162 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.162 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-09-11T23:36:16.162 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.162 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.162 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.162 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.162 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.162 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.162 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.162 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.162 INFO:teuthology.orchestra.run.smithi005.stdout: "ALERTMANAGER_API_HOST": { 2024-09-11T23:36:16.162 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-11T23:36:16.163 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.163 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.163 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.163 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.163 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.163 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.163 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.163 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.163 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.163 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.163 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.163 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.163 INFO:teuthology.orchestra.run.smithi005.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-11T23:36:16.164 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-11T23:36:16.164 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.164 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.164 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.164 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:16.164 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.164 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.164 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.164 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.164 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.164 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.164 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.164 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.165 INFO:teuthology.orchestra.run.smithi005.stdout: "AUDIT_API_ENABLED": { 2024-09-11T23:36:16.165 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "AUDIT_API_ENABLED", 2024-09-11T23:36:16.165 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.165 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.165 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.165 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.165 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.165 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.165 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.165 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.165 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.165 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.166 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.166 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.166 INFO:teuthology.orchestra.run.smithi005.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-11T23:36:16.166 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-11T23:36:16.166 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.166 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.166 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.166 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:16.166 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.166 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.166 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.166 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.166 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.167 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.167 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.167 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.167 INFO:teuthology.orchestra.run.smithi005.stdout: "ENABLE_BROWSABLE_API": { 2024-09-11T23:36:16.167 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-11T23:36:16.167 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.167 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.167 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.167 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:16.167 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.167 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.167 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.167 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.168 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.168 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.168 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.168 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.168 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-11T23:36:16.168 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-11T23:36:16.168 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.168 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.168 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.168 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:16.168 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.168 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.168 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.169 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.169 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.169 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.169 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.169 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.169 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-11T23:36:16.169 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-11T23:36:16.169 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.169 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.169 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.169 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:16.169 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.169 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.170 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.170 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.170 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.170 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.170 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.170 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.170 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-11T23:36:16.170 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-11T23:36:16.170 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.170 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.170 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.170 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:16.170 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.171 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.171 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.171 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.171 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.171 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.171 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.171 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.171 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-11T23:36:16.171 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-11T23:36:16.171 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.171 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.171 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.172 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:16.172 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.172 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.172 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.172 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.172 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.172 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.172 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.172 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.172 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-11T23:36:16.172 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-11T23:36:16.172 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.172 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.172 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.173 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:16.173 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.173 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.173 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.173 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.173 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.173 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.173 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.173 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.173 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-11T23:36:16.173 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-11T23:36:16.173 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.173 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.174 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.174 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:16.174 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.174 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.174 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.174 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.174 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.174 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.174 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.174 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.174 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-11T23:36:16.174 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-11T23:36:16.174 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.175 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.175 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.175 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:16.175 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.175 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.175 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.175 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.175 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.175 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.175 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.175 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.175 INFO:teuthology.orchestra.run.smithi005.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-11T23:36:16.175 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-11T23:36:16.176 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.176 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.176 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.176 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.176 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.176 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.176 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.176 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.176 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.176 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.176 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.176 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.176 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_PASSWORD": { 2024-09-11T23:36:16.177 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-11T23:36:16.177 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.177 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.177 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.177 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2024-09-11T23:36:16.177 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.177 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.177 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.177 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.177 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.177 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.177 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.177 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.177 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-11T23:36:16.178 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-11T23:36:16.178 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.178 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.178 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.178 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:16.178 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.178 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.178 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.178 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.178 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.178 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.178 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.178 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.178 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_URL": { 2024-09-11T23:36:16.179 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_URL", 2024-09-11T23:36:16.179 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.179 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.179 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.179 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.179 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.179 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.179 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.179 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.179 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.179 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.180 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.180 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.180 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_USERNAME": { 2024-09-11T23:36:16.180 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-11T23:36:16.180 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.180 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.180 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.180 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2024-09-11T23:36:16.180 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.180 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.180 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.180 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.181 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.181 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.181 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.181 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.181 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-11T23:36:16.181 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-11T23:36:16.181 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.181 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.181 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.181 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.181 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.181 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.182 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.182 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.182 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.182 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.182 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.182 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.182 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-11T23:36:16.182 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-11T23:36:16.182 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.182 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.182 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.182 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.182 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.183 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.183 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.183 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.183 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.183 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.183 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.183 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.183 INFO:teuthology.orchestra.run.smithi005.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-11T23:36:16.183 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-11T23:36:16.183 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.183 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.183 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.184 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:16.184 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.184 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.184 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.184 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.184 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.184 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.184 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.184 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.184 INFO:teuthology.orchestra.run.smithi005.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-11T23:36:16.184 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-11T23:36:16.184 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.185 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.185 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.185 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.185 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.185 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.185 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.185 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.185 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.185 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.185 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.185 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.185 INFO:teuthology.orchestra.run.smithi005.stdout: "PROMETHEUS_API_HOST": { 2024-09-11T23:36:16.185 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-11T23:36:16.186 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.186 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.186 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.186 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.186 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.186 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.186 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.186 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.186 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.186 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.186 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.186 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.186 INFO:teuthology.orchestra.run.smithi005.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-11T23:36:16.187 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-11T23:36:16.187 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.187 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.187 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.187 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:16.187 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.187 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.187 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.187 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.187 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.187 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.187 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.187 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.188 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-11T23:36:16.188 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-11T23:36:16.188 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.188 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.188 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.188 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.188 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.188 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.188 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.188 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.188 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.188 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.189 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.189 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.189 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-11T23:36:16.189 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-11T23:36:16.189 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.189 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.189 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.189 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.189 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.189 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.189 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.189 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.189 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.190 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.190 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.190 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.190 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-11T23:36:16.190 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-11T23:36:16.190 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.190 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.190 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.190 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:16.190 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.190 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.190 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.190 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.190 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.191 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.191 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.191 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.191 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-11T23:36:16.191 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-11T23:36:16.191 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.191 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.191 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.191 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:16.191 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.191 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.191 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.191 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.192 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.192 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.192 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.192 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.192 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-11T23:36:16.192 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-11T23:36:16.192 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.192 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.192 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.192 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.192 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.192 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.192 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.193 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.193 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.193 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.193 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.193 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.193 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-11T23:36:16.193 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-11T23:36:16.193 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.193 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.193 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.193 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.193 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.193 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.194 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.194 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.194 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.194 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.194 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.194 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.194 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-11T23:36:16.194 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-11T23:36:16.194 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.194 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.194 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.194 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.194 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.195 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.195 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.195 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.195 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.195 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.195 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.195 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.195 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_ENABLED": { 2024-09-11T23:36:16.195 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-11T23:36:16.195 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.195 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.195 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.195 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:16.195 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.196 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.196 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.196 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.196 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.196 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.196 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.196 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.196 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-11T23:36:16.196 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-11T23:36:16.196 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.196 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.196 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.196 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-11T23:36:16.197 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.197 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.197 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.197 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.197 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.197 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.197 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.197 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.197 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-11T23:36:16.197 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-11T23:36:16.197 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:16.197 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.197 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.198 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-09-11T23:36:16.198 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.198 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.198 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.198 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.198 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.198 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.198 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.198 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.198 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-11T23:36:16.198 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-11T23:36:16.198 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:16.199 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.199 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.199 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8", 2024-09-11T23:36:16.199 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.199 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.199 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.199 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.199 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.199 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.199 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.199 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.199 INFO:teuthology.orchestra.run.smithi005.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-11T23:36:16.199 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-11T23:36:16.200 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:16.200 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.200 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.200 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "45", 2024-09-11T23:36:16.200 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.200 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.200 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.200 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.200 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.200 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.200 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.200 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.200 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_ACCESS_KEY": { 2024-09-11T23:36:16.201 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-11T23:36:16.201 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.201 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.201 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.201 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.201 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.201 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.201 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.201 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.201 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.201 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.201 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.201 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.202 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-11T23:36:16.202 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-11T23:36:16.202 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.202 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.202 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.202 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2024-09-11T23:36:16.202 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.202 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.202 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.202 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.202 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.202 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.202 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.203 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.203 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_SECRET_KEY": { 2024-09-11T23:36:16.203 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-11T23:36:16.203 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.203 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.203 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.203 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.203 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.203 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.203 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.203 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.203 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.203 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.204 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.204 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.204 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_SSL_VERIFY": { 2024-09-11T23:36:16.204 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-11T23:36:16.204 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.204 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.204 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.204 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:16.204 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.204 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.204 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.204 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.204 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.204 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.205 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.205 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.205 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-11T23:36:16.205 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-11T23:36:16.205 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:16.205 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.205 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.205 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-11T23:36:16.205 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.205 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.205 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.205 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.205 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.206 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.206 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.206 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.206 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-11T23:36:16.206 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-11T23:36:16.206 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:16.206 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.206 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.206 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-09-11T23:36:16.206 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.206 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.206 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.206 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.207 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.207 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.207 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.207 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.207 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-11T23:36:16.207 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-11T23:36:16.207 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:16.207 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.207 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.207 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2024-09-11T23:36:16.207 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.207 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.207 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.208 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.208 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.208 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.208 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.208 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.208 INFO:teuthology.orchestra.run.smithi005.stdout: "cross_origin_url": { 2024-09-11T23:36:16.208 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cross_origin_url", 2024-09-11T23:36:16.208 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.208 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.208 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.208 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.208 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.208 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.209 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.209 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.209 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.209 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.209 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.209 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.209 INFO:teuthology.orchestra.run.smithi005.stdout: "crt_file": { 2024-09-11T23:36:16.209 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crt_file", 2024-09-11T23:36:16.209 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.209 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.209 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.209 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.209 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.210 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.210 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.210 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.210 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.210 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.210 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.210 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.210 INFO:teuthology.orchestra.run.smithi005.stdout: "debug": { 2024-09-11T23:36:16.210 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "debug", 2024-09-11T23:36:16.210 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.210 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.210 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.210 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.211 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.211 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.211 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.211 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable/disable debug options", 2024-09-11T23:36:16.211 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.211 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.211 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.211 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.211 INFO:teuthology.orchestra.run.smithi005.stdout: "jwt_token_ttl": { 2024-09-11T23:36:16.211 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "jwt_token_ttl", 2024-09-11T23:36:16.211 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:16.211 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.211 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.211 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "28800", 2024-09-11T23:36:16.212 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.212 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.212 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.212 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.212 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.212 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.212 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.212 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.212 INFO:teuthology.orchestra.run.smithi005.stdout: "key_file": { 2024-09-11T23:36:16.212 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "key_file", 2024-09-11T23:36:16.212 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.212 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.212 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.213 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.213 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.213 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.213 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.213 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.213 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.213 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.213 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.213 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.213 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:16.213 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:16.213 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.213 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.213 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.214 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.214 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.214 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.214 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.214 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.214 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.214 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.214 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.214 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.214 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.214 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.214 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.215 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.215 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.215 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.215 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.215 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:16.215 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:16.215 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.215 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.215 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.215 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.215 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.215 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.215 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.216 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.216 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.216 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.216 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.216 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.216 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:16.216 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:16.216 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.216 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.216 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.216 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:16.216 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.217 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.217 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.217 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.217 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.217 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.217 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.217 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.217 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.217 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.217 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.217 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.217 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.218 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.218 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.218 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:16.218 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:16.218 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.218 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.218 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.218 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.218 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.218 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.218 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.218 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.219 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.219 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.219 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.219 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.219 INFO:teuthology.orchestra.run.smithi005.stdout: "motd": { 2024-09-11T23:36:16.219 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "motd", 2024-09-11T23:36:16.219 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.219 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.219 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.219 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.219 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.219 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.220 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.220 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "The message of the day", 2024-09-11T23:36:16.220 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.220 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.220 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.220 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.220 INFO:teuthology.orchestra.run.smithi005.stdout: "redirect_resolve_ip_addr": { 2024-09-11T23:36:16.220 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "redirect_resolve_ip_addr", 2024-09-11T23:36:16.220 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.220 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.220 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.220 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.221 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.221 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.221 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.221 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.221 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.221 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.221 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.221 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.221 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2024-09-11T23:36:16.221 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2024-09-11T23:36:16.221 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.221 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.221 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.222 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "::", 2024-09-11T23:36:16.222 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.222 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.222 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.222 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.222 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.222 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.222 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.222 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.222 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2024-09-11T23:36:16.222 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2024-09-11T23:36:16.222 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:16.223 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.223 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.223 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8080", 2024-09-11T23:36:16.223 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.223 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.223 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.223 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.223 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.223 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.223 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.223 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.223 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl": { 2024-09-11T23:36:16.223 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl", 2024-09-11T23:36:16.224 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.224 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.224 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.224 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:16.224 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.224 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.224 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.224 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.224 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.224 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.224 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.224 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.224 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl_server_port": { 2024-09-11T23:36:16.225 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl_server_port", 2024-09-11T23:36:16.225 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:16.225 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.225 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.225 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8443", 2024-09-11T23:36:16.225 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.225 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.225 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.225 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.225 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.225 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.225 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.225 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.226 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_behaviour": { 2024-09-11T23:36:16.226 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_behaviour", 2024-09-11T23:36:16.226 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.226 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.226 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.226 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "redirect", 2024-09-11T23:36:16.226 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.226 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.226 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.226 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.226 INFO:teuthology.orchestra.run.smithi005.stdout: "redirect" 2024-09-11T23:36:16.226 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.226 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.227 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.227 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.227 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.227 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.227 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_error_status_code": { 2024-09-11T23:36:16.227 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_error_status_code", 2024-09-11T23:36:16.227 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:16.227 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.227 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.227 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "500", 2024-09-11T23:36:16.227 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "400", 2024-09-11T23:36:16.227 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "599", 2024-09-11T23:36:16.227 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.228 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.228 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.228 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.228 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.228 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.228 INFO:teuthology.orchestra.run.smithi005.stdout: "url_prefix": { 2024-09-11T23:36:16.228 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "url_prefix", 2024-09-11T23:36:16.228 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.228 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.228 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.228 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.228 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.229 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.229 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.229 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.229 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.229 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.229 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.229 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.229 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.229 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.229 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:16.229 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "devicehealth", 2024-09-11T23:36:16.229 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:16.229 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:16.230 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:16.230 INFO:teuthology.orchestra.run.smithi005.stdout: "enable_monitoring": { 2024-09-11T23:36:16.230 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enable_monitoring", 2024-09-11T23:36:16.230 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.230 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.230 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.230 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:16.230 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.230 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.230 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.230 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "monitor device health metrics", 2024-09-11T23:36:16.230 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.230 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.231 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.231 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.231 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:16.231 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:16.231 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.231 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.231 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.231 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.231 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.231 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.231 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.231 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.231 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.232 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.232 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.232 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.232 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.232 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.232 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.232 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.232 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.232 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.232 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.232 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:16.232 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:16.232 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.233 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.233 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.233 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.233 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.233 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.233 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.233 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.233 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.233 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.233 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.233 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.233 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:16.233 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:16.234 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.234 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.234 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.234 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:16.234 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.234 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.234 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.234 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.234 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.234 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.234 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.234 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.235 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.235 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.235 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.235 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.235 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.235 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.235 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.235 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:16.235 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:16.235 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.235 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.235 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.235 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.236 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.236 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.236 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.236 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.236 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.236 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.236 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.236 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.236 INFO:teuthology.orchestra.run.smithi005.stdout: "mark_out_threshold": { 2024-09-11T23:36:16.236 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mark_out_threshold", 2024-09-11T23:36:16.236 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:16.236 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.237 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.237 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "2419200", 2024-09-11T23:36:16.237 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.237 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.237 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.237 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-11T23:36:16.237 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.237 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.237 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.237 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.237 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_name": { 2024-09-11T23:36:16.237 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pool_name", 2024-09-11T23:36:16.237 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.238 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.238 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.238 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "device_health_metrics", 2024-09-11T23:36:16.238 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.238 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.238 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.238 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-11T23:36:16.240 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.241 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.241 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.241 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.241 INFO:teuthology.orchestra.run.smithi005.stdout: "retention_period": { 2024-09-11T23:36:16.241 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "retention_period", 2024-09-11T23:36:16.241 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:16.241 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.242 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.242 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15552000", 2024-09-11T23:36:16.242 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.242 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.242 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.242 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long to retain device health metrics", 2024-09-11T23:36:16.242 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.242 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.242 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.242 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.242 INFO:teuthology.orchestra.run.smithi005.stdout: "scrape_frequency": { 2024-09-11T23:36:16.242 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "scrape_frequency", 2024-09-11T23:36:16.242 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:16.243 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.243 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.243 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "86400", 2024-09-11T23:36:16.243 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.243 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.243 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.243 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-11T23:36:16.243 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.243 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.243 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.243 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.243 INFO:teuthology.orchestra.run.smithi005.stdout: "self_heal": { 2024-09-11T23:36:16.244 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "self_heal", 2024-09-11T23:36:16.244 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.244 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.244 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.244 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:16.244 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.244 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.244 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.244 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-11T23:36:16.244 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.244 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.244 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.245 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.245 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2024-09-11T23:36:16.245 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2024-09-11T23:36:16.245 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:16.245 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.245 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.245 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2024-09-11T23:36:16.245 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.245 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.245 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.245 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to wake up and check device health", 2024-09-11T23:36:16.245 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.245 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.246 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.246 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.246 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_threshold": { 2024-09-11T23:36:16.246 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_threshold", 2024-09-11T23:36:16.246 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:16.246 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.246 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.246 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "7257600", 2024-09-11T23:36:16.246 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.246 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.246 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.246 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-11T23:36:16.246 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.247 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.247 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.247 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.247 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.247 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.247 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:16.247 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "diskprediction_local", 2024-09-11T23:36:16.247 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:16.247 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:16.247 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:16.247 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:16.247 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:16.247 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.247 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.248 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.248 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.248 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.248 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.248 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.248 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.248 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.248 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.248 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.248 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.248 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.248 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.248 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.249 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.249 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.249 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.249 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.249 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:16.249 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:16.249 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.249 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.249 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.249 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.249 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.249 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.249 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.250 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.250 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.250 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.250 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.250 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.250 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:16.250 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:16.250 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.250 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.250 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.250 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:16.250 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.250 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.251 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.251 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.251 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.251 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.251 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.251 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.251 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.251 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.251 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.251 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.251 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.251 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.251 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.252 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:16.252 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:16.252 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.252 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.252 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.252 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.252 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.252 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.252 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.252 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.252 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.252 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.252 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.252 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.253 INFO:teuthology.orchestra.run.smithi005.stdout: "predict_interval": { 2024-09-11T23:36:16.253 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "predict_interval", 2024-09-11T23:36:16.253 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.253 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.253 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.253 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "86400", 2024-09-11T23:36:16.253 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.253 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.253 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.254 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.254 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.254 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.254 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.254 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.254 INFO:teuthology.orchestra.run.smithi005.stdout: "predictor_model": { 2024-09-11T23:36:16.254 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "predictor_model", 2024-09-11T23:36:16.254 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.254 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.254 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.254 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "prophetstor", 2024-09-11T23:36:16.254 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.254 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.255 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.255 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.255 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.255 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.255 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.255 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.255 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2024-09-11T23:36:16.255 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2024-09-11T23:36:16.255 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.255 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.255 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.255 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2024-09-11T23:36:16.255 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.255 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.256 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.256 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.256 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.256 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.256 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.256 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.256 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.256 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.256 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:16.256 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "influx", 2024-09-11T23:36:16.256 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": false, 2024-09-11T23:36:16.256 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "influxdb python module not found", 2024-09-11T23:36:16.257 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:16.257 INFO:teuthology.orchestra.run.smithi005.stdout: "batch_size": { 2024-09-11T23:36:16.257 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "batch_size", 2024-09-11T23:36:16.257 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:16.257 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.257 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.257 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5000", 2024-09-11T23:36:16.257 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.257 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.257 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.257 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-11T23:36:16.257 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.257 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.258 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.258 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.258 INFO:teuthology.orchestra.run.smithi005.stdout: "database": { 2024-09-11T23:36:16.258 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "database", 2024-09-11T23:36:16.258 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.258 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.258 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.258 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "ceph", 2024-09-11T23:36:16.258 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.258 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.258 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.258 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-11T23:36:16.259 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.259 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.259 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.259 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.259 INFO:teuthology.orchestra.run.smithi005.stdout: "hostname": { 2024-09-11T23:36:16.259 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "hostname", 2024-09-11T23:36:16.259 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.259 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.259 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.259 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.259 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.259 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.259 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.260 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB server hostname", 2024-09-11T23:36:16.260 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.260 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.260 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.260 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.260 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2024-09-11T23:36:16.260 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2024-09-11T23:36:16.260 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:16.260 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.260 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.260 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "30", 2024-09-11T23:36:16.260 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "5", 2024-09-11T23:36:16.260 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.261 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.261 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-11T23:36:16.261 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.261 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.261 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.261 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.261 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:16.261 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:16.261 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.261 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.261 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.261 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.261 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.262 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.262 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.262 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.262 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.262 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.262 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.262 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.262 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.262 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.262 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.262 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.262 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.262 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.263 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.263 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:16.263 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:16.263 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.263 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.263 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.263 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.263 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.263 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.263 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.263 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.263 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.263 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.264 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.264 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.264 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:16.264 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:16.264 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.264 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.264 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.264 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:16.264 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.264 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.264 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.264 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.264 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.265 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.265 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.265 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.265 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.265 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.265 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.265 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.265 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.265 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.265 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.265 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:16.265 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:16.266 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.266 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.266 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.266 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.266 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.266 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.266 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.266 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.266 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.266 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.266 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.266 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.266 INFO:teuthology.orchestra.run.smithi005.stdout: "password": { 2024-09-11T23:36:16.266 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "password", 2024-09-11T23:36:16.267 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.267 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.267 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.267 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.267 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.267 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.267 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.267 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "password of InfluxDB server user", 2024-09-11T23:36:16.267 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.267 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.267 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.267 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.267 INFO:teuthology.orchestra.run.smithi005.stdout: "port": { 2024-09-11T23:36:16.268 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "port", 2024-09-11T23:36:16.268 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:16.268 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.268 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.268 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8086", 2024-09-11T23:36:16.268 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.268 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.268 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.268 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB server port", 2024-09-11T23:36:16.268 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.268 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.268 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.269 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.269 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl": { 2024-09-11T23:36:16.269 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl", 2024-09-11T23:36:16.269 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.269 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.269 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.269 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "false", 2024-09-11T23:36:16.269 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.269 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.269 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.269 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T23:36:16.269 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.269 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.270 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.270 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.270 INFO:teuthology.orchestra.run.smithi005.stdout: "threads": { 2024-09-11T23:36:16.270 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "threads", 2024-09-11T23:36:16.270 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:16.270 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.270 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.270 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2024-09-11T23:36:16.270 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2024-09-11T23:36:16.270 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "32", 2024-09-11T23:36:16.270 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.270 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-11T23:36:16.270 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.270 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.271 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.271 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.271 INFO:teuthology.orchestra.run.smithi005.stdout: "username": { 2024-09-11T23:36:16.271 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "username", 2024-09-11T23:36:16.271 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.271 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.271 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.271 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.271 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.271 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.271 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.272 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "username of InfluxDB server user", 2024-09-11T23:36:16.272 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.272 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.272 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.272 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.272 INFO:teuthology.orchestra.run.smithi005.stdout: "verify_ssl": { 2024-09-11T23:36:16.272 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "verify_ssl", 2024-09-11T23:36:16.272 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.272 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.272 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.272 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "true", 2024-09-11T23:36:16.272 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.272 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.272 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.273 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T23:36:16.273 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.273 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.273 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.273 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.273 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.273 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.273 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:16.273 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "insights", 2024-09-11T23:36:16.273 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:16.273 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:16.273 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:16.274 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:16.274 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:16.274 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.274 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.274 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.274 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.274 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.274 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.274 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.274 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.274 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.274 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.274 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.275 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.275 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.275 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.275 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.275 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.275 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.275 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.275 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.275 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:16.275 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:16.275 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.275 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.276 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.276 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.276 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.276 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.276 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.276 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.276 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.276 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.276 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.276 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.276 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:16.276 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:16.276 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.277 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.277 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.277 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:16.277 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.277 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.277 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.277 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.277 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.277 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.277 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.277 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.277 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.278 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.278 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.278 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.278 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.278 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.278 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.278 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:16.278 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:16.278 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.278 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.278 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.278 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.278 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.279 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.279 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.279 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.279 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.279 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.279 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.279 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.279 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.279 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.279 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:16.279 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "iostat", 2024-09-11T23:36:16.279 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:16.279 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:16.280 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:16.280 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:16.280 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:16.280 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.280 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.280 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.280 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.280 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.280 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.280 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.280 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.280 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.281 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.281 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.281 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.281 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.281 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.281 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.281 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.281 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.281 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.281 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.281 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:16.281 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:16.281 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.282 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.282 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.282 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.282 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.282 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.282 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.282 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.282 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.282 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.282 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.282 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.282 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:16.282 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:16.283 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.283 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.283 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.283 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:16.283 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.283 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.283 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.283 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.283 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.283 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.283 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.283 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.283 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.284 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.284 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.284 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.284 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.284 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.284 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.284 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:16.284 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:16.284 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.284 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.284 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.284 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.284 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.285 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.285 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.285 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.285 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.285 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.285 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.285 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.285 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.285 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.285 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:16.285 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "k8sevents", 2024-09-11T23:36:16.285 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:16.286 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:16.286 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:16.286 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_event_retention_days": { 2024-09-11T23:36:16.286 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ceph_event_retention_days", 2024-09-11T23:36:16.286 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:16.286 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.286 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.286 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "7", 2024-09-11T23:36:16.286 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.286 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.286 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.286 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-11T23:36:16.286 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.287 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.287 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.287 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.287 INFO:teuthology.orchestra.run.smithi005.stdout: "config_check_secs": { 2024-09-11T23:36:16.287 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "config_check_secs", 2024-09-11T23:36:16.287 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:16.287 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.287 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.287 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-09-11T23:36:16.287 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "10", 2024-09-11T23:36:16.287 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.287 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.288 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-11T23:36:16.288 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.288 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.288 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.288 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.288 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:16.288 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:16.288 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.288 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.288 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.288 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.288 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.288 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.289 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.289 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.289 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.289 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.289 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.289 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.289 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.289 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.289 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.289 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.289 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.289 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.289 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.290 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:16.290 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:16.290 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.290 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.290 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.290 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.290 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.290 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.290 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.290 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.290 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.290 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.290 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.291 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.291 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:16.291 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:16.291 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.291 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.291 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.291 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:16.291 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.291 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.291 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.291 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.291 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.292 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.292 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.292 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.292 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.292 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.292 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.292 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.292 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.292 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.292 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.292 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:16.292 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:16.292 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.293 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.293 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.293 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.293 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.293 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.293 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.293 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.293 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.293 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.293 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.293 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.293 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.293 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.294 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:16.294 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "localpool", 2024-09-11T23:36:16.294 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:16.294 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:16.294 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:16.294 INFO:teuthology.orchestra.run.smithi005.stdout: "failure_domain": { 2024-09-11T23:36:16.294 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "failure_domain", 2024-09-11T23:36:16.294 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.294 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.294 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.294 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "host", 2024-09-11T23:36:16.294 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.294 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.295 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.295 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "failure domain for any created local pool", 2024-09-11T23:36:16.295 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-11T23:36:16.295 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.295 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.295 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.295 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:16.295 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:16.295 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.295 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.295 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.295 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.295 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.296 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.296 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.296 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.296 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.296 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.296 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.296 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.296 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.296 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.296 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.296 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.296 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.296 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.297 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.297 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:16.297 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:16.297 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.297 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.297 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.297 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.297 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.297 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.297 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.297 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.297 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.297 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.298 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.298 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.298 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:16.298 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:16.298 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.298 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.298 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.298 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:16.298 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.298 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.298 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.298 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.299 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.299 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.299 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.299 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.299 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.299 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.299 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.299 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.299 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.299 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.299 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.299 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:16.299 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:16.300 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.300 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.300 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.300 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.300 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.300 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.300 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.300 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.300 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.300 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.300 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.300 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.300 INFO:teuthology.orchestra.run.smithi005.stdout: "min_size": { 2024-09-11T23:36:16.301 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "min_size", 2024-09-11T23:36:16.301 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:16.301 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.301 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.301 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.301 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.301 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.301 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.301 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default min_size for any created local pool", 2024-09-11T23:36:16.301 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-11T23:36:16.301 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.301 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.301 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.302 INFO:teuthology.orchestra.run.smithi005.stdout: "num_rep": { 2024-09-11T23:36:16.302 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "num_rep", 2024-09-11T23:36:16.302 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:16.302 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.302 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.302 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3", 2024-09-11T23:36:16.302 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.302 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.302 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.302 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default replica count for any created local pool", 2024-09-11T23:36:16.302 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.302 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.303 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.303 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.303 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num": { 2024-09-11T23:36:16.303 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pg_num", 2024-09-11T23:36:16.303 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:16.303 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.303 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.303 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "128", 2024-09-11T23:36:16.303 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.303 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.303 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.303 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default pg_num for any created local pool", 2024-09-11T23:36:16.303 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.304 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.304 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.304 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.304 INFO:teuthology.orchestra.run.smithi005.stdout: "prefix": { 2024-09-11T23:36:16.304 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prefix", 2024-09-11T23:36:16.304 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.304 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.304 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.304 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.304 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.304 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.304 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.304 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "name prefix for any created local pool", 2024-09-11T23:36:16.305 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.305 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.305 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.305 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.305 INFO:teuthology.orchestra.run.smithi005.stdout: "subtree": { 2024-09-11T23:36:16.305 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "subtree", 2024-09-11T23:36:16.305 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.305 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.305 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.305 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "rack", 2024-09-11T23:36:16.305 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.305 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.305 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.306 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-11T23:36:16.306 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-11T23:36:16.306 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.306 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.306 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.306 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.306 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.306 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:16.306 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mds_autoscaler", 2024-09-11T23:36:16.306 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:16.306 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:16.306 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:16.306 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:16.307 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:16.307 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.307 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.307 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.307 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.307 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.307 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.307 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.307 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.307 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.307 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.307 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.307 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.308 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.308 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.308 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.308 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.308 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.308 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.308 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.308 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:16.308 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:16.308 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.308 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.309 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.309 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.309 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.309 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.309 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.309 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.309 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.309 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.309 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.309 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.309 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:16.309 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:16.309 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.310 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.310 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.310 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:16.310 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.310 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.310 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.310 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.310 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.310 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.310 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.310 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.310 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.310 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.311 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.311 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.311 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.311 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.311 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.311 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:16.311 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:16.311 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.311 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.311 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.311 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.311 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.312 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.312 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.312 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.312 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.312 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.312 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.312 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.312 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.312 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.312 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:16.312 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mirroring", 2024-09-11T23:36:16.312 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:16.312 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:16.313 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:16.313 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:16.313 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:16.313 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.313 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.313 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.313 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.313 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.313 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.313 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.313 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.313 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.313 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.314 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.314 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.314 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.314 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.314 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.314 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.314 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.314 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.314 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.314 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:16.314 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:16.314 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.314 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.315 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.315 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.315 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.315 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.315 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.315 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.315 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.315 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.315 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.315 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.315 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:16.315 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:16.315 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.316 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.316 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.316 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:16.316 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.316 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.316 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.316 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.316 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.316 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.316 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.316 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.316 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.317 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.317 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.317 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.317 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.317 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.317 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.317 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:16.317 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:16.317 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.317 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.317 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.317 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.318 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.318 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.318 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.318 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.318 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.318 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.318 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.318 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.318 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.318 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.318 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:16.318 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "nfs", 2024-09-11T23:36:16.318 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:16.318 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:16.319 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:16.319 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:16.319 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:16.319 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.319 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.319 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.319 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.319 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.319 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.319 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.319 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.319 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.319 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.320 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.320 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.320 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.320 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.320 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.320 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.320 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.320 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.320 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.320 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:16.320 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:16.320 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.321 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.321 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.321 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.321 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.322 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.322 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.322 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.322 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.322 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.322 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.322 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.322 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:16.322 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:16.322 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.323 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.323 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.323 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:16.323 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.323 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.323 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.323 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.323 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.323 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.323 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.323 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.323 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.324 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.324 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.324 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.324 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.324 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.324 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.324 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:16.324 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:16.324 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.324 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.324 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.324 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.325 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.325 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.325 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.325 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.325 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.325 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.325 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.325 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.325 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.325 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.325 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:16.325 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "orchestrator", 2024-09-11T23:36:16.326 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:16.326 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:16.326 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:16.326 INFO:teuthology.orchestra.run.smithi005.stdout: "fail_fs": { 2024-09-11T23:36:16.326 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "fail_fs", 2024-09-11T23:36:16.326 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.326 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.326 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.326 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.326 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.326 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.326 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.326 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-11T23:36:16.327 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.327 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.327 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.327 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.327 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:16.327 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:16.327 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.327 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.327 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.327 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.327 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.327 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.328 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.328 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.328 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.328 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.328 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.328 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.328 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.328 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.328 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.328 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.328 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.329 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.329 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.329 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:16.329 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:16.329 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.329 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.329 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.329 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.329 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.329 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.329 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.329 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.329 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.330 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.330 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.330 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.330 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:16.330 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:16.330 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.330 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.330 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.330 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:16.330 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.330 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.330 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.331 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.331 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.331 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.331 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.331 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.331 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.331 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.331 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.331 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.331 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.331 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.331 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.331 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:16.332 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:16.332 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.332 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.332 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.332 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.332 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.332 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.333 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.333 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.333 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.333 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.333 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.333 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.333 INFO:teuthology.orchestra.run.smithi005.stdout: "orchestrator": { 2024-09-11T23:36:16.333 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "orchestrator", 2024-09-11T23:36:16.333 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.333 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.333 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.333 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.334 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.334 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.334 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.334 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm", 2024-09-11T23:36:16.334 INFO:teuthology.orchestra.run.smithi005.stdout: "rook", 2024-09-11T23:36:16.334 INFO:teuthology.orchestra.run.smithi005.stdout: "test_orchestrator" 2024-09-11T23:36:16.334 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.334 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Orchestrator backend", 2024-09-11T23:36:16.335 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.335 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.335 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.335 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.335 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.335 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.335 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:16.335 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "osd_perf_query", 2024-09-11T23:36:16.335 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:16.335 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:16.335 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:16.335 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:16.336 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:16.336 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.336 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.336 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.336 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.336 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.336 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.336 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.336 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.336 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.336 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.336 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.337 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.337 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.337 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.337 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.337 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.337 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.337 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.337 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.337 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:16.337 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:16.337 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.338 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.338 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.338 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.338 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.338 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.338 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.338 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.338 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.338 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.338 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.338 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.339 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:16.339 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:16.339 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.339 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.339 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.339 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:16.339 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.339 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.339 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.340 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.340 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.340 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.340 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.340 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.340 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.340 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.340 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.341 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.341 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.341 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.341 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.341 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:16.341 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:16.341 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.341 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.341 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.342 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.342 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.343 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.343 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.343 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.343 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.343 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.343 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.344 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.344 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.344 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.344 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:16.344 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "osd_support", 2024-09-11T23:36:16.344 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:16.344 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:16.345 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:16.345 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:16.345 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:16.345 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.345 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.345 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.345 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.346 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.346 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.346 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.346 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.346 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.346 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.347 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.347 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.347 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.347 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.347 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.347 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.347 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.347 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.348 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.348 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:16.348 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:16.348 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.348 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.348 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.349 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.349 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.349 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.349 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.349 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.349 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.349 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.350 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.350 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.350 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:16.350 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:16.350 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.350 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.350 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.351 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:16.351 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.351 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.351 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.351 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.351 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.351 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.352 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.352 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.352 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.352 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.352 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.352 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.352 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.353 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.353 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.353 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:16.353 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:16.353 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.353 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.353 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.354 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.354 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.354 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.354 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.354 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.354 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.355 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.355 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.355 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.355 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.355 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.355 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:16.355 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pg_autoscaler", 2024-09-11T23:36:16.356 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:16.356 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:16.356 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:16.356 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:16.356 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:16.356 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.357 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.357 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.357 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.357 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.357 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.357 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.357 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.358 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.358 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.358 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.358 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.358 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.358 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.358 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.359 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.359 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.359 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.359 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.359 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:16.359 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:16.359 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.360 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.360 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.360 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.360 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.360 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.361 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.361 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.361 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.361 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.361 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.361 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.362 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:16.362 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:16.362 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.362 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.362 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.362 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:16.362 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.363 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.363 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.363 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.363 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.363 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.363 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.364 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.364 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.364 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.364 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.364 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.364 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.364 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.364 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.364 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:16.364 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:16.365 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.365 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.365 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.365 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.365 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.365 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.365 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.365 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.365 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.366 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.366 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.366 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.366 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2024-09-11T23:36:16.366 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2024-09-11T23:36:16.366 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:16.366 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.366 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.367 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2024-09-11T23:36:16.367 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.367 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.367 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.367 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.367 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.367 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.367 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.367 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.367 INFO:teuthology.orchestra.run.smithi005.stdout: "threshold": { 2024-09-11T23:36:16.368 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "threshold", 2024-09-11T23:36:16.368 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-09-11T23:36:16.368 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.368 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.368 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3.0", 2024-09-11T23:36:16.368 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1.0", 2024-09-11T23:36:16.368 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.368 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.368 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "scaling threshold", 2024-09-11T23:36:16.369 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-11T23:36:16.369 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.369 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.369 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.369 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.369 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.369 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:16.369 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "progress", 2024-09-11T23:36:16.369 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:16.369 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:16.370 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:16.370 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_pg_recovery_event": { 2024-09-11T23:36:16.370 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_pg_recovery_event", 2024-09-11T23:36:16.370 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.370 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.370 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.370 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.370 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.370 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.370 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.370 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-11T23:36:16.371 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.371 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.371 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.371 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.371 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": { 2024-09-11T23:36:16.371 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enabled", 2024-09-11T23:36:16.371 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.371 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.371 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.371 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:16.371 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.372 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.372 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.372 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.372 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.372 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.372 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.372 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.372 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:16.372 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:16.372 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.373 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.373 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.373 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.373 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.373 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.373 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.373 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.373 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.373 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.374 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.374 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.374 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.374 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.374 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.374 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.374 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.374 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.375 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.375 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:16.375 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:16.375 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.375 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.375 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.376 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.376 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.376 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.376 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.376 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.376 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.377 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.377 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.377 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.377 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:16.377 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:16.377 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.378 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.378 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.378 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:16.378 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.378 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.378 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.378 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.379 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.379 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.379 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.379 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.380 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.380 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.380 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.380 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.380 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.380 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.380 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.381 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:16.381 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:16.381 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.381 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.381 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.381 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.381 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.381 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.381 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.382 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.382 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.382 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.382 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.382 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.382 INFO:teuthology.orchestra.run.smithi005.stdout: "max_completed_events": { 2024-09-11T23:36:16.382 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_completed_events", 2024-09-11T23:36:16.382 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:16.382 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.382 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.383 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "50", 2024-09-11T23:36:16.383 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.383 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.383 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.383 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "number of past completed events to remember", 2024-09-11T23:36:16.383 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.383 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.383 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.383 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.384 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2024-09-11T23:36:16.384 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2024-09-11T23:36:16.384 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:16.384 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.385 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.385 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2024-09-11T23:36:16.385 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.385 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.385 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.385 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long the module is going to sleep", 2024-09-11T23:36:16.385 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.386 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.386 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.386 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.386 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.386 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.386 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:16.386 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prometheus", 2024-09-11T23:36:16.387 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:16.387 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:16.387 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:16.387 INFO:teuthology.orchestra.run.smithi005.stdout: "cache": { 2024-09-11T23:36:16.387 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cache", 2024-09-11T23:36:16.387 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.387 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.388 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.388 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:16.388 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.388 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.388 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.388 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.388 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.389 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.389 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.389 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.389 INFO:teuthology.orchestra.run.smithi005.stdout: "exclude_perf_counters": { 2024-09-11T23:36:16.389 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "exclude_perf_counters", 2024-09-11T23:36:16.389 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.389 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.390 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.390 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:16.390 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.390 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.390 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.390 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-11T23:36:16.391 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-11T23:36:16.391 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.391 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.391 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.391 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:16.391 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:16.391 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.392 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.392 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.392 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.392 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.392 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.392 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.393 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.393 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.393 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.393 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.393 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.393 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.393 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.394 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.394 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.394 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.394 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.394 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.394 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:16.394 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:16.395 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.395 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.395 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.395 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.395 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.395 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.395 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.396 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.396 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.396 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.396 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.396 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.396 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:16.396 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:16.397 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.397 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.397 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.397 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:16.397 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.397 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.397 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.398 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.398 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.398 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.398 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.398 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.398 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.398 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.399 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.399 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.399 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.399 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.399 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.400 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:16.400 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:16.400 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.400 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.400 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.400 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.401 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.401 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.401 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.401 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.401 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.401 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.401 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.402 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.402 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_stats_pools": { 2024-09-11T23:36:16.402 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_stats_pools", 2024-09-11T23:36:16.402 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.402 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.402 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.403 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.403 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.403 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.403 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.403 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.403 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.403 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.404 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.404 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.404 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-11T23:36:16.404 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-11T23:36:16.404 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:16.404 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.405 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.405 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "300", 2024-09-11T23:36:16.405 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.405 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.405 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.405 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.405 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.405 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.405 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.405 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.406 INFO:teuthology.orchestra.run.smithi005.stdout: "scrape_interval": { 2024-09-11T23:36:16.406 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "scrape_interval", 2024-09-11T23:36:16.406 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-09-11T23:36:16.406 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.406 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.406 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15.0", 2024-09-11T23:36:16.406 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.406 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.406 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.406 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.407 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.407 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.407 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.407 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.407 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2024-09-11T23:36:16.407 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2024-09-11T23:36:16.407 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.407 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.407 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.407 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "::", 2024-09-11T23:36:16.407 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.408 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.408 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.408 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-11T23:36:16.408 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.408 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.408 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.408 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.409 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2024-09-11T23:36:16.409 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2024-09-11T23:36:16.409 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:16.409 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.409 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.409 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "9283", 2024-09-11T23:36:16.409 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.409 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.409 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.410 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-11T23:36:16.410 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.410 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.410 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.410 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.410 INFO:teuthology.orchestra.run.smithi005.stdout: "stale_cache_strategy": { 2024-09-11T23:36:16.410 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "stale_cache_strategy", 2024-09-11T23:36:16.410 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.411 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.411 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.411 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "log", 2024-09-11T23:36:16.411 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.411 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.411 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.411 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.411 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.411 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.411 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.412 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.412 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_behaviour": { 2024-09-11T23:36:16.412 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_behaviour", 2024-09-11T23:36:16.412 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.412 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.412 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.412 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "default", 2024-09-11T23:36:16.413 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.413 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.413 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.413 INFO:teuthology.orchestra.run.smithi005.stdout: "default", 2024-09-11T23:36:16.413 INFO:teuthology.orchestra.run.smithi005.stdout: "error" 2024-09-11T23:36:16.413 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.413 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.413 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.413 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.413 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.414 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.414 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_error_status_code": { 2024-09-11T23:36:16.414 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_error_status_code", 2024-09-11T23:36:16.414 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:16.414 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.414 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.414 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "500", 2024-09-11T23:36:16.414 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "400", 2024-09-11T23:36:16.414 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "599", 2024-09-11T23:36:16.414 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.415 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.415 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.415 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.415 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.415 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.415 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.415 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.415 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:16.415 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_support", 2024-09-11T23:36:16.416 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:16.416 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:16.416 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:16.416 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:16.416 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:16.416 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.416 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.416 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.417 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.417 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.417 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.417 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.417 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.417 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.417 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.417 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.417 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.418 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.418 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.418 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.418 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.418 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.418 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.418 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.419 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:16.419 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:16.420 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.420 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.420 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.420 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.421 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.421 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.421 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.421 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.421 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.421 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.422 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.422 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.422 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:16.422 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:16.422 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.422 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.422 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.423 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:16.423 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.423 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.423 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.423 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.423 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.424 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.424 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.424 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.424 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.424 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.424 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.424 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.424 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.424 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.424 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.425 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:16.425 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:16.425 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.425 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.425 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.425 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.425 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.425 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.425 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.426 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.426 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.426 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.426 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.426 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.426 INFO:teuthology.orchestra.run.smithi005.stdout: "max_concurrent_snap_create": { 2024-09-11T23:36:16.426 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_concurrent_snap_create", 2024-09-11T23:36:16.426 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:16.426 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.426 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.427 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-09-11T23:36:16.427 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.427 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.427 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.427 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.427 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.427 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.427 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.427 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.427 INFO:teuthology.orchestra.run.smithi005.stdout: "mirror_snapshot_schedule": { 2024-09-11T23:36:16.428 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mirror_snapshot_schedule", 2024-09-11T23:36:16.428 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.428 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.428 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.428 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.428 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.428 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.428 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.428 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.429 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.429 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.429 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.429 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.429 INFO:teuthology.orchestra.run.smithi005.stdout: "trash_purge_schedule": { 2024-09-11T23:36:16.429 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "trash_purge_schedule", 2024-09-11T23:36:16.429 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.430 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.430 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.430 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.430 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.430 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.430 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.430 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.431 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.431 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.431 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.431 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.431 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.431 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.431 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:16.432 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "restful", 2024-09-11T23:36:16.432 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:16.432 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:16.432 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:16.432 INFO:teuthology.orchestra.run.smithi005.stdout: "enable_auth": { 2024-09-11T23:36:16.432 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enable_auth", 2024-09-11T23:36:16.432 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.433 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.433 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.433 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:16.433 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.433 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.433 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.433 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.434 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.434 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.434 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.434 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.434 INFO:teuthology.orchestra.run.smithi005.stdout: "key_file": { 2024-09-11T23:36:16.435 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "key_file", 2024-09-11T23:36:16.435 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.435 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.435 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.435 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.435 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.435 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.435 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.435 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.436 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.436 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.436 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.436 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.436 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:16.436 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:16.436 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.436 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.436 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.436 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.437 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.437 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.437 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.437 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.437 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.437 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.437 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.437 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.437 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.437 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.438 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.438 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.438 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.438 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.438 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.438 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:16.438 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:16.438 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.438 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.438 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.439 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.439 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.439 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.439 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.439 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.439 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.439 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.439 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.439 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.439 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:16.440 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:16.440 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.440 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.440 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.440 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:16.440 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.440 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.440 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.440 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.441 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.441 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.441 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.441 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.441 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.441 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.441 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.441 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.441 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.441 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.442 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.442 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:16.442 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:16.442 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.442 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.442 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.442 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.442 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.444 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.444 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.445 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.445 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.445 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.445 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.445 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.445 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2024-09-11T23:36:16.445 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2024-09-11T23:36:16.445 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.445 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.445 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.445 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.446 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.446 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.446 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.446 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.446 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.446 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.446 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.446 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.446 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2024-09-11T23:36:16.446 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2024-09-11T23:36:16.446 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.447 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.447 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.447 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.447 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.447 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.447 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.447 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.447 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.447 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.447 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.447 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.448 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.448 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.448 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:16.448 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rgw", 2024-09-11T23:36:16.448 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:16.448 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:16.448 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:16.448 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:16.448 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:16.448 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.448 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.449 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.449 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.449 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.449 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.449 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.449 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.449 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.449 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.449 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.449 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.449 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.450 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.450 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.450 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.450 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.450 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.450 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.450 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:16.450 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:16.450 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.451 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.451 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.451 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.451 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.451 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.451 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.451 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.451 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.451 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.451 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.451 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.451 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:16.452 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:16.452 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.452 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.452 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.452 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:16.452 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.452 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.452 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.452 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.452 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.452 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.453 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.453 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.453 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.453 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.453 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.453 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.453 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.453 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.454 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.454 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:16.454 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:16.454 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.454 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.454 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.454 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.454 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.454 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.455 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.455 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.455 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.455 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.455 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.455 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.455 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.455 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.455 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:16.455 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rook", 2024-09-11T23:36:16.455 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:16.456 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:16.456 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:16.456 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:16.456 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:16.456 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.456 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.456 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.456 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.456 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.456 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.456 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.457 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.457 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.457 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.457 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.457 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.457 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.457 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.457 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.457 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.457 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.457 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.458 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.458 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:16.458 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:16.458 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.458 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.458 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.458 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.458 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.458 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.458 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.458 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.459 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.459 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.459 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.459 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.459 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:16.459 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:16.459 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.459 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.459 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.459 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:16.459 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.460 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.460 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.460 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.460 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.460 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.460 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.460 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.460 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.460 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.460 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.460 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.460 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.460 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.461 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.461 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:16.461 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:16.461 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.461 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.461 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.461 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.461 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.461 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.461 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.461 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.461 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.462 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.462 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.462 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.462 INFO:teuthology.orchestra.run.smithi005.stdout: "storage_class": { 2024-09-11T23:36:16.462 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "storage_class", 2024-09-11T23:36:16.462 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.462 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.462 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.462 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "local", 2024-09-11T23:36:16.462 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.462 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.462 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.462 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-11T23:36:16.462 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.463 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.463 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.463 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.463 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.463 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.463 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:16.463 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "selftest", 2024-09-11T23:36:16.463 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:16.463 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:16.463 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:16.463 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:16.463 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:16.463 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.464 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.464 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.464 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.464 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.464 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.464 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.464 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.464 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.464 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.464 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.464 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.464 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.465 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.465 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.465 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.465 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.465 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.465 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.465 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:16.465 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:16.466 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.466 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.466 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.466 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.466 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.466 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.466 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.467 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.467 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.467 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.467 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.467 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.467 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:16.467 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:16.468 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.468 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.468 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.468 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:16.468 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.468 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.468 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.469 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.469 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.469 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.469 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.469 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.469 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.469 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.470 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.470 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.470 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.470 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.470 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.470 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:16.470 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:16.471 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.471 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.471 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.471 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.471 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.471 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.471 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.472 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.472 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.472 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.472 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.472 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.473 INFO:teuthology.orchestra.run.smithi005.stdout: "roption1": { 2024-09-11T23:36:16.473 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "roption1", 2024-09-11T23:36:16.473 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.473 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.473 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.473 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.473 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.474 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.474 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.474 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.474 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.474 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.474 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.475 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.475 INFO:teuthology.orchestra.run.smithi005.stdout: "roption2": { 2024-09-11T23:36:16.475 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "roption2", 2024-09-11T23:36:16.475 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.475 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.475 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.476 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "xyz", 2024-09-11T23:36:16.476 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.476 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.476 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.476 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.476 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.476 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.477 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.477 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.477 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption1": { 2024-09-11T23:36:16.477 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption1", 2024-09-11T23:36:16.477 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.477 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.478 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.478 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.478 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.478 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.478 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.478 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.478 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.479 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.479 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.479 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.479 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption2": { 2024-09-11T23:36:16.479 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption2", 2024-09-11T23:36:16.479 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:16.479 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.480 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.480 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.480 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.480 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.480 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.480 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.481 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.481 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.481 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.481 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.481 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption3": { 2024-09-11T23:36:16.481 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption3", 2024-09-11T23:36:16.482 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-09-11T23:36:16.482 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.482 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.482 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.482 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.482 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.483 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.483 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.483 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.483 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.483 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.483 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.483 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption4": { 2024-09-11T23:36:16.484 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption4", 2024-09-11T23:36:16.484 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.484 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.484 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.484 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.484 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.485 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.485 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.485 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.485 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.485 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.485 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.486 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.486 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption5": { 2024-09-11T23:36:16.486 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption5", 2024-09-11T23:36:16.486 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.486 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.486 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.486 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.487 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.487 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.487 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.487 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.487 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.487 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.487 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.488 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.488 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption6": { 2024-09-11T23:36:16.488 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption6", 2024-09-11T23:36:16.488 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.488 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.488 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.489 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:16.489 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.489 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.489 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.489 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.489 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.489 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.490 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.490 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.490 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption7": { 2024-09-11T23:36:16.490 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption7", 2024-09-11T23:36:16.490 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:16.490 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.491 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.491 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.491 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2024-09-11T23:36:16.491 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "42", 2024-09-11T23:36:16.491 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.491 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.491 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.492 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.492 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.492 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.492 INFO:teuthology.orchestra.run.smithi005.stdout: "testkey": { 2024-09-11T23:36:16.492 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testkey", 2024-09-11T23:36:16.492 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.492 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.493 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.493 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.493 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.493 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.493 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.493 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.493 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.494 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.494 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.494 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.494 INFO:teuthology.orchestra.run.smithi005.stdout: "testlkey": { 2024-09-11T23:36:16.494 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testlkey", 2024-09-11T23:36:16.494 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.494 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.495 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.495 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.495 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.495 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.495 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.495 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.495 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.495 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.495 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.496 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.496 INFO:teuthology.orchestra.run.smithi005.stdout: "testnewline": { 2024-09-11T23:36:16.496 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testnewline", 2024-09-11T23:36:16.496 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.496 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.496 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.496 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.496 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.497 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.497 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.497 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.497 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.497 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.497 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.497 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.497 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.497 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.498 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:16.498 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "snap_schedule", 2024-09-11T23:36:16.498 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:16.498 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:16.498 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:16.498 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_m_granularity": { 2024-09-11T23:36:16.498 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_m_granularity", 2024-09-11T23:36:16.498 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.498 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.498 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.499 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.499 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.499 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.499 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.499 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow minute scheduled snapshots", 2024-09-11T23:36:16.499 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.499 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.499 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.499 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.499 INFO:teuthology.orchestra.run.smithi005.stdout: "dump_on_update": { 2024-09-11T23:36:16.500 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "dump_on_update", 2024-09-11T23:36:16.500 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.500 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.500 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.500 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.500 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.500 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.500 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.500 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "dump database to debug log on update", 2024-09-11T23:36:16.500 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.501 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.501 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.501 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.501 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:16.501 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:16.501 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.501 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.501 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.501 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.501 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.502 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.502 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.502 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.502 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.502 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.502 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.502 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.502 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.502 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.502 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.502 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.503 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.503 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.503 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.503 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:16.503 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:16.503 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.503 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.504 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.504 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.504 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.504 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.504 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.504 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.505 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.505 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.505 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.505 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.505 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:16.505 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:16.505 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.506 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.506 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.506 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:16.506 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.506 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.506 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.506 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.507 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.507 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.507 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.507 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.507 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.507 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.507 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.507 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.507 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.507 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.508 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.508 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:16.508 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:16.508 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.508 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.508 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.508 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.508 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.508 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.509 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.509 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.509 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.509 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.509 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.509 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.509 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.509 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.509 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:16.509 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "stats", 2024-09-11T23:36:16.510 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:16.510 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:16.510 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:16.510 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:16.510 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:16.510 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.510 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.510 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.510 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.510 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.511 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.511 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.511 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.511 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.511 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.511 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.511 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.511 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.512 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.512 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.512 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.512 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.512 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.512 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.513 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:16.513 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:16.513 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.513 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.513 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.513 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.513 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.514 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.514 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.514 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.514 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.514 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.514 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.514 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.515 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:16.515 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:16.515 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.515 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.515 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.515 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:16.515 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.516 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.516 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.516 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.516 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.516 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.516 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.517 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.517 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.517 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.517 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.517 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.517 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.517 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.517 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.518 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:16.518 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:16.518 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.518 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.518 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.518 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.518 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.519 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.519 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.519 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.519 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.519 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.520 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.520 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.520 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.520 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.520 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:16.521 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "status", 2024-09-11T23:36:16.521 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:16.521 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:16.521 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:16.521 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:16.521 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:16.521 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.522 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.522 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.522 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.522 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.522 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.522 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.522 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.523 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.523 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.523 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.523 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.523 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.523 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.524 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.524 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.524 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.524 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.524 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.524 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:16.524 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:16.525 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.525 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.525 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.525 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.525 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.525 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.525 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.526 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.526 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.526 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.526 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.526 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.526 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:16.527 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:16.527 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.527 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.527 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.527 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:16.527 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.528 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.528 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.528 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.528 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.528 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.528 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.528 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.529 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.529 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.529 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.529 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.529 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.529 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.529 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.530 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:16.530 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:16.530 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.530 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.530 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.530 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.530 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.531 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.531 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.531 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.531 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.531 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.531 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.532 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.532 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.532 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.532 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:16.532 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "telegraf", 2024-09-11T23:36:16.532 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:16.533 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:16.533 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:16.533 INFO:teuthology.orchestra.run.smithi005.stdout: "address": { 2024-09-11T23:36:16.533 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "address", 2024-09-11T23:36:16.533 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.533 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.533 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.534 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-11T23:36:16.534 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.534 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.534 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.534 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.534 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.535 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.535 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.535 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.535 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2024-09-11T23:36:16.535 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2024-09-11T23:36:16.536 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:16.536 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.536 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.536 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15", 2024-09-11T23:36:16.536 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.536 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.536 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.537 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.537 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.537 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.537 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.537 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.537 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:16.538 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:16.538 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.538 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.538 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.538 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.538 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.538 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.539 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.539 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.539 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.539 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.539 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.539 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.539 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.540 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.540 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.540 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.540 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.540 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.540 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.540 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:16.541 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:16.541 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.541 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.541 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.541 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.541 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.542 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.542 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.542 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.542 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.542 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.542 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.543 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.543 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:16.543 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:16.543 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.543 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.543 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.543 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:16.544 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.544 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.544 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.544 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.544 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.544 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.544 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.544 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.544 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.545 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.545 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.545 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.545 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.545 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.545 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.545 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:16.545 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:16.545 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.545 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.546 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.546 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.546 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.546 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.546 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.546 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.546 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.546 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.546 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.546 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.547 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.547 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.547 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:16.547 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "telemetry", 2024-09-11T23:36:16.547 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:16.547 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:16.547 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:16.547 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_basic": { 2024-09-11T23:36:16.547 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_basic", 2024-09-11T23:36:16.548 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.548 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.548 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.548 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:16.548 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.548 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.548 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.548 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-11T23:36:16.548 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.548 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.549 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.549 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.549 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_crash": { 2024-09-11T23:36:16.549 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_crash", 2024-09-11T23:36:16.549 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.549 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.549 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.549 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:16.549 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.550 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.550 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.550 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-11T23:36:16.550 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.550 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.550 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.550 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.550 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_device": { 2024-09-11T23:36:16.551 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_device", 2024-09-11T23:36:16.551 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.551 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.551 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.551 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:16.551 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.551 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.552 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.552 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-11T23:36:16.552 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.552 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.552 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.552 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.552 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_ident": { 2024-09-11T23:36:16.553 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_ident", 2024-09-11T23:36:16.553 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.553 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.553 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.553 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.553 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.553 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.553 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.553 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-11T23:36:16.554 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.554 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.554 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.554 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.554 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_perf": { 2024-09-11T23:36:16.554 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_perf", 2024-09-11T23:36:16.554 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.554 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.554 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.555 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.555 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.555 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.555 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.555 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-11T23:36:16.555 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.555 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.555 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.556 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.556 INFO:teuthology.orchestra.run.smithi005.stdout: "contact": { 2024-09-11T23:36:16.556 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "contact", 2024-09-11T23:36:16.556 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.556 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.556 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.556 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.556 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.556 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.556 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.557 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.557 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.557 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.557 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.557 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.557 INFO:teuthology.orchestra.run.smithi005.stdout: "description": { 2024-09-11T23:36:16.557 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "description", 2024-09-11T23:36:16.557 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.557 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.557 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.557 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.558 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.558 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.558 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.558 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.558 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.558 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.558 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.558 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.558 INFO:teuthology.orchestra.run.smithi005.stdout: "device_url": { 2024-09-11T23:36:16.558 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_url", 2024-09-11T23:36:16.559 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.559 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.559 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.559 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-11T23:36:16.559 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.559 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.559 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.559 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.559 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.559 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.560 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.560 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.560 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": { 2024-09-11T23:36:16.560 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enabled", 2024-09-11T23:36:16.560 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.560 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.560 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.560 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.560 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.560 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.561 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.561 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.561 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.561 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.561 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.561 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.561 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2024-09-11T23:36:16.561 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2024-09-11T23:36:16.561 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:16.561 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.562 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.562 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "24", 2024-09-11T23:36:16.562 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "8", 2024-09-11T23:36:16.562 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.562 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.562 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.562 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.563 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.563 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.563 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.563 INFO:teuthology.orchestra.run.smithi005.stdout: "last_opt_revision": { 2024-09-11T23:36:16.563 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "last_opt_revision", 2024-09-11T23:36:16.563 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:16.563 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.564 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.564 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1", 2024-09-11T23:36:16.564 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.564 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.564 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.564 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.564 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.565 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.565 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.565 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.565 INFO:teuthology.orchestra.run.smithi005.stdout: "leaderboard": { 2024-09-11T23:36:16.565 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "leaderboard", 2024-09-11T23:36:16.565 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.565 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.566 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.566 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.566 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.566 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.566 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.566 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.566 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.566 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.567 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.567 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.567 INFO:teuthology.orchestra.run.smithi005.stdout: "leaderboard_description": { 2024-09-11T23:36:16.567 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "leaderboard_description", 2024-09-11T23:36:16.567 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.567 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.568 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.568 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.568 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.568 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.568 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.568 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.568 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.569 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.569 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.569 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.569 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:16.569 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:16.569 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.569 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.570 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.570 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.570 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.570 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.570 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.570 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.571 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.572 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.572 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.572 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.572 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.572 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.572 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.572 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.573 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.573 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.573 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.573 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:16.573 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:16.573 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.573 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.573 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.573 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.574 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.574 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.574 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.574 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.574 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.574 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.574 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.574 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.575 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:16.575 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:16.575 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.575 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.575 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.575 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:16.575 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.575 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.576 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.576 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.576 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.576 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.576 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.576 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.576 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.576 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.576 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.576 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.576 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.576 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.577 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.577 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:16.577 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:16.577 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.577 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.577 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.577 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.577 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.577 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.577 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.577 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.577 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.577 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.578 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.578 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.578 INFO:teuthology.orchestra.run.smithi005.stdout: "organization": { 2024-09-11T23:36:16.578 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "organization", 2024-09-11T23:36:16.578 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.578 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.578 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.578 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.578 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.578 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.578 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.579 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.579 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.579 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.579 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.579 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.579 INFO:teuthology.orchestra.run.smithi005.stdout: "proxy": { 2024-09-11T23:36:16.579 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "proxy", 2024-09-11T23:36:16.579 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.579 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.579 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.579 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.579 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.579 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.580 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.580 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.580 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.580 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.580 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.580 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.580 INFO:teuthology.orchestra.run.smithi005.stdout: "url": { 2024-09-11T23:36:16.580 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "url", 2024-09-11T23:36:16.580 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.580 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.580 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.580 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-11T23:36:16.581 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.581 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.581 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.581 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.581 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.581 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.581 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.582 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.582 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.582 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.582 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:16.582 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "test_orchestrator", 2024-09-11T23:36:16.582 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:16.582 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:16.583 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:16.583 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:16.583 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:16.583 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.583 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.583 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.583 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.584 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.584 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.584 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.584 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.584 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.584 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.584 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.585 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.585 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.585 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.585 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.585 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.585 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.586 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.586 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.586 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:16.586 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:16.586 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.586 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.586 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.587 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.587 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.587 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.587 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.587 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.587 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.587 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.588 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.588 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.588 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:16.588 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:16.588 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.588 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.589 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.589 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:16.589 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.589 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.589 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.589 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.589 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.590 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.590 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.590 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.590 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.590 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.590 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.591 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.591 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.591 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.591 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.591 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:16.591 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:16.591 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.592 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.592 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.592 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.592 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.592 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.592 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.592 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.593 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.593 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.593 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.593 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.593 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.593 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.594 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:16.594 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "volumes", 2024-09-11T23:36:16.594 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:16.594 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:16.594 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:16.594 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:16.594 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:16.595 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.595 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.595 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.595 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.595 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.595 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.595 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.596 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.596 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.596 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.596 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.596 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.596 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.597 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.597 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.597 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.597 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.597 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.597 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.597 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:16.598 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:16.598 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.598 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.598 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.598 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.598 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.598 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.599 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.599 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.599 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.599 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.599 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.599 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.599 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:16.600 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:16.600 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.600 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.600 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.600 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:16.600 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.601 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.601 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.601 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.601 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.601 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.601 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.601 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.602 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.602 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.602 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.602 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.602 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.602 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.602 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.603 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:16.603 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:16.603 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.603 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.603 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.603 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.604 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.604 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.604 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.604 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.604 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.604 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.604 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.604 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.604 INFO:teuthology.orchestra.run.smithi005.stdout: "max_concurrent_clones": { 2024-09-11T23:36:16.605 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_concurrent_clones", 2024-09-11T23:36:16.605 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:16.605 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.605 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.605 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "4", 2024-09-11T23:36:16.605 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.605 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.605 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.605 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-11T23:36:16.605 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.606 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.606 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.606 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.606 INFO:teuthology.orchestra.run.smithi005.stdout: "periodic_async_work": { 2024-09-11T23:36:16.606 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "periodic_async_work", 2024-09-11T23:36:16.606 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.606 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.606 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.606 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.607 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.607 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.607 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.607 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Periodically check for async work", 2024-09-11T23:36:16.607 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.607 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.607 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.607 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.607 INFO:teuthology.orchestra.run.smithi005.stdout: "snapshot_clone_delay": { 2024-09-11T23:36:16.607 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "snapshot_clone_delay", 2024-09-11T23:36:16.608 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:16.608 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.608 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.608 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-11T23:36:16.608 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.608 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.608 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.608 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-11T23:36:16.608 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.608 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.609 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.609 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.609 INFO:teuthology.orchestra.run.smithi005.stdout: "snapshot_clone_no_wait": { 2024-09-11T23:36:16.609 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "snapshot_clone_no_wait", 2024-09-11T23:36:16.609 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.609 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.609 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.609 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-11T23:36:16.609 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.610 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.610 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.610 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-11T23:36:16.610 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.610 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.610 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.610 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.610 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.610 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.610 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:16.611 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix", 2024-09-11T23:36:16.611 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-11T23:36:16.611 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-11T23:36:16.611 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-11T23:36:16.611 INFO:teuthology.orchestra.run.smithi005.stdout: "discovery_interval": { 2024-09-11T23:36:16.611 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "discovery_interval", 2024-09-11T23:36:16.612 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2024-09-11T23:36:16.612 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.612 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.612 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "100", 2024-09-11T23:36:16.612 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.612 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.613 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.613 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.613 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.613 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.613 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.613 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.613 INFO:teuthology.orchestra.run.smithi005.stdout: "identifier": { 2024-09-11T23:36:16.614 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "identifier", 2024-09-11T23:36:16.614 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.614 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.614 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.614 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.614 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.615 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.615 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.615 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.615 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.615 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.615 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.615 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.616 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2024-09-11T23:36:16.616 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2024-09-11T23:36:16.616 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-11T23:36:16.616 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.616 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.616 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2024-09-11T23:36:16.616 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.616 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.616 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.617 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.617 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.617 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.617 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.617 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.617 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-11T23:36:16.617 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-11T23:36:16.617 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.617 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.618 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.618 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.618 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.618 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.618 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.618 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.618 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.618 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.619 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.619 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.619 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.619 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.619 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.619 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.619 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.619 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.620 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.620 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-11T23:36:16.620 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-11T23:36:16.620 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.620 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.620 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.620 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.621 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.621 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.621 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.621 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.621 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.621 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.622 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.622 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.622 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-11T23:36:16.622 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-11T23:36:16.622 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.622 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.623 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.623 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-11T23:36:16.623 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.623 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.623 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-11T23:36:16.623 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-11T23:36:16.623 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-11T23:36:16.624 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-11T23:36:16.624 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-11T23:36:16.624 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-11T23:36:16.624 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-11T23:36:16.624 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.624 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.624 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.624 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.625 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.625 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.625 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-11T23:36:16.625 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-11T23:36:16.625 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-11T23:36:16.625 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.625 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-11T23:36:16.625 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-11T23:36:16.625 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.625 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.626 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.626 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.626 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.626 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.626 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.626 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.626 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_host": { 2024-09-11T23:36:16.626 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_host", 2024-09-11T23:36:16.626 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.626 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.626 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.627 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-11T23:36:16.627 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.627 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.627 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.627 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.627 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.627 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.627 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.628 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.628 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_port": { 2024-09-11T23:36:16.628 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_port", 2024-09-11T23:36:16.628 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-11T23:36:16.628 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.628 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.628 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10051", 2024-09-11T23:36:16.629 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.629 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.629 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.629 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.629 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.629 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.629 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.630 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.630 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_sender": { 2024-09-11T23:36:16.630 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_sender", 2024-09-11T23:36:16.630 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-11T23:36:16.630 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-11T23:36:16.630 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-11T23:36:16.630 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-11T23:36:16.631 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-11T23:36:16.631 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-11T23:36:16.631 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-11T23:36:16.631 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-11T23:36:16.631 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-11T23:36:16.631 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-11T23:36:16.631 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-11T23:36:16.632 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.632 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.632 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.632 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.632 INFO:teuthology.orchestra.run.smithi005.stdout: "services": { 2024-09-11T23:36:16.632 INFO:teuthology.orchestra.run.smithi005.stdout: "dashboard": "https://172.21.15.5:8443/" 2024-09-11T23:36:16.632 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.633 INFO:teuthology.orchestra.run.smithi005.stdout: "always_on_modules": { 2024-09-11T23:36:16.633 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus": [ 2024-09-11T23:36:16.633 INFO:teuthology.orchestra.run.smithi005.stdout: "balancer", 2024-09-11T23:36:16.633 INFO:teuthology.orchestra.run.smithi005.stdout: "crash", 2024-09-11T23:36:16.633 INFO:teuthology.orchestra.run.smithi005.stdout: "devicehealth", 2024-09-11T23:36:16.633 INFO:teuthology.orchestra.run.smithi005.stdout: "orchestrator", 2024-09-11T23:36:16.633 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_autoscaler", 2024-09-11T23:36:16.634 INFO:teuthology.orchestra.run.smithi005.stdout: "progress", 2024-09-11T23:36:16.634 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_support", 2024-09-11T23:36:16.634 INFO:teuthology.orchestra.run.smithi005.stdout: "status", 2024-09-11T23:36:16.634 INFO:teuthology.orchestra.run.smithi005.stdout: "telemetry", 2024-09-11T23:36:16.634 INFO:teuthology.orchestra.run.smithi005.stdout: "volumes" 2024-09-11T23:36:16.634 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.634 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific": [ 2024-09-11T23:36:16.635 INFO:teuthology.orchestra.run.smithi005.stdout: "balancer", 2024-09-11T23:36:16.635 INFO:teuthology.orchestra.run.smithi005.stdout: "crash", 2024-09-11T23:36:16.635 INFO:teuthology.orchestra.run.smithi005.stdout: "devicehealth", 2024-09-11T23:36:16.635 INFO:teuthology.orchestra.run.smithi005.stdout: "orchestrator", 2024-09-11T23:36:16.635 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_autoscaler", 2024-09-11T23:36:16.635 INFO:teuthology.orchestra.run.smithi005.stdout: "progress", 2024-09-11T23:36:16.636 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_support", 2024-09-11T23:36:16.636 INFO:teuthology.orchestra.run.smithi005.stdout: "status", 2024-09-11T23:36:16.636 INFO:teuthology.orchestra.run.smithi005.stdout: "telemetry", 2024-09-11T23:36:16.636 INFO:teuthology.orchestra.run.smithi005.stdout: "volumes" 2024-09-11T23:36:16.636 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.636 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy": [ 2024-09-11T23:36:16.636 INFO:teuthology.orchestra.run.smithi005.stdout: "balancer", 2024-09-11T23:36:16.637 INFO:teuthology.orchestra.run.smithi005.stdout: "crash", 2024-09-11T23:36:16.637 INFO:teuthology.orchestra.run.smithi005.stdout: "devicehealth", 2024-09-11T23:36:16.637 INFO:teuthology.orchestra.run.smithi005.stdout: "orchestrator", 2024-09-11T23:36:16.637 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_autoscaler", 2024-09-11T23:36:16.637 INFO:teuthology.orchestra.run.smithi005.stdout: "progress", 2024-09-11T23:36:16.637 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_support", 2024-09-11T23:36:16.637 INFO:teuthology.orchestra.run.smithi005.stdout: "status", 2024-09-11T23:36:16.638 INFO:teuthology.orchestra.run.smithi005.stdout: "telemetry", 2024-09-11T23:36:16.638 INFO:teuthology.orchestra.run.smithi005.stdout: "volumes" 2024-09-11T23:36:16.638 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.638 INFO:teuthology.orchestra.run.smithi005.stdout: "reef": [ 2024-09-11T23:36:16.638 INFO:teuthology.orchestra.run.smithi005.stdout: "balancer", 2024-09-11T23:36:16.638 INFO:teuthology.orchestra.run.smithi005.stdout: "crash", 2024-09-11T23:36:16.638 INFO:teuthology.orchestra.run.smithi005.stdout: "devicehealth", 2024-09-11T23:36:16.639 INFO:teuthology.orchestra.run.smithi005.stdout: "orchestrator", 2024-09-11T23:36:16.639 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_autoscaler", 2024-09-11T23:36:16.639 INFO:teuthology.orchestra.run.smithi005.stdout: "progress", 2024-09-11T23:36:16.639 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_support", 2024-09-11T23:36:16.639 INFO:teuthology.orchestra.run.smithi005.stdout: "status", 2024-09-11T23:36:16.639 INFO:teuthology.orchestra.run.smithi005.stdout: "telemetry", 2024-09-11T23:36:16.639 INFO:teuthology.orchestra.run.smithi005.stdout: "volumes" 2024-09-11T23:36:16.640 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-11T23:36:16.640 INFO:teuthology.orchestra.run.smithi005.stdout: "squid": [ 2024-09-11T23:36:16.640 INFO:teuthology.orchestra.run.smithi005.stdout: "balancer", 2024-09-11T23:36:16.640 INFO:teuthology.orchestra.run.smithi005.stdout: "crash", 2024-09-11T23:36:16.640 INFO:teuthology.orchestra.run.smithi005.stdout: "devicehealth", 2024-09-11T23:36:16.640 INFO:teuthology.orchestra.run.smithi005.stdout: "orchestrator", 2024-09-11T23:36:16.641 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_autoscaler", 2024-09-11T23:36:16.641 INFO:teuthology.orchestra.run.smithi005.stdout: "progress", 2024-09-11T23:36:16.641 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_support", 2024-09-11T23:36:16.641 INFO:teuthology.orchestra.run.smithi005.stdout: "status", 2024-09-11T23:36:16.641 INFO:teuthology.orchestra.run.smithi005.stdout: "telemetry", 2024-09-11T23:36:16.641 INFO:teuthology.orchestra.run.smithi005.stdout: "volumes" 2024-09-11T23:36:16.641 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-11T23:36:16.642 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.642 INFO:teuthology.orchestra.run.smithi005.stdout: "last_failure_osd_epoch": 3, 2024-09-11T23:36:16.642 INFO:teuthology.orchestra.run.smithi005.stdout: "active_clients": [ 2024-09-11T23:36:16.642 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:16.642 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "devicehealth", 2024-09-11T23:36:16.642 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-11T23:36:16.642 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:16.642 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-11T23:36:16.643 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:0", 2024-09-11T23:36:16.643 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 4216758797 2024-09-11T23:36:16.643 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.643 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-11T23:36:16.643 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.643 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:16.644 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "libcephsqlite", 2024-09-11T23:36:16.644 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-11T23:36:16.644 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:16.644 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-11T23:36:16.644 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:0", 2024-09-11T23:36:16.644 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 778150446 2024-09-11T23:36:16.644 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.645 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-11T23:36:16.645 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.645 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:16.645 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_support", 2024-09-11T23:36:16.645 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-11T23:36:16.645 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:16.645 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-11T23:36:16.646 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:0", 2024-09-11T23:36:16.646 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3011211624 2024-09-11T23:36:16.646 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.646 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-11T23:36:16.646 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:16.646 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:16.648 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "volumes", 2024-09-11T23:36:16.649 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-11T23:36:16.649 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-11T23:36:16.649 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-11T23:36:16.649 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:0", 2024-09-11T23:36:16.649 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2120208310 2024-09-11T23:36:16.649 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.649 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-11T23:36:16.650 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:16.650 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-11T23:36:16.650 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-11T23:36:16.652 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:15 smithi172 ceph-mon[34855]: pgmap v570: 129 pgs: 129 active+clean; 205 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 1.1 MiB/s wr, 318 op/s 2024-09-11T23:36:16.652 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:15 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/2315535785' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-11T23:36:16.652 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:15 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/2757297838' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-11T23:36:16.652 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:15 smithi159 ceph-mon[34394]: pgmap v570: 129 pgs: 129 active+clean; 205 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 1.1 MiB/s wr, 318 op/s 2024-09-11T23:36:16.652 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:15 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/2315535785' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-11T23:36:16.652 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:15 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/2757297838' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-11T23:36:16.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:15.092+0000 7f7ae63d8640 1 -- 172.21.15.5:0/2757297838 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f7ac80a2b90 msgr2=0x7f7ac80a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:16.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:15.092+0000 7f7ae63d8640 1 --2- 172.21.15.5:0/2757297838 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f7ac80a2b90 0x7f7ac80a5050 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0000c00 tx=0x7f7ad0032c40 comp rx=0 tx=0).stop 2024-09-11T23:36:16.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:15.092+0000 7f7ae63d8640 1 -- 172.21.15.5:0/2757297838 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ae01025c0 msgr2=0x7f7ae019f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:16.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:15.092+0000 7f7ae63d8640 1 --2- 172.21.15.5:0/2757297838 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ae01025c0 0x7f7ae019f0c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7ad800eb10 tx=0x7f7ad800c2d0 comp rx=0 tx=0).stop 2024-09-11T23:36:16.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:15.092+0000 7f7ae63d8640 1 -- 172.21.15.5:0/2757297838 shutdown_connections 2024-09-11T23:36:16.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:15.092+0000 7f7ae63d8640 1 --2- 172.21.15.5:0/2757297838 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f7ac80a2b90 0x7f7ac80a5050 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:16.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:15.092+0000 7f7ae63d8640 1 --2- 172.21.15.5:0/2757297838 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ae01025c0 0x7f7ae019f0c0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:16.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:15.092+0000 7f7ae63d8640 1 --2- 172.21.15.5:0/2757297838 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7ae0101c00 0x7f7ae019caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:16.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:15.092+0000 7f7ae63d8640 1 --2- 172.21.15.5:0/2757297838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ae0100a10 0x7f7ae0069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:16.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:15.092+0000 7f7ae63d8640 1 -- 172.21.15.5:0/2757297838 >> 172.21.15.5:0/2757297838 conn(0x7f7ae00fc170 msgr2=0x7f7ae0105060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:36:16.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:15.092+0000 7f7ae63d8640 1 -- 172.21.15.5:0/2757297838 shutdown_connections 2024-09-11T23:36:16.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:15.092+0000 7f7ae63d8640 1 -- 172.21.15.5:0/2757297838 wait complete. 2024-09-11T23:36:16.661 DEBUG:tasks.check_counter:Getting stats from a 2024-09-11T23:36:16.661 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-11T23:36:16.662 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:15 smithi005 ceph-mon[31201]: pgmap v570: 129 pgs: 129 active+clean; 205 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 1.1 MiB/s wr, 318 op/s 2024-09-11T23:36:16.662 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:15 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/2315535785' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-11T23:36:16.662 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:15 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/2757297838' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-11T23:36:16.930 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:36:17.533 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-11T23:36:17.533 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T23:36:17.533 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 163, 2024-09-11T23:36:17.533 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 160, 2024-09-11T23:36:17.533 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 462272, 2024-09-11T23:36:17.533 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 97488, 2024-09-11T23:36:17.533 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 4, 2024-09-11T23:36:17.534 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 0, 2024-09-11T23:36:17.534 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.022510358, 2024-09-11T23:36:17.534 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.010396431, 2024-09-11T23:36:17.534 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.013880917, 2024-09-11T23:36:17.534 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T23:36:17.534 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:36:17.534 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 159, 2024-09-11T23:36:17.534 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.006912719, 2024-09-11T23:36:17.534 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000043476 2024-09-11T23:36:17.534 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:17.534 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:36:17.535 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-09-11T23:36:17.535 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-09-11T23:36:17.535 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-09-11T23:36:17.535 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:17.535 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 462272, 2024-09-11T23:36:17.535 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 97488 2024-09-11T23:36:17.535 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:17.535 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T23:36:17.535 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 1, 2024-09-11T23:36:17.535 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 121, 2024-09-11T23:36:17.535 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 160, 2024-09-11T23:36:17.535 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 99728, 2024-09-11T23:36:17.536 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 3, 2024-09-11T23:36:17.536 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 2, 2024-09-11T23:36:17.536 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.009012508, 2024-09-11T23:36:17.536 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.006827208, 2024-09-11T23:36:17.536 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.001119722, 2024-09-11T23:36:17.536 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T23:36:17.536 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:36:17.536 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 119, 2024-09-11T23:36:17.536 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.004158941, 2024-09-11T23:36:17.536 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000034949 2024-09-11T23:36:17.537 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:17.537 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:36:17.537 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-09-11T23:36:17.537 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-09-11T23:36:17.537 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-09-11T23:36:17.537 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:17.537 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-11T23:36:17.537 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 99728 2024-09-11T23:36:17.537 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:17.537 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T23:36:17.538 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 4, 2024-09-11T23:36:17.538 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 4, 2024-09-11T23:36:17.538 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 2944, 2024-09-11T23:36:17.538 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 448, 2024-09-11T23:36:17.538 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 2, 2024-09-11T23:36:17.538 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 1, 2024-09-11T23:36:17.538 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.002473017, 2024-09-11T23:36:17.538 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.000047964, 2024-09-11T23:36:17.538 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.002418032, 2024-09-11T23:36:17.538 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T23:36:17.539 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:36:17.539 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 3, 2024-09-11T23:36:17.539 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.004304354, 2024-09-11T23:36:17.539 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.001434784 2024-09-11T23:36:17.539 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:17.539 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:36:17.539 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-09-11T23:36:17.539 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-09-11T23:36:17.539 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-09-11T23:36:17.539 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:17.539 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-11T23:36:17.540 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 448 2024-09-11T23:36:17.540 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:17.540 INFO:teuthology.orchestra.run.smithi005.stdout: "cct": { 2024-09-11T23:36:17.540 INFO:teuthology.orchestra.run.smithi005.stdout: "total_workers": 0, 2024-09-11T23:36:17.540 INFO:teuthology.orchestra.run.smithi005.stdout: "unhealthy_workers": 0 2024-09-11T23:36:17.540 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:17.540 INFO:teuthology.orchestra.run.smithi005.stdout: "mempool": { 2024-09-11T23:36:17.540 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_bytes": 0, 2024-09-11T23:36:17.540 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_items": 0, 2024-09-11T23:36:17.540 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T23:36:17.540 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_items": 0, 2024-09-11T23:36:17.541 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T23:36:17.541 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_items": 0, 2024-09-11T23:36:17.541 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T23:36:17.541 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T23:36:17.541 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T23:36:17.541 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T23:36:17.541 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T23:36:17.541 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_items": 0, 2024-09-11T23:36:17.541 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T23:36:17.541 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T23:36:17.541 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_bytes": 0, 2024-09-11T23:36:17.542 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_items": 0, 2024-09-11T23:36:17.542 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_bytes": 0, 2024-09-11T23:36:17.542 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_items": 0, 2024-09-11T23:36:17.542 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T23:36:17.542 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T23:36:17.542 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T23:36:17.542 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T23:36:17.542 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T23:36:17.542 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_items": 0, 2024-09-11T23:36:17.542 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_bytes": 0, 2024-09-11T23:36:17.542 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_items": 0, 2024-09-11T23:36:17.542 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T23:36:17.542 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T23:36:17.543 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_bytes": 0, 2024-09-11T23:36:17.543 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_items": 0, 2024-09-11T23:36:17.543 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_bytes": 0, 2024-09-11T23:36:17.543 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_items": 0, 2024-09-11T23:36:17.543 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T23:36:17.543 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_items": 0, 2024-09-11T23:36:17.543 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T23:36:17.543 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_items": 0, 2024-09-11T23:36:17.543 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_bytes": 148984, 2024-09-11T23:36:17.543 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_items": 30, 2024-09-11T23:36:17.543 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_bytes": 0, 2024-09-11T23:36:17.544 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_items": 0, 2024-09-11T23:36:17.544 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_bytes": 0, 2024-09-11T23:36:17.544 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_items": 0, 2024-09-11T23:36:17.544 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_bytes": 0, 2024-09-11T23:36:17.544 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_items": 0, 2024-09-11T23:36:17.544 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_bytes": 0, 2024-09-11T23:36:17.544 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_items": 0, 2024-09-11T23:36:17.544 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_bytes": 0, 2024-09-11T23:36:17.544 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_items": 0, 2024-09-11T23:36:17.544 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T23:36:17.544 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_items": 0, 2024-09-11T23:36:17.544 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_bytes": 0, 2024-09-11T23:36:17.545 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_items": 0, 2024-09-11T23:36:17.545 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_bytes": 928, 2024-09-11T23:36:17.545 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_items": 2, 2024-09-11T23:36:17.545 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_bytes": 0, 2024-09-11T23:36:17.545 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_items": 0, 2024-09-11T23:36:17.545 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_bytes": 0, 2024-09-11T23:36:17.545 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_items": 0 2024-09-11T23:36:17.545 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:17.545 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T23:36:17.545 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-09-11T23:36:17.545 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 104857600, 2024-09-11T23:36:17.545 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-09-11T23:36:17.546 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 164, 2024-09-11T23:36:17.546 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 439266, 2024-09-11T23:36:17.546 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-09-11T23:36:17.546 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 164, 2024-09-11T23:36:17.546 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2024-09-11T23:36:17.546 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2024-09-11T23:36:17.546 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 164, 2024-09-11T23:36:17.546 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 439266, 2024-09-11T23:36:17.546 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-09-11T23:36:17.546 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-09-11T23:36:17.546 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-09-11T23:36:17.546 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-09-11T23:36:17.547 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:17.547 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:17.547 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-11T23:36:17.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:17 smithi005 ceph-mon[31201]: pgmap v571: 129 pgs: 129 active+clean; 168 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 970 KiB/s rd, 976 KiB/s wr, 384 op/s 2024-09-11T23:36:17.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:17 smithi005 ceph-mon[31201]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T23:36:17.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:17 smithi159 ceph-mon[34394]: pgmap v571: 129 pgs: 129 active+clean; 168 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 970 KiB/s rd, 976 KiB/s wr, 384 op/s 2024-09-11T23:36:17.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:17 smithi159 ceph-mon[34394]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T23:36:17.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:17 smithi172 ceph-mon[34855]: pgmap v571: 129 pgs: 129 active+clean; 168 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 970 KiB/s rd, 976 KiB/s wr, 384 op/s 2024-09-11T23:36:17.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:17 smithi172 ceph-mon[34855]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T23:36:18.352 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-09-11T23:36:18.352 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-09-11T23:36:18.352 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.a 2024-09-11T23:36:18.352 DEBUG:tasks.check_counter:Getting stats from d 2024-09-11T23:36:18.353 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-11T23:36:18.613 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:36:19.453 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-11T23:36:19.453 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T23:36:19.453 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 168, 2024-09-11T23:36:19.454 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 165, 2024-09-11T23:36:19.454 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 463632, 2024-09-11T23:36:19.454 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 100688, 2024-09-11T23:36:19.454 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 4, 2024-09-11T23:36:19.454 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 0, 2024-09-11T23:36:19.454 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.022463270, 2024-09-11T23:36:19.454 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.009919607, 2024-09-11T23:36:19.454 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.014623295, 2024-09-11T23:36:19.454 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T23:36:19.454 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:36:19.454 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 164, 2024-09-11T23:36:19.455 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.007665173, 2024-09-11T23:36:19.455 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000046738 2024-09-11T23:36:19.455 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:19.455 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:36:19.455 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-09-11T23:36:19.455 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-09-11T23:36:19.455 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-09-11T23:36:19.455 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:19.455 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 463632, 2024-09-11T23:36:19.455 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 100688 2024-09-11T23:36:19.456 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:19.456 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T23:36:19.456 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 5, 2024-09-11T23:36:19.456 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 127, 2024-09-11T23:36:19.456 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 3104, 2024-09-11T23:36:19.456 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 100880, 2024-09-11T23:36:19.456 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 3, 2024-09-11T23:36:19.456 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 2, 2024-09-11T23:36:19.456 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.011380626, 2024-09-11T23:36:19.456 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.007243674, 2024-09-11T23:36:19.456 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.003080911, 2024-09-11T23:36:19.457 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T23:36:19.457 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:36:19.457 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 126, 2024-09-11T23:36:19.457 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.009081789, 2024-09-11T23:36:19.457 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000072077 2024-09-11T23:36:19.457 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:19.457 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:36:19.457 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-09-11T23:36:19.457 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-09-11T23:36:19.457 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-09-11T23:36:19.458 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:19.458 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-11T23:36:19.458 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 100880 2024-09-11T23:36:19.458 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:19.458 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T23:36:19.458 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 0, 2024-09-11T23:36:19.458 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 2, 2024-09-11T23:36:19.458 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 0, 2024-09-11T23:36:19.458 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 0, 2024-09-11T23:36:19.459 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 2, 2024-09-11T23:36:19.459 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 1, 2024-09-11T23:36:19.459 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.000252816, 2024-09-11T23:36:19.459 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.000000000, 2024-09-11T23:36:19.459 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.000180500, 2024-09-11T23:36:19.459 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T23:36:19.459 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:36:19.459 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-09-11T23:36:19.459 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-09-11T23:36:19.459 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-09-11T23:36:19.459 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:19.459 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:36:19.460 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-09-11T23:36:19.460 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-09-11T23:36:19.460 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-09-11T23:36:19.460 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:19.460 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T23:36:19.460 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T23:36:19.461 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:19.461 INFO:teuthology.orchestra.run.smithi005.stdout: "cct": { 2024-09-11T23:36:19.461 INFO:teuthology.orchestra.run.smithi005.stdout: "total_workers": 0, 2024-09-11T23:36:19.461 INFO:teuthology.orchestra.run.smithi005.stdout: "unhealthy_workers": 0 2024-09-11T23:36:19.461 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:19.461 INFO:teuthology.orchestra.run.smithi005.stdout: "mempool": { 2024-09-11T23:36:19.461 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_bytes": 0, 2024-09-11T23:36:19.461 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_items": 0, 2024-09-11T23:36:19.461 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T23:36:19.461 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_items": 0, 2024-09-11T23:36:19.461 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T23:36:19.461 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_items": 0, 2024-09-11T23:36:19.461 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T23:36:19.462 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T23:36:19.462 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T23:36:19.462 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T23:36:19.462 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T23:36:19.462 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_items": 0, 2024-09-11T23:36:19.462 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T23:36:19.462 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T23:36:19.462 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_bytes": 0, 2024-09-11T23:36:19.462 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_items": 0, 2024-09-11T23:36:19.462 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_bytes": 0, 2024-09-11T23:36:19.462 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_items": 0, 2024-09-11T23:36:19.462 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T23:36:19.463 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T23:36:19.463 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T23:36:19.463 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T23:36:19.463 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T23:36:19.463 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_items": 0, 2024-09-11T23:36:19.463 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_bytes": 0, 2024-09-11T23:36:19.463 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_items": 0, 2024-09-11T23:36:19.463 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T23:36:19.463 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T23:36:19.463 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_bytes": 0, 2024-09-11T23:36:19.463 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_items": 0, 2024-09-11T23:36:19.463 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_bytes": 0, 2024-09-11T23:36:19.463 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_items": 0, 2024-09-11T23:36:19.464 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T23:36:19.464 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_items": 0, 2024-09-11T23:36:19.464 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T23:36:19.464 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_items": 0, 2024-09-11T23:36:19.464 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_bytes": 148923, 2024-09-11T23:36:19.464 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_items": 29, 2024-09-11T23:36:19.464 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_bytes": 0, 2024-09-11T23:36:19.464 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_items": 0, 2024-09-11T23:36:19.465 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_bytes": 0, 2024-09-11T23:36:19.465 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_items": 0, 2024-09-11T23:36:19.465 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_bytes": 0, 2024-09-11T23:36:19.465 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_items": 0, 2024-09-11T23:36:19.465 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_bytes": 0, 2024-09-11T23:36:19.465 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_items": 0, 2024-09-11T23:36:19.465 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_bytes": 0, 2024-09-11T23:36:19.465 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_items": 0, 2024-09-11T23:36:19.465 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T23:36:19.465 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_items": 0, 2024-09-11T23:36:19.465 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_bytes": 0, 2024-09-11T23:36:19.465 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_items": 0, 2024-09-11T23:36:19.465 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_bytes": 928, 2024-09-11T23:36:19.466 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_items": 2, 2024-09-11T23:36:19.466 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_bytes": 0, 2024-09-11T23:36:19.466 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_items": 0, 2024-09-11T23:36:19.466 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_bytes": 0, 2024-09-11T23:36:19.466 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_items": 0 2024-09-11T23:36:19.466 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:19.466 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T23:36:19.466 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-09-11T23:36:19.466 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 104857600, 2024-09-11T23:36:19.466 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-09-11T23:36:19.466 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 169, 2024-09-11T23:36:19.466 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 439916, 2024-09-11T23:36:19.466 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-09-11T23:36:19.466 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 169, 2024-09-11T23:36:19.467 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2024-09-11T23:36:19.467 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2024-09-11T23:36:19.467 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 169, 2024-09-11T23:36:19.467 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 439916, 2024-09-11T23:36:19.467 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-09-11T23:36:19.467 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-09-11T23:36:19.467 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-09-11T23:36:19.467 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-09-11T23:36:19.467 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:19.467 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:19.467 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-11T23:36:19.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:19 smithi005 ceph-mon[31201]: pgmap v572: 129 pgs: 129 active+clean; 163 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 831 KiB/s rd, 833 KiB/s wr, 280 op/s 2024-09-11T23:36:19.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:19 smithi159 ceph-mon[34394]: pgmap v572: 129 pgs: 129 active+clean; 163 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 831 KiB/s rd, 833 KiB/s wr, 280 op/s 2024-09-11T23:36:19.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:19 smithi172 ceph-mon[34855]: pgmap v572: 129 pgs: 129 active+clean; 163 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 831 KiB/s rd, 833 KiB/s wr, 280 op/s 2024-09-11T23:36:20.117 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-11T23:36:20.117 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-11T23:36:20.118 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2024-09-11T23:36:20.118 DEBUG:tasks.check_counter:Getting stats from g 2024-09-11T23:36:20.118 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-11T23:36:20.376 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:36:20.883 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-11T23:36:20.884 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T23:36:20.884 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 165, 2024-09-11T23:36:20.884 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 162, 2024-09-11T23:36:20.884 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 462816, 2024-09-11T23:36:20.884 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 98768, 2024-09-11T23:36:20.884 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 4, 2024-09-11T23:36:20.884 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 0, 2024-09-11T23:36:20.884 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.022619060, 2024-09-11T23:36:20.884 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.009922974, 2024-09-11T23:36:20.884 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.015226463, 2024-09-11T23:36:20.885 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T23:36:20.885 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:36:20.885 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 161, 2024-09-11T23:36:20.885 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.007164951, 2024-09-11T23:36:20.885 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000044502 2024-09-11T23:36:20.885 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:20.885 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:36:20.885 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-09-11T23:36:20.885 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-09-11T23:36:20.885 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-09-11T23:36:20.885 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:20.885 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 462816, 2024-09-11T23:36:20.885 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 98768 2024-09-11T23:36:20.886 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:20.886 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T23:36:20.886 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 1, 2024-09-11T23:36:20.886 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 122, 2024-09-11T23:36:20.886 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 160, 2024-09-11T23:36:20.886 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 99904, 2024-09-11T23:36:20.886 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 3, 2024-09-11T23:36:20.886 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 2, 2024-09-11T23:36:20.886 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.009920933, 2024-09-11T23:36:20.886 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.007047321, 2024-09-11T23:36:20.886 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.001732196, 2024-09-11T23:36:20.886 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T23:36:20.886 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:36:20.887 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 120, 2024-09-11T23:36:20.887 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.004799845, 2024-09-11T23:36:20.887 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000039998 2024-09-11T23:36:20.887 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:20.887 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:36:20.887 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-09-11T23:36:20.887 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-09-11T23:36:20.887 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-09-11T23:36:20.887 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:20.887 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-11T23:36:20.887 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 99904 2024-09-11T23:36:20.887 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:20.887 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T23:36:20.888 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 4, 2024-09-11T23:36:20.888 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 4, 2024-09-11T23:36:20.888 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 2944, 2024-09-11T23:36:20.888 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 448, 2024-09-11T23:36:20.888 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 2, 2024-09-11T23:36:20.888 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 1, 2024-09-11T23:36:20.888 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.002396620, 2024-09-11T23:36:20.888 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.000032921, 2024-09-11T23:36:20.888 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.002361673, 2024-09-11T23:36:20.888 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T23:36:20.888 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:36:20.888 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 3, 2024-09-11T23:36:20.888 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.004306460, 2024-09-11T23:36:20.889 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.001435486 2024-09-11T23:36:20.889 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:20.889 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:36:20.889 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-09-11T23:36:20.889 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-09-11T23:36:20.889 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-09-11T23:36:20.889 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:20.889 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-11T23:36:20.889 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 448 2024-09-11T23:36:20.889 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:20.889 INFO:teuthology.orchestra.run.smithi005.stdout: "cct": { 2024-09-11T23:36:20.889 INFO:teuthology.orchestra.run.smithi005.stdout: "total_workers": 0, 2024-09-11T23:36:20.889 INFO:teuthology.orchestra.run.smithi005.stdout: "unhealthy_workers": 0 2024-09-11T23:36:20.890 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:20.890 INFO:teuthology.orchestra.run.smithi005.stdout: "mempool": { 2024-09-11T23:36:20.890 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_bytes": 0, 2024-09-11T23:36:20.890 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_items": 0, 2024-09-11T23:36:20.890 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T23:36:20.890 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_items": 0, 2024-09-11T23:36:20.890 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T23:36:20.890 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_items": 0, 2024-09-11T23:36:20.890 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T23:36:20.890 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T23:36:20.890 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T23:36:20.890 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T23:36:20.890 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T23:36:20.891 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_items": 0, 2024-09-11T23:36:20.891 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T23:36:20.891 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T23:36:20.891 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_bytes": 0, 2024-09-11T23:36:20.891 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_items": 0, 2024-09-11T23:36:20.891 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_bytes": 0, 2024-09-11T23:36:20.891 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_items": 0, 2024-09-11T23:36:20.891 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T23:36:20.891 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T23:36:20.891 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T23:36:20.891 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T23:36:20.891 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T23:36:20.892 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_items": 0, 2024-09-11T23:36:20.892 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_bytes": 0, 2024-09-11T23:36:20.892 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_items": 0, 2024-09-11T23:36:20.892 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T23:36:20.892 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T23:36:20.892 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_bytes": 0, 2024-09-11T23:36:20.892 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_items": 0, 2024-09-11T23:36:20.892 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_bytes": 0, 2024-09-11T23:36:20.892 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_items": 0, 2024-09-11T23:36:20.892 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T23:36:20.893 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_items": 0, 2024-09-11T23:36:20.893 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T23:36:20.893 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_items": 0, 2024-09-11T23:36:20.893 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_bytes": 148967, 2024-09-11T23:36:20.893 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_items": 29, 2024-09-11T23:36:20.893 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_bytes": 0, 2024-09-11T23:36:20.893 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_items": 0, 2024-09-11T23:36:20.893 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_bytes": 0, 2024-09-11T23:36:20.893 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_items": 0, 2024-09-11T23:36:20.893 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_bytes": 0, 2024-09-11T23:36:20.893 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_items": 0, 2024-09-11T23:36:20.893 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_bytes": 0, 2024-09-11T23:36:20.893 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_items": 0, 2024-09-11T23:36:20.893 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_bytes": 0, 2024-09-11T23:36:20.894 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_items": 0, 2024-09-11T23:36:20.894 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T23:36:20.894 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_items": 0, 2024-09-11T23:36:20.894 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_bytes": 0, 2024-09-11T23:36:20.894 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_items": 0, 2024-09-11T23:36:20.894 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_bytes": 928, 2024-09-11T23:36:20.894 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_items": 2, 2024-09-11T23:36:20.894 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_bytes": 0, 2024-09-11T23:36:20.894 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_items": 0, 2024-09-11T23:36:20.894 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_bytes": 0, 2024-09-11T23:36:20.894 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_items": 0 2024-09-11T23:36:20.894 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:20.894 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T23:36:20.895 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-09-11T23:36:20.895 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 104857600, 2024-09-11T23:36:20.895 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-09-11T23:36:20.895 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 166, 2024-09-11T23:36:20.895 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 439526, 2024-09-11T23:36:20.895 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-09-11T23:36:20.895 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 166, 2024-09-11T23:36:20.895 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2024-09-11T23:36:20.895 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2024-09-11T23:36:20.895 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 166, 2024-09-11T23:36:20.895 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 439526, 2024-09-11T23:36:20.895 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-09-11T23:36:20.895 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-09-11T23:36:20.895 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-09-11T23:36:20.896 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-09-11T23:36:20.896 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:20.896 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:20.896 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-11T23:36:21.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:21 smithi005 ceph-mon[31201]: pgmap v573: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 734 KiB/s rd, 748 KiB/s wr, 261 op/s 2024-09-11T23:36:21.637 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-11T23:36:21.638 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-11T23:36:21.638 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.g 2024-09-11T23:36:21.638 DEBUG:tasks.check_counter:Getting stats from j 2024-09-11T23:36:21.638 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-11T23:36:21.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:21 smithi159 ceph-mon[34394]: pgmap v573: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 734 KiB/s rd, 748 KiB/s wr, 261 op/s 2024-09-11T23:36:21.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:21 smithi172 ceph-mon[34855]: pgmap v573: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 734 KiB/s rd, 748 KiB/s wr, 261 op/s 2024-09-11T23:36:21.895 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:36:22.438 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-11T23:36:22.438 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T23:36:22.438 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 170, 2024-09-11T23:36:22.439 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 167, 2024-09-11T23:36:22.439 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 464176, 2024-09-11T23:36:22.439 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 101968, 2024-09-11T23:36:22.439 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 4, 2024-09-11T23:36:22.439 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 0, 2024-09-11T23:36:22.439 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.022762171, 2024-09-11T23:36:22.439 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.009433350, 2024-09-11T23:36:22.439 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.015631021, 2024-09-11T23:36:22.439 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T23:36:22.439 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:36:22.439 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 166, 2024-09-11T23:36:22.439 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.006323430, 2024-09-11T23:36:22.440 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000038092 2024-09-11T23:36:22.440 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:22.440 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:36:22.440 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-09-11T23:36:22.440 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-09-11T23:36:22.440 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-09-11T23:36:22.440 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:22.440 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 464176, 2024-09-11T23:36:22.440 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 101968 2024-09-11T23:36:22.440 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:22.440 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T23:36:22.440 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 1, 2024-09-11T23:36:22.441 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 126, 2024-09-11T23:36:22.441 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 160, 2024-09-11T23:36:22.441 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 100608, 2024-09-11T23:36:22.441 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 3, 2024-09-11T23:36:22.441 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 2, 2024-09-11T23:36:22.441 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.009105729, 2024-09-11T23:36:22.441 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.006365512, 2024-09-11T23:36:22.441 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.001690095, 2024-09-11T23:36:22.441 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T23:36:22.441 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:36:22.441 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 124, 2024-09-11T23:36:22.441 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.004131649, 2024-09-11T23:36:22.442 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000033319 2024-09-11T23:36:22.442 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:22.442 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:36:22.442 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-09-11T23:36:22.442 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-09-11T23:36:22.442 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-09-11T23:36:22.442 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:22.442 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-11T23:36:22.442 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 100608 2024-09-11T23:36:22.442 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:22.442 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T23:36:22.442 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 4, 2024-09-11T23:36:22.442 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 4, 2024-09-11T23:36:22.443 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 2944, 2024-09-11T23:36:22.443 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 448, 2024-09-11T23:36:22.443 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 2, 2024-09-11T23:36:22.443 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 1, 2024-09-11T23:36:22.443 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.002426955, 2024-09-11T23:36:22.443 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.000038168, 2024-09-11T23:36:22.443 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.002383151, 2024-09-11T23:36:22.443 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T23:36:22.443 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:36:22.443 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 3, 2024-09-11T23:36:22.443 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.004321272, 2024-09-11T23:36:22.443 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.001440424 2024-09-11T23:36:22.443 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:22.443 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:36:22.444 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-09-11T23:36:22.444 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-09-11T23:36:22.444 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-09-11T23:36:22.444 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:22.444 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-11T23:36:22.444 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 448 2024-09-11T23:36:22.444 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:22.444 INFO:teuthology.orchestra.run.smithi005.stdout: "cct": { 2024-09-11T23:36:22.444 INFO:teuthology.orchestra.run.smithi005.stdout: "total_workers": 0, 2024-09-11T23:36:22.444 INFO:teuthology.orchestra.run.smithi005.stdout: "unhealthy_workers": 0 2024-09-11T23:36:22.444 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:22.444 INFO:teuthology.orchestra.run.smithi005.stdout: "mempool": { 2024-09-11T23:36:22.444 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_bytes": 0, 2024-09-11T23:36:22.445 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_items": 0, 2024-09-11T23:36:22.445 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T23:36:22.445 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_items": 0, 2024-09-11T23:36:22.445 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T23:36:22.445 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_items": 0, 2024-09-11T23:36:22.445 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T23:36:22.445 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T23:36:22.445 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T23:36:22.445 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T23:36:22.445 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T23:36:22.445 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_items": 0, 2024-09-11T23:36:22.445 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T23:36:22.445 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T23:36:22.445 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_bytes": 0, 2024-09-11T23:36:22.446 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_items": 0, 2024-09-11T23:36:22.446 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_bytes": 0, 2024-09-11T23:36:22.446 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_items": 0, 2024-09-11T23:36:22.446 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T23:36:22.446 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T23:36:22.446 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T23:36:22.446 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T23:36:22.446 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T23:36:22.446 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_items": 0, 2024-09-11T23:36:22.446 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_bytes": 0, 2024-09-11T23:36:22.446 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_items": 0, 2024-09-11T23:36:22.446 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T23:36:22.446 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T23:36:22.447 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_bytes": 0, 2024-09-11T23:36:22.447 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_items": 0, 2024-09-11T23:36:22.447 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_bytes": 0, 2024-09-11T23:36:22.447 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_items": 0, 2024-09-11T23:36:22.447 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T23:36:22.447 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_items": 0, 2024-09-11T23:36:22.447 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T23:36:22.447 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_items": 0, 2024-09-11T23:36:22.447 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_bytes": 148962, 2024-09-11T23:36:22.447 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_items": 30, 2024-09-11T23:36:22.447 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_bytes": 0, 2024-09-11T23:36:22.447 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_items": 0, 2024-09-11T23:36:22.447 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_bytes": 0, 2024-09-11T23:36:22.447 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_items": 0, 2024-09-11T23:36:22.448 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_bytes": 0, 2024-09-11T23:36:22.448 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_items": 0, 2024-09-11T23:36:22.448 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_bytes": 0, 2024-09-11T23:36:22.448 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_items": 0, 2024-09-11T23:36:22.448 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_bytes": 0, 2024-09-11T23:36:22.448 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_items": 0, 2024-09-11T23:36:22.448 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T23:36:22.448 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_items": 0, 2024-09-11T23:36:22.448 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_bytes": 0, 2024-09-11T23:36:22.448 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_items": 0, 2024-09-11T23:36:22.448 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_bytes": 928, 2024-09-11T23:36:22.449 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_items": 2, 2024-09-11T23:36:22.449 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_bytes": 0, 2024-09-11T23:36:22.449 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_items": 0, 2024-09-11T23:36:22.449 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_bytes": 0, 2024-09-11T23:36:22.449 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_items": 0 2024-09-11T23:36:22.449 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-11T23:36:22.449 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T23:36:22.449 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-09-11T23:36:22.449 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 104857600, 2024-09-11T23:36:22.449 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-09-11T23:36:22.449 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 171, 2024-09-11T23:36:22.449 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 440176, 2024-09-11T23:36:22.449 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-09-11T23:36:22.450 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 171, 2024-09-11T23:36:22.450 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2024-09-11T23:36:22.450 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2024-09-11T23:36:22.450 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 171, 2024-09-11T23:36:22.450 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 440176, 2024-09-11T23:36:22.450 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-09-11T23:36:22.450 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-09-11T23:36:22.450 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-09-11T23:36:22.450 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-09-11T23:36:22.450 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:22.450 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-11T23:36:22.450 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-11T23:36:23.122 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-11T23:36:23.122 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-11T23:36:23.122 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2024-09-11T23:36:23.122 DEBUG:tasks.check_counter:Getting stats from b 2024-09-11T23:36:23.122 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-11T23:36:23.381 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T23:36:23.758 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:23 smithi159 ceph-mon[34394]: pgmap v574: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 433 KiB/s wr, 221 op/s 2024-09-11T23:36:23.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:23 smithi172 ceph-mon[34855]: pgmap v574: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 433 KiB/s wr, 221 op/s 2024-09-11T23:36:23.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:23 smithi005 ceph-mon[31201]: pgmap v574: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 433 KiB/s wr, 221 op/s 2024-09-11T23:36:23.987 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-11T23:36:23.987 INFO:teuthology.orchestra.run.smithi159.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T23:36:23.988 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_messages": 72506, 2024-09-11T23:36:23.988 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages": 123430, 2024-09-11T23:36:23.988 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_bytes": 22054278, 2024-09-11T23:36:23.988 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_bytes": 96257884, 2024-09-11T23:36:23.988 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_created_connections": 13, 2024-09-11T23:36:23.988 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_active_connections": 6, 2024-09-11T23:36:23.988 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_total_time": 4.967600681, 2024-09-11T23:36:23.988 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_send_time": 1.896147495, 2024-09-11T23:36:23.988 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_recv_time": 2.561208174, 2024-09-11T23:36:23.988 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_fast_dispatch_time": 0.685380161, 2024-09-11T23:36:23.988 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:36:23.988 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 123426, 2024-09-11T23:36:23.989 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 3.055741195, 2024-09-11T23:36:23.989 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000024757 2024-09-11T23:36:23.989 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:23.989 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:36:23.989 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 129965, 2024-09-11T23:36:23.989 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.021443739, 2024-09-11T23:36:23.989 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000164 2024-09-11T23:36:23.989 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:23.989 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_encrypted_bytes": 58672, 2024-09-11T23:36:23.989 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_encrypted_bytes": 30736 2024-09-11T23:36:23.989 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:23.989 INFO:teuthology.orchestra.run.smithi159.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T23:36:23.989 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_messages": 28485, 2024-09-11T23:36:23.990 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages": 30606, 2024-09-11T23:36:23.990 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_bytes": 11404072, 2024-09-11T23:36:23.990 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_bytes": 55518011, 2024-09-11T23:36:23.990 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_created_connections": 8, 2024-09-11T23:36:23.990 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_active_connections": 5, 2024-09-11T23:36:23.990 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_total_time": 1.833812787, 2024-09-11T23:36:23.990 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_send_time": 0.627006859, 2024-09-11T23:36:23.990 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_recv_time": 0.726043562, 2024-09-11T23:36:23.990 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_fast_dispatch_time": 0.487925949, 2024-09-11T23:36:23.990 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:36:23.990 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 30607, 2024-09-11T23:36:23.990 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.867258757, 2024-09-11T23:36:23.990 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000028335 2024-09-11T23:36:23.991 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:23.991 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:36:23.991 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 22339, 2024-09-11T23:36:23.991 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.003228198, 2024-09-11T23:36:23.991 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000144 2024-09-11T23:36:23.991 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:23.991 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-11T23:36:23.991 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_encrypted_bytes": 296704 2024-09-11T23:36:23.991 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:23.991 INFO:teuthology.orchestra.run.smithi159.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T23:36:23.991 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_messages": 36932, 2024-09-11T23:36:23.991 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages": 36338, 2024-09-11T23:36:23.991 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_bytes": 13788377, 2024-09-11T23:36:23.992 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_bytes": 48910512, 2024-09-11T23:36:23.992 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_created_connections": 12, 2024-09-11T23:36:23.992 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_active_connections": 6, 2024-09-11T23:36:23.992 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_total_time": 2.205520484, 2024-09-11T23:36:23.992 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_send_time": 0.691505794, 2024-09-11T23:36:23.992 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_recv_time": 0.885470624, 2024-09-11T23:36:23.992 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_fast_dispatch_time": 0.610882428, 2024-09-11T23:36:23.992 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:36:23.992 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 36337, 2024-09-11T23:36:23.992 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 1.352630483, 2024-09-11T23:36:23.992 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000037224 2024-09-11T23:36:23.992 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:23.993 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:36:23.993 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 24604, 2024-09-11T23:36:23.993 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.003577603, 2024-09-11T23:36:23.993 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000145 2024-09-11T23:36:23.993 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:23.993 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_encrypted_bytes": 536512, 2024-09-11T23:36:23.993 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_encrypted_bytes": 105680 2024-09-11T23:36:23.993 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:23.993 INFO:teuthology.orchestra.run.smithi159.stdout: "cct": { 2024-09-11T23:36:23.993 INFO:teuthology.orchestra.run.smithi159.stdout: "total_workers": 1, 2024-09-11T23:36:23.993 INFO:teuthology.orchestra.run.smithi159.stdout: "unhealthy_workers": 0 2024-09-11T23:36:23.993 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:23.993 INFO:teuthology.orchestra.run.smithi159.stdout: "finisher-MDSRank": { 2024-09-11T23:36:23.994 INFO:teuthology.orchestra.run.smithi159.stdout: "queue_len": 0, 2024-09-11T23:36:23.994 INFO:teuthology.orchestra.run.smithi159.stdout: "complete_latency": { 2024-09-11T23:36:23.994 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 92696, 2024-09-11T23:36:23.994 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 23.018129230, 2024-09-11T23:36:23.994 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000248318 2024-09-11T23:36:23.994 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-11T23:36:23.994 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:23.994 INFO:teuthology.orchestra.run.smithi159.stdout: "finisher-PurgeQueue": { 2024-09-11T23:36:23.994 INFO:teuthology.orchestra.run.smithi159.stdout: "queue_len": 0, 2024-09-11T23:36:23.994 INFO:teuthology.orchestra.run.smithi159.stdout: "complete_latency": { 2024-09-11T23:36:23.994 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 2920, 2024-09-11T23:36:23.994 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.331148668, 2024-09-11T23:36:23.994 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000113407 2024-09-11T23:36:23.995 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-11T23:36:23.995 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:23.995 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": { 2024-09-11T23:36:23.995 INFO:teuthology.orchestra.run.smithi159.stdout: "request": 24417, 2024-09-11T23:36:23.995 INFO:teuthology.orchestra.run.smithi159.stdout: "reply": 22518, 2024-09-11T23:36:23.995 INFO:teuthology.orchestra.run.smithi159.stdout: "reply_latency": { 2024-09-11T23:36:23.995 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 22518, 2024-09-11T23:36:23.995 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 70.307843003, 2024-09-11T23:36:23.995 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.003122295 2024-09-11T23:36:23.995 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:23.995 INFO:teuthology.orchestra.run.smithi159.stdout: "slow_reply": 0, 2024-09-11T23:36:23.995 INFO:teuthology.orchestra.run.smithi159.stdout: "forward": 1899, 2024-09-11T23:36:23.995 INFO:teuthology.orchestra.run.smithi159.stdout: "dir_fetch_complete": 0, 2024-09-11T23:36:23.996 INFO:teuthology.orchestra.run.smithi159.stdout: "dir_fetch_keys": 0, 2024-09-11T23:36:23.996 INFO:teuthology.orchestra.run.smithi159.stdout: "dir_commit": 194, 2024-09-11T23:36:23.996 INFO:teuthology.orchestra.run.smithi159.stdout: "dir_split": 22, 2024-09-11T23:36:23.996 INFO:teuthology.orchestra.run.smithi159.stdout: "dir_merge": 0, 2024-09-11T23:36:23.996 INFO:teuthology.orchestra.run.smithi159.stdout: "inodes": 41, 2024-09-11T23:36:23.996 INFO:teuthology.orchestra.run.smithi159.stdout: "inodes_top": 7, 2024-09-11T23:36:23.996 INFO:teuthology.orchestra.run.smithi159.stdout: "inodes_bottom": 9, 2024-09-11T23:36:23.996 INFO:teuthology.orchestra.run.smithi159.stdout: "inodes_pin_tail": 25, 2024-09-11T23:36:23.996 INFO:teuthology.orchestra.run.smithi159.stdout: "inodes_pinned": 30, 2024-09-11T23:36:23.996 INFO:teuthology.orchestra.run.smithi159.stdout: "inodes_expired": 4936, 2024-09-11T23:36:23.996 INFO:teuthology.orchestra.run.smithi159.stdout: "inodes_with_caps": 2, 2024-09-11T23:36:23.996 INFO:teuthology.orchestra.run.smithi159.stdout: "caps": 2, 2024-09-11T23:36:23.996 INFO:teuthology.orchestra.run.smithi159.stdout: "subtrees": 4, 2024-09-11T23:36:23.996 INFO:teuthology.orchestra.run.smithi159.stdout: "traverse": 31108, 2024-09-11T23:36:23.997 INFO:teuthology.orchestra.run.smithi159.stdout: "traverse_hit": 26296, 2024-09-11T23:36:23.997 INFO:teuthology.orchestra.run.smithi159.stdout: "traverse_forward": 1892, 2024-09-11T23:36:23.997 INFO:teuthology.orchestra.run.smithi159.stdout: "traverse_discover": 2, 2024-09-11T23:36:23.997 INFO:teuthology.orchestra.run.smithi159.stdout: "traverse_dir_fetch": 0, 2024-09-11T23:36:23.997 INFO:teuthology.orchestra.run.smithi159.stdout: "traverse_remote_ino": 0, 2024-09-11T23:36:23.997 INFO:teuthology.orchestra.run.smithi159.stdout: "traverse_lock": 3, 2024-09-11T23:36:23.997 INFO:teuthology.orchestra.run.smithi159.stdout: "load_cent": 2957, 2024-09-11T23:36:23.997 INFO:teuthology.orchestra.run.smithi159.stdout: "q": 0, 2024-09-11T23:36:23.997 INFO:teuthology.orchestra.run.smithi159.stdout: "exported": 116, 2024-09-11T23:36:23.997 INFO:teuthology.orchestra.run.smithi159.stdout: "exported_inodes": 4749, 2024-09-11T23:36:23.997 INFO:teuthology.orchestra.run.smithi159.stdout: "imported": 1, 2024-09-11T23:36:23.997 INFO:teuthology.orchestra.run.smithi159.stdout: "imported_inodes": 1, 2024-09-11T23:36:23.997 INFO:teuthology.orchestra.run.smithi159.stdout: "openino_dir_fetch": 0, 2024-09-11T23:36:23.997 INFO:teuthology.orchestra.run.smithi159.stdout: "openino_backtrace_fetch": 0, 2024-09-11T23:36:23.998 INFO:teuthology.orchestra.run.smithi159.stdout: "openino_peer_discover": 0, 2024-09-11T23:36:23.998 INFO:teuthology.orchestra.run.smithi159.stdout: "root_rfiles": 4, 2024-09-11T23:36:23.998 INFO:teuthology.orchestra.run.smithi159.stdout: "root_rbytes": 234, 2024-09-11T23:36:23.998 INFO:teuthology.orchestra.run.smithi159.stdout: "root_rsnaps": 0, 2024-09-11T23:36:23.998 INFO:teuthology.orchestra.run.smithi159.stdout: "scrub_backtrace_fetch": 0, 2024-09-11T23:36:23.998 INFO:teuthology.orchestra.run.smithi159.stdout: "scrub_set_tag": 0, 2024-09-11T23:36:23.998 INFO:teuthology.orchestra.run.smithi159.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T23:36:23.998 INFO:teuthology.orchestra.run.smithi159.stdout: "scrub_inotable_repaired": 0, 2024-09-11T23:36:23.998 INFO:teuthology.orchestra.run.smithi159.stdout: "scrub_dir_inodes": 0, 2024-09-11T23:36:23.998 INFO:teuthology.orchestra.run.smithi159.stdout: "scrub_dir_base_inodes": 0, 2024-09-11T23:36:23.998 INFO:teuthology.orchestra.run.smithi159.stdout: "scrub_dirfrag_rstats": 0, 2024-09-11T23:36:23.998 INFO:teuthology.orchestra.run.smithi159.stdout: "scrub_file_inodes": 0, 2024-09-11T23:36:23.998 INFO:teuthology.orchestra.run.smithi159.stdout: "handle_inode_file_caps": 0, 2024-09-11T23:36:23.999 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph_cap_op_revoke": 11777, 2024-09-11T23:36:23.999 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph_cap_op_grant": 16524, 2024-09-11T23:36:23.999 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph_cap_op_trunc": 7984, 2024-09-11T23:36:23.999 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T23:36:23.999 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T23:36:23.999 INFO:teuthology.orchestra.run.smithi159.stdout: "handle_client_caps": 19822, 2024-09-11T23:36:23.999 INFO:teuthology.orchestra.run.smithi159.stdout: "handle_client_caps_dirty": 13437, 2024-09-11T23:36:23.999 INFO:teuthology.orchestra.run.smithi159.stdout: "handle_client_cap_release": 60, 2024-09-11T23:36:23.999 INFO:teuthology.orchestra.run.smithi159.stdout: "process_request_cap_release": 18848 2024-09-11T23:36:23.999 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:23.999 INFO:teuthology.orchestra.run.smithi159.stdout: "mds_cache": { 2024-09-11T23:36:23.999 INFO:teuthology.orchestra.run.smithi159.stdout: "dir_update": 0, 2024-09-11T23:36:23.999 INFO:teuthology.orchestra.run.smithi159.stdout: "dir_update_receipt": 0, 2024-09-11T23:36:24.000 INFO:teuthology.orchestra.run.smithi159.stdout: "dir_try_discover": 0, 2024-09-11T23:36:24.000 INFO:teuthology.orchestra.run.smithi159.stdout: "dir_send_discover": 2, 2024-09-11T23:36:24.000 INFO:teuthology.orchestra.run.smithi159.stdout: "dir_handle_discover": 116, 2024-09-11T23:36:24.000 INFO:teuthology.orchestra.run.smithi159.stdout: "num_strays": 2, 2024-09-11T23:36:24.000 INFO:teuthology.orchestra.run.smithi159.stdout: "num_strays_delayed": 0, 2024-09-11T23:36:24.000 INFO:teuthology.orchestra.run.smithi159.stdout: "num_strays_enqueuing": 0, 2024-09-11T23:36:24.000 INFO:teuthology.orchestra.run.smithi159.stdout: "strays_created": 1672, 2024-09-11T23:36:24.000 INFO:teuthology.orchestra.run.smithi159.stdout: "strays_enqueued": 1667, 2024-09-11T23:36:24.000 INFO:teuthology.orchestra.run.smithi159.stdout: "strays_reintegrated": 3, 2024-09-11T23:36:24.000 INFO:teuthology.orchestra.run.smithi159.stdout: "strays_migrated": 0, 2024-09-11T23:36:24.000 INFO:teuthology.orchestra.run.smithi159.stdout: "num_recovering_processing": 0, 2024-09-11T23:36:24.000 INFO:teuthology.orchestra.run.smithi159.stdout: "num_recovering_enqueued": 0, 2024-09-11T23:36:24.000 INFO:teuthology.orchestra.run.smithi159.stdout: "num_recovering_prioritized": 0, 2024-09-11T23:36:24.001 INFO:teuthology.orchestra.run.smithi159.stdout: "recovery_started": 0, 2024-09-11T23:36:24.001 INFO:teuthology.orchestra.run.smithi159.stdout: "recovery_completed": 0, 2024-09-11T23:36:24.001 INFO:teuthology.orchestra.run.smithi159.stdout: "ireq_quiesce_path": 0, 2024-09-11T23:36:24.001 INFO:teuthology.orchestra.run.smithi159.stdout: "ireq_quiesce_inode": 0, 2024-09-11T23:36:24.001 INFO:teuthology.orchestra.run.smithi159.stdout: "ireq_enqueue_scrub": 0, 2024-09-11T23:36:24.001 INFO:teuthology.orchestra.run.smithi159.stdout: "ireq_exportdir": 117, 2024-09-11T23:36:24.001 INFO:teuthology.orchestra.run.smithi159.stdout: "ireq_flush": 0, 2024-09-11T23:36:24.001 INFO:teuthology.orchestra.run.smithi159.stdout: "ireq_fragmentdir": 22, 2024-09-11T23:36:24.001 INFO:teuthology.orchestra.run.smithi159.stdout: "ireq_fragstats": 0, 2024-09-11T23:36:24.001 INFO:teuthology.orchestra.run.smithi159.stdout: "ireq_inodestats": 0 2024-09-11T23:36:24.001 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:24.001 INFO:teuthology.orchestra.run.smithi159.stdout: "mds_log": { 2024-09-11T23:36:24.001 INFO:teuthology.orchestra.run.smithi159.stdout: "evlrg": 0, 2024-09-11T23:36:24.001 INFO:teuthology.orchestra.run.smithi159.stdout: "evadd": 43721, 2024-09-11T23:36:24.002 INFO:teuthology.orchestra.run.smithi159.stdout: "evex": 0, 2024-09-11T23:36:24.002 INFO:teuthology.orchestra.run.smithi159.stdout: "evtrm": 0, 2024-09-11T23:36:24.002 INFO:teuthology.orchestra.run.smithi159.stdout: "ev": 43721, 2024-09-11T23:36:24.002 INFO:teuthology.orchestra.run.smithi159.stdout: "evexg": 0, 2024-09-11T23:36:24.002 INFO:teuthology.orchestra.run.smithi159.stdout: "evexd": 0, 2024-09-11T23:36:24.002 INFO:teuthology.orchestra.run.smithi159.stdout: "segadd": 63, 2024-09-11T23:36:24.002 INFO:teuthology.orchestra.run.smithi159.stdout: "segex": 0, 2024-09-11T23:36:24.002 INFO:teuthology.orchestra.run.smithi159.stdout: "segtrm": 0, 2024-09-11T23:36:24.002 INFO:teuthology.orchestra.run.smithi159.stdout: "seg": 63, 2024-09-11T23:36:24.002 INFO:teuthology.orchestra.run.smithi159.stdout: "segmjr": 5, 2024-09-11T23:36:24.002 INFO:teuthology.orchestra.run.smithi159.stdout: "segexg": 0, 2024-09-11T23:36:24.002 INFO:teuthology.orchestra.run.smithi159.stdout: "segexd": 0, 2024-09-11T23:36:24.002 INFO:teuthology.orchestra.run.smithi159.stdout: "expos": 4194304, 2024-09-11T23:36:24.002 INFO:teuthology.orchestra.run.smithi159.stdout: "wrpos": 97855303, 2024-09-11T23:36:24.003 INFO:teuthology.orchestra.run.smithi159.stdout: "rdpos": 0, 2024-09-11T23:36:24.003 INFO:teuthology.orchestra.run.smithi159.stdout: "jlat": { 2024-09-11T23:36:24.003 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 27401, 2024-09-11T23:36:24.003 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 50.318542417, 2024-09-11T23:36:24.003 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.001836376 2024-09-11T23:36:24.003 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:24.003 INFO:teuthology.orchestra.run.smithi159.stdout: "replayed": 0 2024-09-11T23:36:24.003 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:24.003 INFO:teuthology.orchestra.run.smithi159.stdout: "mds_mem": { 2024-09-11T23:36:24.003 INFO:teuthology.orchestra.run.smithi159.stdout: "ino": 36, 2024-09-11T23:36:24.003 INFO:teuthology.orchestra.run.smithi159.stdout: "ino+": 6325, 2024-09-11T23:36:24.003 INFO:teuthology.orchestra.run.smithi159.stdout: "ino-": 6289, 2024-09-11T23:36:24.003 INFO:teuthology.orchestra.run.smithi159.stdout: "dir": 31, 2024-09-11T23:36:24.004 INFO:teuthology.orchestra.run.smithi159.stdout: "dir+": 274, 2024-09-11T23:36:24.004 INFO:teuthology.orchestra.run.smithi159.stdout: "dir-": 243, 2024-09-11T23:36:24.004 INFO:teuthology.orchestra.run.smithi159.stdout: "dn": 39, 2024-09-11T23:36:24.004 INFO:teuthology.orchestra.run.smithi159.stdout: "dn+": 6788, 2024-09-11T23:36:24.004 INFO:teuthology.orchestra.run.smithi159.stdout: "dn-": 6749, 2024-09-11T23:36:24.004 INFO:teuthology.orchestra.run.smithi159.stdout: "cap": 2, 2024-09-11T23:36:24.004 INFO:teuthology.orchestra.run.smithi159.stdout: "cap+": 6418, 2024-09-11T23:36:24.004 INFO:teuthology.orchestra.run.smithi159.stdout: "cap-": 6416, 2024-09-11T23:36:24.004 INFO:teuthology.orchestra.run.smithi159.stdout: "rss": 87444, 2024-09-11T23:36:24.004 INFO:teuthology.orchestra.run.smithi159.stdout: "heap": 231712 2024-09-11T23:36:24.004 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:24.004 INFO:teuthology.orchestra.run.smithi159.stdout: "mds_server": { 2024-09-11T23:36:24.004 INFO:teuthology.orchestra.run.smithi159.stdout: "dispatch_client_request": 45439, 2024-09-11T23:36:24.005 INFO:teuthology.orchestra.run.smithi159.stdout: "dispatch_server_request": 2061, 2024-09-11T23:36:24.005 INFO:teuthology.orchestra.run.smithi159.stdout: "handle_client_request": 24417, 2024-09-11T23:36:24.005 INFO:teuthology.orchestra.run.smithi159.stdout: "handle_client_session": 135, 2024-09-11T23:36:24.005 INFO:teuthology.orchestra.run.smithi159.stdout: "handle_peer_request": 4091, 2024-09-11T23:36:24.005 INFO:teuthology.orchestra.run.smithi159.stdout: "req_create_latency": { 2024-09-11T23:36:24.005 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 6207, 2024-09-11T23:36:24.005 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 17.775966683, 2024-09-11T23:36:24.005 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.002863858 2024-09-11T23:36:24.005 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:24.005 INFO:teuthology.orchestra.run.smithi159.stdout: "req_getattr_latency": { 2024-09-11T23:36:24.005 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 1246, 2024-09-11T23:36:24.005 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.287402625, 2024-09-11T23:36:24.005 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000230660 2024-09-11T23:36:24.005 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:24.006 INFO:teuthology.orchestra.run.smithi159.stdout: "req_getfilelock_latency": { 2024-09-11T23:36:24.006 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:24.006 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:24.006 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:24.006 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:24.006 INFO:teuthology.orchestra.run.smithi159.stdout: "req_link_latency": { 2024-09-11T23:36:24.006 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 3, 2024-09-11T23:36:24.006 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.007964822, 2024-09-11T23:36:24.006 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.002654940 2024-09-11T23:36:24.006 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:24.006 INFO:teuthology.orchestra.run.smithi159.stdout: "req_lookup_latency": { 2024-09-11T23:36:24.006 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 3976, 2024-09-11T23:36:24.006 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 15.834608933, 2024-09-11T23:36:24.007 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.003982547 2024-09-11T23:36:24.007 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:24.007 INFO:teuthology.orchestra.run.smithi159.stdout: "req_lookuphash_latency": { 2024-09-11T23:36:24.007 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:24.007 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:24.007 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:24.007 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:24.007 INFO:teuthology.orchestra.run.smithi159.stdout: "req_lookupino_latency": { 2024-09-11T23:36:24.007 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:24.007 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:24.007 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:24.007 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:24.007 INFO:teuthology.orchestra.run.smithi159.stdout: "req_lookupname_latency": { 2024-09-11T23:36:24.007 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:24.008 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:24.008 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:24.008 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:24.008 INFO:teuthology.orchestra.run.smithi159.stdout: "req_lookupparent_latency": { 2024-09-11T23:36:24.008 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:24.008 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:24.008 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:24.008 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:24.008 INFO:teuthology.orchestra.run.smithi159.stdout: "req_lookupsnap_latency": { 2024-09-11T23:36:24.008 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:24.008 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:24.008 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:24.008 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:24.009 INFO:teuthology.orchestra.run.smithi159.stdout: "req_lssnap_latency": { 2024-09-11T23:36:24.009 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:24.009 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:24.009 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:24.009 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:24.009 INFO:teuthology.orchestra.run.smithi159.stdout: "req_mkdir_latency": { 2024-09-11T23:36:24.010 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 73, 2024-09-11T23:36:24.010 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.096527139, 2024-09-11T23:36:24.010 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.001322289 2024-09-11T23:36:24.010 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:24.010 INFO:teuthology.orchestra.run.smithi159.stdout: "req_mknod_latency": { 2024-09-11T23:36:24.010 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:24.010 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:24.010 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:24.010 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:24.010 INFO:teuthology.orchestra.run.smithi159.stdout: "req_mksnap_latency": { 2024-09-11T23:36:24.010 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:24.010 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:24.010 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:24.011 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:24.011 INFO:teuthology.orchestra.run.smithi159.stdout: "req_open_latency": { 2024-09-11T23:36:24.011 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 175, 2024-09-11T23:36:24.011 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.211799904, 2024-09-11T23:36:24.011 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.001210285 2024-09-11T23:36:24.011 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:24.011 INFO:teuthology.orchestra.run.smithi159.stdout: "req_readdir_latency": { 2024-09-11T23:36:24.011 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 107, 2024-09-11T23:36:24.011 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.441646436, 2024-09-11T23:36:24.011 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.004127536 2024-09-11T23:36:24.011 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:24.011 INFO:teuthology.orchestra.run.smithi159.stdout: "req_rename_latency": { 2024-09-11T23:36:24.011 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 92, 2024-09-11T23:36:24.011 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.168454512, 2024-09-11T23:36:24.012 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.001831027 2024-09-11T23:36:24.012 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:24.012 INFO:teuthology.orchestra.run.smithi159.stdout: "req_renamesnap_latency": { 2024-09-11T23:36:24.012 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:24.012 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:24.012 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:24.012 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:24.012 INFO:teuthology.orchestra.run.smithi159.stdout: "req_snapdiff_latency": { 2024-09-11T23:36:24.012 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:24.012 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:24.012 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:24.012 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:24.012 INFO:teuthology.orchestra.run.smithi159.stdout: "req_rmdir_latency": { 2024-09-11T23:36:24.013 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 15, 2024-09-11T23:36:24.013 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.074354918, 2024-09-11T23:36:24.013 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.004956994 2024-09-11T23:36:24.013 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:24.013 INFO:teuthology.orchestra.run.smithi159.stdout: "req_rmsnap_latency": { 2024-09-11T23:36:24.013 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:24.013 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:24.013 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:24.013 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:24.013 INFO:teuthology.orchestra.run.smithi159.stdout: "req_rmxattr_latency": { 2024-09-11T23:36:24.013 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:24.013 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:24.013 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:24.014 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:24.014 INFO:teuthology.orchestra.run.smithi159.stdout: "req_setattr_latency": { 2024-09-11T23:36:24.014 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 9000, 2024-09-11T23:36:24.014 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 32.877549011, 2024-09-11T23:36:24.014 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.003653061 2024-09-11T23:36:24.014 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:24.014 INFO:teuthology.orchestra.run.smithi159.stdout: "req_setdirlayout_latency": { 2024-09-11T23:36:24.014 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:24.014 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:24.014 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:24.014 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:24.014 INFO:teuthology.orchestra.run.smithi159.stdout: "req_setfilelock_latency": { 2024-09-11T23:36:24.014 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 8, 2024-09-11T23:36:24.014 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.003276647, 2024-09-11T23:36:24.015 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000409580 2024-09-11T23:36:24.015 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:24.015 INFO:teuthology.orchestra.run.smithi159.stdout: "req_setlayout_latency": { 2024-09-11T23:36:24.015 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:24.015 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:24.015 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:24.015 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:24.015 INFO:teuthology.orchestra.run.smithi159.stdout: "req_setxattr_latency": { 2024-09-11T23:36:24.015 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 8, 2024-09-11T23:36:24.015 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.020050008, 2024-09-11T23:36:24.015 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.002506251 2024-09-11T23:36:24.015 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:24.016 INFO:teuthology.orchestra.run.smithi159.stdout: "req_symlink_latency": { 2024-09-11T23:36:24.016 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 6, 2024-09-11T23:36:24.016 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.004289840, 2024-09-11T23:36:24.016 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000714973 2024-09-11T23:36:24.016 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:24.016 INFO:teuthology.orchestra.run.smithi159.stdout: "req_unlink_latency": { 2024-09-11T23:36:24.016 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 1602, 2024-09-11T23:36:24.016 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 2.503951525, 2024-09-11T23:36:24.016 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.001563015 2024-09-11T23:36:24.016 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:24.016 INFO:teuthology.orchestra.run.smithi159.stdout: "cap_revoke_eviction": 0, 2024-09-11T23:36:24.016 INFO:teuthology.orchestra.run.smithi159.stdout: "cap_acquisition_throttle": 0, 2024-09-11T23:36:24.016 INFO:teuthology.orchestra.run.smithi159.stdout: "req_getvxattr_latency": { 2024-09-11T23:36:24.017 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:24.017 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:24.017 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:24.017 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-11T23:36:24.017 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:24.017 INFO:teuthology.orchestra.run.smithi159.stdout: "mds_sessions": { 2024-09-11T23:36:24.017 INFO:teuthology.orchestra.run.smithi159.stdout: "session_count": 1, 2024-09-11T23:36:24.017 INFO:teuthology.orchestra.run.smithi159.stdout: "session_add": 3, 2024-09-11T23:36:24.017 INFO:teuthology.orchestra.run.smithi159.stdout: "session_remove": 2, 2024-09-11T23:36:24.017 INFO:teuthology.orchestra.run.smithi159.stdout: "sessions_open": 1, 2024-09-11T23:36:24.017 INFO:teuthology.orchestra.run.smithi159.stdout: "sessions_stale": 0, 2024-09-11T23:36:24.017 INFO:teuthology.orchestra.run.smithi159.stdout: "total_load": 2436, 2024-09-11T23:36:24.017 INFO:teuthology.orchestra.run.smithi159.stdout: "average_load": 2436, 2024-09-11T23:36:24.018 INFO:teuthology.orchestra.run.smithi159.stdout: "avg_session_uptime": 441, 2024-09-11T23:36:24.018 INFO:teuthology.orchestra.run.smithi159.stdout: "mdthresh_evicted": 0 2024-09-11T23:36:24.018 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:24.018 INFO:teuthology.orchestra.run.smithi159.stdout: "mempool": { 2024-09-11T23:36:24.018 INFO:teuthology.orchestra.run.smithi159.stdout: "bloom_filter_bytes": 0, 2024-09-11T23:36:24.018 INFO:teuthology.orchestra.run.smithi159.stdout: "bloom_filter_items": 0, 2024-09-11T23:36:24.018 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T23:36:24.018 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_alloc_items": 0, 2024-09-11T23:36:24.018 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T23:36:24.018 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_data_items": 0, 2024-09-11T23:36:24.018 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T23:36:24.018 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T23:36:24.018 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T23:36:24.019 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T23:36:24.019 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T23:36:24.019 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_other_items": 0, 2024-09-11T23:36:24.019 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T23:36:24.019 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T23:36:24.019 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_extent_bytes": 0, 2024-09-11T23:36:24.019 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_extent_items": 0, 2024-09-11T23:36:24.020 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_blob_bytes": 0, 2024-09-11T23:36:24.020 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_blob_items": 0, 2024-09-11T23:36:24.021 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T23:36:24.021 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T23:36:24.021 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T23:36:24.021 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T23:36:24.021 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T23:36:24.021 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_fsck_items": 0, 2024-09-11T23:36:24.021 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_txc_bytes": 0, 2024-09-11T23:36:24.021 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_txc_items": 0, 2024-09-11T23:36:24.021 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T23:36:24.021 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T23:36:24.021 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_writing_bytes": 0, 2024-09-11T23:36:24.021 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_writing_items": 0, 2024-09-11T23:36:24.021 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_bytes": 0, 2024-09-11T23:36:24.022 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_items": 0, 2024-09-11T23:36:24.022 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T23:36:24.022 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_file_reader_items": 0, 2024-09-11T23:36:24.022 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T23:36:24.022 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_file_writer_items": 0, 2024-09-11T23:36:24.022 INFO:teuthology.orchestra.run.smithi159.stdout: "buffer_anon_bytes": 314628, 2024-09-11T23:36:24.022 INFO:teuthology.orchestra.run.smithi159.stdout: "buffer_anon_items": 117, 2024-09-11T23:36:24.022 INFO:teuthology.orchestra.run.smithi159.stdout: "buffer_meta_bytes": 0, 2024-09-11T23:36:24.022 INFO:teuthology.orchestra.run.smithi159.stdout: "buffer_meta_items": 0, 2024-09-11T23:36:24.022 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_bytes": 0, 2024-09-11T23:36:24.022 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_items": 0, 2024-09-11T23:36:24.022 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_mapbl_bytes": 0, 2024-09-11T23:36:24.022 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_mapbl_items": 0, 2024-09-11T23:36:24.023 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_pglog_bytes": 0, 2024-09-11T23:36:24.023 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_pglog_items": 0, 2024-09-11T23:36:24.023 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_bytes": 8960, 2024-09-11T23:36:24.023 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_items": 169, 2024-09-11T23:36:24.023 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T23:36:24.023 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_mapping_items": 0, 2024-09-11T23:36:24.023 INFO:teuthology.orchestra.run.smithi159.stdout: "pgmap_bytes": 0, 2024-09-11T23:36:24.023 INFO:teuthology.orchestra.run.smithi159.stdout: "pgmap_items": 0, 2024-09-11T23:36:24.023 INFO:teuthology.orchestra.run.smithi159.stdout: "mds_co_bytes": 158719, 2024-09-11T23:36:24.023 INFO:teuthology.orchestra.run.smithi159.stdout: "mds_co_items": 1254, 2024-09-11T23:36:24.023 INFO:teuthology.orchestra.run.smithi159.stdout: "unittest_1_bytes": 0, 2024-09-11T23:36:24.023 INFO:teuthology.orchestra.run.smithi159.stdout: "unittest_1_items": 0, 2024-09-11T23:36:24.023 INFO:teuthology.orchestra.run.smithi159.stdout: "unittest_2_bytes": 0, 2024-09-11T23:36:24.024 INFO:teuthology.orchestra.run.smithi159.stdout: "unittest_2_items": 0 2024-09-11T23:36:24.024 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:24.024 INFO:teuthology.orchestra.run.smithi159.stdout: "objecter": { 2024-09-11T23:36:24.024 INFO:teuthology.orchestra.run.smithi159.stdout: "op_active": 0, 2024-09-11T23:36:24.024 INFO:teuthology.orchestra.run.smithi159.stdout: "op_laggy": 0, 2024-09-11T23:36:24.024 INFO:teuthology.orchestra.run.smithi159.stdout: "op_send": 69694, 2024-09-11T23:36:24.024 INFO:teuthology.orchestra.run.smithi159.stdout: "op_send_bytes": 96509714, 2024-09-11T23:36:24.024 INFO:teuthology.orchestra.run.smithi159.stdout: "op_resend": 33, 2024-09-11T23:36:24.024 INFO:teuthology.orchestra.run.smithi159.stdout: "op_reply": 69694, 2024-09-11T23:36:24.024 INFO:teuthology.orchestra.run.smithi159.stdout: "op_latency": { 2024-09-11T23:36:24.024 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 69694, 2024-09-11T23:36:24.024 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 348.339594432, 2024-09-11T23:36:24.025 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.004998128 2024-09-11T23:36:24.025 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:24.025 INFO:teuthology.orchestra.run.smithi159.stdout: "op_inflight": 0, 2024-09-11T23:36:24.025 INFO:teuthology.orchestra.run.smithi159.stdout: "oplen_avg": { 2024-09-11T23:36:24.025 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 69694, 2024-09-11T23:36:24.025 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 70117 2024-09-11T23:36:24.025 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:24.025 INFO:teuthology.orchestra.run.smithi159.stdout: "op": 69694, 2024-09-11T23:36:24.025 INFO:teuthology.orchestra.run.smithi159.stdout: "op_r": 94, 2024-09-11T23:36:24.025 INFO:teuthology.orchestra.run.smithi159.stdout: "op_w": 69600, 2024-09-11T23:36:24.025 INFO:teuthology.orchestra.run.smithi159.stdout: "op_rmw": 0, 2024-09-11T23:36:24.025 INFO:teuthology.orchestra.run.smithi159.stdout: "op_pg": 0, 2024-09-11T23:36:24.025 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_stat": 0, 2024-09-11T23:36:24.026 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_create": 11, 2024-09-11T23:36:24.026 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_read": 94, 2024-09-11T23:36:24.026 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_write": 27495, 2024-09-11T23:36:24.026 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_writefull": 88, 2024-09-11T23:36:24.026 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_writesame": 0, 2024-09-11T23:36:24.026 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_append": 0, 2024-09-11T23:36:24.026 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_zero": 0, 2024-09-11T23:36:24.026 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_truncate": 6, 2024-09-11T23:36:24.026 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_delete": 3899, 2024-09-11T23:36:24.026 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_mapext": 0, 2024-09-11T23:36:24.026 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_sparse_read": 0, 2024-09-11T23:36:24.026 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_clonerange": 0, 2024-09-11T23:36:24.026 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_getxattr": 0, 2024-09-11T23:36:24.027 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_setxattr": 22, 2024-09-11T23:36:24.027 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_cmpxattr": 0, 2024-09-11T23:36:24.027 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_rmxattr": 0, 2024-09-11T23:36:24.027 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_resetxattrs": 0, 2024-09-11T23:36:24.027 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_call": 0, 2024-09-11T23:36:24.027 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_watch": 0, 2024-09-11T23:36:24.027 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_notify": 0, 2024-09-11T23:36:24.027 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T23:36:24.027 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_pgls": 0, 2024-09-11T23:36:24.027 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_pgls_filter": 0, 2024-09-11T23:36:24.027 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_other": 37742, 2024-09-11T23:36:24.027 INFO:teuthology.orchestra.run.smithi159.stdout: "linger_active": 0, 2024-09-11T23:36:24.027 INFO:teuthology.orchestra.run.smithi159.stdout: "linger_send": 0, 2024-09-11T23:36:24.027 INFO:teuthology.orchestra.run.smithi159.stdout: "linger_resend": 0, 2024-09-11T23:36:24.028 INFO:teuthology.orchestra.run.smithi159.stdout: "linger_ping": 0, 2024-09-11T23:36:24.028 INFO:teuthology.orchestra.run.smithi159.stdout: "poolop_active": 0, 2024-09-11T23:36:24.028 INFO:teuthology.orchestra.run.smithi159.stdout: "poolop_send": 0, 2024-09-11T23:36:24.028 INFO:teuthology.orchestra.run.smithi159.stdout: "poolop_resend": 0, 2024-09-11T23:36:24.028 INFO:teuthology.orchestra.run.smithi159.stdout: "poolstat_active": 0, 2024-09-11T23:36:24.028 INFO:teuthology.orchestra.run.smithi159.stdout: "poolstat_send": 0, 2024-09-11T23:36:24.028 INFO:teuthology.orchestra.run.smithi159.stdout: "poolstat_resend": 0, 2024-09-11T23:36:24.028 INFO:teuthology.orchestra.run.smithi159.stdout: "statfs_active": 0, 2024-09-11T23:36:24.028 INFO:teuthology.orchestra.run.smithi159.stdout: "statfs_send": 0, 2024-09-11T23:36:24.028 INFO:teuthology.orchestra.run.smithi159.stdout: "statfs_resend": 0, 2024-09-11T23:36:24.028 INFO:teuthology.orchestra.run.smithi159.stdout: "command_active": 0, 2024-09-11T23:36:24.028 INFO:teuthology.orchestra.run.smithi159.stdout: "command_send": 0, 2024-09-11T23:36:24.028 INFO:teuthology.orchestra.run.smithi159.stdout: "command_resend": 0, 2024-09-11T23:36:24.029 INFO:teuthology.orchestra.run.smithi159.stdout: "map_epoch": 88, 2024-09-11T23:36:24.029 INFO:teuthology.orchestra.run.smithi159.stdout: "map_full": 0, 2024-09-11T23:36:24.029 INFO:teuthology.orchestra.run.smithi159.stdout: "map_inc": 8, 2024-09-11T23:36:24.029 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_sessions": 12, 2024-09-11T23:36:24.029 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_session_open": 12, 2024-09-11T23:36:24.029 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_session_close": 0, 2024-09-11T23:36:24.029 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_laggy": 0, 2024-09-11T23:36:24.029 INFO:teuthology.orchestra.run.smithi159.stdout: "omap_wr": 652, 2024-09-11T23:36:24.029 INFO:teuthology.orchestra.run.smithi159.stdout: "omap_rd": 0, 2024-09-11T23:36:24.029 INFO:teuthology.orchestra.run.smithi159.stdout: "omap_del": 108 2024-09-11T23:36:24.029 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:24.029 INFO:teuthology.orchestra.run.smithi159.stdout: "oft": { 2024-09-11T23:36:24.029 INFO:teuthology.orchestra.run.smithi159.stdout: "omap_total_objs": 1, 2024-09-11T23:36:24.030 INFO:teuthology.orchestra.run.smithi159.stdout: "omap_total_kv_pairs": 0, 2024-09-11T23:36:24.030 INFO:teuthology.orchestra.run.smithi159.stdout: "omap_total_updates": 0, 2024-09-11T23:36:24.030 INFO:teuthology.orchestra.run.smithi159.stdout: "omap_total_removes": 0 2024-09-11T23:36:24.030 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:24.030 INFO:teuthology.orchestra.run.smithi159.stdout: "osd-slow-ops": { 2024-09-11T23:36:24.030 INFO:teuthology.orchestra.run.smithi159.stdout: "slow_ops_count": 0 2024-09-11T23:36:24.030 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:24.030 INFO:teuthology.orchestra.run.smithi159.stdout: "purge_queue": { 2024-09-11T23:36:24.030 INFO:teuthology.orchestra.run.smithi159.stdout: "pq_executing_ops": 0, 2024-09-11T23:36:24.030 INFO:teuthology.orchestra.run.smithi159.stdout: "pq_executing_ops_high_water": 35, 2024-09-11T23:36:24.030 INFO:teuthology.orchestra.run.smithi159.stdout: "pq_executing": 0, 2024-09-11T23:36:24.030 INFO:teuthology.orchestra.run.smithi159.stdout: "pq_executing_high_water": 10, 2024-09-11T23:36:24.031 INFO:teuthology.orchestra.run.smithi159.stdout: "pq_executed_ops": 3349, 2024-09-11T23:36:24.031 INFO:teuthology.orchestra.run.smithi159.stdout: "pq_executed": 1667, 2024-09-11T23:36:24.031 INFO:teuthology.orchestra.run.smithi159.stdout: "pq_item_in_journal": 0 2024-09-11T23:36:24.031 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:24.031 INFO:teuthology.orchestra.run.smithi159.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T23:36:24.031 INFO:teuthology.orchestra.run.smithi159.stdout: "val": 0, 2024-09-11T23:36:24.031 INFO:teuthology.orchestra.run.smithi159.stdout: "max": 104857600, 2024-09-11T23:36:24.031 INFO:teuthology.orchestra.run.smithi159.stdout: "get_started": 0, 2024-09-11T23:36:24.031 INFO:teuthology.orchestra.run.smithi159.stdout: "get": 137919, 2024-09-11T23:36:24.031 INFO:teuthology.orchestra.run.smithi159.stdout: "get_sum": 34813726, 2024-09-11T23:36:24.031 INFO:teuthology.orchestra.run.smithi159.stdout: "get_or_fail_fail": 0, 2024-09-11T23:36:24.031 INFO:teuthology.orchestra.run.smithi159.stdout: "get_or_fail_success": 137919, 2024-09-11T23:36:24.031 INFO:teuthology.orchestra.run.smithi159.stdout: "take": 0, 2024-09-11T23:36:24.031 INFO:teuthology.orchestra.run.smithi159.stdout: "take_sum": 0, 2024-09-11T23:36:24.032 INFO:teuthology.orchestra.run.smithi159.stdout: "put": 137919, 2024-09-11T23:36:24.032 INFO:teuthology.orchestra.run.smithi159.stdout: "put_sum": 34813726, 2024-09-11T23:36:24.032 INFO:teuthology.orchestra.run.smithi159.stdout: "wait": { 2024-09-11T23:36:24.032 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:24.032 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:24.032 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:24.032 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-11T23:36:24.032 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:24.032 INFO:teuthology.orchestra.run.smithi159.stdout: "throttle-objecter_bytes": { 2024-09-11T23:36:24.032 INFO:teuthology.orchestra.run.smithi159.stdout: "val": 0, 2024-09-11T23:36:24.032 INFO:teuthology.orchestra.run.smithi159.stdout: "max": 104857600, 2024-09-11T23:36:24.032 INFO:teuthology.orchestra.run.smithi159.stdout: "get_started": 0, 2024-09-11T23:36:24.032 INFO:teuthology.orchestra.run.smithi159.stdout: "get": 0, 2024-09-11T23:36:24.033 INFO:teuthology.orchestra.run.smithi159.stdout: "get_sum": 0, 2024-09-11T23:36:24.033 INFO:teuthology.orchestra.run.smithi159.stdout: "get_or_fail_fail": 0, 2024-09-11T23:36:24.033 INFO:teuthology.orchestra.run.smithi159.stdout: "get_or_fail_success": 0, 2024-09-11T23:36:24.033 INFO:teuthology.orchestra.run.smithi159.stdout: "take": 69694, 2024-09-11T23:36:24.033 INFO:teuthology.orchestra.run.smithi159.stdout: "take_sum": 96691321, 2024-09-11T23:36:24.033 INFO:teuthology.orchestra.run.smithi159.stdout: "put": 69694, 2024-09-11T23:36:24.033 INFO:teuthology.orchestra.run.smithi159.stdout: "put_sum": 96691321, 2024-09-11T23:36:24.033 INFO:teuthology.orchestra.run.smithi159.stdout: "wait": { 2024-09-11T23:36:24.033 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:24.033 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:24.033 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:24.033 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-11T23:36:24.033 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:24.034 INFO:teuthology.orchestra.run.smithi159.stdout: "throttle-objecter_ops": { 2024-09-11T23:36:24.034 INFO:teuthology.orchestra.run.smithi159.stdout: "val": 0, 2024-09-11T23:36:24.034 INFO:teuthology.orchestra.run.smithi159.stdout: "max": 1024, 2024-09-11T23:36:24.034 INFO:teuthology.orchestra.run.smithi159.stdout: "get_started": 0, 2024-09-11T23:36:24.034 INFO:teuthology.orchestra.run.smithi159.stdout: "get": 0, 2024-09-11T23:36:24.034 INFO:teuthology.orchestra.run.smithi159.stdout: "get_sum": 0, 2024-09-11T23:36:24.034 INFO:teuthology.orchestra.run.smithi159.stdout: "get_or_fail_fail": 0, 2024-09-11T23:36:24.034 INFO:teuthology.orchestra.run.smithi159.stdout: "get_or_fail_success": 0, 2024-09-11T23:36:24.034 INFO:teuthology.orchestra.run.smithi159.stdout: "take": 69694, 2024-09-11T23:36:24.034 INFO:teuthology.orchestra.run.smithi159.stdout: "take_sum": 69694, 2024-09-11T23:36:24.034 INFO:teuthology.orchestra.run.smithi159.stdout: "put": 69694, 2024-09-11T23:36:24.034 INFO:teuthology.orchestra.run.smithi159.stdout: "put_sum": 69694, 2024-09-11T23:36:24.034 INFO:teuthology.orchestra.run.smithi159.stdout: "wait": { 2024-09-11T23:36:24.034 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:24.035 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:24.035 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:24.035 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-11T23:36:24.035 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:24.035 INFO:teuthology.orchestra.run.smithi159.stdout: "throttle-write_buf_throttle": { 2024-09-11T23:36:24.035 INFO:teuthology.orchestra.run.smithi159.stdout: "val": 0, 2024-09-11T23:36:24.035 INFO:teuthology.orchestra.run.smithi159.stdout: "max": 3758096384, 2024-09-11T23:36:24.035 INFO:teuthology.orchestra.run.smithi159.stdout: "get_started": 0, 2024-09-11T23:36:24.035 INFO:teuthology.orchestra.run.smithi159.stdout: "get": 1667, 2024-09-11T23:36:24.035 INFO:teuthology.orchestra.run.smithi159.stdout: "get_sum": 181607, 2024-09-11T23:36:24.035 INFO:teuthology.orchestra.run.smithi159.stdout: "get_or_fail_fail": 0, 2024-09-11T23:36:24.035 INFO:teuthology.orchestra.run.smithi159.stdout: "get_or_fail_success": 1667, 2024-09-11T23:36:24.035 INFO:teuthology.orchestra.run.smithi159.stdout: "take": 0, 2024-09-11T23:36:24.035 INFO:teuthology.orchestra.run.smithi159.stdout: "take_sum": 0, 2024-09-11T23:36:24.036 INFO:teuthology.orchestra.run.smithi159.stdout: "put": 94, 2024-09-11T23:36:24.036 INFO:teuthology.orchestra.run.smithi159.stdout: "put_sum": 181607, 2024-09-11T23:36:24.036 INFO:teuthology.orchestra.run.smithi159.stdout: "wait": { 2024-09-11T23:36:24.036 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:24.036 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:24.036 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:24.036 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-11T23:36:24.036 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:24.036 INFO:teuthology.orchestra.run.smithi159.stdout: "throttle-write_buf_throttle-0x5622ed2be960": { 2024-09-11T23:36:24.036 INFO:teuthology.orchestra.run.smithi159.stdout: "val": 0, 2024-09-11T23:36:24.036 INFO:teuthology.orchestra.run.smithi159.stdout: "max": 3758096384, 2024-09-11T23:36:24.036 INFO:teuthology.orchestra.run.smithi159.stdout: "get_started": 0, 2024-09-11T23:36:24.036 INFO:teuthology.orchestra.run.smithi159.stdout: "get": 43721, 2024-09-11T23:36:24.036 INFO:teuthology.orchestra.run.smithi159.stdout: "get_sum": 93660999, 2024-09-11T23:36:24.037 INFO:teuthology.orchestra.run.smithi159.stdout: "get_or_fail_fail": 0, 2024-09-11T23:36:24.037 INFO:teuthology.orchestra.run.smithi159.stdout: "get_or_fail_success": 43721, 2024-09-11T23:36:24.037 INFO:teuthology.orchestra.run.smithi159.stdout: "take": 0, 2024-09-11T23:36:24.037 INFO:teuthology.orchestra.run.smithi159.stdout: "take_sum": 0, 2024-09-11T23:36:24.037 INFO:teuthology.orchestra.run.smithi159.stdout: "put": 27401, 2024-09-11T23:36:24.037 INFO:teuthology.orchestra.run.smithi159.stdout: "put_sum": 93660999, 2024-09-11T23:36:24.037 INFO:teuthology.orchestra.run.smithi159.stdout: "wait": { 2024-09-11T23:36:24.037 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:24.037 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:24.037 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:24.037 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-11T23:36:24.037 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-11T23:36:24.037 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-11T23:36:24.781 INFO:tasks.check_counter:Daemon mds.b mds.exported=116 2024-09-11T23:36:24.781 INFO:tasks.check_counter:Daemon mds.b mds.imported=1 2024-09-11T23:36:24.781 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=22 2024-09-11T23:36:24.781 DEBUG:tasks.check_counter:Getting stats from e 2024-09-11T23:36:24.782 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-11T23:36:25.030 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T23:36:25.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:25 smithi159 ceph-mon[34394]: pgmap v575: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 157 KiB/s wr, 109 op/s 2024-09-11T23:36:25.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:25 smithi172 ceph-mon[34855]: pgmap v575: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 157 KiB/s wr, 109 op/s 2024-09-11T23:36:25.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:25 smithi005 ceph-mon[31201]: pgmap v575: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 157 KiB/s wr, 109 op/s 2024-09-11T23:36:26.517 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-11T23:36:26.517 INFO:teuthology.orchestra.run.smithi159.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T23:36:26.517 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_messages": 560, 2024-09-11T23:36:26.518 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages": 562, 2024-09-11T23:36:26.518 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_bytes": 12729215, 2024-09-11T23:36:26.518 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_bytes": 178144, 2024-09-11T23:36:26.518 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_created_connections": 7, 2024-09-11T23:36:26.518 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_active_connections": 3, 2024-09-11T23:36:26.518 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_total_time": 0.049494790, 2024-09-11T23:36:26.518 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_send_time": 0.016531738, 2024-09-11T23:36:26.518 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_recv_time": 0.016347935, 2024-09-11T23:36:26.518 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_fast_dispatch_time": 0.012018265, 2024-09-11T23:36:26.518 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:36:26.518 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 560, 2024-09-11T23:36:26.518 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.019017369, 2024-09-11T23:36:26.519 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000033959 2024-09-11T23:36:26.519 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.519 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:36:26.519 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:26.519 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:26.519 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:26.519 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.519 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T23:36:26.519 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T23:36:26.519 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.519 INFO:teuthology.orchestra.run.smithi159.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T23:36:26.519 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_messages": 386, 2024-09-11T23:36:26.519 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages": 373, 2024-09-11T23:36:26.520 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_bytes": 13152768, 2024-09-11T23:36:26.520 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_bytes": 165929, 2024-09-11T23:36:26.520 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_created_connections": 5, 2024-09-11T23:36:26.520 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_active_connections": 4, 2024-09-11T23:36:26.520 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_total_time": 0.048172196, 2024-09-11T23:36:26.520 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_send_time": 0.015213113, 2024-09-11T23:36:26.520 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_recv_time": 0.031403230, 2024-09-11T23:36:26.520 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_fast_dispatch_time": 0.005437854, 2024-09-11T23:36:26.520 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:36:26.520 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 373, 2024-09-11T23:36:26.520 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.021688364, 2024-09-11T23:36:26.521 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000058145 2024-09-11T23:36:26.521 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.521 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:36:26.521 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:26.521 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:26.521 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:26.522 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.522 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_encrypted_bytes": 516736, 2024-09-11T23:36:26.522 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_encrypted_bytes": 102960 2024-09-11T23:36:26.522 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.522 INFO:teuthology.orchestra.run.smithi159.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T23:36:26.522 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_messages": 867, 2024-09-11T23:36:26.522 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages": 992, 2024-09-11T23:36:26.522 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_bytes": 6733666, 2024-09-11T23:36:26.522 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_bytes": 561420, 2024-09-11T23:36:26.523 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_created_connections": 5, 2024-09-11T23:36:26.523 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_active_connections": 4, 2024-09-11T23:36:26.523 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_total_time": 0.081409454, 2024-09-11T23:36:26.523 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_send_time": 0.026224281, 2024-09-11T23:36:26.523 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_recv_time": 0.021776848, 2024-09-11T23:36:26.523 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_fast_dispatch_time": 0.026222690, 2024-09-11T23:36:26.523 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:36:26.523 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 990, 2024-09-11T23:36:26.523 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.034854382, 2024-09-11T23:36:26.523 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000035206 2024-09-11T23:36:26.523 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.523 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:36:26.523 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:26.524 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:26.524 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:26.524 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.524 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-11T23:36:26.524 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_encrypted_bytes": 286032 2024-09-11T23:36:26.524 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.524 INFO:teuthology.orchestra.run.smithi159.stdout: "cct": { 2024-09-11T23:36:26.524 INFO:teuthology.orchestra.run.smithi159.stdout: "total_workers": 1, 2024-09-11T23:36:26.524 INFO:teuthology.orchestra.run.smithi159.stdout: "unhealthy_workers": 0 2024-09-11T23:36:26.524 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.524 INFO:teuthology.orchestra.run.smithi159.stdout: "finisher-MDSRank": { 2024-09-11T23:36:26.524 INFO:teuthology.orchestra.run.smithi159.stdout: "queue_len": 0, 2024-09-11T23:36:26.524 INFO:teuthology.orchestra.run.smithi159.stdout: "complete_latency": { 2024-09-11T23:36:26.525 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 2737, 2024-09-11T23:36:26.525 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.070250869, 2024-09-11T23:36:26.525 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000025667 2024-09-11T23:36:26.525 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-11T23:36:26.525 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.525 INFO:teuthology.orchestra.run.smithi159.stdout: "finisher-PurgeQueue": { 2024-09-11T23:36:26.525 INFO:teuthology.orchestra.run.smithi159.stdout: "queue_len": 0, 2024-09-11T23:36:26.525 INFO:teuthology.orchestra.run.smithi159.stdout: "complete_latency": { 2024-09-11T23:36:26.525 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:26.525 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:26.525 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:26.525 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-11T23:36:26.525 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.526 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": { 2024-09-11T23:36:26.526 INFO:teuthology.orchestra.run.smithi159.stdout: "request": 0, 2024-09-11T23:36:26.526 INFO:teuthology.orchestra.run.smithi159.stdout: "reply": 0, 2024-09-11T23:36:26.526 INFO:teuthology.orchestra.run.smithi159.stdout: "reply_latency": { 2024-09-11T23:36:26.526 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:26.526 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:26.526 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:26.526 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.526 INFO:teuthology.orchestra.run.smithi159.stdout: "slow_reply": 0, 2024-09-11T23:36:26.526 INFO:teuthology.orchestra.run.smithi159.stdout: "forward": 0, 2024-09-11T23:36:26.526 INFO:teuthology.orchestra.run.smithi159.stdout: "dir_fetch_complete": 0, 2024-09-11T23:36:26.526 INFO:teuthology.orchestra.run.smithi159.stdout: "dir_fetch_keys": 0, 2024-09-11T23:36:26.526 INFO:teuthology.orchestra.run.smithi159.stdout: "dir_commit": 0, 2024-09-11T23:36:26.527 INFO:teuthology.orchestra.run.smithi159.stdout: "dir_split": 0, 2024-09-11T23:36:26.527 INFO:teuthology.orchestra.run.smithi159.stdout: "dir_merge": 0, 2024-09-11T23:36:26.527 INFO:teuthology.orchestra.run.smithi159.stdout: "inodes": 2180, 2024-09-11T23:36:26.527 INFO:teuthology.orchestra.run.smithi159.stdout: "inodes_top": 0, 2024-09-11T23:36:26.527 INFO:teuthology.orchestra.run.smithi159.stdout: "inodes_bottom": 2180, 2024-09-11T23:36:26.527 INFO:teuthology.orchestra.run.smithi159.stdout: "inodes_pin_tail": 0, 2024-09-11T23:36:26.527 INFO:teuthology.orchestra.run.smithi159.stdout: "inodes_pinned": 2180, 2024-09-11T23:36:26.527 INFO:teuthology.orchestra.run.smithi159.stdout: "inodes_expired": 0, 2024-09-11T23:36:26.527 INFO:teuthology.orchestra.run.smithi159.stdout: "inodes_with_caps": 0, 2024-09-11T23:36:26.527 INFO:teuthology.orchestra.run.smithi159.stdout: "caps": 0, 2024-09-11T23:36:26.527 INFO:teuthology.orchestra.run.smithi159.stdout: "subtrees": 1, 2024-09-11T23:36:26.527 INFO:teuthology.orchestra.run.smithi159.stdout: "traverse": 0, 2024-09-11T23:36:26.527 INFO:teuthology.orchestra.run.smithi159.stdout: "traverse_hit": 0, 2024-09-11T23:36:26.528 INFO:teuthology.orchestra.run.smithi159.stdout: "traverse_forward": 0, 2024-09-11T23:36:26.528 INFO:teuthology.orchestra.run.smithi159.stdout: "traverse_discover": 0, 2024-09-11T23:36:26.528 INFO:teuthology.orchestra.run.smithi159.stdout: "traverse_dir_fetch": 0, 2024-09-11T23:36:26.528 INFO:teuthology.orchestra.run.smithi159.stdout: "traverse_remote_ino": 0, 2024-09-11T23:36:26.528 INFO:teuthology.orchestra.run.smithi159.stdout: "traverse_lock": 0, 2024-09-11T23:36:26.528 INFO:teuthology.orchestra.run.smithi159.stdout: "load_cent": 0, 2024-09-11T23:36:26.528 INFO:teuthology.orchestra.run.smithi159.stdout: "q": 0, 2024-09-11T23:36:26.528 INFO:teuthology.orchestra.run.smithi159.stdout: "exported": 0, 2024-09-11T23:36:26.528 INFO:teuthology.orchestra.run.smithi159.stdout: "exported_inodes": 0, 2024-09-11T23:36:26.528 INFO:teuthology.orchestra.run.smithi159.stdout: "imported": 0, 2024-09-11T23:36:26.528 INFO:teuthology.orchestra.run.smithi159.stdout: "imported_inodes": 0, 2024-09-11T23:36:26.528 INFO:teuthology.orchestra.run.smithi159.stdout: "openino_dir_fetch": 0, 2024-09-11T23:36:26.529 INFO:teuthology.orchestra.run.smithi159.stdout: "openino_backtrace_fetch": 0, 2024-09-11T23:36:26.529 INFO:teuthology.orchestra.run.smithi159.stdout: "openino_peer_discover": 0, 2024-09-11T23:36:26.529 INFO:teuthology.orchestra.run.smithi159.stdout: "root_rfiles": 0, 2024-09-11T23:36:26.529 INFO:teuthology.orchestra.run.smithi159.stdout: "root_rbytes": 0, 2024-09-11T23:36:26.529 INFO:teuthology.orchestra.run.smithi159.stdout: "root_rsnaps": 0, 2024-09-11T23:36:26.529 INFO:teuthology.orchestra.run.smithi159.stdout: "scrub_backtrace_fetch": 0, 2024-09-11T23:36:26.529 INFO:teuthology.orchestra.run.smithi159.stdout: "scrub_set_tag": 0, 2024-09-11T23:36:26.529 INFO:teuthology.orchestra.run.smithi159.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T23:36:26.529 INFO:teuthology.orchestra.run.smithi159.stdout: "scrub_inotable_repaired": 0, 2024-09-11T23:36:26.529 INFO:teuthology.orchestra.run.smithi159.stdout: "scrub_dir_inodes": 0, 2024-09-11T23:36:26.529 INFO:teuthology.orchestra.run.smithi159.stdout: "scrub_dir_base_inodes": 0, 2024-09-11T23:36:26.529 INFO:teuthology.orchestra.run.smithi159.stdout: "scrub_dirfrag_rstats": 0, 2024-09-11T23:36:26.529 INFO:teuthology.orchestra.run.smithi159.stdout: "scrub_file_inodes": 0, 2024-09-11T23:36:26.530 INFO:teuthology.orchestra.run.smithi159.stdout: "handle_inode_file_caps": 0, 2024-09-11T23:36:26.530 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph_cap_op_revoke": 0, 2024-09-11T23:36:26.530 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph_cap_op_grant": 0, 2024-09-11T23:36:26.530 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph_cap_op_trunc": 0, 2024-09-11T23:36:26.530 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T23:36:26.530 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T23:36:26.530 INFO:teuthology.orchestra.run.smithi159.stdout: "handle_client_caps": 0, 2024-09-11T23:36:26.530 INFO:teuthology.orchestra.run.smithi159.stdout: "handle_client_caps_dirty": 0, 2024-09-11T23:36:26.530 INFO:teuthology.orchestra.run.smithi159.stdout: "handle_client_cap_release": 0, 2024-09-11T23:36:26.530 INFO:teuthology.orchestra.run.smithi159.stdout: "process_request_cap_release": 0 2024-09-11T23:36:26.530 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.530 INFO:teuthology.orchestra.run.smithi159.stdout: "mds_cache": { 2024-09-11T23:36:26.530 INFO:teuthology.orchestra.run.smithi159.stdout: "dir_update": 0, 2024-09-11T23:36:26.531 INFO:teuthology.orchestra.run.smithi159.stdout: "dir_update_receipt": 0, 2024-09-11T23:36:26.531 INFO:teuthology.orchestra.run.smithi159.stdout: "dir_try_discover": 0, 2024-09-11T23:36:26.531 INFO:teuthology.orchestra.run.smithi159.stdout: "dir_send_discover": 0, 2024-09-11T23:36:26.531 INFO:teuthology.orchestra.run.smithi159.stdout: "dir_handle_discover": 0, 2024-09-11T23:36:26.531 INFO:teuthology.orchestra.run.smithi159.stdout: "num_strays": 0, 2024-09-11T23:36:26.531 INFO:teuthology.orchestra.run.smithi159.stdout: "num_strays_delayed": 0, 2024-09-11T23:36:26.531 INFO:teuthology.orchestra.run.smithi159.stdout: "num_strays_enqueuing": 0, 2024-09-11T23:36:26.531 INFO:teuthology.orchestra.run.smithi159.stdout: "strays_created": 0, 2024-09-11T23:36:26.531 INFO:teuthology.orchestra.run.smithi159.stdout: "strays_enqueued": 0, 2024-09-11T23:36:26.531 INFO:teuthology.orchestra.run.smithi159.stdout: "strays_reintegrated": 0, 2024-09-11T23:36:26.531 INFO:teuthology.orchestra.run.smithi159.stdout: "strays_migrated": 0, 2024-09-11T23:36:26.531 INFO:teuthology.orchestra.run.smithi159.stdout: "num_recovering_processing": 0, 2024-09-11T23:36:26.531 INFO:teuthology.orchestra.run.smithi159.stdout: "num_recovering_enqueued": 0, 2024-09-11T23:36:26.531 INFO:teuthology.orchestra.run.smithi159.stdout: "num_recovering_prioritized": 0, 2024-09-11T23:36:26.532 INFO:teuthology.orchestra.run.smithi159.stdout: "recovery_started": 0, 2024-09-11T23:36:26.532 INFO:teuthology.orchestra.run.smithi159.stdout: "recovery_completed": 0, 2024-09-11T23:36:26.532 INFO:teuthology.orchestra.run.smithi159.stdout: "ireq_quiesce_path": 0, 2024-09-11T23:36:26.532 INFO:teuthology.orchestra.run.smithi159.stdout: "ireq_quiesce_inode": 0, 2024-09-11T23:36:26.532 INFO:teuthology.orchestra.run.smithi159.stdout: "ireq_enqueue_scrub": 0, 2024-09-11T23:36:26.532 INFO:teuthology.orchestra.run.smithi159.stdout: "ireq_exportdir": 0, 2024-09-11T23:36:26.532 INFO:teuthology.orchestra.run.smithi159.stdout: "ireq_flush": 0, 2024-09-11T23:36:26.532 INFO:teuthology.orchestra.run.smithi159.stdout: "ireq_fragmentdir": 0, 2024-09-11T23:36:26.532 INFO:teuthology.orchestra.run.smithi159.stdout: "ireq_fragstats": 0, 2024-09-11T23:36:26.532 INFO:teuthology.orchestra.run.smithi159.stdout: "ireq_inodestats": 0 2024-09-11T23:36:26.532 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.532 INFO:teuthology.orchestra.run.smithi159.stdout: "mds_log": { 2024-09-11T23:36:26.532 INFO:teuthology.orchestra.run.smithi159.stdout: "evlrg": 0, 2024-09-11T23:36:26.533 INFO:teuthology.orchestra.run.smithi159.stdout: "evadd": 0, 2024-09-11T23:36:26.533 INFO:teuthology.orchestra.run.smithi159.stdout: "evex": 0, 2024-09-11T23:36:26.533 INFO:teuthology.orchestra.run.smithi159.stdout: "evtrm": 0, 2024-09-11T23:36:26.533 INFO:teuthology.orchestra.run.smithi159.stdout: "ev": 42081, 2024-09-11T23:36:26.533 INFO:teuthology.orchestra.run.smithi159.stdout: "evexg": 0, 2024-09-11T23:36:26.533 INFO:teuthology.orchestra.run.smithi159.stdout: "evexd": 0, 2024-09-11T23:36:26.533 INFO:teuthology.orchestra.run.smithi159.stdout: "segadd": 0, 2024-09-11T23:36:26.533 INFO:teuthology.orchestra.run.smithi159.stdout: "segex": 0, 2024-09-11T23:36:26.533 INFO:teuthology.orchestra.run.smithi159.stdout: "segtrm": 0, 2024-09-11T23:36:26.533 INFO:teuthology.orchestra.run.smithi159.stdout: "seg": 48, 2024-09-11T23:36:26.533 INFO:teuthology.orchestra.run.smithi159.stdout: "segmjr": 5, 2024-09-11T23:36:26.533 INFO:teuthology.orchestra.run.smithi159.stdout: "segexg": 0, 2024-09-11T23:36:26.533 INFO:teuthology.orchestra.run.smithi159.stdout: "segexd": 0, 2024-09-11T23:36:26.534 INFO:teuthology.orchestra.run.smithi159.stdout: "expos": 4194304, 2024-09-11T23:36:26.534 INFO:teuthology.orchestra.run.smithi159.stdout: "wrpos": 35831322, 2024-09-11T23:36:26.534 INFO:teuthology.orchestra.run.smithi159.stdout: "rdpos": 35830723, 2024-09-11T23:36:26.534 INFO:teuthology.orchestra.run.smithi159.stdout: "jlat": { 2024-09-11T23:36:26.534 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:26.534 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:26.534 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:26.534 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.534 INFO:teuthology.orchestra.run.smithi159.stdout: "replayed": 42081 2024-09-11T23:36:26.534 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.534 INFO:teuthology.orchestra.run.smithi159.stdout: "mds_mem": { 2024-09-11T23:36:26.534 INFO:teuthology.orchestra.run.smithi159.stdout: "ino": 13, 2024-09-11T23:36:26.534 INFO:teuthology.orchestra.run.smithi159.stdout: "ino+": 2218, 2024-09-11T23:36:26.534 INFO:teuthology.orchestra.run.smithi159.stdout: "ino-": 2205, 2024-09-11T23:36:26.535 INFO:teuthology.orchestra.run.smithi159.stdout: "dir": 11, 2024-09-11T23:36:26.535 INFO:teuthology.orchestra.run.smithi159.stdout: "dir+": 107, 2024-09-11T23:36:26.535 INFO:teuthology.orchestra.run.smithi159.stdout: "dir-": 96, 2024-09-11T23:36:26.535 INFO:teuthology.orchestra.run.smithi159.stdout: "dn": 2180, 2024-09-11T23:36:26.535 INFO:teuthology.orchestra.run.smithi159.stdout: "dn+": 3936, 2024-09-11T23:36:26.535 INFO:teuthology.orchestra.run.smithi159.stdout: "dn-": 1756, 2024-09-11T23:36:26.535 INFO:teuthology.orchestra.run.smithi159.stdout: "cap": 0, 2024-09-11T23:36:26.535 INFO:teuthology.orchestra.run.smithi159.stdout: "cap+": 0, 2024-09-11T23:36:26.535 INFO:teuthology.orchestra.run.smithi159.stdout: "cap-": 0, 2024-09-11T23:36:26.535 INFO:teuthology.orchestra.run.smithi159.stdout: "rss": 53604, 2024-09-11T23:36:26.535 INFO:teuthology.orchestra.run.smithi159.stdout: "heap": 215328 2024-09-11T23:36:26.535 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.535 INFO:teuthology.orchestra.run.smithi159.stdout: "mds_server": { 2024-09-11T23:36:26.536 INFO:teuthology.orchestra.run.smithi159.stdout: "dispatch_client_request": 0, 2024-09-11T23:36:26.536 INFO:teuthology.orchestra.run.smithi159.stdout: "dispatch_server_request": 0, 2024-09-11T23:36:26.536 INFO:teuthology.orchestra.run.smithi159.stdout: "handle_client_request": 0, 2024-09-11T23:36:26.536 INFO:teuthology.orchestra.run.smithi159.stdout: "handle_client_session": 0, 2024-09-11T23:36:26.536 INFO:teuthology.orchestra.run.smithi159.stdout: "handle_peer_request": 0, 2024-09-11T23:36:26.536 INFO:teuthology.orchestra.run.smithi159.stdout: "req_create_latency": { 2024-09-11T23:36:26.536 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:26.536 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:26.536 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:26.536 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.536 INFO:teuthology.orchestra.run.smithi159.stdout: "req_getattr_latency": { 2024-09-11T23:36:26.536 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:26.536 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:26.537 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:26.537 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.537 INFO:teuthology.orchestra.run.smithi159.stdout: "req_getfilelock_latency": { 2024-09-11T23:36:26.537 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:26.537 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:26.537 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:26.537 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.537 INFO:teuthology.orchestra.run.smithi159.stdout: "req_link_latency": { 2024-09-11T23:36:26.537 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:26.537 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:26.537 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:26.537 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.537 INFO:teuthology.orchestra.run.smithi159.stdout: "req_lookup_latency": { 2024-09-11T23:36:26.538 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:26.538 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:26.538 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:26.538 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.538 INFO:teuthology.orchestra.run.smithi159.stdout: "req_lookuphash_latency": { 2024-09-11T23:36:26.538 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:26.538 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:26.538 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:26.538 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.538 INFO:teuthology.orchestra.run.smithi159.stdout: "req_lookupino_latency": { 2024-09-11T23:36:26.538 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:26.538 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:26.538 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:26.538 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.539 INFO:teuthology.orchestra.run.smithi159.stdout: "req_lookupname_latency": { 2024-09-11T23:36:26.539 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:26.539 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:26.539 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:26.539 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.539 INFO:teuthology.orchestra.run.smithi159.stdout: "req_lookupparent_latency": { 2024-09-11T23:36:26.539 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:26.539 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:26.539 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:26.539 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.539 INFO:teuthology.orchestra.run.smithi159.stdout: "req_lookupsnap_latency": { 2024-09-11T23:36:26.539 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:26.539 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:26.540 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:26.540 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.540 INFO:teuthology.orchestra.run.smithi159.stdout: "req_lssnap_latency": { 2024-09-11T23:36:26.540 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:26.540 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:26.540 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:26.540 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.540 INFO:teuthology.orchestra.run.smithi159.stdout: "req_mkdir_latency": { 2024-09-11T23:36:26.540 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:26.540 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:26.540 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:26.540 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.540 INFO:teuthology.orchestra.run.smithi159.stdout: "req_mknod_latency": { 2024-09-11T23:36:26.541 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:26.541 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:26.541 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:26.541 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.541 INFO:teuthology.orchestra.run.smithi159.stdout: "req_mksnap_latency": { 2024-09-11T23:36:26.541 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:26.541 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:26.541 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:26.541 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.541 INFO:teuthology.orchestra.run.smithi159.stdout: "req_open_latency": { 2024-09-11T23:36:26.541 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:26.541 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:26.541 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:26.542 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.542 INFO:teuthology.orchestra.run.smithi159.stdout: "req_readdir_latency": { 2024-09-11T23:36:26.542 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:26.542 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:26.542 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:26.542 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.542 INFO:teuthology.orchestra.run.smithi159.stdout: "req_rename_latency": { 2024-09-11T23:36:26.542 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:26.542 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:26.542 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:26.542 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.542 INFO:teuthology.orchestra.run.smithi159.stdout: "req_renamesnap_latency": { 2024-09-11T23:36:26.543 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:26.543 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:26.543 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:26.543 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.543 INFO:teuthology.orchestra.run.smithi159.stdout: "req_snapdiff_latency": { 2024-09-11T23:36:26.543 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:26.543 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:26.543 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:26.543 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.543 INFO:teuthology.orchestra.run.smithi159.stdout: "req_rmdir_latency": { 2024-09-11T23:36:26.543 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:26.543 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:26.543 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:26.544 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.544 INFO:teuthology.orchestra.run.smithi159.stdout: "req_rmsnap_latency": { 2024-09-11T23:36:26.544 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:26.544 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:26.544 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:26.544 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.544 INFO:teuthology.orchestra.run.smithi159.stdout: "req_rmxattr_latency": { 2024-09-11T23:36:26.544 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:26.544 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:26.544 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:26.544 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.544 INFO:teuthology.orchestra.run.smithi159.stdout: "req_setattr_latency": { 2024-09-11T23:36:26.544 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:26.545 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:26.545 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:26.545 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.545 INFO:teuthology.orchestra.run.smithi159.stdout: "req_setdirlayout_latency": { 2024-09-11T23:36:26.545 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:26.545 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:26.545 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:26.545 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.545 INFO:teuthology.orchestra.run.smithi159.stdout: "req_setfilelock_latency": { 2024-09-11T23:36:26.545 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:26.545 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:26.545 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:26.545 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.546 INFO:teuthology.orchestra.run.smithi159.stdout: "req_setlayout_latency": { 2024-09-11T23:36:26.546 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:26.546 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:26.546 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:26.546 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.546 INFO:teuthology.orchestra.run.smithi159.stdout: "req_setxattr_latency": { 2024-09-11T23:36:26.546 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:26.546 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:26.546 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:26.546 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.546 INFO:teuthology.orchestra.run.smithi159.stdout: "req_symlink_latency": { 2024-09-11T23:36:26.546 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:26.547 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:26.547 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:26.547 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.547 INFO:teuthology.orchestra.run.smithi159.stdout: "req_unlink_latency": { 2024-09-11T23:36:26.547 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:26.547 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:26.547 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:26.547 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.547 INFO:teuthology.orchestra.run.smithi159.stdout: "cap_revoke_eviction": 0, 2024-09-11T23:36:26.547 INFO:teuthology.orchestra.run.smithi159.stdout: "cap_acquisition_throttle": 0, 2024-09-11T23:36:26.547 INFO:teuthology.orchestra.run.smithi159.stdout: "req_getvxattr_latency": { 2024-09-11T23:36:26.547 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:26.547 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:26.548 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:26.548 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-11T23:36:26.548 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.548 INFO:teuthology.orchestra.run.smithi159.stdout: "mds_sessions": { 2024-09-11T23:36:26.548 INFO:teuthology.orchestra.run.smithi159.stdout: "session_count": 1, 2024-09-11T23:36:26.548 INFO:teuthology.orchestra.run.smithi159.stdout: "session_add": 1, 2024-09-11T23:36:26.548 INFO:teuthology.orchestra.run.smithi159.stdout: "session_remove": 0, 2024-09-11T23:36:26.548 INFO:teuthology.orchestra.run.smithi159.stdout: "sessions_open": 1, 2024-09-11T23:36:26.548 INFO:teuthology.orchestra.run.smithi159.stdout: "sessions_stale": 0, 2024-09-11T23:36:26.548 INFO:teuthology.orchestra.run.smithi159.stdout: "total_load": 0, 2024-09-11T23:36:26.548 INFO:teuthology.orchestra.run.smithi159.stdout: "average_load": 0, 2024-09-11T23:36:26.548 INFO:teuthology.orchestra.run.smithi159.stdout: "avg_session_uptime": 1487, 2024-09-11T23:36:26.548 INFO:teuthology.orchestra.run.smithi159.stdout: "mdthresh_evicted": 0 2024-09-11T23:36:26.549 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.549 INFO:teuthology.orchestra.run.smithi159.stdout: "mempool": { 2024-09-11T23:36:26.549 INFO:teuthology.orchestra.run.smithi159.stdout: "bloom_filter_bytes": 0, 2024-09-11T23:36:26.549 INFO:teuthology.orchestra.run.smithi159.stdout: "bloom_filter_items": 0, 2024-09-11T23:36:26.549 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T23:36:26.549 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_alloc_items": 0, 2024-09-11T23:36:26.549 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T23:36:26.549 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_data_items": 0, 2024-09-11T23:36:26.549 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T23:36:26.549 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T23:36:26.549 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T23:36:26.549 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T23:36:26.549 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T23:36:26.550 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_other_items": 0, 2024-09-11T23:36:26.550 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T23:36:26.550 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T23:36:26.550 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_extent_bytes": 0, 2024-09-11T23:36:26.550 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_extent_items": 0, 2024-09-11T23:36:26.550 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_blob_bytes": 0, 2024-09-11T23:36:26.550 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_blob_items": 0, 2024-09-11T23:36:26.550 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T23:36:26.550 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T23:36:26.550 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T23:36:26.550 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T23:36:26.550 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T23:36:26.550 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_fsck_items": 0, 2024-09-11T23:36:26.551 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_txc_bytes": 0, 2024-09-11T23:36:26.551 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_txc_items": 0, 2024-09-11T23:36:26.551 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T23:36:26.551 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T23:36:26.551 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_writing_bytes": 0, 2024-09-11T23:36:26.551 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_writing_items": 0, 2024-09-11T23:36:26.551 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_bytes": 0, 2024-09-11T23:36:26.551 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_items": 0, 2024-09-11T23:36:26.551 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T23:36:26.551 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_file_reader_items": 0, 2024-09-11T23:36:26.551 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T23:36:26.551 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_file_writer_items": 0, 2024-09-11T23:36:26.551 INFO:teuthology.orchestra.run.smithi159.stdout: "buffer_anon_bytes": 214424, 2024-09-11T23:36:26.552 INFO:teuthology.orchestra.run.smithi159.stdout: "buffer_anon_items": 65, 2024-09-11T23:36:26.552 INFO:teuthology.orchestra.run.smithi159.stdout: "buffer_meta_bytes": 0, 2024-09-11T23:36:26.552 INFO:teuthology.orchestra.run.smithi159.stdout: "buffer_meta_items": 0, 2024-09-11T23:36:26.552 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_bytes": 0, 2024-09-11T23:36:26.552 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_items": 0, 2024-09-11T23:36:26.552 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_mapbl_bytes": 0, 2024-09-11T23:36:26.552 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_mapbl_items": 0, 2024-09-11T23:36:26.552 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_pglog_bytes": 0, 2024-09-11T23:36:26.552 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_pglog_items": 0, 2024-09-11T23:36:26.552 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_bytes": 8960, 2024-09-11T23:36:26.552 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_items": 169, 2024-09-11T23:36:26.552 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T23:36:26.552 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_mapping_items": 0, 2024-09-11T23:36:26.553 INFO:teuthology.orchestra.run.smithi159.stdout: "pgmap_bytes": 0, 2024-09-11T23:36:26.553 INFO:teuthology.orchestra.run.smithi159.stdout: "pgmap_items": 0, 2024-09-11T23:36:26.553 INFO:teuthology.orchestra.run.smithi159.stdout: "mds_co_bytes": 1578312, 2024-09-11T23:36:26.553 INFO:teuthology.orchestra.run.smithi159.stdout: "mds_co_items": 8848, 2024-09-11T23:36:26.553 INFO:teuthology.orchestra.run.smithi159.stdout: "unittest_1_bytes": 0, 2024-09-11T23:36:26.553 INFO:teuthology.orchestra.run.smithi159.stdout: "unittest_1_items": 0, 2024-09-11T23:36:26.553 INFO:teuthology.orchestra.run.smithi159.stdout: "unittest_2_bytes": 0, 2024-09-11T23:36:26.553 INFO:teuthology.orchestra.run.smithi159.stdout: "unittest_2_items": 0 2024-09-11T23:36:26.553 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.553 INFO:teuthology.orchestra.run.smithi159.stdout: "objecter": { 2024-09-11T23:36:26.553 INFO:teuthology.orchestra.run.smithi159.stdout: "op_active": 0, 2024-09-11T23:36:26.553 INFO:teuthology.orchestra.run.smithi159.stdout: "op_laggy": 0, 2024-09-11T23:36:26.553 INFO:teuthology.orchestra.run.smithi159.stdout: "op_send": 1624, 2024-09-11T23:36:26.554 INFO:teuthology.orchestra.run.smithi159.stdout: "op_send_bytes": 21, 2024-09-11T23:36:26.554 INFO:teuthology.orchestra.run.smithi159.stdout: "op_resend": 3, 2024-09-11T23:36:26.554 INFO:teuthology.orchestra.run.smithi159.stdout: "op_reply": 1624, 2024-09-11T23:36:26.554 INFO:teuthology.orchestra.run.smithi159.stdout: "op_latency": { 2024-09-11T23:36:26.554 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 1624, 2024-09-11T23:36:26.554 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.935982782, 2024-09-11T23:36:26.554 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000576344 2024-09-11T23:36:26.554 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.554 INFO:teuthology.orchestra.run.smithi159.stdout: "op_inflight": 0, 2024-09-11T23:36:26.554 INFO:teuthology.orchestra.run.smithi159.stdout: "oplen_avg": { 2024-09-11T23:36:26.554 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 1624, 2024-09-11T23:36:26.554 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 1625 2024-09-11T23:36:26.554 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.555 INFO:teuthology.orchestra.run.smithi159.stdout: "op": 1624, 2024-09-11T23:36:26.555 INFO:teuthology.orchestra.run.smithi159.stdout: "op_r": 1624, 2024-09-11T23:36:26.555 INFO:teuthology.orchestra.run.smithi159.stdout: "op_w": 0, 2024-09-11T23:36:26.555 INFO:teuthology.orchestra.run.smithi159.stdout: "op_rmw": 0, 2024-09-11T23:36:26.555 INFO:teuthology.orchestra.run.smithi159.stdout: "op_pg": 0, 2024-09-11T23:36:26.555 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_stat": 1002, 2024-09-11T23:36:26.555 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_create": 0, 2024-09-11T23:36:26.555 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_read": 620, 2024-09-11T23:36:26.555 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_write": 0, 2024-09-11T23:36:26.555 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_writefull": 0, 2024-09-11T23:36:26.556 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_writesame": 0, 2024-09-11T23:36:26.556 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_append": 0, 2024-09-11T23:36:26.556 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_zero": 0, 2024-09-11T23:36:26.556 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_truncate": 0, 2024-09-11T23:36:26.556 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_delete": 0, 2024-09-11T23:36:26.556 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_mapext": 0, 2024-09-11T23:36:26.556 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_sparse_read": 0, 2024-09-11T23:36:26.556 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_clonerange": 0, 2024-09-11T23:36:26.556 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_getxattr": 1, 2024-09-11T23:36:26.557 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_setxattr": 0, 2024-09-11T23:36:26.557 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_cmpxattr": 0, 2024-09-11T23:36:26.557 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_rmxattr": 0, 2024-09-11T23:36:26.557 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_resetxattrs": 0, 2024-09-11T23:36:26.557 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_call": 0, 2024-09-11T23:36:26.557 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_watch": 0, 2024-09-11T23:36:26.557 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_notify": 0, 2024-09-11T23:36:26.557 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T23:36:26.557 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_pgls": 0, 2024-09-11T23:36:26.557 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_pgls_filter": 0, 2024-09-11T23:36:26.557 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_other": 0, 2024-09-11T23:36:26.557 INFO:teuthology.orchestra.run.smithi159.stdout: "linger_active": 0, 2024-09-11T23:36:26.557 INFO:teuthology.orchestra.run.smithi159.stdout: "linger_send": 0, 2024-09-11T23:36:26.558 INFO:teuthology.orchestra.run.smithi159.stdout: "linger_resend": 0, 2024-09-11T23:36:26.558 INFO:teuthology.orchestra.run.smithi159.stdout: "linger_ping": 0, 2024-09-11T23:36:26.558 INFO:teuthology.orchestra.run.smithi159.stdout: "poolop_active": 0, 2024-09-11T23:36:26.558 INFO:teuthology.orchestra.run.smithi159.stdout: "poolop_send": 0, 2024-09-11T23:36:26.558 INFO:teuthology.orchestra.run.smithi159.stdout: "poolop_resend": 0, 2024-09-11T23:36:26.558 INFO:teuthology.orchestra.run.smithi159.stdout: "poolstat_active": 0, 2024-09-11T23:36:26.558 INFO:teuthology.orchestra.run.smithi159.stdout: "poolstat_send": 0, 2024-09-11T23:36:26.558 INFO:teuthology.orchestra.run.smithi159.stdout: "poolstat_resend": 0, 2024-09-11T23:36:26.558 INFO:teuthology.orchestra.run.smithi159.stdout: "statfs_active": 0, 2024-09-11T23:36:26.558 INFO:teuthology.orchestra.run.smithi159.stdout: "statfs_send": 0, 2024-09-11T23:36:26.558 INFO:teuthology.orchestra.run.smithi159.stdout: "statfs_resend": 0, 2024-09-11T23:36:26.558 INFO:teuthology.orchestra.run.smithi159.stdout: "command_active": 0, 2024-09-11T23:36:26.558 INFO:teuthology.orchestra.run.smithi159.stdout: "command_send": 0, 2024-09-11T23:36:26.558 INFO:teuthology.orchestra.run.smithi159.stdout: "command_resend": 0, 2024-09-11T23:36:26.559 INFO:teuthology.orchestra.run.smithi159.stdout: "map_epoch": 88, 2024-09-11T23:36:26.559 INFO:teuthology.orchestra.run.smithi159.stdout: "map_full": 0, 2024-09-11T23:36:26.559 INFO:teuthology.orchestra.run.smithi159.stdout: "map_inc": 2, 2024-09-11T23:36:26.559 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_sessions": 8, 2024-09-11T23:36:26.559 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_session_open": 8, 2024-09-11T23:36:26.559 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_session_close": 0, 2024-09-11T23:36:26.559 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_laggy": 0, 2024-09-11T23:36:26.559 INFO:teuthology.orchestra.run.smithi159.stdout: "omap_wr": 0, 2024-09-11T23:36:26.559 INFO:teuthology.orchestra.run.smithi159.stdout: "omap_rd": 2, 2024-09-11T23:36:26.559 INFO:teuthology.orchestra.run.smithi159.stdout: "omap_del": 0 2024-09-11T23:36:26.559 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.559 INFO:teuthology.orchestra.run.smithi159.stdout: "oft": { 2024-09-11T23:36:26.559 INFO:teuthology.orchestra.run.smithi159.stdout: "omap_total_objs": 0, 2024-09-11T23:36:26.560 INFO:teuthology.orchestra.run.smithi159.stdout: "omap_total_kv_pairs": 0, 2024-09-11T23:36:26.560 INFO:teuthology.orchestra.run.smithi159.stdout: "omap_total_updates": 0, 2024-09-11T23:36:26.560 INFO:teuthology.orchestra.run.smithi159.stdout: "omap_total_removes": 0 2024-09-11T23:36:26.560 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.560 INFO:teuthology.orchestra.run.smithi159.stdout: "osd-slow-ops": { 2024-09-11T23:36:26.560 INFO:teuthology.orchestra.run.smithi159.stdout: "slow_ops_count": 0 2024-09-11T23:36:26.560 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.560 INFO:teuthology.orchestra.run.smithi159.stdout: "purge_queue": { 2024-09-11T23:36:26.560 INFO:teuthology.orchestra.run.smithi159.stdout: "pq_executing_ops": 0, 2024-09-11T23:36:26.560 INFO:teuthology.orchestra.run.smithi159.stdout: "pq_executing_ops_high_water": 0, 2024-09-11T23:36:26.560 INFO:teuthology.orchestra.run.smithi159.stdout: "pq_executing": 0, 2024-09-11T23:36:26.560 INFO:teuthology.orchestra.run.smithi159.stdout: "pq_executing_high_water": 0, 2024-09-11T23:36:26.560 INFO:teuthology.orchestra.run.smithi159.stdout: "pq_executed_ops": 0, 2024-09-11T23:36:26.561 INFO:teuthology.orchestra.run.smithi159.stdout: "pq_executed": 0, 2024-09-11T23:36:26.561 INFO:teuthology.orchestra.run.smithi159.stdout: "pq_item_in_journal": 0 2024-09-11T23:36:26.561 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.561 INFO:teuthology.orchestra.run.smithi159.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T23:36:26.561 INFO:teuthology.orchestra.run.smithi159.stdout: "val": 0, 2024-09-11T23:36:26.561 INFO:teuthology.orchestra.run.smithi159.stdout: "max": 104857600, 2024-09-11T23:36:26.561 INFO:teuthology.orchestra.run.smithi159.stdout: "get_started": 0, 2024-09-11T23:36:26.561 INFO:teuthology.orchestra.run.smithi159.stdout: "get": 1809, 2024-09-11T23:36:26.561 INFO:teuthology.orchestra.run.smithi159.stdout: "get_sum": 32440487, 2024-09-11T23:36:26.561 INFO:teuthology.orchestra.run.smithi159.stdout: "get_or_fail_fail": 0, 2024-09-11T23:36:26.561 INFO:teuthology.orchestra.run.smithi159.stdout: "get_or_fail_success": 1809, 2024-09-11T23:36:26.561 INFO:teuthology.orchestra.run.smithi159.stdout: "take": 0, 2024-09-11T23:36:26.561 INFO:teuthology.orchestra.run.smithi159.stdout: "take_sum": 0, 2024-09-11T23:36:26.562 INFO:teuthology.orchestra.run.smithi159.stdout: "put": 1809, 2024-09-11T23:36:26.562 INFO:teuthology.orchestra.run.smithi159.stdout: "put_sum": 32440487, 2024-09-11T23:36:26.562 INFO:teuthology.orchestra.run.smithi159.stdout: "wait": { 2024-09-11T23:36:26.562 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:26.562 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:26.562 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:26.562 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-11T23:36:26.562 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.562 INFO:teuthology.orchestra.run.smithi159.stdout: "throttle-objecter_bytes": { 2024-09-11T23:36:26.562 INFO:teuthology.orchestra.run.smithi159.stdout: "val": 0, 2024-09-11T23:36:26.562 INFO:teuthology.orchestra.run.smithi159.stdout: "max": 104857600, 2024-09-11T23:36:26.562 INFO:teuthology.orchestra.run.smithi159.stdout: "get_started": 0, 2024-09-11T23:36:26.563 INFO:teuthology.orchestra.run.smithi159.stdout: "get": 0, 2024-09-11T23:36:26.563 INFO:teuthology.orchestra.run.smithi159.stdout: "get_sum": 0, 2024-09-11T23:36:26.563 INFO:teuthology.orchestra.run.smithi159.stdout: "get_or_fail_fail": 0, 2024-09-11T23:36:26.563 INFO:teuthology.orchestra.run.smithi159.stdout: "get_or_fail_success": 0, 2024-09-11T23:36:26.563 INFO:teuthology.orchestra.run.smithi159.stdout: "take": 1624, 2024-09-11T23:36:26.563 INFO:teuthology.orchestra.run.smithi159.stdout: "take_sum": 31640517, 2024-09-11T23:36:26.563 INFO:teuthology.orchestra.run.smithi159.stdout: "put": 1624, 2024-09-11T23:36:26.563 INFO:teuthology.orchestra.run.smithi159.stdout: "put_sum": 31640517, 2024-09-11T23:36:26.564 INFO:teuthology.orchestra.run.smithi159.stdout: "wait": { 2024-09-11T23:36:26.564 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:26.564 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:26.564 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:26.564 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-11T23:36:26.564 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.564 INFO:teuthology.orchestra.run.smithi159.stdout: "throttle-objecter_ops": { 2024-09-11T23:36:26.564 INFO:teuthology.orchestra.run.smithi159.stdout: "val": 0, 2024-09-11T23:36:26.564 INFO:teuthology.orchestra.run.smithi159.stdout: "max": 1024, 2024-09-11T23:36:26.564 INFO:teuthology.orchestra.run.smithi159.stdout: "get_started": 0, 2024-09-11T23:36:26.564 INFO:teuthology.orchestra.run.smithi159.stdout: "get": 0, 2024-09-11T23:36:26.565 INFO:teuthology.orchestra.run.smithi159.stdout: "get_sum": 0, 2024-09-11T23:36:26.565 INFO:teuthology.orchestra.run.smithi159.stdout: "get_or_fail_fail": 0, 2024-09-11T23:36:26.565 INFO:teuthology.orchestra.run.smithi159.stdout: "get_or_fail_success": 0, 2024-09-11T23:36:26.565 INFO:teuthology.orchestra.run.smithi159.stdout: "take": 1624, 2024-09-11T23:36:26.565 INFO:teuthology.orchestra.run.smithi159.stdout: "take_sum": 1624, 2024-09-11T23:36:26.565 INFO:teuthology.orchestra.run.smithi159.stdout: "put": 1624, 2024-09-11T23:36:26.565 INFO:teuthology.orchestra.run.smithi159.stdout: "put_sum": 1624, 2024-09-11T23:36:26.566 INFO:teuthology.orchestra.run.smithi159.stdout: "wait": { 2024-09-11T23:36:26.566 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:26.566 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:26.566 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:26.566 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-11T23:36:26.566 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.566 INFO:teuthology.orchestra.run.smithi159.stdout: "throttle-write_buf_throttle": { 2024-09-11T23:36:26.566 INFO:teuthology.orchestra.run.smithi159.stdout: "val": 0, 2024-09-11T23:36:26.566 INFO:teuthology.orchestra.run.smithi159.stdout: "max": 3758096384, 2024-09-11T23:36:26.566 INFO:teuthology.orchestra.run.smithi159.stdout: "get_started": 0, 2024-09-11T23:36:26.566 INFO:teuthology.orchestra.run.smithi159.stdout: "get": 0, 2024-09-11T23:36:26.566 INFO:teuthology.orchestra.run.smithi159.stdout: "get_sum": 0, 2024-09-11T23:36:26.566 INFO:teuthology.orchestra.run.smithi159.stdout: "get_or_fail_fail": 0, 2024-09-11T23:36:26.567 INFO:teuthology.orchestra.run.smithi159.stdout: "get_or_fail_success": 0, 2024-09-11T23:36:26.567 INFO:teuthology.orchestra.run.smithi159.stdout: "take": 0, 2024-09-11T23:36:26.567 INFO:teuthology.orchestra.run.smithi159.stdout: "take_sum": 0, 2024-09-11T23:36:26.567 INFO:teuthology.orchestra.run.smithi159.stdout: "put": 0, 2024-09-11T23:36:26.567 INFO:teuthology.orchestra.run.smithi159.stdout: "put_sum": 0, 2024-09-11T23:36:26.567 INFO:teuthology.orchestra.run.smithi159.stdout: "wait": { 2024-09-11T23:36:26.567 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:26.567 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:26.567 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:26.567 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-11T23:36:26.568 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:26.568 INFO:teuthology.orchestra.run.smithi159.stdout: "throttle-write_buf_throttle-0x56455f59ab40": { 2024-09-11T23:36:26.568 INFO:teuthology.orchestra.run.smithi159.stdout: "val": 0, 2024-09-11T23:36:26.568 INFO:teuthology.orchestra.run.smithi159.stdout: "max": 3758096384, 2024-09-11T23:36:26.568 INFO:teuthology.orchestra.run.smithi159.stdout: "get_started": 0, 2024-09-11T23:36:26.568 INFO:teuthology.orchestra.run.smithi159.stdout: "get": 0, 2024-09-11T23:36:26.568 INFO:teuthology.orchestra.run.smithi159.stdout: "get_sum": 0, 2024-09-11T23:36:26.568 INFO:teuthology.orchestra.run.smithi159.stdout: "get_or_fail_fail": 0, 2024-09-11T23:36:26.568 INFO:teuthology.orchestra.run.smithi159.stdout: "get_or_fail_success": 0, 2024-09-11T23:36:26.568 INFO:teuthology.orchestra.run.smithi159.stdout: "take": 0, 2024-09-11T23:36:26.568 INFO:teuthology.orchestra.run.smithi159.stdout: "take_sum": 0, 2024-09-11T23:36:26.569 INFO:teuthology.orchestra.run.smithi159.stdout: "put": 0, 2024-09-11T23:36:26.569 INFO:teuthology.orchestra.run.smithi159.stdout: "put_sum": 0, 2024-09-11T23:36:26.569 INFO:teuthology.orchestra.run.smithi159.stdout: "wait": { 2024-09-11T23:36:26.569 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:26.569 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:26.569 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:26.569 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-11T23:36:26.569 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-11T23:36:26.569 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-11T23:36:27.318 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-11T23:36:27.318 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-11T23:36:27.318 INFO:tasks.check_counter:Daemon mds.e mds.dir_split=0 2024-09-11T23:36:27.319 DEBUG:tasks.check_counter:Getting stats from h 2024-09-11T23:36:27.319 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-11T23:36:27.578 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T23:36:27.825 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:27 smithi159 ceph-mon[34394]: pgmap v576: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 149 KiB/s wr, 99 op/s 2024-09-11T23:36:27.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:27 smithi172 ceph-mon[34855]: pgmap v576: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 149 KiB/s wr, 99 op/s 2024-09-11T23:36:27.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:27 smithi005 ceph-mon[31201]: pgmap v576: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 149 KiB/s wr, 99 op/s 2024-09-11T23:36:28.216 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-11T23:36:28.216 INFO:teuthology.orchestra.run.smithi159.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T23:36:28.216 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_messages": 14523, 2024-09-11T23:36:28.217 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages": 15873, 2024-09-11T23:36:28.217 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_bytes": 4729413, 2024-09-11T23:36:28.217 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_bytes": 23794308, 2024-09-11T23:36:28.217 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_created_connections": 14, 2024-09-11T23:36:28.217 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_active_connections": 5, 2024-09-11T23:36:28.217 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_total_time": 0.843144697, 2024-09-11T23:36:28.217 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_send_time": 0.350100633, 2024-09-11T23:36:28.217 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_recv_time": 0.513354958, 2024-09-11T23:36:28.217 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_fast_dispatch_time": 0.076762687, 2024-09-11T23:36:28.217 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:36:28.217 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 15871, 2024-09-11T23:36:28.217 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.636879415, 2024-09-11T23:36:28.218 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000040128 2024-09-11T23:36:28.218 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.218 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:36:28.218 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 22703, 2024-09-11T23:36:28.218 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.003493756, 2024-09-11T23:36:28.218 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000153 2024-09-11T23:36:28.218 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.218 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T23:36:28.218 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T23:36:28.218 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.218 INFO:teuthology.orchestra.run.smithi159.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T23:36:28.218 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_messages": 4470, 2024-09-11T23:36:28.218 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages": 6112, 2024-09-11T23:36:28.218 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_bytes": 1770034, 2024-09-11T23:36:28.219 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_bytes": 14458878, 2024-09-11T23:36:28.219 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_created_connections": 7, 2024-09-11T23:36:28.219 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_active_connections": 6, 2024-09-11T23:36:28.219 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_total_time": 0.329904700, 2024-09-11T23:36:28.219 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_send_time": 0.131441991, 2024-09-11T23:36:28.219 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_recv_time": 0.147626495, 2024-09-11T23:36:28.219 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_fast_dispatch_time": 0.059440944, 2024-09-11T23:36:28.219 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:36:28.219 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 6112, 2024-09-11T23:36:28.219 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.383683255, 2024-09-11T23:36:28.219 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000062775 2024-09-11T23:36:28.219 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.219 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:36:28.219 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 6190, 2024-09-11T23:36:28.220 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000895447, 2024-09-11T23:36:28.220 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000144 2024-09-11T23:36:28.220 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.220 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_encrypted_bytes": 526000, 2024-09-11T23:36:28.220 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_encrypted_bytes": 106992 2024-09-11T23:36:28.220 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.220 INFO:teuthology.orchestra.run.smithi159.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T23:36:28.220 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_messages": 13782, 2024-09-11T23:36:28.220 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages": 11901, 2024-09-11T23:36:28.220 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_bytes": 25471541, 2024-09-11T23:36:28.220 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_bytes": 11861653, 2024-09-11T23:36:28.220 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_created_connections": 9, 2024-09-11T23:36:28.220 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_active_connections": 6, 2024-09-11T23:36:28.221 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_total_time": 0.790459006, 2024-09-11T23:36:28.221 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_send_time": 0.350225046, 2024-09-11T23:36:28.221 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_recv_time": 0.495463119, 2024-09-11T23:36:28.221 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_fast_dispatch_time": 0.044512289, 2024-09-11T23:36:28.221 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:36:28.221 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 11899, 2024-09-11T23:36:28.221 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.356084256, 2024-09-11T23:36:28.221 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000029925 2024-09-11T23:36:28.221 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.221 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:36:28.221 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 22251, 2024-09-11T23:36:28.221 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.002907282, 2024-09-11T23:36:28.221 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000130 2024-09-11T23:36:28.222 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.222 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-11T23:36:28.222 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_encrypted_bytes": 285680 2024-09-11T23:36:28.222 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.222 INFO:teuthology.orchestra.run.smithi159.stdout: "cct": { 2024-09-11T23:36:28.222 INFO:teuthology.orchestra.run.smithi159.stdout: "total_workers": 1, 2024-09-11T23:36:28.222 INFO:teuthology.orchestra.run.smithi159.stdout: "unhealthy_workers": 0 2024-09-11T23:36:28.222 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.222 INFO:teuthology.orchestra.run.smithi159.stdout: "finisher-MDSRank": { 2024-09-11T23:36:28.222 INFO:teuthology.orchestra.run.smithi159.stdout: "queue_len": 0, 2024-09-11T23:36:28.222 INFO:teuthology.orchestra.run.smithi159.stdout: "complete_latency": { 2024-09-11T23:36:28.222 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 2491, 2024-09-11T23:36:28.222 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 3.200034542, 2024-09-11T23:36:28.222 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.001284638 2024-09-11T23:36:28.223 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-11T23:36:28.223 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.223 INFO:teuthology.orchestra.run.smithi159.stdout: "finisher-PurgeQueue": { 2024-09-11T23:36:28.223 INFO:teuthology.orchestra.run.smithi159.stdout: "queue_len": 0, 2024-09-11T23:36:28.223 INFO:teuthology.orchestra.run.smithi159.stdout: "complete_latency": { 2024-09-11T23:36:28.223 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 3894, 2024-09-11T23:36:28.223 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.402550118, 2024-09-11T23:36:28.223 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000103377 2024-09-11T23:36:28.223 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-11T23:36:28.223 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.223 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": { 2024-09-11T23:36:28.223 INFO:teuthology.orchestra.run.smithi159.stdout: "request": 5329, 2024-09-11T23:36:28.223 INFO:teuthology.orchestra.run.smithi159.stdout: "reply": 5309, 2024-09-11T23:36:28.224 INFO:teuthology.orchestra.run.smithi159.stdout: "reply_latency": { 2024-09-11T23:36:28.224 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 5309, 2024-09-11T23:36:28.224 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 7.161338676, 2024-09-11T23:36:28.224 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.001348905 2024-09-11T23:36:28.224 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.224 INFO:teuthology.orchestra.run.smithi159.stdout: "slow_reply": 0, 2024-09-11T23:36:28.224 INFO:teuthology.orchestra.run.smithi159.stdout: "forward": 20, 2024-09-11T23:36:28.224 INFO:teuthology.orchestra.run.smithi159.stdout: "dir_fetch_complete": 0, 2024-09-11T23:36:28.224 INFO:teuthology.orchestra.run.smithi159.stdout: "dir_fetch_keys": 0, 2024-09-11T23:36:28.224 INFO:teuthology.orchestra.run.smithi159.stdout: "dir_commit": 11, 2024-09-11T23:36:28.224 INFO:teuthology.orchestra.run.smithi159.stdout: "dir_split": 0, 2024-09-11T23:36:28.224 INFO:teuthology.orchestra.run.smithi159.stdout: "dir_merge": 0, 2024-09-11T23:36:28.224 INFO:teuthology.orchestra.run.smithi159.stdout: "inodes": 19, 2024-09-11T23:36:28.224 INFO:teuthology.orchestra.run.smithi159.stdout: "inodes_top": 2, 2024-09-11T23:36:28.225 INFO:teuthology.orchestra.run.smithi159.stdout: "inodes_bottom": 1, 2024-09-11T23:36:28.225 INFO:teuthology.orchestra.run.smithi159.stdout: "inodes_pin_tail": 16, 2024-09-11T23:36:28.225 INFO:teuthology.orchestra.run.smithi159.stdout: "inodes_pinned": 16, 2024-09-11T23:36:28.225 INFO:teuthology.orchestra.run.smithi159.stdout: "inodes_expired": 68, 2024-09-11T23:36:28.225 INFO:teuthology.orchestra.run.smithi159.stdout: "inodes_with_caps": 0, 2024-09-11T23:36:28.225 INFO:teuthology.orchestra.run.smithi159.stdout: "caps": 0, 2024-09-11T23:36:28.225 INFO:teuthology.orchestra.run.smithi159.stdout: "subtrees": 4, 2024-09-11T23:36:28.225 INFO:teuthology.orchestra.run.smithi159.stdout: "traverse": 12523, 2024-09-11T23:36:28.225 INFO:teuthology.orchestra.run.smithi159.stdout: "traverse_hit": 7797, 2024-09-11T23:36:28.225 INFO:teuthology.orchestra.run.smithi159.stdout: "traverse_forward": 20, 2024-09-11T23:36:28.225 INFO:teuthology.orchestra.run.smithi159.stdout: "traverse_discover": 34, 2024-09-11T23:36:28.225 INFO:teuthology.orchestra.run.smithi159.stdout: "traverse_dir_fetch": 0, 2024-09-11T23:36:28.225 INFO:teuthology.orchestra.run.smithi159.stdout: "traverse_remote_ino": 0, 2024-09-11T23:36:28.225 INFO:teuthology.orchestra.run.smithi159.stdout: "traverse_lock": 0, 2024-09-11T23:36:28.226 INFO:teuthology.orchestra.run.smithi159.stdout: "load_cent": 5778, 2024-09-11T23:36:28.226 INFO:teuthology.orchestra.run.smithi159.stdout: "q": 0, 2024-09-11T23:36:28.226 INFO:teuthology.orchestra.run.smithi159.stdout: "exported": 61, 2024-09-11T23:36:28.226 INFO:teuthology.orchestra.run.smithi159.stdout: "exported_inodes": 433, 2024-09-11T23:36:28.226 INFO:teuthology.orchestra.run.smithi159.stdout: "imported": 61, 2024-09-11T23:36:28.226 INFO:teuthology.orchestra.run.smithi159.stdout: "imported_inodes": 1715, 2024-09-11T23:36:28.226 INFO:teuthology.orchestra.run.smithi159.stdout: "openino_dir_fetch": 0, 2024-09-11T23:36:28.226 INFO:teuthology.orchestra.run.smithi159.stdout: "openino_backtrace_fetch": 0, 2024-09-11T23:36:28.226 INFO:teuthology.orchestra.run.smithi159.stdout: "openino_peer_discover": 0, 2024-09-11T23:36:28.226 INFO:teuthology.orchestra.run.smithi159.stdout: "root_rfiles": 4, 2024-09-11T23:36:28.226 INFO:teuthology.orchestra.run.smithi159.stdout: "root_rbytes": 234, 2024-09-11T23:36:28.226 INFO:teuthology.orchestra.run.smithi159.stdout: "root_rsnaps": 0, 2024-09-11T23:36:28.226 INFO:teuthology.orchestra.run.smithi159.stdout: "scrub_backtrace_fetch": 0, 2024-09-11T23:36:28.227 INFO:teuthology.orchestra.run.smithi159.stdout: "scrub_set_tag": 0, 2024-09-11T23:36:28.227 INFO:teuthology.orchestra.run.smithi159.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T23:36:28.227 INFO:teuthology.orchestra.run.smithi159.stdout: "scrub_inotable_repaired": 0, 2024-09-11T23:36:28.227 INFO:teuthology.orchestra.run.smithi159.stdout: "scrub_dir_inodes": 0, 2024-09-11T23:36:28.227 INFO:teuthology.orchestra.run.smithi159.stdout: "scrub_dir_base_inodes": 0, 2024-09-11T23:36:28.227 INFO:teuthology.orchestra.run.smithi159.stdout: "scrub_dirfrag_rstats": 0, 2024-09-11T23:36:28.227 INFO:teuthology.orchestra.run.smithi159.stdout: "scrub_file_inodes": 0, 2024-09-11T23:36:28.227 INFO:teuthology.orchestra.run.smithi159.stdout: "handle_inode_file_caps": 0, 2024-09-11T23:36:28.227 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph_cap_op_revoke": 60, 2024-09-11T23:36:28.227 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph_cap_op_grant": 2701, 2024-09-11T23:36:28.227 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph_cap_op_trunc": 0, 2024-09-11T23:36:28.227 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T23:36:28.227 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T23:36:28.227 INFO:teuthology.orchestra.run.smithi159.stdout: "handle_client_caps": 6672, 2024-09-11T23:36:28.228 INFO:teuthology.orchestra.run.smithi159.stdout: "handle_client_caps_dirty": 957, 2024-09-11T23:36:28.228 INFO:teuthology.orchestra.run.smithi159.stdout: "handle_client_cap_release": 42, 2024-09-11T23:36:28.228 INFO:teuthology.orchestra.run.smithi159.stdout: "process_request_cap_release": 4837 2024-09-11T23:36:28.228 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.228 INFO:teuthology.orchestra.run.smithi159.stdout: "mds_cache": { 2024-09-11T23:36:28.228 INFO:teuthology.orchestra.run.smithi159.stdout: "dir_update": 0, 2024-09-11T23:36:28.228 INFO:teuthology.orchestra.run.smithi159.stdout: "dir_update_receipt": 0, 2024-09-11T23:36:28.228 INFO:teuthology.orchestra.run.smithi159.stdout: "dir_try_discover": 0, 2024-09-11T23:36:28.228 INFO:teuthology.orchestra.run.smithi159.stdout: "dir_send_discover": 32, 2024-09-11T23:36:28.228 INFO:teuthology.orchestra.run.smithi159.stdout: "dir_handle_discover": 61, 2024-09-11T23:36:28.228 INFO:teuthology.orchestra.run.smithi159.stdout: "num_strays": 0, 2024-09-11T23:36:28.228 INFO:teuthology.orchestra.run.smithi159.stdout: "num_strays_delayed": 0, 2024-09-11T23:36:28.228 INFO:teuthology.orchestra.run.smithi159.stdout: "num_strays_enqueuing": 0, 2024-09-11T23:36:28.228 INFO:teuthology.orchestra.run.smithi159.stdout: "strays_created": 2170, 2024-09-11T23:36:28.229 INFO:teuthology.orchestra.run.smithi159.stdout: "strays_enqueued": 2170, 2024-09-11T23:36:28.229 INFO:teuthology.orchestra.run.smithi159.stdout: "strays_reintegrated": 0, 2024-09-11T23:36:28.229 INFO:teuthology.orchestra.run.smithi159.stdout: "strays_migrated": 0, 2024-09-11T23:36:28.229 INFO:teuthology.orchestra.run.smithi159.stdout: "num_recovering_processing": 0, 2024-09-11T23:36:28.229 INFO:teuthology.orchestra.run.smithi159.stdout: "num_recovering_enqueued": 0, 2024-09-11T23:36:28.229 INFO:teuthology.orchestra.run.smithi159.stdout: "num_recovering_prioritized": 0, 2024-09-11T23:36:28.229 INFO:teuthology.orchestra.run.smithi159.stdout: "recovery_started": 0, 2024-09-11T23:36:28.229 INFO:teuthology.orchestra.run.smithi159.stdout: "recovery_completed": 0, 2024-09-11T23:36:28.229 INFO:teuthology.orchestra.run.smithi159.stdout: "ireq_quiesce_path": 0, 2024-09-11T23:36:28.229 INFO:teuthology.orchestra.run.smithi159.stdout: "ireq_quiesce_inode": 0, 2024-09-11T23:36:28.229 INFO:teuthology.orchestra.run.smithi159.stdout: "ireq_enqueue_scrub": 0, 2024-09-11T23:36:28.229 INFO:teuthology.orchestra.run.smithi159.stdout: "ireq_exportdir": 61, 2024-09-11T23:36:28.229 INFO:teuthology.orchestra.run.smithi159.stdout: "ireq_flush": 0, 2024-09-11T23:36:28.229 INFO:teuthology.orchestra.run.smithi159.stdout: "ireq_fragmentdir": 0, 2024-09-11T23:36:28.230 INFO:teuthology.orchestra.run.smithi159.stdout: "ireq_fragstats": 0, 2024-09-11T23:36:28.230 INFO:teuthology.orchestra.run.smithi159.stdout: "ireq_inodestats": 0 2024-09-11T23:36:28.230 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.230 INFO:teuthology.orchestra.run.smithi159.stdout: "mds_log": { 2024-09-11T23:36:28.230 INFO:teuthology.orchestra.run.smithi159.stdout: "evlrg": 0, 2024-09-11T23:36:28.230 INFO:teuthology.orchestra.run.smithi159.stdout: "evadd": 42081, 2024-09-11T23:36:28.230 INFO:teuthology.orchestra.run.smithi159.stdout: "evex": 0, 2024-09-11T23:36:28.230 INFO:teuthology.orchestra.run.smithi159.stdout: "evtrm": 0, 2024-09-11T23:36:28.230 INFO:teuthology.orchestra.run.smithi159.stdout: "ev": 42081, 2024-09-11T23:36:28.230 INFO:teuthology.orchestra.run.smithi159.stdout: "evexg": 0, 2024-09-11T23:36:28.230 INFO:teuthology.orchestra.run.smithi159.stdout: "evexd": 0, 2024-09-11T23:36:28.230 INFO:teuthology.orchestra.run.smithi159.stdout: "segadd": 48, 2024-09-11T23:36:28.230 INFO:teuthology.orchestra.run.smithi159.stdout: "segex": 0, 2024-09-11T23:36:28.230 INFO:teuthology.orchestra.run.smithi159.stdout: "segtrm": 0, 2024-09-11T23:36:28.231 INFO:teuthology.orchestra.run.smithi159.stdout: "seg": 48, 2024-09-11T23:36:28.231 INFO:teuthology.orchestra.run.smithi159.stdout: "segmjr": 5, 2024-09-11T23:36:28.231 INFO:teuthology.orchestra.run.smithi159.stdout: "segexg": 0, 2024-09-11T23:36:28.231 INFO:teuthology.orchestra.run.smithi159.stdout: "segexd": 0, 2024-09-11T23:36:28.231 INFO:teuthology.orchestra.run.smithi159.stdout: "expos": 4194304, 2024-09-11T23:36:28.231 INFO:teuthology.orchestra.run.smithi159.stdout: "wrpos": 35831322, 2024-09-11T23:36:28.231 INFO:teuthology.orchestra.run.smithi159.stdout: "rdpos": 0, 2024-09-11T23:36:28.231 INFO:teuthology.orchestra.run.smithi159.stdout: "jlat": { 2024-09-11T23:36:28.231 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 1222, 2024-09-11T23:36:28.231 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 3.186747905, 2024-09-11T23:36:28.231 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.002607813 2024-09-11T23:36:28.231 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.231 INFO:teuthology.orchestra.run.smithi159.stdout: "replayed": 0 2024-09-11T23:36:28.231 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.232 INFO:teuthology.orchestra.run.smithi159.stdout: "mds_mem": { 2024-09-11T23:36:28.232 INFO:teuthology.orchestra.run.smithi159.stdout: "ino": 28, 2024-09-11T23:36:28.232 INFO:teuthology.orchestra.run.smithi159.stdout: "ino+": 2212, 2024-09-11T23:36:28.232 INFO:teuthology.orchestra.run.smithi159.stdout: "ino-": 2184, 2024-09-11T23:36:28.232 INFO:teuthology.orchestra.run.smithi159.stdout: "dir": 72, 2024-09-11T23:36:28.232 INFO:teuthology.orchestra.run.smithi159.stdout: "dir+": 103, 2024-09-11T23:36:28.232 INFO:teuthology.orchestra.run.smithi159.stdout: "dir-": 31, 2024-09-11T23:36:28.232 INFO:teuthology.orchestra.run.smithi159.stdout: "dn": 424, 2024-09-11T23:36:28.232 INFO:teuthology.orchestra.run.smithi159.stdout: "dn+": 3951, 2024-09-11T23:36:28.232 INFO:teuthology.orchestra.run.smithi159.stdout: "dn-": 3527, 2024-09-11T23:36:28.232 INFO:teuthology.orchestra.run.smithi159.stdout: "cap": 0, 2024-09-11T23:36:28.232 INFO:teuthology.orchestra.run.smithi159.stdout: "cap+": 2184, 2024-09-11T23:36:28.232 INFO:teuthology.orchestra.run.smithi159.stdout: "cap-": 2184, 2024-09-11T23:36:28.232 INFO:teuthology.orchestra.run.smithi159.stdout: "rss": 68948, 2024-09-11T23:36:28.233 INFO:teuthology.orchestra.run.smithi159.stdout: "heap": 223520 2024-09-11T23:36:28.233 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.233 INFO:teuthology.orchestra.run.smithi159.stdout: "mds_server": { 2024-09-11T23:36:28.233 INFO:teuthology.orchestra.run.smithi159.stdout: "dispatch_client_request": 10087, 2024-09-11T23:36:28.233 INFO:teuthology.orchestra.run.smithi159.stdout: "dispatch_server_request": 12, 2024-09-11T23:36:28.233 INFO:teuthology.orchestra.run.smithi159.stdout: "handle_client_request": 5329, 2024-09-11T23:36:28.233 INFO:teuthology.orchestra.run.smithi159.stdout: "handle_client_session": 7, 2024-09-11T23:36:28.233 INFO:teuthology.orchestra.run.smithi159.stdout: "handle_peer_request": 2682, 2024-09-11T23:36:28.233 INFO:teuthology.orchestra.run.smithi159.stdout: "req_create_latency": { 2024-09-11T23:36:28.233 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 497, 2024-09-11T23:36:28.233 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 1.311499940, 2024-09-11T23:36:28.233 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.002638832 2024-09-11T23:36:28.233 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.234 INFO:teuthology.orchestra.run.smithi159.stdout: "req_getattr_latency": { 2024-09-11T23:36:28.234 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 42, 2024-09-11T23:36:28.234 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.008291506, 2024-09-11T23:36:28.234 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000197416 2024-09-11T23:36:28.234 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.234 INFO:teuthology.orchestra.run.smithi159.stdout: "req_getfilelock_latency": { 2024-09-11T23:36:28.234 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:28.234 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:28.234 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:28.234 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.234 INFO:teuthology.orchestra.run.smithi159.stdout: "req_link_latency": { 2024-09-11T23:36:28.234 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:28.234 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:28.234 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:28.235 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.235 INFO:teuthology.orchestra.run.smithi159.stdout: "req_lookup_latency": { 2024-09-11T23:36:28.235 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 2466, 2024-09-11T23:36:28.235 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 1.240411357, 2024-09-11T23:36:28.235 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000503005 2024-09-11T23:36:28.235 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.235 INFO:teuthology.orchestra.run.smithi159.stdout: "req_lookuphash_latency": { 2024-09-11T23:36:28.235 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:28.235 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:28.235 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:28.235 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.235 INFO:teuthology.orchestra.run.smithi159.stdout: "req_lookupino_latency": { 2024-09-11T23:36:28.235 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:28.235 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:28.236 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:28.236 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.236 INFO:teuthology.orchestra.run.smithi159.stdout: "req_lookupname_latency": { 2024-09-11T23:36:28.236 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:28.236 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:28.236 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:28.236 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.236 INFO:teuthology.orchestra.run.smithi159.stdout: "req_lookupparent_latency": { 2024-09-11T23:36:28.236 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:28.236 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:28.236 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:28.236 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.236 INFO:teuthology.orchestra.run.smithi159.stdout: "req_lookupsnap_latency": { 2024-09-11T23:36:28.236 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:28.237 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:28.237 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:28.237 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.237 INFO:teuthology.orchestra.run.smithi159.stdout: "req_lssnap_latency": { 2024-09-11T23:36:28.237 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:28.237 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:28.238 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:28.238 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.238 INFO:teuthology.orchestra.run.smithi159.stdout: "req_mkdir_latency": { 2024-09-11T23:36:28.238 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:28.238 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:28.238 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:28.238 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.238 INFO:teuthology.orchestra.run.smithi159.stdout: "req_mknod_latency": { 2024-09-11T23:36:28.238 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:28.238 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:28.238 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:28.238 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.238 INFO:teuthology.orchestra.run.smithi159.stdout: "req_mksnap_latency": { 2024-09-11T23:36:28.238 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:28.239 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:28.239 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:28.239 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.239 INFO:teuthology.orchestra.run.smithi159.stdout: "req_open_latency": { 2024-09-11T23:36:28.239 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 2, 2024-09-11T23:36:28.239 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000765581, 2024-09-11T23:36:28.239 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000382790 2024-09-11T23:36:28.239 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.239 INFO:teuthology.orchestra.run.smithi159.stdout: "req_readdir_latency": { 2024-09-11T23:36:28.239 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 132, 2024-09-11T23:36:28.239 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.089845111, 2024-09-11T23:36:28.239 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000680644 2024-09-11T23:36:28.239 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.239 INFO:teuthology.orchestra.run.smithi159.stdout: "req_rename_latency": { 2024-09-11T23:36:28.240 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:28.240 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:28.240 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:28.240 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.240 INFO:teuthology.orchestra.run.smithi159.stdout: "req_renamesnap_latency": { 2024-09-11T23:36:28.240 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:28.240 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:28.240 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:28.240 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.240 INFO:teuthology.orchestra.run.smithi159.stdout: "req_snapdiff_latency": { 2024-09-11T23:36:28.240 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:28.240 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:28.240 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:28.241 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.241 INFO:teuthology.orchestra.run.smithi159.stdout: "req_rmdir_latency": { 2024-09-11T23:36:28.241 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 11, 2024-09-11T23:36:28.241 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.131848253, 2024-09-11T23:36:28.241 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.011986204 2024-09-11T23:36:28.241 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.241 INFO:teuthology.orchestra.run.smithi159.stdout: "req_rmsnap_latency": { 2024-09-11T23:36:28.241 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:28.241 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:28.241 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:28.241 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.241 INFO:teuthology.orchestra.run.smithi159.stdout: "req_rmxattr_latency": { 2024-09-11T23:36:28.241 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:28.242 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:28.242 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:28.242 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.242 INFO:teuthology.orchestra.run.smithi159.stdout: "req_setattr_latency": { 2024-09-11T23:36:28.242 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:28.242 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:28.242 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:28.242 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.242 INFO:teuthology.orchestra.run.smithi159.stdout: "req_setdirlayout_latency": { 2024-09-11T23:36:28.242 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:28.242 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:28.242 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:28.242 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.243 INFO:teuthology.orchestra.run.smithi159.stdout: "req_setfilelock_latency": { 2024-09-11T23:36:28.243 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:28.243 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:28.243 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:28.243 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.243 INFO:teuthology.orchestra.run.smithi159.stdout: "req_setlayout_latency": { 2024-09-11T23:36:28.243 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:28.243 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:28.243 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:28.243 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.243 INFO:teuthology.orchestra.run.smithi159.stdout: "req_setxattr_latency": { 2024-09-11T23:36:28.243 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:28.243 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:28.244 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:28.244 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.244 INFO:teuthology.orchestra.run.smithi159.stdout: "req_symlink_latency": { 2024-09-11T23:36:28.244 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:28.244 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:28.244 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:28.244 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.244 INFO:teuthology.orchestra.run.smithi159.stdout: "req_unlink_latency": { 2024-09-11T23:36:28.244 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 2159, 2024-09-11T23:36:28.244 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 4.378676928, 2024-09-11T23:36:28.244 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.002028104 2024-09-11T23:36:28.244 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.244 INFO:teuthology.orchestra.run.smithi159.stdout: "cap_revoke_eviction": 0, 2024-09-11T23:36:28.244 INFO:teuthology.orchestra.run.smithi159.stdout: "cap_acquisition_throttle": 0, 2024-09-11T23:36:28.245 INFO:teuthology.orchestra.run.smithi159.stdout: "req_getvxattr_latency": { 2024-09-11T23:36:28.245 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:28.245 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:28.245 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:28.245 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-11T23:36:28.245 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.245 INFO:teuthology.orchestra.run.smithi159.stdout: "mds_sessions": { 2024-09-11T23:36:28.245 INFO:teuthology.orchestra.run.smithi159.stdout: "session_count": 1, 2024-09-11T23:36:28.245 INFO:teuthology.orchestra.run.smithi159.stdout: "session_add": 1, 2024-09-11T23:36:28.245 INFO:teuthology.orchestra.run.smithi159.stdout: "session_remove": 0, 2024-09-11T23:36:28.245 INFO:teuthology.orchestra.run.smithi159.stdout: "sessions_open": 1, 2024-09-11T23:36:28.245 INFO:teuthology.orchestra.run.smithi159.stdout: "sessions_stale": 0, 2024-09-11T23:36:28.245 INFO:teuthology.orchestra.run.smithi159.stdout: "total_load": 3138, 2024-09-11T23:36:28.246 INFO:teuthology.orchestra.run.smithi159.stdout: "average_load": 3138, 2024-09-11T23:36:28.246 INFO:teuthology.orchestra.run.smithi159.stdout: "avg_session_uptime": 450, 2024-09-11T23:36:28.246 INFO:teuthology.orchestra.run.smithi159.stdout: "mdthresh_evicted": 0 2024-09-11T23:36:28.246 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.246 INFO:teuthology.orchestra.run.smithi159.stdout: "mempool": { 2024-09-11T23:36:28.246 INFO:teuthology.orchestra.run.smithi159.stdout: "bloom_filter_bytes": 0, 2024-09-11T23:36:28.246 INFO:teuthology.orchestra.run.smithi159.stdout: "bloom_filter_items": 0, 2024-09-11T23:36:28.246 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T23:36:28.246 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_alloc_items": 0, 2024-09-11T23:36:28.246 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T23:36:28.246 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_data_items": 0, 2024-09-11T23:36:28.246 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T23:36:28.246 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T23:36:28.247 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T23:36:28.247 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T23:36:28.247 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T23:36:28.247 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_other_items": 0, 2024-09-11T23:36:28.247 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T23:36:28.247 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T23:36:28.247 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_extent_bytes": 0, 2024-09-11T23:36:28.247 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_extent_items": 0, 2024-09-11T23:36:28.247 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_blob_bytes": 0, 2024-09-11T23:36:28.247 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_blob_items": 0, 2024-09-11T23:36:28.247 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T23:36:28.247 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T23:36:28.247 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T23:36:28.247 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T23:36:28.248 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T23:36:28.248 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_fsck_items": 0, 2024-09-11T23:36:28.248 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_txc_bytes": 0, 2024-09-11T23:36:28.248 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_txc_items": 0, 2024-09-11T23:36:28.248 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T23:36:28.248 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T23:36:28.248 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_writing_bytes": 0, 2024-09-11T23:36:28.248 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_writing_items": 0, 2024-09-11T23:36:28.248 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_bytes": 0, 2024-09-11T23:36:28.248 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_items": 0, 2024-09-11T23:36:28.248 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T23:36:28.248 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_file_reader_items": 0, 2024-09-11T23:36:28.248 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T23:36:28.249 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_file_writer_items": 0, 2024-09-11T23:36:28.249 INFO:teuthology.orchestra.run.smithi159.stdout: "buffer_anon_bytes": 300963, 2024-09-11T23:36:28.249 INFO:teuthology.orchestra.run.smithi159.stdout: "buffer_anon_items": 124, 2024-09-11T23:36:28.249 INFO:teuthology.orchestra.run.smithi159.stdout: "buffer_meta_bytes": 0, 2024-09-11T23:36:28.249 INFO:teuthology.orchestra.run.smithi159.stdout: "buffer_meta_items": 0, 2024-09-11T23:36:28.249 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_bytes": 0, 2024-09-11T23:36:28.249 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_items": 0, 2024-09-11T23:36:28.249 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_mapbl_bytes": 0, 2024-09-11T23:36:28.249 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_mapbl_items": 0, 2024-09-11T23:36:28.249 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_pglog_bytes": 0, 2024-09-11T23:36:28.249 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_pglog_items": 0, 2024-09-11T23:36:28.249 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_bytes": 8960, 2024-09-11T23:36:28.249 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_items": 169, 2024-09-11T23:36:28.249 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T23:36:28.250 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_mapping_items": 0, 2024-09-11T23:36:28.250 INFO:teuthology.orchestra.run.smithi159.stdout: "pgmap_bytes": 0, 2024-09-11T23:36:28.250 INFO:teuthology.orchestra.run.smithi159.stdout: "pgmap_items": 0, 2024-09-11T23:36:28.250 INFO:teuthology.orchestra.run.smithi159.stdout: "mds_co_bytes": 507288, 2024-09-11T23:36:28.250 INFO:teuthology.orchestra.run.smithi159.stdout: "mds_co_items": 6220, 2024-09-11T23:36:28.250 INFO:teuthology.orchestra.run.smithi159.stdout: "unittest_1_bytes": 0, 2024-09-11T23:36:28.250 INFO:teuthology.orchestra.run.smithi159.stdout: "unittest_1_items": 0, 2024-09-11T23:36:28.250 INFO:teuthology.orchestra.run.smithi159.stdout: "unittest_2_bytes": 0, 2024-09-11T23:36:28.250 INFO:teuthology.orchestra.run.smithi159.stdout: "unittest_2_items": 0 2024-09-11T23:36:28.250 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.250 INFO:teuthology.orchestra.run.smithi159.stdout: "objecter": { 2024-09-11T23:36:28.250 INFO:teuthology.orchestra.run.smithi159.stdout: "op_active": 0, 2024-09-11T23:36:28.250 INFO:teuthology.orchestra.run.smithi159.stdout: "op_laggy": 0, 2024-09-11T23:36:28.250 INFO:teuthology.orchestra.run.smithi159.stdout: "op_send": 5902, 2024-09-11T23:36:28.251 INFO:teuthology.orchestra.run.smithi159.stdout: "op_send_bytes": 31971150, 2024-09-11T23:36:28.251 INFO:teuthology.orchestra.run.smithi159.stdout: "op_resend": 30, 2024-09-11T23:36:28.251 INFO:teuthology.orchestra.run.smithi159.stdout: "op_reply": 5902, 2024-09-11T23:36:28.251 INFO:teuthology.orchestra.run.smithi159.stdout: "op_latency": { 2024-09-11T23:36:28.251 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 5902, 2024-09-11T23:36:28.251 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 33.850376853, 2024-09-11T23:36:28.251 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.005735407 2024-09-11T23:36:28.251 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.251 INFO:teuthology.orchestra.run.smithi159.stdout: "op_inflight": 0, 2024-09-11T23:36:28.251 INFO:teuthology.orchestra.run.smithi159.stdout: "oplen_avg": { 2024-09-11T23:36:28.251 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 5902, 2024-09-11T23:36:28.251 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 6028 2024-09-11T23:36:28.251 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.251 INFO:teuthology.orchestra.run.smithi159.stdout: "op": 5902, 2024-09-11T23:36:28.252 INFO:teuthology.orchestra.run.smithi159.stdout: "op_r": 90, 2024-09-11T23:36:28.252 INFO:teuthology.orchestra.run.smithi159.stdout: "op_w": 5812, 2024-09-11T23:36:28.252 INFO:teuthology.orchestra.run.smithi159.stdout: "op_rmw": 0, 2024-09-11T23:36:28.252 INFO:teuthology.orchestra.run.smithi159.stdout: "op_pg": 0, 2024-09-11T23:36:28.252 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_stat": 0, 2024-09-11T23:36:28.252 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_create": 10, 2024-09-11T23:36:28.252 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_read": 90, 2024-09-11T23:36:28.252 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_write": 1312, 2024-09-11T23:36:28.252 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_writefull": 58, 2024-09-11T23:36:28.252 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_writesame": 0, 2024-09-11T23:36:28.252 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_append": 0, 2024-09-11T23:36:28.252 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_zero": 0, 2024-09-11T23:36:28.252 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_truncate": 0, 2024-09-11T23:36:28.253 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_delete": 4347, 2024-09-11T23:36:28.253 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_mapext": 0, 2024-09-11T23:36:28.253 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_sparse_read": 0, 2024-09-11T23:36:28.253 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_clonerange": 0, 2024-09-11T23:36:28.253 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_getxattr": 0, 2024-09-11T23:36:28.253 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_setxattr": 20, 2024-09-11T23:36:28.253 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_cmpxattr": 0, 2024-09-11T23:36:28.253 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_rmxattr": 0, 2024-09-11T23:36:28.253 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_resetxattrs": 0, 2024-09-11T23:36:28.253 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_call": 0, 2024-09-11T23:36:28.253 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_watch": 0, 2024-09-11T23:36:28.253 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_notify": 0, 2024-09-11T23:36:28.253 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T23:36:28.253 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_pgls": 0, 2024-09-11T23:36:28.254 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_pgls_filter": 0, 2024-09-11T23:36:28.254 INFO:teuthology.orchestra.run.smithi159.stdout: "osdop_other": 0, 2024-09-11T23:36:28.254 INFO:teuthology.orchestra.run.smithi159.stdout: "linger_active": 0, 2024-09-11T23:36:28.254 INFO:teuthology.orchestra.run.smithi159.stdout: "linger_send": 0, 2024-09-11T23:36:28.254 INFO:teuthology.orchestra.run.smithi159.stdout: "linger_resend": 0, 2024-09-11T23:36:28.254 INFO:teuthology.orchestra.run.smithi159.stdout: "linger_ping": 0, 2024-09-11T23:36:28.254 INFO:teuthology.orchestra.run.smithi159.stdout: "poolop_active": 0, 2024-09-11T23:36:28.254 INFO:teuthology.orchestra.run.smithi159.stdout: "poolop_send": 0, 2024-09-11T23:36:28.254 INFO:teuthology.orchestra.run.smithi159.stdout: "poolop_resend": 0, 2024-09-11T23:36:28.254 INFO:teuthology.orchestra.run.smithi159.stdout: "poolstat_active": 0, 2024-09-11T23:36:28.254 INFO:teuthology.orchestra.run.smithi159.stdout: "poolstat_send": 0, 2024-09-11T23:36:28.254 INFO:teuthology.orchestra.run.smithi159.stdout: "poolstat_resend": 0, 2024-09-11T23:36:28.254 INFO:teuthology.orchestra.run.smithi159.stdout: "statfs_active": 0, 2024-09-11T23:36:28.254 INFO:teuthology.orchestra.run.smithi159.stdout: "statfs_send": 0, 2024-09-11T23:36:28.255 INFO:teuthology.orchestra.run.smithi159.stdout: "statfs_resend": 0, 2024-09-11T23:36:28.255 INFO:teuthology.orchestra.run.smithi159.stdout: "command_active": 0, 2024-09-11T23:36:28.255 INFO:teuthology.orchestra.run.smithi159.stdout: "command_send": 0, 2024-09-11T23:36:28.255 INFO:teuthology.orchestra.run.smithi159.stdout: "command_resend": 0, 2024-09-11T23:36:28.255 INFO:teuthology.orchestra.run.smithi159.stdout: "map_epoch": 88, 2024-09-11T23:36:28.255 INFO:teuthology.orchestra.run.smithi159.stdout: "map_full": 0, 2024-09-11T23:36:28.255 INFO:teuthology.orchestra.run.smithi159.stdout: "map_inc": 2, 2024-09-11T23:36:28.255 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_sessions": 12, 2024-09-11T23:36:28.255 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_session_open": 12, 2024-09-11T23:36:28.255 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_session_close": 0, 2024-09-11T23:36:28.255 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_laggy": 0, 2024-09-11T23:36:28.255 INFO:teuthology.orchestra.run.smithi159.stdout: "omap_wr": 133, 2024-09-11T23:36:28.255 INFO:teuthology.orchestra.run.smithi159.stdout: "omap_rd": 0, 2024-09-11T23:36:28.256 INFO:teuthology.orchestra.run.smithi159.stdout: "omap_del": 58 2024-09-11T23:36:28.256 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.256 INFO:teuthology.orchestra.run.smithi159.stdout: "oft": { 2024-09-11T23:36:28.256 INFO:teuthology.orchestra.run.smithi159.stdout: "omap_total_objs": 1, 2024-09-11T23:36:28.256 INFO:teuthology.orchestra.run.smithi159.stdout: "omap_total_kv_pairs": 0, 2024-09-11T23:36:28.256 INFO:teuthology.orchestra.run.smithi159.stdout: "omap_total_updates": 0, 2024-09-11T23:36:28.256 INFO:teuthology.orchestra.run.smithi159.stdout: "omap_total_removes": 0 2024-09-11T23:36:28.256 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.256 INFO:teuthology.orchestra.run.smithi159.stdout: "osd-slow-ops": { 2024-09-11T23:36:28.256 INFO:teuthology.orchestra.run.smithi159.stdout: "slow_ops_count": 0 2024-09-11T23:36:28.256 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.256 INFO:teuthology.orchestra.run.smithi159.stdout: "purge_queue": { 2024-09-11T23:36:28.256 INFO:teuthology.orchestra.run.smithi159.stdout: "pq_executing_ops": 0, 2024-09-11T23:36:28.257 INFO:teuthology.orchestra.run.smithi159.stdout: "pq_executing_ops_high_water": 17, 2024-09-11T23:36:28.257 INFO:teuthology.orchestra.run.smithi159.stdout: "pq_executing": 0, 2024-09-11T23:36:28.257 INFO:teuthology.orchestra.run.smithi159.stdout: "pq_executing_high_water": 11, 2024-09-11T23:36:28.257 INFO:teuthology.orchestra.run.smithi159.stdout: "pq_executed_ops": 4328, 2024-09-11T23:36:28.257 INFO:teuthology.orchestra.run.smithi159.stdout: "pq_executed": 2170, 2024-09-11T23:36:28.257 INFO:teuthology.orchestra.run.smithi159.stdout: "pq_item_in_journal": 0 2024-09-11T23:36:28.257 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.257 INFO:teuthology.orchestra.run.smithi159.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T23:36:28.257 INFO:teuthology.orchestra.run.smithi159.stdout: "val": 0, 2024-09-11T23:36:28.257 INFO:teuthology.orchestra.run.smithi159.stdout: "max": 104857600, 2024-09-11T23:36:28.257 INFO:teuthology.orchestra.run.smithi159.stdout: "get_started": 0, 2024-09-11T23:36:28.257 INFO:teuthology.orchestra.run.smithi159.stdout: "get": 32771, 2024-09-11T23:36:28.257 INFO:teuthology.orchestra.run.smithi159.stdout: "get_sum": 29007960, 2024-09-11T23:36:28.257 INFO:teuthology.orchestra.run.smithi159.stdout: "get_or_fail_fail": 0, 2024-09-11T23:36:28.258 INFO:teuthology.orchestra.run.smithi159.stdout: "get_or_fail_success": 32771, 2024-09-11T23:36:28.258 INFO:teuthology.orchestra.run.smithi159.stdout: "take": 0, 2024-09-11T23:36:28.258 INFO:teuthology.orchestra.run.smithi159.stdout: "take_sum": 0, 2024-09-11T23:36:28.258 INFO:teuthology.orchestra.run.smithi159.stdout: "put": 32771, 2024-09-11T23:36:28.258 INFO:teuthology.orchestra.run.smithi159.stdout: "put_sum": 29007960, 2024-09-11T23:36:28.258 INFO:teuthology.orchestra.run.smithi159.stdout: "wait": { 2024-09-11T23:36:28.258 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:28.258 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:28.258 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:28.258 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-11T23:36:28.258 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.258 INFO:teuthology.orchestra.run.smithi159.stdout: "throttle-objecter_bytes": { 2024-09-11T23:36:28.258 INFO:teuthology.orchestra.run.smithi159.stdout: "val": 0, 2024-09-11T23:36:28.258 INFO:teuthology.orchestra.run.smithi159.stdout: "max": 104857600, 2024-09-11T23:36:28.259 INFO:teuthology.orchestra.run.smithi159.stdout: "get_started": 0, 2024-09-11T23:36:28.259 INFO:teuthology.orchestra.run.smithi159.stdout: "get": 0, 2024-09-11T23:36:28.259 INFO:teuthology.orchestra.run.smithi159.stdout: "get_sum": 0, 2024-09-11T23:36:28.259 INFO:teuthology.orchestra.run.smithi159.stdout: "get_or_fail_fail": 0, 2024-09-11T23:36:28.259 INFO:teuthology.orchestra.run.smithi159.stdout: "get_or_fail_success": 0, 2024-09-11T23:36:28.259 INFO:teuthology.orchestra.run.smithi159.stdout: "take": 5902, 2024-09-11T23:36:28.259 INFO:teuthology.orchestra.run.smithi159.stdout: "take_sum": 32207584, 2024-09-11T23:36:28.259 INFO:teuthology.orchestra.run.smithi159.stdout: "put": 5902, 2024-09-11T23:36:28.259 INFO:teuthology.orchestra.run.smithi159.stdout: "put_sum": 32207584, 2024-09-11T23:36:28.259 INFO:teuthology.orchestra.run.smithi159.stdout: "wait": { 2024-09-11T23:36:28.259 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:28.259 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:28.259 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:28.260 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-11T23:36:28.260 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.260 INFO:teuthology.orchestra.run.smithi159.stdout: "throttle-objecter_ops": { 2024-09-11T23:36:28.260 INFO:teuthology.orchestra.run.smithi159.stdout: "val": 0, 2024-09-11T23:36:28.260 INFO:teuthology.orchestra.run.smithi159.stdout: "max": 1024, 2024-09-11T23:36:28.260 INFO:teuthology.orchestra.run.smithi159.stdout: "get_started": 0, 2024-09-11T23:36:28.260 INFO:teuthology.orchestra.run.smithi159.stdout: "get": 0, 2024-09-11T23:36:28.260 INFO:teuthology.orchestra.run.smithi159.stdout: "get_sum": 0, 2024-09-11T23:36:28.260 INFO:teuthology.orchestra.run.smithi159.stdout: "get_or_fail_fail": 0, 2024-09-11T23:36:28.260 INFO:teuthology.orchestra.run.smithi159.stdout: "get_or_fail_success": 0, 2024-09-11T23:36:28.260 INFO:teuthology.orchestra.run.smithi159.stdout: "take": 5902, 2024-09-11T23:36:28.260 INFO:teuthology.orchestra.run.smithi159.stdout: "take_sum": 5902, 2024-09-11T23:36:28.260 INFO:teuthology.orchestra.run.smithi159.stdout: "put": 5902, 2024-09-11T23:36:28.261 INFO:teuthology.orchestra.run.smithi159.stdout: "put_sum": 5902, 2024-09-11T23:36:28.261 INFO:teuthology.orchestra.run.smithi159.stdout: "wait": { 2024-09-11T23:36:28.261 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:28.261 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:28.261 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:28.261 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-11T23:36:28.261 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.261 INFO:teuthology.orchestra.run.smithi159.stdout: "throttle-write_buf_throttle": { 2024-09-11T23:36:28.261 INFO:teuthology.orchestra.run.smithi159.stdout: "val": 0, 2024-09-11T23:36:28.261 INFO:teuthology.orchestra.run.smithi159.stdout: "max": 3758096384, 2024-09-11T23:36:28.261 INFO:teuthology.orchestra.run.smithi159.stdout: "get_started": 0, 2024-09-11T23:36:28.261 INFO:teuthology.orchestra.run.smithi159.stdout: "get": 2170, 2024-09-11T23:36:28.261 INFO:teuthology.orchestra.run.smithi159.stdout: "get_sum": 236434, 2024-09-11T23:36:28.261 INFO:teuthology.orchestra.run.smithi159.stdout: "get_or_fail_fail": 0, 2024-09-11T23:36:28.262 INFO:teuthology.orchestra.run.smithi159.stdout: "get_or_fail_success": 2170, 2024-09-11T23:36:28.262 INFO:teuthology.orchestra.run.smithi159.stdout: "take": 0, 2024-09-11T23:36:28.262 INFO:teuthology.orchestra.run.smithi159.stdout: "take_sum": 0, 2024-09-11T23:36:28.262 INFO:teuthology.orchestra.run.smithi159.stdout: "put": 90, 2024-09-11T23:36:28.262 INFO:teuthology.orchestra.run.smithi159.stdout: "put_sum": 236434, 2024-09-11T23:36:28.262 INFO:teuthology.orchestra.run.smithi159.stdout: "wait": { 2024-09-11T23:36:28.262 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:28.262 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:28.262 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:28.262 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-11T23:36:28.262 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:28.262 INFO:teuthology.orchestra.run.smithi159.stdout: "throttle-write_buf_throttle-0x555dd210e960": { 2024-09-11T23:36:28.262 INFO:teuthology.orchestra.run.smithi159.stdout: "val": 0, 2024-09-11T23:36:28.262 INFO:teuthology.orchestra.run.smithi159.stdout: "max": 3758096384, 2024-09-11T23:36:28.263 INFO:teuthology.orchestra.run.smithi159.stdout: "get_started": 0, 2024-09-11T23:36:28.263 INFO:teuthology.orchestra.run.smithi159.stdout: "get": 42081, 2024-09-11T23:36:28.263 INFO:teuthology.orchestra.run.smithi159.stdout: "get_sum": 31637018, 2024-09-11T23:36:28.263 INFO:teuthology.orchestra.run.smithi159.stdout: "get_or_fail_fail": 0, 2024-09-11T23:36:28.263 INFO:teuthology.orchestra.run.smithi159.stdout: "get_or_fail_success": 42081, 2024-09-11T23:36:28.263 INFO:teuthology.orchestra.run.smithi159.stdout: "take": 0, 2024-09-11T23:36:28.263 INFO:teuthology.orchestra.run.smithi159.stdout: "take_sum": 0, 2024-09-11T23:36:28.263 INFO:teuthology.orchestra.run.smithi159.stdout: "put": 1222, 2024-09-11T23:36:28.263 INFO:teuthology.orchestra.run.smithi159.stdout: "put_sum": 31637018, 2024-09-11T23:36:28.263 INFO:teuthology.orchestra.run.smithi159.stdout: "wait": { 2024-09-11T23:36:28.263 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:28.263 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:28.263 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:28.263 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-11T23:36:28.263 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-11T23:36:28.264 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-11T23:36:28.927 INFO:tasks.check_counter:Daemon mds.h mds.exported=61 2024-09-11T23:36:28.927 INFO:tasks.check_counter:Daemon mds.h mds.imported=61 2024-09-11T23:36:28.927 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=0 2024-09-11T23:36:28.927 DEBUG:tasks.check_counter:Getting stats from k 2024-09-11T23:36:28.928 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-11T23:36:29.175 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T23:36:29.595 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:29 smithi159 ceph-mon[34394]: pgmap v577: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.5 KiB/s wr, 18 op/s 2024-09-11T23:36:29.696 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-11T23:36:29.697 INFO:teuthology.orchestra.run.smithi159.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T23:36:29.697 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_messages": 0, 2024-09-11T23:36:29.697 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages": 2, 2024-09-11T23:36:29.697 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_bytes": 0, 2024-09-11T23:36:29.697 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_bytes": 0, 2024-09-11T23:36:29.697 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_created_connections": 4, 2024-09-11T23:36:29.697 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_active_connections": 0, 2024-09-11T23:36:29.697 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_total_time": 0.001053991, 2024-09-11T23:36:29.697 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_send_time": 0.000000000, 2024-09-11T23:36:29.697 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_recv_time": 0.000240790, 2024-09-11T23:36:29.697 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T23:36:29.697 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:36:29.698 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:29.698 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:29.698 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:29.698 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:29.698 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:36:29.698 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:29.698 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:29.698 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:29.698 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:29.698 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T23:36:29.698 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T23:36:29.698 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:29.698 INFO:teuthology.orchestra.run.smithi159.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T23:36:29.699 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_messages": 5, 2024-09-11T23:36:29.699 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages": 130, 2024-09-11T23:36:29.699 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_bytes": 3104, 2024-09-11T23:36:29.699 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_bytes": 101408, 2024-09-11T23:36:29.699 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_created_connections": 3, 2024-09-11T23:36:29.699 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_active_connections": 2, 2024-09-11T23:36:29.699 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_total_time": 0.009134456, 2024-09-11T23:36:29.699 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_send_time": 0.005058822, 2024-09-11T23:36:29.699 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_recv_time": 0.002810569, 2024-09-11T23:36:29.699 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T23:36:29.699 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:36:29.699 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 129, 2024-09-11T23:36:29.699 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.010187711, 2024-09-11T23:36:29.700 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000078974 2024-09-11T23:36:29.700 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:29.700 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:36:29.700 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:29.700 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:29.700 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:29.700 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:29.700 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-11T23:36:29.700 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_encrypted_bytes": 101408 2024-09-11T23:36:29.700 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:29.700 INFO:teuthology.orchestra.run.smithi159.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T23:36:29.700 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_messages": 172, 2024-09-11T23:36:29.700 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages": 169, 2024-09-11T23:36:29.701 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_bytes": 464720, 2024-09-11T23:36:29.701 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_bytes": 103248, 2024-09-11T23:36:29.701 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_created_connections": 2, 2024-09-11T23:36:29.701 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_active_connections": 1, 2024-09-11T23:36:29.701 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_total_time": 0.022884199, 2024-09-11T23:36:29.701 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_send_time": 0.010216291, 2024-09-11T23:36:29.701 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_recv_time": 0.017403086, 2024-09-11T23:36:29.701 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T23:36:29.701 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:36:29.701 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 168, 2024-09-11T23:36:29.701 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.009503821, 2024-09-11T23:36:29.701 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000056570 2024-09-11T23:36:29.701 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:29.701 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:36:29.702 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:29.702 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:29.702 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:29.702 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:29.702 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_recv_encrypted_bytes": 464720, 2024-09-11T23:36:29.702 INFO:teuthology.orchestra.run.smithi159.stdout: "msgr_send_encrypted_bytes": 103248 2024-09-11T23:36:29.702 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:29.702 INFO:teuthology.orchestra.run.smithi159.stdout: "cct": { 2024-09-11T23:36:29.702 INFO:teuthology.orchestra.run.smithi159.stdout: "total_workers": 0, 2024-09-11T23:36:29.702 INFO:teuthology.orchestra.run.smithi159.stdout: "unhealthy_workers": 0 2024-09-11T23:36:29.702 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:29.702 INFO:teuthology.orchestra.run.smithi159.stdout: "mempool": { 2024-09-11T23:36:29.702 INFO:teuthology.orchestra.run.smithi159.stdout: "bloom_filter_bytes": 0, 2024-09-11T23:36:29.702 INFO:teuthology.orchestra.run.smithi159.stdout: "bloom_filter_items": 0, 2024-09-11T23:36:29.703 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T23:36:29.703 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_alloc_items": 0, 2024-09-11T23:36:29.703 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T23:36:29.703 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_data_items": 0, 2024-09-11T23:36:29.703 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T23:36:29.703 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T23:36:29.703 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T23:36:29.703 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T23:36:29.703 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T23:36:29.703 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_other_items": 0, 2024-09-11T23:36:29.703 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T23:36:29.703 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T23:36:29.703 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_extent_bytes": 0, 2024-09-11T23:36:29.704 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_extent_items": 0, 2024-09-11T23:36:29.704 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_blob_bytes": 0, 2024-09-11T23:36:29.704 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_blob_items": 0, 2024-09-11T23:36:29.704 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T23:36:29.704 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T23:36:29.704 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T23:36:29.704 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T23:36:29.704 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T23:36:29.704 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_fsck_items": 0, 2024-09-11T23:36:29.704 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_txc_bytes": 0, 2024-09-11T23:36:29.704 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_txc_items": 0, 2024-09-11T23:36:29.704 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T23:36:29.704 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T23:36:29.705 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_writing_bytes": 0, 2024-09-11T23:36:29.705 INFO:teuthology.orchestra.run.smithi159.stdout: "bluestore_writing_items": 0, 2024-09-11T23:36:29.705 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_bytes": 0, 2024-09-11T23:36:29.705 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_items": 0, 2024-09-11T23:36:29.705 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T23:36:29.705 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_file_reader_items": 0, 2024-09-11T23:36:29.705 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T23:36:29.705 INFO:teuthology.orchestra.run.smithi159.stdout: "bluefs_file_writer_items": 0, 2024-09-11T23:36:29.705 INFO:teuthology.orchestra.run.smithi159.stdout: "buffer_anon_bytes": 148967, 2024-09-11T23:36:29.705 INFO:teuthology.orchestra.run.smithi159.stdout: "buffer_anon_items": 29, 2024-09-11T23:36:29.705 INFO:teuthology.orchestra.run.smithi159.stdout: "buffer_meta_bytes": 0, 2024-09-11T23:36:29.705 INFO:teuthology.orchestra.run.smithi159.stdout: "buffer_meta_items": 0, 2024-09-11T23:36:29.705 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_bytes": 0, 2024-09-11T23:36:29.705 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_items": 0, 2024-09-11T23:36:29.706 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_mapbl_bytes": 0, 2024-09-11T23:36:29.706 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_mapbl_items": 0, 2024-09-11T23:36:29.706 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_pglog_bytes": 0, 2024-09-11T23:36:29.706 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_pglog_items": 0, 2024-09-11T23:36:29.706 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_bytes": 0, 2024-09-11T23:36:29.706 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_items": 0, 2024-09-11T23:36:29.706 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T23:36:29.706 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_mapping_items": 0, 2024-09-11T23:36:29.706 INFO:teuthology.orchestra.run.smithi159.stdout: "pgmap_bytes": 0, 2024-09-11T23:36:29.706 INFO:teuthology.orchestra.run.smithi159.stdout: "pgmap_items": 0, 2024-09-11T23:36:29.707 INFO:teuthology.orchestra.run.smithi159.stdout: "mds_co_bytes": 928, 2024-09-11T23:36:29.707 INFO:teuthology.orchestra.run.smithi159.stdout: "mds_co_items": 2, 2024-09-11T23:36:29.707 INFO:teuthology.orchestra.run.smithi159.stdout: "unittest_1_bytes": 0, 2024-09-11T23:36:29.707 INFO:teuthology.orchestra.run.smithi159.stdout: "unittest_1_items": 0, 2024-09-11T23:36:29.707 INFO:teuthology.orchestra.run.smithi159.stdout: "unittest_2_bytes": 0, 2024-09-11T23:36:29.707 INFO:teuthology.orchestra.run.smithi159.stdout: "unittest_2_items": 0 2024-09-11T23:36:29.707 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-11T23:36:29.707 INFO:teuthology.orchestra.run.smithi159.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T23:36:29.707 INFO:teuthology.orchestra.run.smithi159.stdout: "val": 0, 2024-09-11T23:36:29.707 INFO:teuthology.orchestra.run.smithi159.stdout: "max": 104857600, 2024-09-11T23:36:29.707 INFO:teuthology.orchestra.run.smithi159.stdout: "get_started": 0, 2024-09-11T23:36:29.707 INFO:teuthology.orchestra.run.smithi159.stdout: "get": 173, 2024-09-11T23:36:29.707 INFO:teuthology.orchestra.run.smithi159.stdout: "get_sum": 440436, 2024-09-11T23:36:29.707 INFO:teuthology.orchestra.run.smithi159.stdout: "get_or_fail_fail": 0, 2024-09-11T23:36:29.708 INFO:teuthology.orchestra.run.smithi159.stdout: "get_or_fail_success": 173, 2024-09-11T23:36:29.708 INFO:teuthology.orchestra.run.smithi159.stdout: "take": 0, 2024-09-11T23:36:29.708 INFO:teuthology.orchestra.run.smithi159.stdout: "take_sum": 0, 2024-09-11T23:36:29.708 INFO:teuthology.orchestra.run.smithi159.stdout: "put": 173, 2024-09-11T23:36:29.708 INFO:teuthology.orchestra.run.smithi159.stdout: "put_sum": 440436, 2024-09-11T23:36:29.708 INFO:teuthology.orchestra.run.smithi159.stdout: "wait": { 2024-09-11T23:36:29.708 INFO:teuthology.orchestra.run.smithi159.stdout: "avgcount": 0, 2024-09-11T23:36:29.708 INFO:teuthology.orchestra.run.smithi159.stdout: "sum": 0.000000000, 2024-09-11T23:36:29.708 INFO:teuthology.orchestra.run.smithi159.stdout: "avgtime": 0.000000000 2024-09-11T23:36:29.708 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-11T23:36:29.708 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-11T23:36:29.708 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-11T23:36:29.790 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:29 smithi005 ceph-mon[31201]: pgmap v577: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.5 KiB/s wr, 18 op/s 2024-09-11T23:36:29.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:29 smithi172 ceph-mon[34855]: pgmap v577: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.5 KiB/s wr, 18 op/s 2024-09-11T23:36:30.394 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-09-11T23:36:30.394 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-09-11T23:36:30.394 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.k 2024-09-11T23:36:30.394 DEBUG:tasks.check_counter:Getting stats from c 2024-09-11T23:36:30.394 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-11T23:36:30.654 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:36:31.200 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-11T23:36:31.200 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T23:36:31.201 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 1118, 2024-09-11T23:36:31.201 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 1120, 2024-09-11T23:36:31.201 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 26918503, 2024-09-11T23:36:31.201 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 355534, 2024-09-11T23:36:31.201 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 8, 2024-09-11T23:36:31.201 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 4, 2024-09-11T23:36:31.201 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.105954019, 2024-09-11T23:36:31.201 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.028830460, 2024-09-11T23:36:31.201 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.039042797, 2024-09-11T23:36:31.201 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.029433275, 2024-09-11T23:36:31.201 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:36:31.201 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1118, 2024-09-11T23:36:31.201 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.036858512, 2024-09-11T23:36:31.202 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000032968 2024-09-11T23:36:31.202 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.202 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:36:31.202 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:31.202 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:31.202 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:31.202 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.202 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T23:36:31.202 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T23:36:31.202 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.202 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T23:36:31.202 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 872, 2024-09-11T23:36:31.202 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 859, 2024-09-11T23:36:31.203 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 46826667, 2024-09-11T23:36:31.203 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 320371, 2024-09-11T23:36:31.203 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 5, 2024-09-11T23:36:31.203 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 4, 2024-09-11T23:36:31.203 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.094331221, 2024-09-11T23:36:31.203 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.026052009, 2024-09-11T23:36:31.203 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.053462945, 2024-09-11T23:36:31.203 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.015713821, 2024-09-11T23:36:31.203 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:36:31.203 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 859, 2024-09-11T23:36:31.203 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.033689156, 2024-09-11T23:36:31.203 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000039219 2024-09-11T23:36:31.204 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.204 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:36:31.204 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:31.204 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:31.204 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:31.204 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.204 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 516896, 2024-09-11T23:36:31.204 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 103120 2024-09-11T23:36:31.204 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.204 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T23:36:31.204 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 243, 2024-09-11T23:36:31.204 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 368, 2024-09-11T23:36:31.205 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 21033645, 2024-09-11T23:36:31.205 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 364614, 2024-09-11T23:36:31.205 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 6, 2024-09-11T23:36:31.205 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 5, 2024-09-11T23:36:31.205 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.030914079, 2024-09-11T23:36:31.205 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.009655334, 2024-09-11T23:36:31.205 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.014440894, 2024-09-11T23:36:31.205 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.004591807, 2024-09-11T23:36:31.205 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:36:31.205 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 366, 2024-09-11T23:36:31.205 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.015235429, 2024-09-11T23:36:31.205 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000041626 2024-09-11T23:36:31.206 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.206 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:36:31.206 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:31.206 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:31.206 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:31.206 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.206 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-11T23:36:31.206 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 287648 2024-09-11T23:36:31.206 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.206 INFO:teuthology.orchestra.run.smithi172.stdout: "cct": { 2024-09-11T23:36:31.206 INFO:teuthology.orchestra.run.smithi172.stdout: "total_workers": 1, 2024-09-11T23:36:31.206 INFO:teuthology.orchestra.run.smithi172.stdout: "unhealthy_workers": 0 2024-09-11T23:36:31.207 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.207 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-MDSRank": { 2024-09-11T23:36:31.207 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-09-11T23:36:31.207 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-09-11T23:36:31.207 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 3452, 2024-09-11T23:36:31.207 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.073738641, 2024-09-11T23:36:31.207 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000021361 2024-09-11T23:36:31.207 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-11T23:36:31.207 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.207 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-PurgeQueue": { 2024-09-11T23:36:31.207 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-09-11T23:36:31.207 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-09-11T23:36:31.207 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:31.208 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:31.208 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:31.208 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-11T23:36:31.208 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.208 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": { 2024-09-11T23:36:31.208 INFO:teuthology.orchestra.run.smithi172.stdout: "request": 0, 2024-09-11T23:36:31.208 INFO:teuthology.orchestra.run.smithi172.stdout: "reply": 0, 2024-09-11T23:36:31.208 INFO:teuthology.orchestra.run.smithi172.stdout: "reply_latency": { 2024-09-11T23:36:31.208 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:31.208 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:31.208 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:31.208 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.209 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_reply": 0, 2024-09-11T23:36:31.209 INFO:teuthology.orchestra.run.smithi172.stdout: "forward": 0, 2024-09-11T23:36:31.209 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_complete": 0, 2024-09-11T23:36:31.209 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_keys": 0, 2024-09-11T23:36:31.209 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_commit": 0, 2024-09-11T23:36:31.209 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_split": 0, 2024-09-11T23:36:31.209 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_merge": 0, 2024-09-11T23:36:31.209 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes": 1711, 2024-09-11T23:36:31.209 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_top": 0, 2024-09-11T23:36:31.209 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_bottom": 1711, 2024-09-11T23:36:31.209 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pin_tail": 0, 2024-09-11T23:36:31.209 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pinned": 1711, 2024-09-11T23:36:31.209 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_expired": 0, 2024-09-11T23:36:31.210 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_with_caps": 0, 2024-09-11T23:36:31.210 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": 0, 2024-09-11T23:36:31.210 INFO:teuthology.orchestra.run.smithi172.stdout: "subtrees": 2, 2024-09-11T23:36:31.210 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse": 0, 2024-09-11T23:36:31.210 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_hit": 0, 2024-09-11T23:36:31.210 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_forward": 0, 2024-09-11T23:36:31.210 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_discover": 0, 2024-09-11T23:36:31.210 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_dir_fetch": 0, 2024-09-11T23:36:31.210 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_remote_ino": 0, 2024-09-11T23:36:31.210 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_lock": 0, 2024-09-11T23:36:31.210 INFO:teuthology.orchestra.run.smithi172.stdout: "load_cent": 0, 2024-09-11T23:36:31.210 INFO:teuthology.orchestra.run.smithi172.stdout: "q": 0, 2024-09-11T23:36:31.210 INFO:teuthology.orchestra.run.smithi172.stdout: "exported": 0, 2024-09-11T23:36:31.211 INFO:teuthology.orchestra.run.smithi172.stdout: "exported_inodes": 0, 2024-09-11T23:36:31.211 INFO:teuthology.orchestra.run.smithi172.stdout: "imported": 0, 2024-09-11T23:36:31.211 INFO:teuthology.orchestra.run.smithi172.stdout: "imported_inodes": 0, 2024-09-11T23:36:31.211 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_dir_fetch": 0, 2024-09-11T23:36:31.211 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_backtrace_fetch": 0, 2024-09-11T23:36:31.211 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_peer_discover": 0, 2024-09-11T23:36:31.211 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rfiles": 4, 2024-09-11T23:36:31.211 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rbytes": 234, 2024-09-11T23:36:31.211 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rsnaps": 0, 2024-09-11T23:36:31.211 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_fetch": 0, 2024-09-11T23:36:31.211 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_set_tag": 0, 2024-09-11T23:36:31.211 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T23:36:31.211 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_inotable_repaired": 0, 2024-09-11T23:36:31.212 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_inodes": 0, 2024-09-11T23:36:31.212 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_base_inodes": 0, 2024-09-11T23:36:31.212 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dirfrag_rstats": 0, 2024-09-11T23:36:31.212 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_file_inodes": 0, 2024-09-11T23:36:31.212 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_inode_file_caps": 0, 2024-09-11T23:36:31.212 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_revoke": 0, 2024-09-11T23:36:31.212 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_grant": 0, 2024-09-11T23:36:31.212 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_trunc": 0, 2024-09-11T23:36:31.212 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T23:36:31.212 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T23:36:31.213 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps": 0, 2024-09-11T23:36:31.213 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps_dirty": 0, 2024-09-11T23:36:31.213 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_cap_release": 0, 2024-09-11T23:36:31.213 INFO:teuthology.orchestra.run.smithi172.stdout: "process_request_cap_release": 0 2024-09-11T23:36:31.213 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.213 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_cache": { 2024-09-11T23:36:31.213 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update": 0, 2024-09-11T23:36:31.213 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update_receipt": 0, 2024-09-11T23:36:31.213 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_try_discover": 0, 2024-09-11T23:36:31.213 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_send_discover": 0, 2024-09-11T23:36:31.213 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_handle_discover": 0, 2024-09-11T23:36:31.213 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays": 0, 2024-09-11T23:36:31.214 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_delayed": 0, 2024-09-11T23:36:31.214 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_enqueuing": 0, 2024-09-11T23:36:31.214 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_created": 0, 2024-09-11T23:36:31.214 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_enqueued": 0, 2024-09-11T23:36:31.214 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_reintegrated": 0, 2024-09-11T23:36:31.214 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_migrated": 0, 2024-09-11T23:36:31.214 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_processing": 0, 2024-09-11T23:36:31.214 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_enqueued": 0, 2024-09-11T23:36:31.214 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_prioritized": 0, 2024-09-11T23:36:31.214 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_started": 0, 2024-09-11T23:36:31.214 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_completed": 0, 2024-09-11T23:36:31.214 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_path": 0, 2024-09-11T23:36:31.215 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_inode": 0, 2024-09-11T23:36:31.215 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_enqueue_scrub": 0, 2024-09-11T23:36:31.215 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_exportdir": 0, 2024-09-11T23:36:31.215 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_flush": 0, 2024-09-11T23:36:31.215 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragmentdir": 0, 2024-09-11T23:36:31.215 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragstats": 0, 2024-09-11T23:36:31.215 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_inodestats": 0 2024-09-11T23:36:31.215 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.215 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_log": { 2024-09-11T23:36:31.215 INFO:teuthology.orchestra.run.smithi172.stdout: "evlrg": 0, 2024-09-11T23:36:31.216 INFO:teuthology.orchestra.run.smithi172.stdout: "evadd": 0, 2024-09-11T23:36:31.216 INFO:teuthology.orchestra.run.smithi172.stdout: "evex": 0, 2024-09-11T23:36:31.216 INFO:teuthology.orchestra.run.smithi172.stdout: "evtrm": 0, 2024-09-11T23:36:31.216 INFO:teuthology.orchestra.run.smithi172.stdout: "ev": 43722, 2024-09-11T23:36:31.216 INFO:teuthology.orchestra.run.smithi172.stdout: "evexg": 0, 2024-09-11T23:36:31.216 INFO:teuthology.orchestra.run.smithi172.stdout: "evexd": 0, 2024-09-11T23:36:31.216 INFO:teuthology.orchestra.run.smithi172.stdout: "segadd": 0, 2024-09-11T23:36:31.216 INFO:teuthology.orchestra.run.smithi172.stdout: "segex": 0, 2024-09-11T23:36:31.216 INFO:teuthology.orchestra.run.smithi172.stdout: "segtrm": 0, 2024-09-11T23:36:31.216 INFO:teuthology.orchestra.run.smithi172.stdout: "seg": 63, 2024-09-11T23:36:31.216 INFO:teuthology.orchestra.run.smithi172.stdout: "segmjr": 5, 2024-09-11T23:36:31.216 INFO:teuthology.orchestra.run.smithi172.stdout: "segexg": 0, 2024-09-11T23:36:31.217 INFO:teuthology.orchestra.run.smithi172.stdout: "segexd": 0, 2024-09-11T23:36:31.217 INFO:teuthology.orchestra.run.smithi172.stdout: "expos": 4194304, 2024-09-11T23:36:31.217 INFO:teuthology.orchestra.run.smithi172.stdout: "wrpos": 97859604, 2024-09-11T23:36:31.217 INFO:teuthology.orchestra.run.smithi172.stdout: "rdpos": 97855303, 2024-09-11T23:36:31.217 INFO:teuthology.orchestra.run.smithi172.stdout: "jlat": { 2024-09-11T23:36:31.217 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:31.217 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:31.217 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:31.217 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.217 INFO:teuthology.orchestra.run.smithi172.stdout: "replayed": 43722 2024-09-11T23:36:31.218 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.218 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_mem": { 2024-09-11T23:36:31.218 INFO:teuthology.orchestra.run.smithi172.stdout: "ino": 25, 2024-09-11T23:36:31.218 INFO:teuthology.orchestra.run.smithi172.stdout: "ino+": 6299, 2024-09-11T23:36:31.218 INFO:teuthology.orchestra.run.smithi172.stdout: "ino-": 6274, 2024-09-11T23:36:31.218 INFO:teuthology.orchestra.run.smithi172.stdout: "dir": 20, 2024-09-11T23:36:31.218 INFO:teuthology.orchestra.run.smithi172.stdout: "dir+": 261, 2024-09-11T23:36:31.218 INFO:teuthology.orchestra.run.smithi172.stdout: "dir-": 241, 2024-09-11T23:36:31.218 INFO:teuthology.orchestra.run.smithi172.stdout: "dn": 1711, 2024-09-11T23:36:31.218 INFO:teuthology.orchestra.run.smithi172.stdout: "dn+": 6469, 2024-09-11T23:36:31.218 INFO:teuthology.orchestra.run.smithi172.stdout: "dn-": 4758, 2024-09-11T23:36:31.218 INFO:teuthology.orchestra.run.smithi172.stdout: "cap": 0, 2024-09-11T23:36:31.219 INFO:teuthology.orchestra.run.smithi172.stdout: "cap+": 0, 2024-09-11T23:36:31.219 INFO:teuthology.orchestra.run.smithi172.stdout: "cap-": 0, 2024-09-11T23:36:31.219 INFO:teuthology.orchestra.run.smithi172.stdout: "rss": 60648, 2024-09-11T23:36:31.219 INFO:teuthology.orchestra.run.smithi172.stdout: "heap": 215328 2024-09-11T23:36:31.219 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.219 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_server": { 2024-09-11T23:36:31.219 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_client_request": 0, 2024-09-11T23:36:31.219 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_server_request": 0, 2024-09-11T23:36:31.219 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_request": 0, 2024-09-11T23:36:31.219 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_session": 0, 2024-09-11T23:36:31.220 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_peer_request": 0, 2024-09-11T23:36:31.220 INFO:teuthology.orchestra.run.smithi172.stdout: "req_create_latency": { 2024-09-11T23:36:31.220 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:31.220 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:31.220 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:31.220 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.220 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getattr_latency": { 2024-09-11T23:36:31.220 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:31.220 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:31.220 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:31.220 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.221 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getfilelock_latency": { 2024-09-11T23:36:31.221 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:31.221 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:31.221 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:31.221 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.221 INFO:teuthology.orchestra.run.smithi172.stdout: "req_link_latency": { 2024-09-11T23:36:31.221 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:31.221 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:31.221 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:31.221 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.221 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookup_latency": { 2024-09-11T23:36:31.222 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:31.222 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:31.222 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:31.222 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.222 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookuphash_latency": { 2024-09-11T23:36:31.222 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:31.222 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:31.222 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:31.222 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.222 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupino_latency": { 2024-09-11T23:36:31.223 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:31.223 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:31.223 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:31.223 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.223 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupname_latency": { 2024-09-11T23:36:31.223 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:31.223 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:31.223 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:31.223 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.224 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupparent_latency": { 2024-09-11T23:36:31.224 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:31.224 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:31.224 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:31.224 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.224 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupsnap_latency": { 2024-09-11T23:36:31.224 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:31.224 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:31.224 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:31.225 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.225 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lssnap_latency": { 2024-09-11T23:36:31.225 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:31.225 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:31.225 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:31.225 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.225 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mkdir_latency": { 2024-09-11T23:36:31.226 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:31.226 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:31.226 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:31.226 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.226 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mknod_latency": { 2024-09-11T23:36:31.226 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:31.227 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:31.227 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:31.227 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.227 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mksnap_latency": { 2024-09-11T23:36:31.227 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:31.227 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:31.227 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:31.227 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.227 INFO:teuthology.orchestra.run.smithi172.stdout: "req_open_latency": { 2024-09-11T23:36:31.227 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:31.227 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:31.227 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:31.228 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.228 INFO:teuthology.orchestra.run.smithi172.stdout: "req_readdir_latency": { 2024-09-11T23:36:31.228 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:31.228 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:31.228 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:31.228 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.228 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rename_latency": { 2024-09-11T23:36:31.228 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:31.228 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:31.228 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:31.228 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.228 INFO:teuthology.orchestra.run.smithi172.stdout: "req_renamesnap_latency": { 2024-09-11T23:36:31.229 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:31.229 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:31.229 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:31.229 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.229 INFO:teuthology.orchestra.run.smithi172.stdout: "req_snapdiff_latency": { 2024-09-11T23:36:31.229 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:31.229 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:31.229 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:31.229 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.229 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmdir_latency": { 2024-09-11T23:36:31.229 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:31.229 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:31.230 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:31.230 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.230 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmsnap_latency": { 2024-09-11T23:36:31.230 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:31.230 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:31.230 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:31.230 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.230 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmxattr_latency": { 2024-09-11T23:36:31.230 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:31.230 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:31.230 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:31.230 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.230 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setattr_latency": { 2024-09-11T23:36:31.231 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:31.231 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:31.231 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:31.231 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.231 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setdirlayout_latency": { 2024-09-11T23:36:31.231 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:31.231 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:31.231 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:31.231 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.231 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setfilelock_latency": { 2024-09-11T23:36:31.231 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:31.232 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:31.232 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:31.232 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.232 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setlayout_latency": { 2024-09-11T23:36:31.232 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:31.232 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:31.232 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:31.232 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.232 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setxattr_latency": { 2024-09-11T23:36:31.232 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:31.233 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:31.233 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:31.233 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.233 INFO:teuthology.orchestra.run.smithi172.stdout: "req_symlink_latency": { 2024-09-11T23:36:31.233 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:31.233 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:31.233 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:31.233 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.233 INFO:teuthology.orchestra.run.smithi172.stdout: "req_unlink_latency": { 2024-09-11T23:36:31.234 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:31.234 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:31.234 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:31.234 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.234 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_revoke_eviction": 0, 2024-09-11T23:36:31.234 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_acquisition_throttle": 0, 2024-09-11T23:36:31.234 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getvxattr_latency": { 2024-09-11T23:36:31.234 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:31.234 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:31.234 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:31.235 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-11T23:36:31.235 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.235 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_sessions": { 2024-09-11T23:36:31.235 INFO:teuthology.orchestra.run.smithi172.stdout: "session_count": 1, 2024-09-11T23:36:31.235 INFO:teuthology.orchestra.run.smithi172.stdout: "session_add": 3, 2024-09-11T23:36:31.235 INFO:teuthology.orchestra.run.smithi172.stdout: "session_remove": 2, 2024-09-11T23:36:31.235 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_open": 1, 2024-09-11T23:36:31.235 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_stale": 0, 2024-09-11T23:36:31.235 INFO:teuthology.orchestra.run.smithi172.stdout: "total_load": 0, 2024-09-11T23:36:31.235 INFO:teuthology.orchestra.run.smithi172.stdout: "average_load": 0, 2024-09-11T23:36:31.235 INFO:teuthology.orchestra.run.smithi172.stdout: "avg_session_uptime": 1489, 2024-09-11T23:36:31.235 INFO:teuthology.orchestra.run.smithi172.stdout: "mdthresh_evicted": 0 2024-09-11T23:36:31.235 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.236 INFO:teuthology.orchestra.run.smithi172.stdout: "mempool": { 2024-09-11T23:36:31.236 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_bytes": 0, 2024-09-11T23:36:31.236 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_items": 0, 2024-09-11T23:36:31.236 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T23:36:31.236 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_items": 0, 2024-09-11T23:36:31.236 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T23:36:31.236 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_items": 0, 2024-09-11T23:36:31.236 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T23:36:31.236 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T23:36:31.236 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T23:36:31.236 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T23:36:31.236 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T23:36:31.236 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_items": 0, 2024-09-11T23:36:31.237 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T23:36:31.237 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T23:36:31.237 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_bytes": 0, 2024-09-11T23:36:31.237 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_items": 0, 2024-09-11T23:36:31.237 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_bytes": 0, 2024-09-11T23:36:31.237 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_items": 0, 2024-09-11T23:36:31.237 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T23:36:31.237 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T23:36:31.237 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T23:36:31.237 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T23:36:31.237 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T23:36:31.237 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_items": 0, 2024-09-11T23:36:31.238 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_bytes": 0, 2024-09-11T23:36:31.238 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_items": 0, 2024-09-11T23:36:31.238 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T23:36:31.238 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T23:36:31.238 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_bytes": 0, 2024-09-11T23:36:31.238 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_items": 0, 2024-09-11T23:36:31.238 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_bytes": 0, 2024-09-11T23:36:31.238 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_items": 0, 2024-09-11T23:36:31.238 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T23:36:31.238 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_items": 0, 2024-09-11T23:36:31.238 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T23:36:31.238 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_items": 0, 2024-09-11T23:36:31.239 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_bytes": 231351, 2024-09-11T23:36:31.239 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_items": 74, 2024-09-11T23:36:31.239 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_bytes": 0, 2024-09-11T23:36:31.239 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_items": 0, 2024-09-11T23:36:31.239 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_bytes": 0, 2024-09-11T23:36:31.239 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_items": 0, 2024-09-11T23:36:31.239 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_bytes": 0, 2024-09-11T23:36:31.239 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_items": 0, 2024-09-11T23:36:31.239 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_bytes": 0, 2024-09-11T23:36:31.239 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_items": 0, 2024-09-11T23:36:31.239 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_bytes": 8960, 2024-09-11T23:36:31.239 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_items": 169, 2024-09-11T23:36:31.239 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T23:36:31.240 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_items": 0, 2024-09-11T23:36:31.240 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_bytes": 0, 2024-09-11T23:36:31.240 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_items": 0, 2024-09-11T23:36:31.240 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_bytes": 1286256, 2024-09-11T23:36:31.240 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_items": 7316, 2024-09-11T23:36:31.240 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_bytes": 0, 2024-09-11T23:36:31.240 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_items": 0, 2024-09-11T23:36:31.240 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_bytes": 0, 2024-09-11T23:36:31.240 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_items": 0 2024-09-11T23:36:31.240 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.240 INFO:teuthology.orchestra.run.smithi172.stdout: "objecter": { 2024-09-11T23:36:31.240 INFO:teuthology.orchestra.run.smithi172.stdout: "op_active": 0, 2024-09-11T23:36:31.240 INFO:teuthology.orchestra.run.smithi172.stdout: "op_laggy": 0, 2024-09-11T23:36:31.241 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send": 2043, 2024-09-11T23:36:31.241 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send_bytes": 26, 2024-09-11T23:36:31.241 INFO:teuthology.orchestra.run.smithi172.stdout: "op_resend": 4, 2024-09-11T23:36:31.241 INFO:teuthology.orchestra.run.smithi172.stdout: "op_reply": 2043, 2024-09-11T23:36:31.241 INFO:teuthology.orchestra.run.smithi172.stdout: "op_latency": { 2024-09-11T23:36:31.241 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2043, 2024-09-11T23:36:31.241 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.324967680, 2024-09-11T23:36:31.241 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000648540 2024-09-11T23:36:31.241 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.241 INFO:teuthology.orchestra.run.smithi172.stdout: "op_inflight": 0, 2024-09-11T23:36:31.241 INFO:teuthology.orchestra.run.smithi172.stdout: "oplen_avg": { 2024-09-11T23:36:31.241 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2043, 2024-09-11T23:36:31.242 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 2044 2024-09-11T23:36:31.242 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.242 INFO:teuthology.orchestra.run.smithi172.stdout: "op": 2043, 2024-09-11T23:36:31.242 INFO:teuthology.orchestra.run.smithi172.stdout: "op_r": 2043, 2024-09-11T23:36:31.242 INFO:teuthology.orchestra.run.smithi172.stdout: "op_w": 0, 2024-09-11T23:36:31.242 INFO:teuthology.orchestra.run.smithi172.stdout: "op_rmw": 0, 2024-09-11T23:36:31.242 INFO:teuthology.orchestra.run.smithi172.stdout: "op_pg": 0, 2024-09-11T23:36:31.242 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_stat": 1120, 2024-09-11T23:36:31.242 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_create": 0, 2024-09-11T23:36:31.242 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_read": 920, 2024-09-11T23:36:31.242 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_write": 0, 2024-09-11T23:36:31.242 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writefull": 0, 2024-09-11T23:36:31.243 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writesame": 0, 2024-09-11T23:36:31.243 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_append": 0, 2024-09-11T23:36:31.243 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_zero": 0, 2024-09-11T23:36:31.243 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_truncate": 0, 2024-09-11T23:36:31.243 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_delete": 0, 2024-09-11T23:36:31.243 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_mapext": 0, 2024-09-11T23:36:31.243 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_sparse_read": 0, 2024-09-11T23:36:31.243 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_clonerange": 0, 2024-09-11T23:36:31.243 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_getxattr": 2, 2024-09-11T23:36:31.243 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_setxattr": 0, 2024-09-11T23:36:31.243 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_cmpxattr": 0, 2024-09-11T23:36:31.243 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_rmxattr": 0, 2024-09-11T23:36:31.243 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_resetxattrs": 0, 2024-09-11T23:36:31.244 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_call": 0, 2024-09-11T23:36:31.244 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_watch": 0, 2024-09-11T23:36:31.244 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_notify": 0, 2024-09-11T23:36:31.244 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T23:36:31.244 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls": 0, 2024-09-11T23:36:31.244 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls_filter": 0, 2024-09-11T23:36:31.244 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_other": 0, 2024-09-11T23:36:31.244 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_active": 0, 2024-09-11T23:36:31.244 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_send": 0, 2024-09-11T23:36:31.244 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_resend": 0, 2024-09-11T23:36:31.245 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_ping": 0, 2024-09-11T23:36:31.245 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_active": 0, 2024-09-11T23:36:31.245 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_send": 0, 2024-09-11T23:36:31.245 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_resend": 0, 2024-09-11T23:36:31.245 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_active": 0, 2024-09-11T23:36:31.245 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_send": 0, 2024-09-11T23:36:31.245 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_resend": 0, 2024-09-11T23:36:31.245 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_active": 0, 2024-09-11T23:36:31.245 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_send": 0, 2024-09-11T23:36:31.245 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_resend": 0, 2024-09-11T23:36:31.245 INFO:teuthology.orchestra.run.smithi172.stdout: "command_active": 0, 2024-09-11T23:36:31.246 INFO:teuthology.orchestra.run.smithi172.stdout: "command_send": 0, 2024-09-11T23:36:31.246 INFO:teuthology.orchestra.run.smithi172.stdout: "command_resend": 0, 2024-09-11T23:36:31.246 INFO:teuthology.orchestra.run.smithi172.stdout: "map_epoch": 88, 2024-09-11T23:36:31.246 INFO:teuthology.orchestra.run.smithi172.stdout: "map_full": 0, 2024-09-11T23:36:31.246 INFO:teuthology.orchestra.run.smithi172.stdout: "map_inc": 2, 2024-09-11T23:36:31.246 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_sessions": 10, 2024-09-11T23:36:31.246 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_open": 10, 2024-09-11T23:36:31.246 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_close": 0, 2024-09-11T23:36:31.246 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_laggy": 0, 2024-09-11T23:36:31.246 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_wr": 0, 2024-09-11T23:36:31.247 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_rd": 2, 2024-09-11T23:36:31.247 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_del": 0 2024-09-11T23:36:31.247 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.247 INFO:teuthology.orchestra.run.smithi172.stdout: "oft": { 2024-09-11T23:36:31.247 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_objs": 0, 2024-09-11T23:36:31.247 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_kv_pairs": 0, 2024-09-11T23:36:31.247 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_updates": 0, 2024-09-11T23:36:31.248 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_removes": 0 2024-09-11T23:36:31.248 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.248 INFO:teuthology.orchestra.run.smithi172.stdout: "osd-slow-ops": { 2024-09-11T23:36:31.248 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_ops_count": 0 2024-09-11T23:36:31.248 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.248 INFO:teuthology.orchestra.run.smithi172.stdout: "purge_queue": { 2024-09-11T23:36:31.248 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops": 0, 2024-09-11T23:36:31.248 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops_high_water": 0, 2024-09-11T23:36:31.248 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing": 0, 2024-09-11T23:36:31.249 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_high_water": 0, 2024-09-11T23:36:31.249 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed_ops": 0, 2024-09-11T23:36:31.249 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed": 0, 2024-09-11T23:36:31.249 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_item_in_journal": 0 2024-09-11T23:36:31.249 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.249 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T23:36:31.249 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-11T23:36:31.249 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-09-11T23:36:31.250 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-11T23:36:31.250 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 2229, 2024-09-11T23:36:31.250 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 94565807, 2024-09-11T23:36:31.250 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-11T23:36:31.250 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 2229, 2024-09-11T23:36:31.250 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-11T23:36:31.250 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-11T23:36:31.250 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 2229, 2024-09-11T23:36:31.250 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 94565807, 2024-09-11T23:36:31.250 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-11T23:36:31.250 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:31.250 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:31.250 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:31.251 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-11T23:36:31.251 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.251 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_bytes": { 2024-09-11T23:36:31.251 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-11T23:36:31.251 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-09-11T23:36:31.251 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-11T23:36:31.251 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-11T23:36:31.251 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-11T23:36:31.251 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-11T23:36:31.251 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-11T23:36:31.252 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 2043, 2024-09-11T23:36:31.252 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 93697017, 2024-09-11T23:36:31.252 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 2043, 2024-09-11T23:36:31.252 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 93697017, 2024-09-11T23:36:31.252 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-11T23:36:31.252 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:31.252 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:31.252 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:31.252 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-11T23:36:31.252 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.252 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_ops": { 2024-09-11T23:36:31.253 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-11T23:36:31.253 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 1024, 2024-09-11T23:36:31.253 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-11T23:36:31.253 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-11T23:36:31.253 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-11T23:36:31.253 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-11T23:36:31.253 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-11T23:36:31.253 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 2043, 2024-09-11T23:36:31.253 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 2043, 2024-09-11T23:36:31.253 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 2043, 2024-09-11T23:36:31.254 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 2043, 2024-09-11T23:36:31.254 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-11T23:36:31.254 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:31.254 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:31.254 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:31.254 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-11T23:36:31.254 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.254 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle": { 2024-09-11T23:36:31.254 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-11T23:36:31.254 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-09-11T23:36:31.255 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-11T23:36:31.255 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-11T23:36:31.255 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-11T23:36:31.255 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-11T23:36:31.255 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-11T23:36:31.256 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-11T23:36:31.256 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-11T23:36:31.256 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 0, 2024-09-11T23:36:31.256 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 0, 2024-09-11T23:36:31.256 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-11T23:36:31.256 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:31.256 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:31.256 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:31.257 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-11T23:36:31.257 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:31.257 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle-0x563e599aab40": { 2024-09-11T23:36:31.257 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-11T23:36:31.257 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-09-11T23:36:31.257 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-11T23:36:31.257 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-11T23:36:31.258 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-11T23:36:31.258 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-11T23:36:31.258 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-11T23:36:31.258 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-11T23:36:31.258 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-11T23:36:31.258 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 0, 2024-09-11T23:36:31.258 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 0, 2024-09-11T23:36:31.258 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-11T23:36:31.259 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:31.259 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:31.259 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:31.259 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-11T23:36:31.259 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-11T23:36:31.259 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-11T23:36:31.633 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:31 smithi172 ceph-mon[34855]: pgmap v578: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 7.2 KiB/s wr, 10 op/s 2024-09-11T23:36:31.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:31 smithi159 ceph-mon[34394]: pgmap v578: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 7.2 KiB/s wr, 10 op/s 2024-09-11T23:36:31.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:31 smithi005 ceph-mon[31201]: pgmap v578: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 7.2 KiB/s wr, 10 op/s 2024-09-11T23:36:32.018 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-11T23:36:32.018 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-11T23:36:32.018 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=0 2024-09-11T23:36:32.018 DEBUG:tasks.check_counter:Getting stats from f 2024-09-11T23:36:32.019 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-11T23:36:32.273 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:36:32.805 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-11T23:36:32.806 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T23:36:32.806 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 1220, 2024-09-11T23:36:32.806 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 1220, 2024-09-11T23:36:32.806 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 17132731, 2024-09-11T23:36:32.806 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 387137, 2024-09-11T23:36:32.806 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 7, 2024-09-11T23:36:32.806 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 3, 2024-09-11T23:36:32.806 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.108811926, 2024-09-11T23:36:32.806 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.030374172, 2024-09-11T23:36:32.806 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.035688451, 2024-09-11T23:36:32.806 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.034072982, 2024-09-11T23:36:32.806 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:36:32.807 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1219, 2024-09-11T23:36:32.807 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.041557625, 2024-09-11T23:36:32.807 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000034091 2024-09-11T23:36:32.807 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.807 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:36:32.807 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:32.807 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:32.807 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:32.807 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.807 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-11T23:36:32.807 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 448 2024-09-11T23:36:32.807 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.807 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T23:36:32.808 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 403, 2024-09-11T23:36:32.808 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 528, 2024-09-11T23:36:32.808 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 18315600, 2024-09-11T23:36:32.808 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 415552, 2024-09-11T23:36:32.808 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 6, 2024-09-11T23:36:32.808 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 5, 2024-09-11T23:36:32.808 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.044250666, 2024-09-11T23:36:32.808 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.013856508, 2024-09-11T23:36:32.808 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.017905446, 2024-09-11T23:36:32.808 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.008715096, 2024-09-11T23:36:32.808 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:36:32.808 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 526, 2024-09-11T23:36:32.809 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.019503162, 2024-09-11T23:36:32.809 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000037078 2024-09-11T23:36:32.809 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.809 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:36:32.809 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:32.809 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:32.809 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:32.809 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.809 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-11T23:36:32.809 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 287648 2024-09-11T23:36:32.809 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.809 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T23:36:32.810 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 219, 2024-09-11T23:36:32.810 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 208, 2024-09-11T23:36:32.810 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 4716866, 2024-09-11T23:36:32.810 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 113964, 2024-09-11T23:36:32.810 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 5, 2024-09-11T23:36:32.810 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 4, 2024-09-11T23:36:32.810 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.029294419, 2024-09-11T23:36:32.810 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.011115987, 2024-09-11T23:36:32.810 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.021570590, 2024-09-11T23:36:32.810 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.001160946, 2024-09-11T23:36:32.810 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:36:32.810 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 207, 2024-09-11T23:36:32.810 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.013778193, 2024-09-11T23:36:32.811 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000066561 2024-09-11T23:36:32.811 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.811 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:36:32.811 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:32.811 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:32.811 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:32.811 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.811 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 514064, 2024-09-11T23:36:32.811 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 103152 2024-09-11T23:36:32.811 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.811 INFO:teuthology.orchestra.run.smithi172.stdout: "cct": { 2024-09-11T23:36:32.811 INFO:teuthology.orchestra.run.smithi172.stdout: "total_workers": 1, 2024-09-11T23:36:32.811 INFO:teuthology.orchestra.run.smithi172.stdout: "unhealthy_workers": 0 2024-09-11T23:36:32.812 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.812 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-MDSRank": { 2024-09-11T23:36:32.812 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-09-11T23:36:32.812 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-09-11T23:36:32.812 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2791, 2024-09-11T23:36:32.812 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.067484568, 2024-09-11T23:36:32.812 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000024179 2024-09-11T23:36:32.812 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-11T23:36:32.812 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.812 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-PurgeQueue": { 2024-09-11T23:36:32.812 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-09-11T23:36:32.812 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-09-11T23:36:32.813 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:32.813 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:32.813 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:32.813 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-11T23:36:32.813 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.813 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": { 2024-09-11T23:36:32.813 INFO:teuthology.orchestra.run.smithi172.stdout: "request": 0, 2024-09-11T23:36:32.813 INFO:teuthology.orchestra.run.smithi172.stdout: "reply": 0, 2024-09-11T23:36:32.813 INFO:teuthology.orchestra.run.smithi172.stdout: "reply_latency": { 2024-09-11T23:36:32.813 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:32.813 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:32.813 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:32.813 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.814 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_reply": 0, 2024-09-11T23:36:32.814 INFO:teuthology.orchestra.run.smithi172.stdout: "forward": 0, 2024-09-11T23:36:32.814 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_complete": 0, 2024-09-11T23:36:32.814 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_keys": 0, 2024-09-11T23:36:32.814 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_commit": 0, 2024-09-11T23:36:32.814 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_split": 0, 2024-09-11T23:36:32.814 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_merge": 0, 2024-09-11T23:36:32.814 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes": 6335, 2024-09-11T23:36:32.814 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_top": 10, 2024-09-11T23:36:32.814 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_bottom": 6325, 2024-09-11T23:36:32.814 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pin_tail": 0, 2024-09-11T23:36:32.814 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pinned": 6320, 2024-09-11T23:36:32.814 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_expired": 0, 2024-09-11T23:36:32.814 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_with_caps": 0, 2024-09-11T23:36:32.815 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": 0, 2024-09-11T23:36:32.815 INFO:teuthology.orchestra.run.smithi172.stdout: "subtrees": 1, 2024-09-11T23:36:32.815 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse": 0, 2024-09-11T23:36:32.815 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_hit": 0, 2024-09-11T23:36:32.815 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_forward": 0, 2024-09-11T23:36:32.815 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_discover": 0, 2024-09-11T23:36:32.815 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_dir_fetch": 0, 2024-09-11T23:36:32.815 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_remote_ino": 0, 2024-09-11T23:36:32.815 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_lock": 0, 2024-09-11T23:36:32.815 INFO:teuthology.orchestra.run.smithi172.stdout: "load_cent": 0, 2024-09-11T23:36:32.815 INFO:teuthology.orchestra.run.smithi172.stdout: "q": 0, 2024-09-11T23:36:32.815 INFO:teuthology.orchestra.run.smithi172.stdout: "exported": 0, 2024-09-11T23:36:32.815 INFO:teuthology.orchestra.run.smithi172.stdout: "exported_inodes": 0, 2024-09-11T23:36:32.816 INFO:teuthology.orchestra.run.smithi172.stdout: "imported": 0, 2024-09-11T23:36:32.816 INFO:teuthology.orchestra.run.smithi172.stdout: "imported_inodes": 0, 2024-09-11T23:36:32.816 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_dir_fetch": 0, 2024-09-11T23:36:32.816 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_backtrace_fetch": 0, 2024-09-11T23:36:32.816 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_peer_discover": 0, 2024-09-11T23:36:32.816 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rfiles": 0, 2024-09-11T23:36:32.816 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rbytes": 0, 2024-09-11T23:36:32.816 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rsnaps": 0, 2024-09-11T23:36:32.816 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_fetch": 0, 2024-09-11T23:36:32.816 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_set_tag": 0, 2024-09-11T23:36:32.816 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T23:36:32.816 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_inotable_repaired": 0, 2024-09-11T23:36:32.816 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_inodes": 0, 2024-09-11T23:36:32.817 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_base_inodes": 0, 2024-09-11T23:36:32.817 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dirfrag_rstats": 0, 2024-09-11T23:36:32.817 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_file_inodes": 0, 2024-09-11T23:36:32.817 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_inode_file_caps": 0, 2024-09-11T23:36:32.817 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_revoke": 0, 2024-09-11T23:36:32.817 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_grant": 0, 2024-09-11T23:36:32.817 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_trunc": 0, 2024-09-11T23:36:32.817 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T23:36:32.817 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T23:36:32.817 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps": 0, 2024-09-11T23:36:32.817 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps_dirty": 0, 2024-09-11T23:36:32.817 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_cap_release": 0, 2024-09-11T23:36:32.817 INFO:teuthology.orchestra.run.smithi172.stdout: "process_request_cap_release": 0 2024-09-11T23:36:32.818 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.818 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_cache": { 2024-09-11T23:36:32.818 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update": 0, 2024-09-11T23:36:32.818 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update_receipt": 0, 2024-09-11T23:36:32.818 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_try_discover": 0, 2024-09-11T23:36:32.818 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_send_discover": 0, 2024-09-11T23:36:32.818 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_handle_discover": 0, 2024-09-11T23:36:32.818 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays": 0, 2024-09-11T23:36:32.818 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_delayed": 0, 2024-09-11T23:36:32.818 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_enqueuing": 0, 2024-09-11T23:36:32.818 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_created": 0, 2024-09-11T23:36:32.818 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_enqueued": 0, 2024-09-11T23:36:32.818 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_reintegrated": 0, 2024-09-11T23:36:32.819 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_migrated": 0, 2024-09-11T23:36:32.819 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_processing": 0, 2024-09-11T23:36:32.819 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_enqueued": 0, 2024-09-11T23:36:32.819 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_prioritized": 0, 2024-09-11T23:36:32.819 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_started": 0, 2024-09-11T23:36:32.819 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_completed": 0, 2024-09-11T23:36:32.819 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_path": 0, 2024-09-11T23:36:32.819 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_inode": 0, 2024-09-11T23:36:32.819 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_enqueue_scrub": 0, 2024-09-11T23:36:32.819 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_exportdir": 0, 2024-09-11T23:36:32.819 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_flush": 0, 2024-09-11T23:36:32.819 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragmentdir": 0, 2024-09-11T23:36:32.819 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragstats": 0, 2024-09-11T23:36:32.819 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_inodestats": 0 2024-09-11T23:36:32.820 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.820 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_log": { 2024-09-11T23:36:32.820 INFO:teuthology.orchestra.run.smithi172.stdout: "evlrg": 0, 2024-09-11T23:36:32.820 INFO:teuthology.orchestra.run.smithi172.stdout: "evadd": 0, 2024-09-11T23:36:32.820 INFO:teuthology.orchestra.run.smithi172.stdout: "evex": 0, 2024-09-11T23:36:32.820 INFO:teuthology.orchestra.run.smithi172.stdout: "evtrm": 0, 2024-09-11T23:36:32.820 INFO:teuthology.orchestra.run.smithi172.stdout: "ev": 43689, 2024-09-11T23:36:32.820 INFO:teuthology.orchestra.run.smithi172.stdout: "evexg": 0, 2024-09-11T23:36:32.820 INFO:teuthology.orchestra.run.smithi172.stdout: "evexd": 0, 2024-09-11T23:36:32.820 INFO:teuthology.orchestra.run.smithi172.stdout: "segadd": 0, 2024-09-11T23:36:32.820 INFO:teuthology.orchestra.run.smithi172.stdout: "segex": 0, 2024-09-11T23:36:32.820 INFO:teuthology.orchestra.run.smithi172.stdout: "segtrm": 0, 2024-09-11T23:36:32.820 INFO:teuthology.orchestra.run.smithi172.stdout: "seg": 53, 2024-09-11T23:36:32.821 INFO:teuthology.orchestra.run.smithi172.stdout: "segmjr": 5, 2024-09-11T23:36:32.821 INFO:teuthology.orchestra.run.smithi172.stdout: "segexg": 0, 2024-09-11T23:36:32.821 INFO:teuthology.orchestra.run.smithi172.stdout: "segexd": 0, 2024-09-11T23:36:32.821 INFO:teuthology.orchestra.run.smithi172.stdout: "expos": 4194304, 2024-09-11T23:36:32.821 INFO:teuthology.orchestra.run.smithi172.stdout: "wrpos": 43376120, 2024-09-11T23:36:32.821 INFO:teuthology.orchestra.run.smithi172.stdout: "rdpos": 43373897, 2024-09-11T23:36:32.821 INFO:teuthology.orchestra.run.smithi172.stdout: "jlat": { 2024-09-11T23:36:32.825 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:32.825 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:32.825 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:32.825 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.825 INFO:teuthology.orchestra.run.smithi172.stdout: "replayed": 43689 2024-09-11T23:36:32.825 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.825 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_mem": { 2024-09-11T23:36:32.825 INFO:teuthology.orchestra.run.smithi172.stdout: "ino": 19, 2024-09-11T23:36:32.825 INFO:teuthology.orchestra.run.smithi172.stdout: "ino+": 3459, 2024-09-11T23:36:32.826 INFO:teuthology.orchestra.run.smithi172.stdout: "ino-": 3440, 2024-09-11T23:36:32.826 INFO:teuthology.orchestra.run.smithi172.stdout: "dir": 157, 2024-09-11T23:36:32.826 INFO:teuthology.orchestra.run.smithi172.stdout: "dir+": 222, 2024-09-11T23:36:32.826 INFO:teuthology.orchestra.run.smithi172.stdout: "dir-": 65, 2024-09-11T23:36:32.826 INFO:teuthology.orchestra.run.smithi172.stdout: "dn": 6335, 2024-09-11T23:36:32.826 INFO:teuthology.orchestra.run.smithi172.stdout: "dn+": 6939, 2024-09-11T23:36:32.826 INFO:teuthology.orchestra.run.smithi172.stdout: "dn-": 604, 2024-09-11T23:36:32.826 INFO:teuthology.orchestra.run.smithi172.stdout: "cap": 0, 2024-09-11T23:36:32.826 INFO:teuthology.orchestra.run.smithi172.stdout: "cap+": 0, 2024-09-11T23:36:32.826 INFO:teuthology.orchestra.run.smithi172.stdout: "cap-": 0, 2024-09-11T23:36:32.826 INFO:teuthology.orchestra.run.smithi172.stdout: "rss": 60948, 2024-09-11T23:36:32.826 INFO:teuthology.orchestra.run.smithi172.stdout: "heap": 215328 2024-09-11T23:36:32.826 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.827 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_server": { 2024-09-11T23:36:32.827 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_client_request": 0, 2024-09-11T23:36:32.827 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_server_request": 0, 2024-09-11T23:36:32.827 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_request": 0, 2024-09-11T23:36:32.827 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_session": 0, 2024-09-11T23:36:32.827 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_peer_request": 0, 2024-09-11T23:36:32.827 INFO:teuthology.orchestra.run.smithi172.stdout: "req_create_latency": { 2024-09-11T23:36:32.827 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:32.827 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:32.827 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:32.827 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.827 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getattr_latency": { 2024-09-11T23:36:32.827 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:32.827 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:32.828 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:32.828 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.828 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getfilelock_latency": { 2024-09-11T23:36:32.828 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:32.828 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:32.828 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:32.828 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.828 INFO:teuthology.orchestra.run.smithi172.stdout: "req_link_latency": { 2024-09-11T23:36:32.828 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:32.828 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:32.828 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:32.828 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.828 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookup_latency": { 2024-09-11T23:36:32.829 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:32.829 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:32.829 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:32.829 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.829 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookuphash_latency": { 2024-09-11T23:36:32.829 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:32.829 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:32.829 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:32.829 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.829 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupino_latency": { 2024-09-11T23:36:32.829 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:32.829 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:32.829 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:32.830 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.830 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupname_latency": { 2024-09-11T23:36:32.830 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:32.830 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:32.830 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:32.830 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.830 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupparent_latency": { 2024-09-11T23:36:32.830 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:32.830 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:32.830 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:32.830 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.830 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupsnap_latency": { 2024-09-11T23:36:32.830 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:32.831 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:32.831 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:32.831 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.831 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lssnap_latency": { 2024-09-11T23:36:32.831 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:32.831 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:32.831 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:32.831 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.832 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mkdir_latency": { 2024-09-11T23:36:32.832 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:32.832 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:32.832 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:32.832 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.832 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mknod_latency": { 2024-09-11T23:36:32.832 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:32.832 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:32.832 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:32.832 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.833 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mksnap_latency": { 2024-09-11T23:36:32.833 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:32.833 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:32.833 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:32.833 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.833 INFO:teuthology.orchestra.run.smithi172.stdout: "req_open_latency": { 2024-09-11T23:36:32.833 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:32.833 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:32.833 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:32.833 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.833 INFO:teuthology.orchestra.run.smithi172.stdout: "req_readdir_latency": { 2024-09-11T23:36:32.833 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:32.833 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:32.834 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:32.834 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.834 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rename_latency": { 2024-09-11T23:36:32.834 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:32.834 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:32.834 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:32.834 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.834 INFO:teuthology.orchestra.run.smithi172.stdout: "req_renamesnap_latency": { 2024-09-11T23:36:32.834 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:32.834 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:32.834 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:32.834 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.834 INFO:teuthology.orchestra.run.smithi172.stdout: "req_snapdiff_latency": { 2024-09-11T23:36:32.835 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:32.835 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:32.835 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:32.835 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.835 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmdir_latency": { 2024-09-11T23:36:32.835 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:32.835 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:32.835 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:32.835 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.835 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmsnap_latency": { 2024-09-11T23:36:32.835 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:32.835 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:32.835 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:32.836 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.836 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmxattr_latency": { 2024-09-11T23:36:32.836 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:32.836 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:32.836 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:32.836 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.836 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setattr_latency": { 2024-09-11T23:36:32.836 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:32.836 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:32.836 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:32.836 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.836 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setdirlayout_latency": { 2024-09-11T23:36:32.837 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:32.837 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:32.837 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:32.837 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.837 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setfilelock_latency": { 2024-09-11T23:36:32.837 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:32.837 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:32.837 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:32.837 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.837 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setlayout_latency": { 2024-09-11T23:36:32.837 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:32.837 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:32.837 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:32.838 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.838 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setxattr_latency": { 2024-09-11T23:36:32.838 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:32.838 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:32.838 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:32.838 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.838 INFO:teuthology.orchestra.run.smithi172.stdout: "req_symlink_latency": { 2024-09-11T23:36:32.838 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:32.838 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:32.838 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:32.838 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.838 INFO:teuthology.orchestra.run.smithi172.stdout: "req_unlink_latency": { 2024-09-11T23:36:32.838 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:32.839 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:32.839 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:32.839 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.839 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_revoke_eviction": 0, 2024-09-11T23:36:32.839 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_acquisition_throttle": 0, 2024-09-11T23:36:32.839 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getvxattr_latency": { 2024-09-11T23:36:32.839 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:32.839 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:32.839 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:32.839 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-11T23:36:32.839 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.839 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_sessions": { 2024-09-11T23:36:32.839 INFO:teuthology.orchestra.run.smithi172.stdout: "session_count": 1, 2024-09-11T23:36:32.840 INFO:teuthology.orchestra.run.smithi172.stdout: "session_add": 1, 2024-09-11T23:36:32.840 INFO:teuthology.orchestra.run.smithi172.stdout: "session_remove": 0, 2024-09-11T23:36:32.840 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_open": 1, 2024-09-11T23:36:32.840 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_stale": 0, 2024-09-11T23:36:32.840 INFO:teuthology.orchestra.run.smithi172.stdout: "total_load": 0, 2024-09-11T23:36:32.840 INFO:teuthology.orchestra.run.smithi172.stdout: "average_load": 0, 2024-09-11T23:36:32.840 INFO:teuthology.orchestra.run.smithi172.stdout: "avg_session_uptime": 1486, 2024-09-11T23:36:32.840 INFO:teuthology.orchestra.run.smithi172.stdout: "mdthresh_evicted": 0 2024-09-11T23:36:32.840 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.840 INFO:teuthology.orchestra.run.smithi172.stdout: "mempool": { 2024-09-11T23:36:32.840 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_bytes": 0, 2024-09-11T23:36:32.840 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_items": 0, 2024-09-11T23:36:32.840 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T23:36:32.841 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_items": 0, 2024-09-11T23:36:32.841 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T23:36:32.841 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_items": 0, 2024-09-11T23:36:32.841 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T23:36:32.841 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T23:36:32.841 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T23:36:32.841 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T23:36:32.841 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T23:36:32.841 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_items": 0, 2024-09-11T23:36:32.841 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T23:36:32.841 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T23:36:32.841 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_bytes": 0, 2024-09-11T23:36:32.841 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_items": 0, 2024-09-11T23:36:32.842 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_bytes": 0, 2024-09-11T23:36:32.842 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_items": 0, 2024-09-11T23:36:32.842 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T23:36:32.842 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T23:36:32.842 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T23:36:32.842 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T23:36:32.842 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T23:36:32.842 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_items": 0, 2024-09-11T23:36:32.842 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_bytes": 0, 2024-09-11T23:36:32.842 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_items": 0, 2024-09-11T23:36:32.842 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T23:36:32.842 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T23:36:32.842 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_bytes": 0, 2024-09-11T23:36:32.843 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_items": 0, 2024-09-11T23:36:32.843 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_bytes": 0, 2024-09-11T23:36:32.843 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_items": 0, 2024-09-11T23:36:32.843 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T23:36:32.843 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_items": 0, 2024-09-11T23:36:32.843 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T23:36:32.843 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_items": 0, 2024-09-11T23:36:32.843 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_bytes": 222487, 2024-09-11T23:36:32.843 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_items": 68, 2024-09-11T23:36:32.843 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_bytes": 0, 2024-09-11T23:36:32.843 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_items": 0, 2024-09-11T23:36:32.843 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_bytes": 0, 2024-09-11T23:36:32.843 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_items": 0, 2024-09-11T23:36:32.844 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_bytes": 0, 2024-09-11T23:36:32.844 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_items": 0, 2024-09-11T23:36:32.844 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_bytes": 0, 2024-09-11T23:36:32.844 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_items": 0, 2024-09-11T23:36:32.844 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_bytes": 8960, 2024-09-11T23:36:32.844 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_items": 169, 2024-09-11T23:36:32.844 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T23:36:32.844 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_items": 0, 2024-09-11T23:36:32.844 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_bytes": 0, 2024-09-11T23:36:32.844 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_items": 0, 2024-09-11T23:36:32.844 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_bytes": 4719614, 2024-09-11T23:36:32.844 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_items": 26400, 2024-09-11T23:36:32.844 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_bytes": 0, 2024-09-11T23:36:32.845 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_items": 0, 2024-09-11T23:36:32.845 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_bytes": 0, 2024-09-11T23:36:32.845 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_items": 0 2024-09-11T23:36:32.845 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.845 INFO:teuthology.orchestra.run.smithi172.stdout: "objecter": { 2024-09-11T23:36:32.845 INFO:teuthology.orchestra.run.smithi172.stdout: "op_active": 0, 2024-09-11T23:36:32.845 INFO:teuthology.orchestra.run.smithi172.stdout: "op_laggy": 0, 2024-09-11T23:36:32.845 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send": 1652, 2024-09-11T23:36:32.845 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send_bytes": 21, 2024-09-11T23:36:32.845 INFO:teuthology.orchestra.run.smithi172.stdout: "op_resend": 3, 2024-09-11T23:36:32.845 INFO:teuthology.orchestra.run.smithi172.stdout: "op_reply": 1652, 2024-09-11T23:36:32.845 INFO:teuthology.orchestra.run.smithi172.stdout: "op_latency": { 2024-09-11T23:36:32.845 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1652, 2024-09-11T23:36:32.846 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.062974084, 2024-09-11T23:36:32.846 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000643446 2024-09-11T23:36:32.846 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.846 INFO:teuthology.orchestra.run.smithi172.stdout: "op_inflight": 0, 2024-09-11T23:36:32.846 INFO:teuthology.orchestra.run.smithi172.stdout: "oplen_avg": { 2024-09-11T23:36:32.846 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1652, 2024-09-11T23:36:32.846 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1653 2024-09-11T23:36:32.846 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.846 INFO:teuthology.orchestra.run.smithi172.stdout: "op": 1652, 2024-09-11T23:36:32.846 INFO:teuthology.orchestra.run.smithi172.stdout: "op_r": 1652, 2024-09-11T23:36:32.846 INFO:teuthology.orchestra.run.smithi172.stdout: "op_w": 0, 2024-09-11T23:36:32.846 INFO:teuthology.orchestra.run.smithi172.stdout: "op_rmw": 0, 2024-09-11T23:36:32.846 INFO:teuthology.orchestra.run.smithi172.stdout: "op_pg": 0, 2024-09-11T23:36:32.847 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_stat": 1019, 2024-09-11T23:36:32.847 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_create": 0, 2024-09-11T23:36:32.847 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_read": 631, 2024-09-11T23:36:32.847 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_write": 0, 2024-09-11T23:36:32.847 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writefull": 0, 2024-09-11T23:36:32.847 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writesame": 0, 2024-09-11T23:36:32.847 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_append": 0, 2024-09-11T23:36:32.847 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_zero": 0, 2024-09-11T23:36:32.847 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_truncate": 0, 2024-09-11T23:36:32.847 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_delete": 0, 2024-09-11T23:36:32.847 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_mapext": 0, 2024-09-11T23:36:32.847 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_sparse_read": 0, 2024-09-11T23:36:32.847 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_clonerange": 0, 2024-09-11T23:36:32.848 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_getxattr": 1, 2024-09-11T23:36:32.848 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_setxattr": 0, 2024-09-11T23:36:32.848 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_cmpxattr": 0, 2024-09-11T23:36:32.848 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_rmxattr": 0, 2024-09-11T23:36:32.848 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_resetxattrs": 0, 2024-09-11T23:36:32.848 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_call": 0, 2024-09-11T23:36:32.848 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_watch": 0, 2024-09-11T23:36:32.848 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_notify": 0, 2024-09-11T23:36:32.848 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T23:36:32.848 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls": 0, 2024-09-11T23:36:32.848 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls_filter": 0, 2024-09-11T23:36:32.848 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_other": 0, 2024-09-11T23:36:32.848 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_active": 0, 2024-09-11T23:36:32.849 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_send": 0, 2024-09-11T23:36:32.849 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_resend": 0, 2024-09-11T23:36:32.849 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_ping": 0, 2024-09-11T23:36:32.849 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_active": 0, 2024-09-11T23:36:32.849 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_send": 0, 2024-09-11T23:36:32.849 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_resend": 0, 2024-09-11T23:36:32.849 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_active": 0, 2024-09-11T23:36:32.849 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_send": 0, 2024-09-11T23:36:32.849 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_resend": 0, 2024-09-11T23:36:32.849 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_active": 0, 2024-09-11T23:36:32.849 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_send": 0, 2024-09-11T23:36:32.849 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_resend": 0, 2024-09-11T23:36:32.849 INFO:teuthology.orchestra.run.smithi172.stdout: "command_active": 0, 2024-09-11T23:36:32.850 INFO:teuthology.orchestra.run.smithi172.stdout: "command_send": 0, 2024-09-11T23:36:32.850 INFO:teuthology.orchestra.run.smithi172.stdout: "command_resend": 0, 2024-09-11T23:36:32.850 INFO:teuthology.orchestra.run.smithi172.stdout: "map_epoch": 88, 2024-09-11T23:36:32.850 INFO:teuthology.orchestra.run.smithi172.stdout: "map_full": 0, 2024-09-11T23:36:32.850 INFO:teuthology.orchestra.run.smithi172.stdout: "map_inc": 2, 2024-09-11T23:36:32.850 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_sessions": 9, 2024-09-11T23:36:32.850 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_open": 9, 2024-09-11T23:36:32.850 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_close": 0, 2024-09-11T23:36:32.850 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_laggy": 0, 2024-09-11T23:36:32.850 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_wr": 0, 2024-09-11T23:36:32.850 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_rd": 2, 2024-09-11T23:36:32.850 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_del": 0 2024-09-11T23:36:32.850 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.850 INFO:teuthology.orchestra.run.smithi172.stdout: "oft": { 2024-09-11T23:36:32.851 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_objs": 0, 2024-09-11T23:36:32.851 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_kv_pairs": 0, 2024-09-11T23:36:32.851 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_updates": 0, 2024-09-11T23:36:32.851 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_removes": 0 2024-09-11T23:36:32.851 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.851 INFO:teuthology.orchestra.run.smithi172.stdout: "osd-slow-ops": { 2024-09-11T23:36:32.851 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_ops_count": 0 2024-09-11T23:36:32.851 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.851 INFO:teuthology.orchestra.run.smithi172.stdout: "purge_queue": { 2024-09-11T23:36:32.851 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops": 0, 2024-09-11T23:36:32.851 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops_high_water": 0, 2024-09-11T23:36:32.851 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing": 0, 2024-09-11T23:36:32.851 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_high_water": 0, 2024-09-11T23:36:32.852 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed_ops": 0, 2024-09-11T23:36:32.852 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed": 0, 2024-09-11T23:36:32.852 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_item_in_journal": 0 2024-09-11T23:36:32.852 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.852 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T23:36:32.852 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-11T23:36:32.852 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-09-11T23:36:32.852 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-11T23:36:32.852 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 1838, 2024-09-11T23:36:32.852 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 39987373, 2024-09-11T23:36:32.852 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-11T23:36:32.852 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 1838, 2024-09-11T23:36:32.852 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-11T23:36:32.852 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-11T23:36:32.853 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 1838, 2024-09-11T23:36:32.853 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 39987373, 2024-09-11T23:36:32.853 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-11T23:36:32.853 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:32.853 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:32.853 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:32.853 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-11T23:36:32.853 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.853 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_bytes": { 2024-09-11T23:36:32.853 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-11T23:36:32.853 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-09-11T23:36:32.853 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-11T23:36:32.853 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-11T23:36:32.854 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-11T23:36:32.854 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-11T23:36:32.854 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-11T23:36:32.854 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 1652, 2024-09-11T23:36:32.854 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 39181821, 2024-09-11T23:36:32.854 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 1652, 2024-09-11T23:36:32.854 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 39181821, 2024-09-11T23:36:32.854 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-11T23:36:32.854 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:32.854 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:32.854 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:32.854 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-11T23:36:32.854 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.854 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_ops": { 2024-09-11T23:36:32.855 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-11T23:36:32.855 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 1024, 2024-09-11T23:36:32.855 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-11T23:36:32.855 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-11T23:36:32.855 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-11T23:36:32.855 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-11T23:36:32.855 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-11T23:36:32.855 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 1652, 2024-09-11T23:36:32.855 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 1652, 2024-09-11T23:36:32.855 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 1652, 2024-09-11T23:36:32.855 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 1652, 2024-09-11T23:36:32.855 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-11T23:36:32.855 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:32.856 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:32.856 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:32.856 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-11T23:36:32.856 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.856 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle": { 2024-09-11T23:36:32.856 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-11T23:36:32.856 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-09-11T23:36:32.856 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-11T23:36:32.856 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-11T23:36:32.856 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-11T23:36:32.856 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-11T23:36:32.856 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-11T23:36:32.856 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-11T23:36:32.857 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-11T23:36:32.857 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 0, 2024-09-11T23:36:32.857 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 0, 2024-09-11T23:36:32.857 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-11T23:36:32.857 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:32.857 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:32.857 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:32.857 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-11T23:36:32.857 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:32.857 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle-0x55eb1c3aab40": { 2024-09-11T23:36:32.857 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-11T23:36:32.857 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-09-11T23:36:32.857 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-11T23:36:32.858 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-11T23:36:32.858 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-11T23:36:32.858 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-11T23:36:32.858 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-11T23:36:32.858 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-11T23:36:32.858 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-11T23:36:32.858 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 0, 2024-09-11T23:36:32.858 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 0, 2024-09-11T23:36:32.858 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-11T23:36:32.858 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:32.858 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:32.858 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:32.858 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-11T23:36:32.858 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-11T23:36:32.859 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-11T23:36:33.610 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-11T23:36:33.610 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-11T23:36:33.610 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=0 2024-09-11T23:36:33.611 DEBUG:tasks.check_counter:Getting stats from i 2024-09-11T23:36:33.611 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-11T23:36:33.859 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:36:33.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:33 smithi159 ceph-mon[34394]: pgmap v579: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.2 KiB/s wr, 7 op/s 2024-09-11T23:36:33.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:33 smithi172 ceph-mon[34855]: pgmap v579: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.2 KiB/s wr, 7 op/s 2024-09-11T23:36:33.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:33 smithi005 ceph-mon[31201]: pgmap v579: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.2 KiB/s wr, 7 op/s 2024-09-11T23:36:34.354 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-11T23:36:34.355 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T23:36:34.355 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 3408, 2024-09-11T23:36:34.355 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 3396, 2024-09-11T23:36:34.355 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 1706227, 2024-09-11T23:36:34.355 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 17094966, 2024-09-11T23:36:34.356 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 9, 2024-09-11T23:36:34.356 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 5, 2024-09-11T23:36:34.356 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.292078440, 2024-09-11T23:36:34.356 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.113237410, 2024-09-11T23:36:34.356 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.074528071, 2024-09-11T23:36:34.357 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.089001954, 2024-09-11T23:36:34.357 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:36:34.357 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 3393, 2024-09-11T23:36:34.357 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.307128965, 2024-09-11T23:36:34.357 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000090518 2024-09-11T23:36:34.358 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.358 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:36:34.358 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:34.359 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:34.359 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:34.359 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.359 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 526992, 2024-09-11T23:36:34.359 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 106688 2024-09-11T23:36:34.360 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.360 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T23:36:34.360 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 17572, 2024-09-11T23:36:34.361 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 16609, 2024-09-11T23:36:34.361 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 27148800, 2024-09-11T23:36:34.361 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 11441436, 2024-09-11T23:36:34.361 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 8, 2024-09-11T23:36:34.361 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 6, 2024-09-11T23:36:34.361 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.934545694, 2024-09-11T23:36:34.361 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.370688151, 2024-09-11T23:36:34.361 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.644354503, 2024-09-11T23:36:34.361 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.052596924, 2024-09-11T23:36:34.362 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:36:34.362 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 16610, 2024-09-11T23:36:34.362 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.567125859, 2024-09-11T23:36:34.362 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000034143 2024-09-11T23:36:34.362 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.362 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:36:34.362 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 30571, 2024-09-11T23:36:34.362 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.004641114, 2024-09-11T23:36:34.362 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000151 2024-09-11T23:36:34.362 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.362 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-11T23:36:34.362 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 289536 2024-09-11T23:36:34.362 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.363 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T23:36:34.363 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 25047, 2024-09-11T23:36:34.363 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 24814, 2024-09-11T23:36:34.363 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 8159746, 2024-09-11T23:36:34.363 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 29783248, 2024-09-11T23:36:34.363 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 12, 2024-09-11T23:36:34.363 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 7, 2024-09-11T23:36:34.363 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 1.374801466, 2024-09-11T23:36:34.363 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.568748896, 2024-09-11T23:36:34.363 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.844738841, 2024-09-11T23:36:34.364 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.127943451, 2024-09-11T23:36:34.364 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:36:34.364 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 24812, 2024-09-11T23:36:34.364 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.088531349, 2024-09-11T23:36:34.364 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000043871 2024-09-11T23:36:34.364 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.364 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:36:34.364 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 36673, 2024-09-11T23:36:34.364 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.005491539, 2024-09-11T23:36:34.364 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000149 2024-09-11T23:36:34.364 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.365 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T23:36:34.365 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T23:36:34.365 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.365 INFO:teuthology.orchestra.run.smithi172.stdout: "cct": { 2024-09-11T23:36:34.365 INFO:teuthology.orchestra.run.smithi172.stdout: "total_workers": 1, 2024-09-11T23:36:34.366 INFO:teuthology.orchestra.run.smithi172.stdout: "unhealthy_workers": 0 2024-09-11T23:36:34.366 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.366 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-MDSRank": { 2024-09-11T23:36:34.366 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-09-11T23:36:34.366 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-09-11T23:36:34.366 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2553, 2024-09-11T23:36:34.366 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 4.486559763, 2024-09-11T23:36:34.366 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.001757367 2024-09-11T23:36:34.366 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-11T23:36:34.366 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.366 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-PurgeQueue": { 2024-09-11T23:36:34.366 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-09-11T23:36:34.366 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-09-11T23:36:34.367 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 5927, 2024-09-11T23:36:34.367 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.766150203, 2024-09-11T23:36:34.367 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000129264 2024-09-11T23:36:34.367 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-11T23:36:34.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.367 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": { 2024-09-11T23:36:34.367 INFO:teuthology.orchestra.run.smithi172.stdout: "request": 8783, 2024-09-11T23:36:34.367 INFO:teuthology.orchestra.run.smithi172.stdout: "reply": 8036, 2024-09-11T23:36:34.367 INFO:teuthology.orchestra.run.smithi172.stdout: "reply_latency": { 2024-09-11T23:36:34.367 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 8036, 2024-09-11T23:36:34.367 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 13.730347828, 2024-09-11T23:36:34.367 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.001708604 2024-09-11T23:36:34.368 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.368 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_reply": 0, 2024-09-11T23:36:34.368 INFO:teuthology.orchestra.run.smithi172.stdout: "forward": 747, 2024-09-11T23:36:34.368 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_complete": 0, 2024-09-11T23:36:34.368 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_keys": 0, 2024-09-11T23:36:34.368 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_commit": 11, 2024-09-11T23:36:34.368 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_split": 0, 2024-09-11T23:36:34.368 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_merge": 0, 2024-09-11T23:36:34.368 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes": 376, 2024-09-11T23:36:34.368 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_top": 5, 2024-09-11T23:36:34.368 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_bottom": 355, 2024-09-11T23:36:34.368 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pin_tail": 16, 2024-09-11T23:36:34.368 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pinned": 321, 2024-09-11T23:36:34.369 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_expired": 12, 2024-09-11T23:36:34.369 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_with_caps": 4, 2024-09-11T23:36:34.369 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": 4, 2024-09-11T23:36:34.369 INFO:teuthology.orchestra.run.smithi172.stdout: "subtrees": 3, 2024-09-11T23:36:34.369 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse": 15845, 2024-09-11T23:36:34.369 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_hit": 11978, 2024-09-11T23:36:34.369 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_forward": 623, 2024-09-11T23:36:34.369 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_discover": 19, 2024-09-11T23:36:34.369 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_dir_fetch": 0, 2024-09-11T23:36:34.369 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_remote_ino": 0, 2024-09-11T23:36:34.369 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_lock": 0, 2024-09-11T23:36:34.369 INFO:teuthology.orchestra.run.smithi172.stdout: "load_cent": 8230, 2024-09-11T23:36:34.369 INFO:teuthology.orchestra.run.smithi172.stdout: "q": 0, 2024-09-11T23:36:34.370 INFO:teuthology.orchestra.run.smithi172.stdout: "exported": 1, 2024-09-11T23:36:34.370 INFO:teuthology.orchestra.run.smithi172.stdout: "exported_inodes": 1, 2024-09-11T23:36:34.370 INFO:teuthology.orchestra.run.smithi172.stdout: "imported": 116, 2024-09-11T23:36:34.370 INFO:teuthology.orchestra.run.smithi172.stdout: "imported_inodes": 3467, 2024-09-11T23:36:34.370 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_dir_fetch": 0, 2024-09-11T23:36:34.370 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_backtrace_fetch": 0, 2024-09-11T23:36:34.370 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_peer_discover": 0, 2024-09-11T23:36:34.370 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rfiles": 4, 2024-09-11T23:36:34.370 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rbytes": 234, 2024-09-11T23:36:34.370 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rsnaps": 0, 2024-09-11T23:36:34.370 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_fetch": 0, 2024-09-11T23:36:34.370 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_set_tag": 0, 2024-09-11T23:36:34.371 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T23:36:34.371 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_inotable_repaired": 0, 2024-09-11T23:36:34.371 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_inodes": 0, 2024-09-11T23:36:34.371 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_base_inodes": 0, 2024-09-11T23:36:34.371 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dirfrag_rstats": 0, 2024-09-11T23:36:34.371 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_file_inodes": 0, 2024-09-11T23:36:34.371 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_inode_file_caps": 14, 2024-09-11T23:36:34.371 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_revoke": 121, 2024-09-11T23:36:34.371 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_grant": 4012, 2024-09-11T23:36:34.371 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_trunc": 0, 2024-09-11T23:36:34.371 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T23:36:34.371 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T23:36:34.372 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps": 12305, 2024-09-11T23:36:34.372 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps_dirty": 1000, 2024-09-11T23:36:34.372 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_cap_release": 42, 2024-09-11T23:36:34.372 INFO:teuthology.orchestra.run.smithi172.stdout: "process_request_cap_release": 7383 2024-09-11T23:36:34.372 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.372 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_cache": { 2024-09-11T23:36:34.372 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update": 0, 2024-09-11T23:36:34.372 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update_receipt": 0, 2024-09-11T23:36:34.372 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_try_discover": 0, 2024-09-11T23:36:34.372 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_send_discover": 143, 2024-09-11T23:36:34.372 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_handle_discover": 2, 2024-09-11T23:36:34.373 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays": 6, 2024-09-11T23:36:34.373 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_delayed": 0, 2024-09-11T23:36:34.373 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_enqueuing": 0, 2024-09-11T23:36:34.373 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_created": 3437, 2024-09-11T23:36:34.373 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_enqueued": 3431, 2024-09-11T23:36:34.373 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_reintegrated": 0, 2024-09-11T23:36:34.373 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_migrated": 0, 2024-09-11T23:36:34.373 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_processing": 0, 2024-09-11T23:36:34.373 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_enqueued": 0, 2024-09-11T23:36:34.373 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_prioritized": 0, 2024-09-11T23:36:34.373 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_started": 0, 2024-09-11T23:36:34.374 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_completed": 0, 2024-09-11T23:36:34.374 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_path": 0, 2024-09-11T23:36:34.374 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_inode": 0, 2024-09-11T23:36:34.374 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_enqueue_scrub": 0, 2024-09-11T23:36:34.374 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_exportdir": 1, 2024-09-11T23:36:34.374 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_flush": 0, 2024-09-11T23:36:34.374 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragmentdir": 0, 2024-09-11T23:36:34.374 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragstats": 0, 2024-09-11T23:36:34.374 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_inodestats": 0 2024-09-11T23:36:34.374 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.374 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_log": { 2024-09-11T23:36:34.374 INFO:teuthology.orchestra.run.smithi172.stdout: "evlrg": 1, 2024-09-11T23:36:34.374 INFO:teuthology.orchestra.run.smithi172.stdout: "evadd": 43689, 2024-09-11T23:36:34.375 INFO:teuthology.orchestra.run.smithi172.stdout: "evex": 0, 2024-09-11T23:36:34.375 INFO:teuthology.orchestra.run.smithi172.stdout: "evtrm": 0, 2024-09-11T23:36:34.375 INFO:teuthology.orchestra.run.smithi172.stdout: "ev": 43689, 2024-09-11T23:36:34.375 INFO:teuthology.orchestra.run.smithi172.stdout: "evexg": 0, 2024-09-11T23:36:34.375 INFO:teuthology.orchestra.run.smithi172.stdout: "evexd": 0, 2024-09-11T23:36:34.375 INFO:teuthology.orchestra.run.smithi172.stdout: "segadd": 53, 2024-09-11T23:36:34.375 INFO:teuthology.orchestra.run.smithi172.stdout: "segex": 0, 2024-09-11T23:36:34.375 INFO:teuthology.orchestra.run.smithi172.stdout: "segtrm": 0, 2024-09-11T23:36:34.376 INFO:teuthology.orchestra.run.smithi172.stdout: "seg": 53, 2024-09-11T23:36:34.376 INFO:teuthology.orchestra.run.smithi172.stdout: "segmjr": 5, 2024-09-11T23:36:34.376 INFO:teuthology.orchestra.run.smithi172.stdout: "segexg": 0, 2024-09-11T23:36:34.376 INFO:teuthology.orchestra.run.smithi172.stdout: "segexd": 0, 2024-09-11T23:36:34.376 INFO:teuthology.orchestra.run.smithi172.stdout: "expos": 4194304, 2024-09-11T23:36:34.376 INFO:teuthology.orchestra.run.smithi172.stdout: "wrpos": 43376120, 2024-09-11T23:36:34.376 INFO:teuthology.orchestra.run.smithi172.stdout: "rdpos": 0, 2024-09-11T23:36:34.376 INFO:teuthology.orchestra.run.smithi172.stdout: "jlat": { 2024-09-11T23:36:34.377 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1335, 2024-09-11T23:36:34.377 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 11.689692542, 2024-09-11T23:36:34.377 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.008756324 2024-09-11T23:36:34.377 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.377 INFO:teuthology.orchestra.run.smithi172.stdout: "replayed": 0 2024-09-11T23:36:34.377 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.377 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_mem": { 2024-09-11T23:36:34.377 INFO:teuthology.orchestra.run.smithi172.stdout: "ino": 25, 2024-09-11T23:36:34.377 INFO:teuthology.orchestra.run.smithi172.stdout: "ino+": 3461, 2024-09-11T23:36:34.377 INFO:teuthology.orchestra.run.smithi172.stdout: "ino-": 3436, 2024-09-11T23:36:34.377 INFO:teuthology.orchestra.run.smithi172.stdout: "dir": 164, 2024-09-11T23:36:34.377 INFO:teuthology.orchestra.run.smithi172.stdout: "dir+": 225, 2024-09-11T23:36:34.377 INFO:teuthology.orchestra.run.smithi172.stdout: "dir-": 61, 2024-09-11T23:36:34.378 INFO:teuthology.orchestra.run.smithi172.stdout: "dn": 353, 2024-09-11T23:36:34.378 INFO:teuthology.orchestra.run.smithi172.stdout: "dn+": 6950, 2024-09-11T23:36:34.378 INFO:teuthology.orchestra.run.smithi172.stdout: "dn-": 6597, 2024-09-11T23:36:34.378 INFO:teuthology.orchestra.run.smithi172.stdout: "cap": 4, 2024-09-11T23:36:34.378 INFO:teuthology.orchestra.run.smithi172.stdout: "cap+": 3442, 2024-09-11T23:36:34.378 INFO:teuthology.orchestra.run.smithi172.stdout: "cap-": 3438, 2024-09-11T23:36:34.378 INFO:teuthology.orchestra.run.smithi172.stdout: "rss": 76564, 2024-09-11T23:36:34.378 INFO:teuthology.orchestra.run.smithi172.stdout: "heap": 223520 2024-09-11T23:36:34.378 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.378 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_server": { 2024-09-11T23:36:34.378 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_client_request": 12526, 2024-09-11T23:36:34.378 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_server_request": 1671, 2024-09-11T23:36:34.378 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_request": 8783, 2024-09-11T23:36:34.379 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_session": 7, 2024-09-11T23:36:34.379 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_peer_request": 4428, 2024-09-11T23:36:34.379 INFO:teuthology.orchestra.run.smithi172.stdout: "req_create_latency": { 2024-09-11T23:36:34.379 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 503, 2024-09-11T23:36:34.379 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.476543504, 2024-09-11T23:36:34.379 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.002935474 2024-09-11T23:36:34.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.379 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getattr_latency": { 2024-09-11T23:36:34.379 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 292, 2024-09-11T23:36:34.379 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.109161553, 2024-09-11T23:36:34.379 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000373840 2024-09-11T23:36:34.380 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.380 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getfilelock_latency": { 2024-09-11T23:36:34.380 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:34.380 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:34.380 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:34.380 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.380 INFO:teuthology.orchestra.run.smithi172.stdout: "req_link_latency": { 2024-09-11T23:36:34.380 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:34.380 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:34.380 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:34.380 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.380 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookup_latency": { 2024-09-11T23:36:34.380 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 3536, 2024-09-11T23:36:34.381 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.590544177, 2024-09-11T23:36:34.381 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000449814 2024-09-11T23:36:34.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.381 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookuphash_latency": { 2024-09-11T23:36:34.381 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:34.381 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:34.382 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:34.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.382 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupino_latency": { 2024-09-11T23:36:34.382 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:34.382 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:34.383 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:34.383 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.383 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupname_latency": { 2024-09-11T23:36:34.383 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:34.384 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:34.384 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:34.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.384 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupparent_latency": { 2024-09-11T23:36:34.384 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:34.384 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:34.385 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:34.385 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.385 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupsnap_latency": { 2024-09-11T23:36:34.386 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:34.386 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:34.386 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:34.386 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.386 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lssnap_latency": { 2024-09-11T23:36:34.387 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:34.387 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:34.387 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:34.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.388 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mkdir_latency": { 2024-09-11T23:36:34.388 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:34.388 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:34.388 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:34.389 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.389 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mknod_latency": { 2024-09-11T23:36:34.389 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:34.390 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:34.390 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:34.390 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.390 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mksnap_latency": { 2024-09-11T23:36:34.390 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:34.391 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:34.391 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:34.391 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.392 INFO:teuthology.orchestra.run.smithi172.stdout: "req_open_latency": { 2024-09-11T23:36:34.392 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:34.392 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:34.393 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:34.393 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.393 INFO:teuthology.orchestra.run.smithi172.stdout: "req_readdir_latency": { 2024-09-11T23:36:34.393 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 266, 2024-09-11T23:36:34.394 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.182571100, 2024-09-11T23:36:34.394 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000686357 2024-09-11T23:36:34.394 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.395 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rename_latency": { 2024-09-11T23:36:34.395 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2, 2024-09-11T23:36:34.395 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 4.161306050, 2024-09-11T23:36:34.396 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 2.080653025 2024-09-11T23:36:34.396 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.396 INFO:teuthology.orchestra.run.smithi172.stdout: "req_renamesnap_latency": { 2024-09-11T23:36:34.396 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:34.396 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:34.396 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:34.397 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.397 INFO:teuthology.orchestra.run.smithi172.stdout: "req_snapdiff_latency": { 2024-09-11T23:36:34.397 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:34.397 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:34.397 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:34.398 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.398 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmdir_latency": { 2024-09-11T23:36:34.398 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 47, 2024-09-11T23:36:34.398 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.498014748, 2024-09-11T23:36:34.398 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.010596058 2024-09-11T23:36:34.398 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.399 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmsnap_latency": { 2024-09-11T23:36:34.399 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:34.399 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:34.399 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:34.399 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.399 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmxattr_latency": { 2024-09-11T23:36:34.400 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:34.400 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:34.400 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:34.400 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.400 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setattr_latency": { 2024-09-11T23:36:34.401 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:34.401 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:34.401 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:34.401 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.401 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setdirlayout_latency": { 2024-09-11T23:36:34.401 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:34.402 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:34.402 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:34.402 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.402 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setfilelock_latency": { 2024-09-11T23:36:34.402 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:34.403 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:34.403 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:34.403 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.403 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setlayout_latency": { 2024-09-11T23:36:34.403 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:34.403 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:34.404 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:34.404 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.404 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setxattr_latency": { 2024-09-11T23:36:34.404 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:34.404 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:34.405 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:34.405 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.405 INFO:teuthology.orchestra.run.smithi172.stdout: "req_symlink_latency": { 2024-09-11T23:36:34.405 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:34.405 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:34.405 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:34.406 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.406 INFO:teuthology.orchestra.run.smithi172.stdout: "req_unlink_latency": { 2024-09-11T23:36:34.406 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 3390, 2024-09-11T23:36:34.406 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 5.712206696, 2024-09-11T23:36:34.406 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.001685016 2024-09-11T23:36:34.406 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.407 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_revoke_eviction": 0, 2024-09-11T23:36:34.407 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_acquisition_throttle": 0, 2024-09-11T23:36:34.407 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getvxattr_latency": { 2024-09-11T23:36:34.407 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:34.407 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:34.408 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:34.408 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-11T23:36:34.408 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.408 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_sessions": { 2024-09-11T23:36:34.408 INFO:teuthology.orchestra.run.smithi172.stdout: "session_count": 1, 2024-09-11T23:36:34.409 INFO:teuthology.orchestra.run.smithi172.stdout: "session_add": 1, 2024-09-11T23:36:34.409 INFO:teuthology.orchestra.run.smithi172.stdout: "session_remove": 0, 2024-09-11T23:36:34.409 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_open": 1, 2024-09-11T23:36:34.409 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_stale": 0, 2024-09-11T23:36:34.409 INFO:teuthology.orchestra.run.smithi172.stdout: "total_load": 5415, 2024-09-11T23:36:34.409 INFO:teuthology.orchestra.run.smithi172.stdout: "average_load": 5415, 2024-09-11T23:36:34.410 INFO:teuthology.orchestra.run.smithi172.stdout: "avg_session_uptime": 453, 2024-09-11T23:36:34.410 INFO:teuthology.orchestra.run.smithi172.stdout: "mdthresh_evicted": 0 2024-09-11T23:36:34.410 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.410 INFO:teuthology.orchestra.run.smithi172.stdout: "mempool": { 2024-09-11T23:36:34.410 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_bytes": 0, 2024-09-11T23:36:34.410 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_items": 0, 2024-09-11T23:36:34.411 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T23:36:34.411 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_items": 0, 2024-09-11T23:36:34.411 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T23:36:34.411 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_items": 0, 2024-09-11T23:36:34.411 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T23:36:34.411 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T23:36:34.412 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T23:36:34.412 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T23:36:34.412 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T23:36:34.412 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_items": 0, 2024-09-11T23:36:34.412 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T23:36:34.413 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T23:36:34.413 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_bytes": 0, 2024-09-11T23:36:34.413 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_items": 0, 2024-09-11T23:36:34.413 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_bytes": 0, 2024-09-11T23:36:34.413 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_items": 0, 2024-09-11T23:36:34.413 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T23:36:34.414 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T23:36:34.414 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T23:36:34.414 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T23:36:34.414 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T23:36:34.414 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_items": 0, 2024-09-11T23:36:34.415 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_bytes": 0, 2024-09-11T23:36:34.415 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_items": 0, 2024-09-11T23:36:34.415 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T23:36:34.415 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T23:36:34.415 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_bytes": 0, 2024-09-11T23:36:34.415 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_items": 0, 2024-09-11T23:36:34.416 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_bytes": 0, 2024-09-11T23:36:34.416 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_items": 0, 2024-09-11T23:36:34.416 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T23:36:34.416 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_items": 0, 2024-09-11T23:36:34.417 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T23:36:34.417 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_items": 0, 2024-09-11T23:36:34.417 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_bytes": 287725, 2024-09-11T23:36:34.417 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_items": 101, 2024-09-11T23:36:34.418 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_bytes": 0, 2024-09-11T23:36:34.418 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_items": 0, 2024-09-11T23:36:34.418 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_bytes": 0, 2024-09-11T23:36:34.418 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_items": 0, 2024-09-11T23:36:34.418 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_bytes": 0, 2024-09-11T23:36:34.419 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_items": 0, 2024-09-11T23:36:34.419 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_bytes": 0, 2024-09-11T23:36:34.419 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_items": 0, 2024-09-11T23:36:34.419 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_bytes": 8960, 2024-09-11T23:36:34.420 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_items": 169, 2024-09-11T23:36:34.420 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T23:36:34.420 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_items": 0, 2024-09-11T23:36:34.420 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_bytes": 0, 2024-09-11T23:36:34.420 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_items": 0, 2024-09-11T23:36:34.420 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_bytes": 578225, 2024-09-11T23:36:34.421 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_items": 4822, 2024-09-11T23:36:34.421 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_bytes": 0, 2024-09-11T23:36:34.421 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_items": 0, 2024-09-11T23:36:34.422 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_bytes": 0, 2024-09-11T23:36:34.422 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_items": 0 2024-09-11T23:36:34.422 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.422 INFO:teuthology.orchestra.run.smithi172.stdout: "objecter": { 2024-09-11T23:36:34.422 INFO:teuthology.orchestra.run.smithi172.stdout: "op_active": 0, 2024-09-11T23:36:34.423 INFO:teuthology.orchestra.run.smithi172.stdout: "op_laggy": 0, 2024-09-11T23:36:34.423 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send": 8563, 2024-09-11T23:36:34.423 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send_bytes": 39660147, 2024-09-11T23:36:34.423 INFO:teuthology.orchestra.run.smithi172.stdout: "op_resend": 28, 2024-09-11T23:36:34.424 INFO:teuthology.orchestra.run.smithi172.stdout: "op_reply": 8563, 2024-09-11T23:36:34.424 INFO:teuthology.orchestra.run.smithi172.stdout: "op_latency": { 2024-09-11T23:36:34.424 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 8563, 2024-09-11T23:36:34.424 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 49.037802707, 2024-09-11T23:36:34.424 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.005726708 2024-09-11T23:36:34.425 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.425 INFO:teuthology.orchestra.run.smithi172.stdout: "op_inflight": 0, 2024-09-11T23:36:34.425 INFO:teuthology.orchestra.run.smithi172.stdout: "oplen_avg": { 2024-09-11T23:36:34.425 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 8563, 2024-09-11T23:36:34.426 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 8709 2024-09-11T23:36:34.426 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.426 INFO:teuthology.orchestra.run.smithi172.stdout: "op": 8563, 2024-09-11T23:36:34.427 INFO:teuthology.orchestra.run.smithi172.stdout: "op_r": 100, 2024-09-11T23:36:34.427 INFO:teuthology.orchestra.run.smithi172.stdout: "op_w": 8463, 2024-09-11T23:36:34.427 INFO:teuthology.orchestra.run.smithi172.stdout: "op_rmw": 0, 2024-09-11T23:36:34.428 INFO:teuthology.orchestra.run.smithi172.stdout: "op_pg": 0, 2024-09-11T23:36:34.428 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_stat": 0, 2024-09-11T23:36:34.428 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_create": 10, 2024-09-11T23:36:34.428 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_read": 100, 2024-09-11T23:36:34.428 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_write": 1435, 2024-09-11T23:36:34.429 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writefull": 59, 2024-09-11T23:36:34.429 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writesame": 0, 2024-09-11T23:36:34.429 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_append": 0, 2024-09-11T23:36:34.429 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_zero": 0, 2024-09-11T23:36:34.429 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_truncate": 0, 2024-09-11T23:36:34.430 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_delete": 6861, 2024-09-11T23:36:34.430 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_mapext": 0, 2024-09-11T23:36:34.430 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_sparse_read": 0, 2024-09-11T23:36:34.430 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_clonerange": 0, 2024-09-11T23:36:34.430 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_getxattr": 0, 2024-09-11T23:36:34.431 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_setxattr": 20, 2024-09-11T23:36:34.431 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_cmpxattr": 0, 2024-09-11T23:36:34.431 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_rmxattr": 0, 2024-09-11T23:36:34.431 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_resetxattrs": 0, 2024-09-11T23:36:34.431 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_call": 0, 2024-09-11T23:36:34.431 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_watch": 0, 2024-09-11T23:36:34.432 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_notify": 0, 2024-09-11T23:36:34.432 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T23:36:34.432 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls": 0, 2024-09-11T23:36:34.433 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls_filter": 0, 2024-09-11T23:36:34.433 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_other": 0, 2024-09-11T23:36:34.433 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_active": 0, 2024-09-11T23:36:34.433 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_send": 0, 2024-09-11T23:36:34.434 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_resend": 0, 2024-09-11T23:36:34.434 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_ping": 0, 2024-09-11T23:36:34.434 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_active": 0, 2024-09-11T23:36:34.434 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_send": 0, 2024-09-11T23:36:34.434 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_resend": 0, 2024-09-11T23:36:34.434 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_active": 0, 2024-09-11T23:36:34.435 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_send": 0, 2024-09-11T23:36:34.435 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_resend": 0, 2024-09-11T23:36:34.435 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_active": 0, 2024-09-11T23:36:34.435 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_send": 0, 2024-09-11T23:36:34.435 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_resend": 0, 2024-09-11T23:36:34.435 INFO:teuthology.orchestra.run.smithi172.stdout: "command_active": 0, 2024-09-11T23:36:34.435 INFO:teuthology.orchestra.run.smithi172.stdout: "command_send": 0, 2024-09-11T23:36:34.436 INFO:teuthology.orchestra.run.smithi172.stdout: "command_resend": 0, 2024-09-11T23:36:34.436 INFO:teuthology.orchestra.run.smithi172.stdout: "map_epoch": 88, 2024-09-11T23:36:34.436 INFO:teuthology.orchestra.run.smithi172.stdout: "map_full": 0, 2024-09-11T23:36:34.436 INFO:teuthology.orchestra.run.smithi172.stdout: "map_inc": 2, 2024-09-11T23:36:34.436 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_sessions": 12, 2024-09-11T23:36:34.436 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_open": 12, 2024-09-11T23:36:34.437 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_close": 0, 2024-09-11T23:36:34.437 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_laggy": 0, 2024-09-11T23:36:34.437 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_wr": 159, 2024-09-11T23:36:34.437 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_rd": 0, 2024-09-11T23:36:34.437 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_del": 65 2024-09-11T23:36:34.438 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.438 INFO:teuthology.orchestra.run.smithi172.stdout: "oft": { 2024-09-11T23:36:34.438 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_objs": 1, 2024-09-11T23:36:34.438 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_kv_pairs": 0, 2024-09-11T23:36:34.438 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_updates": 0, 2024-09-11T23:36:34.438 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_removes": 0 2024-09-11T23:36:34.439 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.439 INFO:teuthology.orchestra.run.smithi172.stdout: "osd-slow-ops": { 2024-09-11T23:36:34.439 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_ops_count": 0 2024-09-11T23:36:34.439 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.439 INFO:teuthology.orchestra.run.smithi172.stdout: "purge_queue": { 2024-09-11T23:36:34.440 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops": 0, 2024-09-11T23:36:34.440 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops_high_water": 24, 2024-09-11T23:36:34.440 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing": 0, 2024-09-11T23:36:34.440 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_high_water": 10, 2024-09-11T23:36:34.440 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed_ops": 6840, 2024-09-11T23:36:34.440 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed": 3431, 2024-09-11T23:36:34.441 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_item_in_journal": 0 2024-09-11T23:36:34.441 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.441 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T23:36:34.441 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-11T23:36:34.441 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-09-11T23:36:34.441 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-11T23:36:34.441 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 46023, 2024-09-11T23:36:34.441 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 32859015, 2024-09-11T23:36:34.441 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-11T23:36:34.441 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 46023, 2024-09-11T23:36:34.441 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-11T23:36:34.442 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-11T23:36:34.442 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 46023, 2024-09-11T23:36:34.442 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 32859015, 2024-09-11T23:36:34.442 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-11T23:36:34.442 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:34.442 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:34.442 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:34.442 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-11T23:36:34.442 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.442 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_bytes": { 2024-09-11T23:36:34.442 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-11T23:36:34.442 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-09-11T23:36:34.442 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-11T23:36:34.442 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-11T23:36:34.443 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-11T23:36:34.443 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-11T23:36:34.443 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-11T23:36:34.443 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 8563, 2024-09-11T23:36:34.443 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 40033814, 2024-09-11T23:36:34.443 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 8563, 2024-09-11T23:36:34.443 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 40033814, 2024-09-11T23:36:34.443 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-11T23:36:34.443 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:34.443 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:34.443 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:34.443 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-11T23:36:34.443 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.444 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_ops": { 2024-09-11T23:36:34.444 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-11T23:36:34.444 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 1024, 2024-09-11T23:36:34.444 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-11T23:36:34.444 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-11T23:36:34.444 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-11T23:36:34.444 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-11T23:36:34.444 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-11T23:36:34.444 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 8563, 2024-09-11T23:36:34.444 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 8563, 2024-09-11T23:36:34.444 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 8563, 2024-09-11T23:36:34.444 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 8563, 2024-09-11T23:36:34.444 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-11T23:36:34.445 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:34.445 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:34.445 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:34.445 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-11T23:36:34.445 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.445 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle": { 2024-09-11T23:36:34.445 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-11T23:36:34.445 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-09-11T23:36:34.445 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-11T23:36:34.445 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 3431, 2024-09-11T23:36:34.445 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 373667, 2024-09-11T23:36:34.445 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-11T23:36:34.445 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 3431, 2024-09-11T23:36:34.446 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-11T23:36:34.446 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-11T23:36:34.446 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 100, 2024-09-11T23:36:34.446 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 373667, 2024-09-11T23:36:34.446 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-11T23:36:34.446 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:34.446 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:34.446 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:34.446 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-11T23:36:34.446 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:34.446 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle-0x55da587c0960": { 2024-09-11T23:36:34.446 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-11T23:36:34.446 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-09-11T23:36:34.446 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-11T23:36:34.447 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 43689, 2024-09-11T23:36:34.447 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 39181816, 2024-09-11T23:36:34.447 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-11T23:36:34.447 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 43689, 2024-09-11T23:36:34.447 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-11T23:36:34.447 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-11T23:36:34.447 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 1335, 2024-09-11T23:36:34.447 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 39181816, 2024-09-11T23:36:34.447 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-11T23:36:34.447 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:34.447 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:34.447 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:34.447 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-11T23:36:34.447 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-11T23:36:34.448 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-11T23:36:35.262 INFO:tasks.check_counter:Daemon mds.i mds.exported=1 2024-09-11T23:36:35.262 INFO:tasks.check_counter:Daemon mds.i mds.imported=116 2024-09-11T23:36:35.262 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=0 2024-09-11T23:36:35.262 DEBUG:tasks.check_counter:Getting stats from l 2024-09-11T23:36:35.262 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-11T23:36:35.509 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:36:35.793 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:35 smithi172 ceph-mon[34855]: pgmap v580: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-11T23:36:35.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:35 smithi159 ceph-mon[34394]: pgmap v580: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-11T23:36:35.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:35 smithi005 ceph-mon[31201]: pgmap v580: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-11T23:36:36.033 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-11T23:36:36.033 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T23:36:36.033 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 179, 2024-09-11T23:36:36.034 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 174, 2024-09-11T23:36:36.034 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 468480, 2024-09-11T23:36:36.034 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 105616, 2024-09-11T23:36:36.034 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 4, 2024-09-11T23:36:36.034 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 0, 2024-09-11T23:36:36.034 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.026972543, 2024-09-11T23:36:36.034 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.010677749, 2024-09-11T23:36:36.034 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.019047752, 2024-09-11T23:36:36.034 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T23:36:36.034 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:36:36.034 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 174, 2024-09-11T23:36:36.034 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.012839208, 2024-09-11T23:36:36.035 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000073788 2024-09-11T23:36:36.035 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:36.035 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:36:36.035 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:36.035 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:36.035 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:36.035 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:36.035 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 468480, 2024-09-11T23:36:36.035 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 105616 2024-09-11T23:36:36.035 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:36.035 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T23:36:36.035 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 1, 2024-09-11T23:36:36.035 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 130, 2024-09-11T23:36:36.036 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 160, 2024-09-11T23:36:36.036 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 101312, 2024-09-11T23:36:36.036 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 3, 2024-09-11T23:36:36.036 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 2, 2024-09-11T23:36:36.036 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.007456296, 2024-09-11T23:36:36.036 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.005286733, 2024-09-11T23:36:36.036 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.000825369, 2024-09-11T23:36:36.036 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T23:36:36.036 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:36:36.036 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 128, 2024-09-11T23:36:36.036 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.006710754, 2024-09-11T23:36:36.036 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000052427 2024-09-11T23:36:36.036 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:36.037 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:36:36.037 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:36.037 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:36.037 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:36.037 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:36.037 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-11T23:36:36.037 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 101312 2024-09-11T23:36:36.037 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:36.037 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T23:36:36.037 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 0, 2024-09-11T23:36:36.037 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 2, 2024-09-11T23:36:36.037 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 0, 2024-09-11T23:36:36.037 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 0, 2024-09-11T23:36:36.038 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 2, 2024-09-11T23:36:36.038 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 1, 2024-09-11T23:36:36.038 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.000327777, 2024-09-11T23:36:36.038 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.000000000, 2024-09-11T23:36:36.038 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.000258737, 2024-09-11T23:36:36.038 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T23:36:36.038 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T23:36:36.038 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:36.038 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:36.038 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:36.038 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:36.039 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-11T23:36:36.039 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:36.039 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:36.039 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:36.039 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:36.039 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T23:36:36.039 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T23:36:36.039 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:36.039 INFO:teuthology.orchestra.run.smithi172.stdout: "cct": { 2024-09-11T23:36:36.039 INFO:teuthology.orchestra.run.smithi172.stdout: "total_workers": 0, 2024-09-11T23:36:36.039 INFO:teuthology.orchestra.run.smithi172.stdout: "unhealthy_workers": 0 2024-09-11T23:36:36.039 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:36.040 INFO:teuthology.orchestra.run.smithi172.stdout: "mempool": { 2024-09-11T23:36:36.040 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_bytes": 0, 2024-09-11T23:36:36.040 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_items": 0, 2024-09-11T23:36:36.040 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T23:36:36.040 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_items": 0, 2024-09-11T23:36:36.040 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T23:36:36.040 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_items": 0, 2024-09-11T23:36:36.040 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T23:36:36.040 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T23:36:36.040 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T23:36:36.041 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T23:36:36.041 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T23:36:36.041 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_items": 0, 2024-09-11T23:36:36.041 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T23:36:36.041 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T23:36:36.041 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_bytes": 0, 2024-09-11T23:36:36.041 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_items": 0, 2024-09-11T23:36:36.041 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_bytes": 0, 2024-09-11T23:36:36.041 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_items": 0, 2024-09-11T23:36:36.041 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T23:36:36.041 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T23:36:36.042 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T23:36:36.042 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T23:36:36.042 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T23:36:36.042 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_items": 0, 2024-09-11T23:36:36.042 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_bytes": 0, 2024-09-11T23:36:36.042 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_items": 0, 2024-09-11T23:36:36.042 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T23:36:36.042 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T23:36:36.042 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_bytes": 0, 2024-09-11T23:36:36.042 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_items": 0, 2024-09-11T23:36:36.042 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_bytes": 0, 2024-09-11T23:36:36.043 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_items": 0, 2024-09-11T23:36:36.043 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T23:36:36.043 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_items": 0, 2024-09-11T23:36:36.043 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T23:36:36.043 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_items": 0, 2024-09-11T23:36:36.043 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_bytes": 148984, 2024-09-11T23:36:36.043 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_items": 30, 2024-09-11T23:36:36.043 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_bytes": 0, 2024-09-11T23:36:36.043 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_items": 0, 2024-09-11T23:36:36.043 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_bytes": 0, 2024-09-11T23:36:36.044 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_items": 0, 2024-09-11T23:36:36.044 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_bytes": 0, 2024-09-11T23:36:36.044 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_items": 0, 2024-09-11T23:36:36.044 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_bytes": 0, 2024-09-11T23:36:36.044 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_items": 0, 2024-09-11T23:36:36.044 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_bytes": 0, 2024-09-11T23:36:36.044 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_items": 0, 2024-09-11T23:36:36.044 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T23:36:36.044 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_items": 0, 2024-09-11T23:36:36.044 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_bytes": 0, 2024-09-11T23:36:36.045 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_items": 0, 2024-09-11T23:36:36.045 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_bytes": 928, 2024-09-11T23:36:36.045 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_items": 2, 2024-09-11T23:36:36.045 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_bytes": 0, 2024-09-11T23:36:36.045 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_items": 0, 2024-09-11T23:36:36.045 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_bytes": 0, 2024-09-11T23:36:36.045 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_items": 0 2024-09-11T23:36:36.045 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-11T23:36:36.045 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T23:36:36.045 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-11T23:36:36.045 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-09-11T23:36:36.045 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-11T23:36:36.045 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 176, 2024-09-11T23:36:36.046 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 440826, 2024-09-11T23:36:36.046 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-11T23:36:36.046 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 176, 2024-09-11T23:36:36.046 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-11T23:36:36.046 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-11T23:36:36.046 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 176, 2024-09-11T23:36:36.046 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 440826, 2024-09-11T23:36:36.046 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-11T23:36:36.046 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-11T23:36:36.046 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-11T23:36:36.046 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-11T23:36:36.046 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-11T23:36:36.046 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-11T23:36:36.047 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-11T23:36:36.949 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-09-11T23:36:36.949 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-09-11T23:36:36.949 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.l 2024-09-11T23:36:36.950 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-11T23:36:36.959 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-11T23:36:36.959 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-11T23:36:36.959 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:36:36.982 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-11T23:36:36.982 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:36:37.042 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-11T23:36:37.347 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:36:37.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:37 smithi005 ceph-mon[31201]: pgmap v581: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-11T23:36:37.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:37.832+0000 7f586da5e640 1 -- 172.21.15.5:0/1974894119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58681027a0 msgr2=0x7f58681067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:37.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:37.832+0000 7f586da5e640 1 --2- 172.21.15.5:0/1974894119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58681027a0 0x7f58681067f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5850009900 tx=0x7f585002a410 comp rx=0 tx=0).stop 2024-09-11T23:36:37.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:37.832+0000 7f586da5e640 1 -- 172.21.15.5:0/1974894119 shutdown_connections 2024-09-11T23:36:37.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:37.832+0000 7f586da5e640 1 --2- 172.21.15.5:0/1974894119 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5868106f20 0x7f586810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:37.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:37.832+0000 7f586da5e640 1 --2- 172.21.15.5:0/1974894119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58681027a0 0x7f58681067f0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:37.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:37.832+0000 7f586da5e640 1 --2- 172.21.15.5:0/1974894119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5868101df0 0x7f58681021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:37.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:37.832+0000 7f586da5e640 1 -- 172.21.15.5:0/1974894119 >> 172.21.15.5:0/1974894119 conn(0x7f58680fd8b0 msgr2=0x7f58680ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:36:37.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:37.833+0000 7f586da5e640 1 -- 172.21.15.5:0/1974894119 shutdown_connections 2024-09-11T23:36:37.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:37.833+0000 7f586da5e640 1 -- 172.21.15.5:0/1974894119 wait complete. 2024-09-11T23:36:37.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:37.833+0000 7f586da5e640 1 Processor -- start 2024-09-11T23:36:37.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:37.833+0000 7f586da5e640 1 -- start start 2024-09-11T23:36:37.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:37.833+0000 7f586da5e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5868101df0 0x7f5868198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:37.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:37.833+0000 7f586da5e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58681027a0 0x7f58681988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:37.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:37.833+0000 7f586da5e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5868106f20 0x7f586819cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:37.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:37.833+0000 7f586da5e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5868111e30 con 0x7f5868101df0 2024-09-11T23:36:37.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:37.833+0000 7f586da5e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5868111cb0 con 0x7f5868106f20 2024-09-11T23:36:37.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:37.833+0000 7f586da5e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5868111fb0 con 0x7f58681027a0 2024-09-11T23:36:37.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:37.834+0000 7f5866ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5868101df0 0x7f5868198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:37.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:37.834+0000 7f5866ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5868101df0 0x7f5868198390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58674/0 (socket says 172.21.15.5:58674) 2024-09-11T23:36:37.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:37.834+0000 7f5866ffd640 1 -- 172.21.15.5:0/3766667982 learned_addr learned my addr 172.21.15.5:0/3766667982 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:36:37.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:37.834+0000 7f585e7fc640 1 --2- 172.21.15.5:0/3766667982 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58681027a0 0x7f58681988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:37.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:37.834+0000 7f5866ffd640 1 -- 172.21.15.5:0/3766667982 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58681027a0 msgr2=0x7f58681988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:37.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:37.834+0000 7f58677fe640 1 --2- 172.21.15.5:0/3766667982 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5868106f20 0x7f586819cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:37.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:37.834+0000 7f5866ffd640 1 --2- 172.21.15.5:0/3766667982 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58681027a0 0x7f58681988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:37.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:37.834+0000 7f5866ffd640 1 -- 172.21.15.5:0/3766667982 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5868106f20 msgr2=0x7f586819cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:37.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:37.834+0000 7f5866ffd640 1 --2- 172.21.15.5:0/3766667982 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5868106f20 0x7f586819cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:37.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:37.834+0000 7f5866ffd640 1 -- 172.21.15.5:0/3766667982 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f586819d340 con 0x7f5868101df0 2024-09-11T23:36:37.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:37.834+0000 7f5866ffd640 1 --2- 172.21.15.5:0/3766667982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5868101df0 0x7f5868198390 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f585800c890 tx=0x7f585800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:36:37.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:37.834+0000 7f586ca5c640 1 -- 172.21.15.5:0/3766667982 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5858004220 con 0x7f5868101df0 2024-09-11T23:36:37.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:37.834+0000 7f586ca5c640 1 -- 172.21.15.5:0/3766667982 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f58580043c0 con 0x7f5868101df0 2024-09-11T23:36:37.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:37.834+0000 7f586da5e640 1 -- 172.21.15.5:0/3766667982 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f586819d630 con 0x7f5868101df0 2024-09-11T23:36:37.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:37.834+0000 7f586ca5c640 1 -- 172.21.15.5:0/3766667982 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5858004a00 con 0x7f5868101df0 2024-09-11T23:36:37.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:37.834+0000 7f586da5e640 1 -- 172.21.15.5:0/3766667982 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58681a4f10 con 0x7f5868101df0 2024-09-11T23:36:37.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:37.836+0000 7f586da5e640 1 -- 172.21.15.5:0/3766667982 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58681021d0 con 0x7f5868101df0 2024-09-11T23:36:37.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:37.837+0000 7f586ca5c640 1 -- 172.21.15.5:0/3766667982 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f5858004ba0 con 0x7f5868101df0 2024-09-11T23:36:37.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:37.838+0000 7f586ca5c640 1 --2- 172.21.15.5:0/3766667982 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f58540a2c00 0x7f58540a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:37.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:37.838+0000 7f585e7fc640 1 --2- 172.21.15.5:0/3766667982 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f58540a2c00 0x7f58540a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:37.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:37.838+0000 7f586ca5c640 1 -- 172.21.15.5:0/3766667982 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7f58580cf040 con 0x7f5868101df0 2024-09-11T23:36:37.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:37.838+0000 7f585e7fc640 1 --2- 172.21.15.5:0/3766667982 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f58540a2c00 0x7f58540a50c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5850031440 tx=0x7f5850005b50 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:36:37.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:37.842+0000 7f586ca5c640 1 -- 172.21.15.5:0/3766667982 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5858014030 con 0x7f5868101df0 2024-09-11T23:36:37.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:37 smithi159 ceph-mon[34394]: pgmap v581: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-11T23:36:37.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:37 smithi172 ceph-mon[34855]: pgmap v581: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-11T23:36:38.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:38.029+0000 7f586da5e640 1 -- 172.21.15.5:0/3766667982 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f586802d7c0 con 0x7f5868101df0 2024-09-11T23:36:38.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:38.030+0000 7f586ca5c640 1 -- 172.21.15.5:0/3766667982 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v88) ==== 81+0+582 (secure 0 0 0) 0x7f585809bbe0 con 0x7f5868101df0 2024-09-11T23:36:38.030 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/2713701762 2024-09-12T23:19:50.031855+0000 2024-09-11T23:36:38.030 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/3135835713 2024-09-12T23:19:50.031855+0000 2024-09-11T23:36:38.030 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/3935034940 2024-09-12T23:19:50.031855+0000 2024-09-11T23:36:38.030 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6801/1790126649 2024-09-12T23:19:50.031855+0000 2024-09-11T23:36:38.030 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6801/1358356358 2024-09-12T23:19:26.149011+0000 2024-09-11T23:36:38.031 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6800/1790126649 2024-09-12T23:19:50.031855+0000 2024-09-11T23:36:38.031 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6800/1358356358 2024-09-12T23:19:26.149011+0000 2024-09-11T23:36:38.031 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/2243688290 2024-09-12T23:19:26.149011+0000 2024-09-11T23:36:38.031 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/1493331899 2024-09-12T23:19:26.149011+0000 2024-09-11T23:36:38.031 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/2329812802 2024-09-12T23:19:26.149011+0000 2024-09-11T23:36:38.031 INFO:teuthology.orchestra.run.smithi005.stderr:listed 10 entries 2024-09-11T23:36:38.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:38.032+0000 7f586da5e640 1 -- 172.21.15.5:0/3766667982 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f58540a2c00 msgr2=0x7f58540a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:38.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:38.032+0000 7f586da5e640 1 --2- 172.21.15.5:0/3766667982 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f58540a2c00 0x7f58540a50c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5850031440 tx=0x7f5850005b50 comp rx=0 tx=0).stop 2024-09-11T23:36:38.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:38.032+0000 7f586da5e640 1 -- 172.21.15.5:0/3766667982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5868101df0 msgr2=0x7f5868198390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:38.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:38.032+0000 7f586da5e640 1 --2- 172.21.15.5:0/3766667982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5868101df0 0x7f5868198390 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f585800c890 tx=0x7f585800cd50 comp rx=0 tx=0).stop 2024-09-11T23:36:38.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:38.032+0000 7f586da5e640 1 -- 172.21.15.5:0/3766667982 shutdown_connections 2024-09-11T23:36:38.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:38.032+0000 7f586da5e640 1 --2- 172.21.15.5:0/3766667982 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f58540a2c00 0x7f58540a50c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:38.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:38.032+0000 7f586da5e640 1 --2- 172.21.15.5:0/3766667982 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5868106f20 0x7f586819cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:38.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:38.032+0000 7f586da5e640 1 --2- 172.21.15.5:0/3766667982 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58681027a0 0x7f58681988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:38.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:38.032+0000 7f586da5e640 1 --2- 172.21.15.5:0/3766667982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5868101df0 0x7f5868198390 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:38.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:38.032+0000 7f586da5e640 1 -- 172.21.15.5:0/3766667982 >> 172.21.15.5:0/3766667982 conn(0x7f58680fd8b0 msgr2=0x7f58680fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:36:38.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:38.032+0000 7f586da5e640 1 -- 172.21.15.5:0/3766667982 shutdown_connections 2024-09-11T23:36:38.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:38.032+0000 7f586da5e640 1 -- 172.21.15.5:0/3766667982 wait complete. 2024-09-11T23:36:38.837 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:38 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/3766667982' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-11T23:36:38.864 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-11T23:36:38.864 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:36:38.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:38 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/3766667982' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-11T23:36:38.882 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-11T23:36:38.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:38 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/3766667982' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-11T23:36:39.178 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:36:39.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.641+0000 7f57085a1640 1 -- 172.21.15.5:0/2241990599 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5700102ef0 msgr2=0x7f570010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:39.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.641+0000 7f57085a1640 1 --2- 172.21.15.5:0/2241990599 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5700102ef0 0x7f570010da40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f56f8009ca0 tx=0x7f56f802a950 comp rx=0 tx=0).stop 2024-09-11T23:36:39.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.641+0000 7f57085a1640 1 -- 172.21.15.5:0/2241990599 shutdown_connections 2024-09-11T23:36:39.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.641+0000 7f57085a1640 1 --2- 172.21.15.5:0/2241990599 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5700102ef0 0x7f570010da40 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:39.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.641+0000 7f57085a1640 1 --2- 172.21.15.5:0/2241990599 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5700102570 0x7f57001029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:39.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.641+0000 7f57085a1640 1 --2- 172.21.15.5:0/2241990599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5700100e20 0x7f5700101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:39.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.641+0000 7f57085a1640 1 -- 172.21.15.5:0/2241990599 >> 172.21.15.5:0/2241990599 conn(0x7f57000fc7d0 msgr2=0x7f57000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:36:39.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.641+0000 7f57085a1640 1 -- 172.21.15.5:0/2241990599 shutdown_connections 2024-09-11T23:36:39.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.641+0000 7f57085a1640 1 -- 172.21.15.5:0/2241990599 wait complete. 2024-09-11T23:36:39.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.642+0000 7f57085a1640 1 Processor -- start 2024-09-11T23:36:39.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.642+0000 7f57085a1640 1 -- start start 2024-09-11T23:36:39.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.642+0000 7f57085a1640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5700100e20 0x7f57001970b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:39.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.642+0000 7f57085a1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5700102570 0x7f57001975f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:39.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.642+0000 7f57085a1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5700102ef0 0x7f5700197b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:39.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.642+0000 7f57085a1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5700110e30 con 0x7f5700102570 2024-09-11T23:36:39.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.642+0000 7f57085a1640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5700110cb0 con 0x7f5700100e20 2024-09-11T23:36:39.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.642+0000 7f57085a1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5700110fb0 con 0x7f5700102ef0 2024-09-11T23:36:39.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.642+0000 7f5705b3c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5700102570 0x7f57001975f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:39.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.642+0000 7f5705b3c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5700102570 0x7f57001975f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58680/0 (socket says 172.21.15.5:58680) 2024-09-11T23:36:39.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.642+0000 7f5705b3c640 1 -- 172.21.15.5:0/772186412 learned_addr learned my addr 172.21.15.5:0/772186412 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:36:39.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.642+0000 7f570633d640 1 --2- 172.21.15.5:0/772186412 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5700100e20 0x7f57001970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:39.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.642+0000 7f5706b3e640 1 --2- 172.21.15.5:0/772186412 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5700102ef0 0x7f5700197b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:39.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.642+0000 7f5705b3c640 1 -- 172.21.15.5:0/772186412 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5700102ef0 msgr2=0x7f5700197b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:39.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.642+0000 7f5705b3c640 1 --2- 172.21.15.5:0/772186412 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5700102ef0 0x7f5700197b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:39.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.642+0000 7f5705b3c640 1 -- 172.21.15.5:0/772186412 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5700100e20 msgr2=0x7f57001970b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:39.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.642+0000 7f5705b3c640 1 --2- 172.21.15.5:0/772186412 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5700100e20 0x7f57001970b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:39.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.642+0000 7f5705b3c640 1 -- 172.21.15.5:0/772186412 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57001a6920 con 0x7f5700102570 2024-09-11T23:36:39.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.642+0000 7f5706b3e640 1 --2- 172.21.15.5:0/772186412 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5700102ef0 0x7f5700197b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:36:39.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.643+0000 7f5705b3c640 1 --2- 172.21.15.5:0/772186412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5700102570 0x7f57001975f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f56f000d950 tx=0x7f56f000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:36:39.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.643+0000 7f56f77fe640 1 -- 172.21.15.5:0/772186412 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f0017070 con 0x7f5700102570 2024-09-11T23:36:39.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.643+0000 7f56f77fe640 1 -- 172.21.15.5:0/772186412 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f56f0009c30 con 0x7f5700102570 2024-09-11T23:36:39.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.643+0000 7f57085a1640 1 -- 172.21.15.5:0/772186412 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57001a6c10 con 0x7f5700102570 2024-09-11T23:36:39.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.643+0000 7f56f77fe640 1 -- 172.21.15.5:0/772186412 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f000f620 con 0x7f5700102570 2024-09-11T23:36:39.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.643+0000 7f57085a1640 1 -- 172.21.15.5:0/772186412 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57001a71a0 con 0x7f5700102570 2024-09-11T23:36:39.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.644+0000 7f57085a1640 1 -- 172.21.15.5:0/772186412 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5700101200 con 0x7f5700102570 2024-09-11T23:36:39.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.645+0000 7f56f77fe640 1 -- 172.21.15.5:0/772186412 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f56f00109a0 con 0x7f5700102570 2024-09-11T23:36:39.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.646+0000 7f56f77fe640 1 --2- 172.21.15.5:0/772186412 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f56ec0a2c00 0x7f56ec0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:39.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.646+0000 7f570633d640 1 --2- 172.21.15.5:0/772186412 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f56ec0a2c00 0x7f56ec0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:39.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.646+0000 7f56f77fe640 1 -- 172.21.15.5:0/772186412 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7f56f00cef30 con 0x7f5700102570 2024-09-11T23:36:39.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.646+0000 7f570633d640 1 --2- 172.21.15.5:0/772186412 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f56ec0a2c00 0x7f56ec0a50c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f56fc0058c0 tx=0x7f56fc00a250 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:36:39.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.650+0000 7f56f77fe640 1 -- 172.21.15.5:0/772186412 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f56f0009de0 con 0x7f5700102570 2024-09-11T23:36:39.808 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:39 smithi172 ceph-mon[34855]: pgmap v582: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-11T23:36:39.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.840+0000 7f57085a1640 1 -- 172.21.15.5:0/772186412 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f570002d7c0 con 0x7f5700102570 2024-09-11T23:36:39.841 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:39 smithi005 ceph-mon[31201]: pgmap v582: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-11T23:36:39.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.841+0000 7f56f77fe640 1 -- 172.21.15.5:0/772186412 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v88) ==== 81+0+582 (secure 0 0 0) 0x7f56f009bad0 con 0x7f5700102570 2024-09-11T23:36:39.842 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/2713701762 2024-09-12T23:19:50.031855+0000 2024-09-11T23:36:39.842 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/3135835713 2024-09-12T23:19:50.031855+0000 2024-09-11T23:36:39.842 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/3935034940 2024-09-12T23:19:50.031855+0000 2024-09-11T23:36:39.842 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6801/1790126649 2024-09-12T23:19:50.031855+0000 2024-09-11T23:36:39.842 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6801/1358356358 2024-09-12T23:19:26.149011+0000 2024-09-11T23:36:39.842 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6800/1790126649 2024-09-12T23:19:50.031855+0000 2024-09-11T23:36:39.842 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6800/1358356358 2024-09-12T23:19:26.149011+0000 2024-09-11T23:36:39.842 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/2243688290 2024-09-12T23:19:26.149011+0000 2024-09-11T23:36:39.843 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/1493331899 2024-09-12T23:19:26.149011+0000 2024-09-11T23:36:39.843 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/2329812802 2024-09-12T23:19:26.149011+0000 2024-09-11T23:36:39.843 INFO:teuthology.orchestra.run.smithi005.stderr:listed 10 entries 2024-09-11T23:36:39.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.843+0000 7f57085a1640 1 -- 172.21.15.5:0/772186412 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f56ec0a2c00 msgr2=0x7f56ec0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:39.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.843+0000 7f57085a1640 1 --2- 172.21.15.5:0/772186412 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f56ec0a2c00 0x7f56ec0a50c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f56fc0058c0 tx=0x7f56fc00a250 comp rx=0 tx=0).stop 2024-09-11T23:36:39.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.843+0000 7f57085a1640 1 -- 172.21.15.5:0/772186412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5700102570 msgr2=0x7f57001975f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:39.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.843+0000 7f57085a1640 1 --2- 172.21.15.5:0/772186412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5700102570 0x7f57001975f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f56f000d950 tx=0x7f56f000de10 comp rx=0 tx=0).stop 2024-09-11T23:36:39.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.843+0000 7f57085a1640 1 -- 172.21.15.5:0/772186412 shutdown_connections 2024-09-11T23:36:39.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.843+0000 7f57085a1640 1 --2- 172.21.15.5:0/772186412 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f56ec0a2c00 0x7f56ec0a50c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:39.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.843+0000 7f57085a1640 1 --2- 172.21.15.5:0/772186412 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5700102ef0 0x7f5700197b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:39.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.843+0000 7f57085a1640 1 --2- 172.21.15.5:0/772186412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5700102570 0x7f57001975f0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:39.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.843+0000 7f57085a1640 1 --2- 172.21.15.5:0/772186412 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5700100e20 0x7f57001970b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:39.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.843+0000 7f57085a1640 1 -- 172.21.15.5:0/772186412 >> 172.21.15.5:0/772186412 conn(0x7f57000fc7d0 msgr2=0x7f57000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:36:39.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.843+0000 7f57085a1640 1 -- 172.21.15.5:0/772186412 shutdown_connections 2024-09-11T23:36:39.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:39.843+0000 7f57085a1640 1 -- 172.21.15.5:0/772186412 wait complete. 2024-09-11T23:36:39.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:39 smithi159 ceph-mon[34394]: pgmap v582: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-11T23:36:40.601 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi005.front.sepia.ceph.com... 2024-09-11T23:36:40.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:36:40.602 DEBUG:teuthology.orchestra.run.smithi005:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-11T23:36:40.629 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi005.stderr:ceph-fuse[85170]: fuse finished with error 0 and tester_r 0 2024-09-11T23:36:40.632 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:36:40.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:40 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/772186412' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-11T23:36:40.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:40 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/772186412' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-11T23:36:40.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:40 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/772186412' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-11T23:36:41.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:41 smithi159 ceph-mon[34394]: pgmap v583: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T23:36:41.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:41 smithi172 ceph-mon[34855]: pgmap v583: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T23:36:41.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:41 smithi005 ceph-mon[31201]: pgmap v583: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T23:36:43.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:43 smithi159 ceph-mon[34394]: pgmap v584: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-11T23:36:43.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:43 smithi172 ceph-mon[34855]: pgmap v584: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-11T23:36:43.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:43 smithi005 ceph-mon[31201]: pgmap v584: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-11T23:36:45.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:45 smithi159 ceph-mon[34394]: pgmap v585: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-11T23:36:45.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:45 smithi172 ceph-mon[34855]: pgmap v585: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-11T23:36:45.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:45 smithi005 ceph-mon[31201]: pgmap v585: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-11T23:36:46.734 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-09-11T23:36:46.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:36:46.734 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T23:36:46.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:36:46.756 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-09-11T23:36:46.817 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T23:36:46.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:36:46.817 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:36:46.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:36:46.890 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2024-09-11T23:36:46.986 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-11T23:36:46.999 INFO:tasks.cephadm:Teardown begin 2024-09-11T23:36:46.999 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T23:36:46.999 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:36:47.261 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:36:47.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.742+0000 7f303b948640 1 -- 172.21.15.5:0/3287212583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3034100b30 msgr2=0x7f3034100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:47.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.742+0000 7f303b948640 1 --2- 172.21.15.5:0/3287212583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3034100b30 0x7f3034100f10 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3030009900 tx=0x7f303002a470 comp rx=0 tx=0).stop 2024-09-11T23:36:47.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.742+0000 7f303b948640 1 -- 172.21.15.5:0/3287212583 shutdown_connections 2024-09-11T23:36:47.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.742+0000 7f303b948640 1 --2- 172.21.15.5:0/3287212583 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3034105f40 0x7f30341063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:47.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.742+0000 7f303b948640 1 --2- 172.21.15.5:0/3287212583 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3034101450 0x7f3034105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:47.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.742+0000 7f303b948640 1 --2- 172.21.15.5:0/3287212583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3034100b30 0x7f3034100f10 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:47.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.742+0000 7f303b948640 1 -- 172.21.15.5:0/3287212583 >> 172.21.15.5:0/3287212583 conn(0x7f30340fc7a0 msgr2=0x7f30340febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:36:47.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.742+0000 7f303b948640 1 -- 172.21.15.5:0/3287212583 shutdown_connections 2024-09-11T23:36:47.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.742+0000 7f303b948640 1 -- 172.21.15.5:0/3287212583 wait complete. 2024-09-11T23:36:47.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.742+0000 7f303b948640 1 Processor -- start 2024-09-11T23:36:47.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.742+0000 7f303b948640 1 -- start start 2024-09-11T23:36:47.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.743+0000 7f303b948640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3034100b30 0x7f30341a4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:47.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.743+0000 7f303b948640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3034101450 0x7f30341a4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:47.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.743+0000 7f303b948640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3034105f40 0x7f303419e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:47.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.743+0000 7f303b948640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3034118470 con 0x7f3034105f40 2024-09-11T23:36:47.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.743+0000 7f303b948640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f30341182f0 con 0x7f3034101450 2024-09-11T23:36:47.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.743+0000 7f303b948640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f30341185f0 con 0x7f3034100b30 2024-09-11T23:36:47.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.743+0000 7f3039ee5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3034105f40 0x7f303419e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:47.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.743+0000 7f3039ee5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3034105f40 0x7f303419e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58776/0 (socket says 172.21.15.5:58776) 2024-09-11T23:36:47.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.743+0000 7f3039ee5640 1 -- 172.21.15.5:0/1314356956 learned_addr learned my addr 172.21.15.5:0/1314356956 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:36:47.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.743+0000 7f3038ee3640 1 --2- 172.21.15.5:0/1314356956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3034101450 0x7f30341a4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:47.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.743+0000 7f30396e4640 1 --2- 172.21.15.5:0/1314356956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3034100b30 0x7f30341a4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:47.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.743+0000 7f3039ee5640 1 -- 172.21.15.5:0/1314356956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3034100b30 msgr2=0x7f30341a4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:47.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.743+0000 7f3039ee5640 1 --2- 172.21.15.5:0/1314356956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3034100b30 0x7f30341a4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:47.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.743+0000 7f3039ee5640 1 -- 172.21.15.5:0/1314356956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3034101450 msgr2=0x7f30341a4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:47.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.743+0000 7f3039ee5640 1 --2- 172.21.15.5:0/1314356956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3034101450 0x7f30341a4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:47.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.743+0000 7f3039ee5640 1 -- 172.21.15.5:0/1314356956 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f303419f090 con 0x7f3034105f40 2024-09-11T23:36:47.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.743+0000 7f3038ee3640 1 --2- 172.21.15.5:0/1314356956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3034101450 0x7f30341a4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:36:47.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.743+0000 7f3039ee5640 1 --2- 172.21.15.5:0/1314356956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3034105f40 0x7f303419e860 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f302c00eaa0 tx=0x7f302c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:36:47.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.743+0000 7f302a7fc640 1 -- 172.21.15.5:0/1314356956 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f302c00cdb0 con 0x7f3034105f40 2024-09-11T23:36:47.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.743+0000 7f303b948640 1 -- 172.21.15.5:0/1314356956 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f303419f380 con 0x7f3034105f40 2024-09-11T23:36:47.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.743+0000 7f302a7fc640 1 -- 172.21.15.5:0/1314356956 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f302c005020 con 0x7f3034105f40 2024-09-11T23:36:47.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.743+0000 7f302a7fc640 1 -- 172.21.15.5:0/1314356956 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f302c0116d0 con 0x7f3034105f40 2024-09-11T23:36:47.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.744+0000 7f303b948640 1 -- 172.21.15.5:0/1314356956 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30341ab6f0 con 0x7f3034105f40 2024-09-11T23:36:47.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.745+0000 7f303b948640 1 -- 172.21.15.5:0/1314356956 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3034105920 con 0x7f3034105f40 2024-09-11T23:36:47.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.747+0000 7f302a7fc640 1 -- 172.21.15.5:0/1314356956 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f302c0051d0 con 0x7f3034105f40 2024-09-11T23:36:47.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.747+0000 7f302a7fc640 1 --2- 172.21.15.5:0/1314356956 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f30200a2b80 0x7f30200a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:47.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.747+0000 7f30396e4640 1 --2- 172.21.15.5:0/1314356956 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f30200a2b80 0x7f30200a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:47.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.747+0000 7f302a7fc640 1 -- 172.21.15.5:0/1314356956 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7f302c0cf9a0 con 0x7f3034105f40 2024-09-11T23:36:47.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.748+0000 7f30396e4640 1 --2- 172.21.15.5:0/1314356956 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f30200a2b80 0x7f30200a5040 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3030000c00 tx=0x7f3030031400 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:36:47.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.751+0000 7f302a7fc640 1 -- 172.21.15.5:0/1314356956 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f302c016030 con 0x7f3034105f40 2024-09-11T23:36:47.881 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:47 smithi159 ceph-mon[34394]: pgmap v586: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-11T23:36:47.885 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:47 smithi172 ceph-mon[34855]: pgmap v586: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-11T23:36:47.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.964+0000 7f303b948640 1 -- 172.21.15.5:0/1314356956 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f303419fd70 con 0x7f3034105f40 2024-09-11T23:36:47.965 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:47 smithi005 ceph-mon[31201]: pgmap v586: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-11T23:36:47.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.964+0000 7f302a7fc640 1 -- 172.21.15.5:0/1314356956 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11922 (secure 0 0 0) 0x7f303419fd70 con 0x7f3034105f40 2024-09-11T23:36:47.966 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:36:47.966 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":31,"btime":"2024-09-11T23:36:16:511804+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3865435482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3865435482},{"type":"v1","addr":"172.21.15.5:6835","nonce":3865435482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1323314897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":1323314897},{"type":"v1","addr":"172.21.15.5:6837","nonce":1323314897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14610,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6839/4140073288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":4140073288},{"type":"v1","addr":"172.21.15.5:6839","nonce":4140073288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6841/1162578713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":1162578713},{"type":"v1","addr":"172.21.15.5:6841","nonce":1162578713}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3113658116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3113658116},{"type":"v1","addr":"172.21.15.172:6833","nonce":3113658116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3887336060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3887336060},{"type":"v1","addr":"172.21.15.159:6833","nonce":3887336060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:26:45.305894+0000","modified":"2024-09-11T23:36:15.751467+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24475,"mds_2":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24440":{"gid":24440,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.159:6835/2539263301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2539263301},{"type":"v1","addr":"172.21.15.159:6835","nonce":2539263301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/4240913699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":4240913699},{"type":"v1","addr":"172.21.15.172:6835","nonce":4240913699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/4200951601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":4200951601},{"type":"v1","addr":"172.21.15.172:6837","nonce":4200951601}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":16,"addr":"172.21.15.159:6837/4020181017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":4020181017},{"type":"v1","addr":"172.21.15.159:6837","nonce":4020181017}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.172:6839/3928313314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3928313314},{"type":"v1","addr":"172.21.15.172:6839","nonce":3928313314}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.159:6839/3843336290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3843336290},{"type":"v1","addr":"172.21.15.159:6839","nonce":3843336290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24494,24475,24461]},"id":1}]} 2024-09-11T23:36:47.966 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 31 2024-09-11T23:36:47.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.967+0000 7f303b948640 1 -- 172.21.15.5:0/1314356956 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f30200a2b80 msgr2=0x7f30200a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:47.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.967+0000 7f303b948640 1 --2- 172.21.15.5:0/1314356956 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f30200a2b80 0x7f30200a5040 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3030000c00 tx=0x7f3030031400 comp rx=0 tx=0).stop 2024-09-11T23:36:47.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.967+0000 7f303b948640 1 -- 172.21.15.5:0/1314356956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3034105f40 msgr2=0x7f303419e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:47.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.967+0000 7f303b948640 1 --2- 172.21.15.5:0/1314356956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3034105f40 0x7f303419e860 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f302c00eaa0 tx=0x7f302c00ef60 comp rx=0 tx=0).stop 2024-09-11T23:36:47.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.967+0000 7f303b948640 1 -- 172.21.15.5:0/1314356956 shutdown_connections 2024-09-11T23:36:47.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.967+0000 7f303b948640 1 --2- 172.21.15.5:0/1314356956 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f30200a2b80 0x7f30200a5040 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:47.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.967+0000 7f303b948640 1 --2- 172.21.15.5:0/1314356956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3034105f40 0x7f303419e860 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:47.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.967+0000 7f303b948640 1 --2- 172.21.15.5:0/1314356956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3034101450 0x7f30341a4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:47.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.967+0000 7f303b948640 1 --2- 172.21.15.5:0/1314356956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3034100b30 0x7f30341a4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:47.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.967+0000 7f303b948640 1 -- 172.21.15.5:0/1314356956 >> 172.21.15.5:0/1314356956 conn(0x7f30340fc7a0 msgr2=0x7f303410f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:36:47.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.967+0000 7f303b948640 1 -- 172.21.15.5:0/1314356956 shutdown_connections 2024-09-11T23:36:47.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:47.967+0000 7f303b948640 1 -- 172.21.15.5:0/1314356956 wait complete. 2024-09-11T23:36:48.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:48 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/1314356956' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:36:48.766 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:36:48.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:48 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/1314356956' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:36:48.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:48 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/1314356956' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:36:49.035 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:36:49.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.503+0000 7f2b7a093640 1 -- 172.21.15.5:0/637112836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b74102570 msgr2=0x7f2b741029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:49.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.503+0000 7f2b7a093640 1 --2- 172.21.15.5:0/637112836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b74102570 0x7f2b741029b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c009900 tx=0x7f2b5c02a480 comp rx=0 tx=0).stop 2024-09-11T23:36:49.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.503+0000 7f2b7a093640 1 -- 172.21.15.5:0/637112836 shutdown_connections 2024-09-11T23:36:49.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.503+0000 7f2b7a093640 1 --2- 172.21.15.5:0/637112836 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b74102ef0 0x7f2b7410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:49.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.503+0000 7f2b7a093640 1 --2- 172.21.15.5:0/637112836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b74102570 0x7f2b741029b0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:49.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.503+0000 7f2b7a093640 1 --2- 172.21.15.5:0/637112836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b74100e20 0x7f2b74101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:49.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.503+0000 7f2b7a093640 1 -- 172.21.15.5:0/637112836 >> 172.21.15.5:0/637112836 conn(0x7f2b740fc7d0 msgr2=0x7f2b740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:36:49.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.503+0000 7f2b7a093640 1 -- 172.21.15.5:0/637112836 shutdown_connections 2024-09-11T23:36:49.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.503+0000 7f2b7a093640 1 -- 172.21.15.5:0/637112836 wait complete. 2024-09-11T23:36:49.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.504+0000 7f2b7a093640 1 Processor -- start 2024-09-11T23:36:49.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.504+0000 7f2b7a093640 1 -- start start 2024-09-11T23:36:49.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.504+0000 7f2b7a093640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b74100e20 0x7f2b740fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:49.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.504+0000 7f2b7a093640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b74102570 0x7f2b740fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:49.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.504+0000 7f2b7a093640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b74102ef0 0x7f2b740fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:49.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.504+0000 7f2b7a093640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2b74110e30 con 0x7f2b74102570 2024-09-11T23:36:49.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.504+0000 7f2b7a093640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f2b74110cb0 con 0x7f2b74100e20 2024-09-11T23:36:49.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.504+0000 7f2b7a093640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2b74110fb0 con 0x7f2b74102ef0 2024-09-11T23:36:49.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.504+0000 7f2b72ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b74102570 0x7f2b740fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:49.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.504+0000 7f2b72ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b74102570 0x7f2b740fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58806/0 (socket says 172.21.15.5:58806) 2024-09-11T23:36:49.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.504+0000 7f2b72ffd640 1 -- 172.21.15.5:0/2500354173 learned_addr learned my addr 172.21.15.5:0/2500354173 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:36:49.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.504+0000 7f2b737fe640 1 --2- 172.21.15.5:0/2500354173 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b74100e20 0x7f2b740fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:49.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.505+0000 7f2b73fff640 1 --2- 172.21.15.5:0/2500354173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b74102ef0 0x7f2b740fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:49.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.505+0000 7f2b72ffd640 1 -- 172.21.15.5:0/2500354173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b74102ef0 msgr2=0x7f2b740fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:49.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.505+0000 7f2b72ffd640 1 --2- 172.21.15.5:0/2500354173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b74102ef0 0x7f2b740fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:49.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.505+0000 7f2b72ffd640 1 -- 172.21.15.5:0/2500354173 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b74100e20 msgr2=0x7f2b740fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:49.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.505+0000 7f2b72ffd640 1 --2- 172.21.15.5:0/2500354173 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b74100e20 0x7f2b740fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:49.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.505+0000 7f2b72ffd640 1 -- 172.21.15.5:0/2500354173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b741a6870 con 0x7f2b74102570 2024-09-11T23:36:49.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.505+0000 7f2b72ffd640 1 --2- 172.21.15.5:0/2500354173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b74102570 0x7f2b740fd1c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c006010 tx=0x7f2b5c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:36:49.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.505+0000 7f2b70ff9640 1 -- 172.21.15.5:0/2500354173 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b5c03f030 con 0x7f2b74102570 2024-09-11T23:36:49.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.505+0000 7f2b7a093640 1 -- 172.21.15.5:0/2500354173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b741a6b00 con 0x7f2b74102570 2024-09-11T23:36:49.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.505+0000 7f2b70ff9640 1 -- 172.21.15.5:0/2500354173 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2b5c003aa0 con 0x7f2b74102570 2024-09-11T23:36:49.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.505+0000 7f2b70ff9640 1 -- 172.21.15.5:0/2500354173 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b5c035070 con 0x7f2b74102570 2024-09-11T23:36:49.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.505+0000 7f2b7a093640 1 -- 172.21.15.5:0/2500354173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b741a6fe0 con 0x7f2b74102570 2024-09-11T23:36:49.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.507+0000 7f2b7a093640 1 -- 172.21.15.5:0/2500354173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b74101200 con 0x7f2b74102570 2024-09-11T23:36:49.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.507+0000 7f2b70ff9640 1 -- 172.21.15.5:0/2500354173 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f2b5c042030 con 0x7f2b74102570 2024-09-11T23:36:49.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.508+0000 7f2b70ff9640 1 --2- 172.21.15.5:0/2500354173 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f2b600a2b80 0x7f2b600a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:49.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.508+0000 7f2b70ff9640 1 -- 172.21.15.5:0/2500354173 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7f2b5c0efa50 con 0x7f2b74102570 2024-09-11T23:36:49.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.508+0000 7f2b737fe640 1 --2- 172.21.15.5:0/2500354173 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f2b600a2b80 0x7f2b600a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:49.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.509+0000 7f2b737fe640 1 --2- 172.21.15.5:0/2500354173 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f2b600a2b80 0x7f2b600a5040 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2b64009bd0 tx=0x7f2b64005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:36:49.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.512+0000 7f2b70ff9640 1 -- 172.21.15.5:0/2500354173 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2b5c0bc590 con 0x7f2b74102570 2024-09-11T23:36:49.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:49 smithi005 ceph-mon[31201]: pgmap v587: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-11T23:36:49.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.730+0000 7f2b7a093640 1 -- 172.21.15.5:0/2500354173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2b7410a0a0 con 0x7f2b74102570 2024-09-11T23:36:49.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.730+0000 7f2b70ff9640 1 -- 172.21.15.5:0/2500354173 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11922 (secure 0 0 0) 0x7f2b5c0bbe90 con 0x7f2b74102570 2024-09-11T23:36:49.731 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:36:49.731 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":31,"btime":"2024-09-11T23:36:16:511804+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3865435482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3865435482},{"type":"v1","addr":"172.21.15.5:6835","nonce":3865435482}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/1323314897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":1323314897},{"type":"v1","addr":"172.21.15.5:6837","nonce":1323314897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14610,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6839/4140073288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":4140073288},{"type":"v1","addr":"172.21.15.5:6839","nonce":4140073288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6841/1162578713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":1162578713},{"type":"v1","addr":"172.21.15.5:6841","nonce":1162578713}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3113658116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3113658116},{"type":"v1","addr":"172.21.15.172:6833","nonce":3113658116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3887336060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3887336060},{"type":"v1","addr":"172.21.15.159:6833","nonce":3887336060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:26:45.305894+0000","modified":"2024-09-11T23:36:15.751467+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24494,"mds_1":24475,"mds_2":24461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24440":{"gid":24440,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.159:6835/2539263301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2539263301},{"type":"v1","addr":"172.21.15.159:6835","nonce":2539263301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/4240913699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":4240913699},{"type":"v1","addr":"172.21.15.172:6835","nonce":4240913699}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/4200951601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":4200951601},{"type":"v1","addr":"172.21.15.172:6837","nonce":4200951601}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":16,"addr":"172.21.15.159:6837/4020181017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":4020181017},{"type":"v1","addr":"172.21.15.159:6837","nonce":4020181017}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":15,"addr":"172.21.15.172:6839/3928313314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3928313314},{"type":"v1","addr":"172.21.15.172:6839","nonce":3928313314}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.159:6839/3843336290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":3843336290},{"type":"v1","addr":"172.21.15.159:6839","nonce":3843336290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24494,24475,24461]},"id":1}]} 2024-09-11T23:36:49.732 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 31 2024-09-11T23:36:49.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.733+0000 7f2b7a093640 1 -- 172.21.15.5:0/2500354173 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f2b600a2b80 msgr2=0x7f2b600a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:49.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.733+0000 7f2b7a093640 1 --2- 172.21.15.5:0/2500354173 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f2b600a2b80 0x7f2b600a5040 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2b64009bd0 tx=0x7f2b64005f90 comp rx=0 tx=0).stop 2024-09-11T23:36:49.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.733+0000 7f2b7a093640 1 -- 172.21.15.5:0/2500354173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b74102570 msgr2=0x7f2b740fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:49.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.733+0000 7f2b7a093640 1 --2- 172.21.15.5:0/2500354173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b74102570 0x7f2b740fd1c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c006010 tx=0x7f2b5c004270 comp rx=0 tx=0).stop 2024-09-11T23:36:49.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.733+0000 7f2b7a093640 1 -- 172.21.15.5:0/2500354173 shutdown_connections 2024-09-11T23:36:49.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.733+0000 7f2b7a093640 1 --2- 172.21.15.5:0/2500354173 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f2b600a2b80 0x7f2b600a5040 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:49.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.733+0000 7f2b7a093640 1 --2- 172.21.15.5:0/2500354173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b74102ef0 0x7f2b740fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:49.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.733+0000 7f2b7a093640 1 --2- 172.21.15.5:0/2500354173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b74102570 0x7f2b740fd1c0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:49.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.733+0000 7f2b7a093640 1 --2- 172.21.15.5:0/2500354173 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b74100e20 0x7f2b740fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:49.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.733+0000 7f2b7a093640 1 -- 172.21.15.5:0/2500354173 >> 172.21.15.5:0/2500354173 conn(0x7f2b740fc7d0 msgr2=0x7f2b7406a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:36:49.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.733+0000 7f2b7a093640 1 -- 172.21.15.5:0/2500354173 shutdown_connections 2024-09-11T23:36:49.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:49.733+0000 7f2b7a093640 1 -- 172.21.15.5:0/2500354173 wait complete. 2024-09-11T23:36:49.838 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:49 smithi172 ceph-mon[34855]: pgmap v587: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-11T23:36:49.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:49 smithi159 ceph-mon[34394]: pgmap v587: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-11T23:36:50.658 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T23:36:50.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:50 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/2500354173' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:36:50.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:50 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/2500354173' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:36:50.921 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:36:50.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:50 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/2500354173' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:36:51.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.496+0000 7f9c5abdc640 1 -- 172.21.15.5:0/679355404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c54100a80 msgr2=0x7f9c54100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:51.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.496+0000 7f9c5abdc640 1 --2- 172.21.15.5:0/679355404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c54100a80 0x7f9c54100ee0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9c44009930 tx=0x7f9c4402a420 comp rx=0 tx=0).stop 2024-09-11T23:36:51.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.496+0000 7f9c5abdc640 1 -- 172.21.15.5:0/679355404 shutdown_connections 2024-09-11T23:36:51.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.496+0000 7f9c5abdc640 1 --2- 172.21.15.5:0/679355404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c54101420 0x7f9c5410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:51.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.496+0000 7f9c5abdc640 1 --2- 172.21.15.5:0/679355404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c54100a80 0x7f9c54100ee0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:51.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.496+0000 7f9c5abdc640 1 --2- 172.21.15.5:0/679355404 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c54106a80 0x7f9c54106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:51.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.496+0000 7f9c5abdc640 1 -- 172.21.15.5:0/679355404 >> 172.21.15.5:0/679355404 conn(0x7f9c540fc7a0 msgr2=0x7f9c540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:36:51.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.496+0000 7f9c5abdc640 1 -- 172.21.15.5:0/679355404 shutdown_connections 2024-09-11T23:36:51.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.496+0000 7f9c5abdc640 1 -- 172.21.15.5:0/679355404 wait complete. 2024-09-11T23:36:51.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.497+0000 7f9c5abdc640 1 Processor -- start 2024-09-11T23:36:51.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.497+0000 7f9c5abdc640 1 -- start start 2024-09-11T23:36:51.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.497+0000 7f9c5abdc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c54100a80 0x7f9c54199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:51.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.497+0000 7f9c5abdc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c54101420 0x7f9c541998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:51.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.497+0000 7f9c5abdc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c54106a80 0x7f9c541a43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:51.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.497+0000 7f9c5abdc640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9c54110dd0 con 0x7f9c54100a80 2024-09-11T23:36:51.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.497+0000 7f9c5abdc640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9c54110c50 con 0x7f9c54106a80 2024-09-11T23:36:51.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.497+0000 7f9c5abdc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9c54110f50 con 0x7f9c54101420 2024-09-11T23:36:51.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.497+0000 7f9c58978640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c54100a80 0x7f9c54199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:51.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.497+0000 7f9c58978640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c54100a80 0x7f9c54199360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58838/0 (socket says 172.21.15.5:58838) 2024-09-11T23:36:51.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.497+0000 7f9c58978640 1 -- 172.21.15.5:0/2986559271 learned_addr learned my addr 172.21.15.5:0/2986559271 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:36:51.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.497+0000 7f9c4bfff640 1 --2- 172.21.15.5:0/2986559271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c54101420 0x7f9c541998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:51.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.497+0000 7f9c59179640 1 --2- 172.21.15.5:0/2986559271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c54106a80 0x7f9c541a43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:51.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.498+0000 7f9c58978640 1 -- 172.21.15.5:0/2986559271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c54101420 msgr2=0x7f9c541998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:51.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.498+0000 7f9c58978640 1 --2- 172.21.15.5:0/2986559271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c54101420 0x7f9c541998a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:51.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.498+0000 7f9c58978640 1 -- 172.21.15.5:0/2986559271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c54106a80 msgr2=0x7f9c541a43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:51.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.498+0000 7f9c58978640 1 --2- 172.21.15.5:0/2986559271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c54106a80 0x7f9c541a43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:51.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.498+0000 7f9c58978640 1 -- 172.21.15.5:0/2986559271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c541a4920 con 0x7f9c54100a80 2024-09-11T23:36:51.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.498+0000 7f9c59179640 1 --2- 172.21.15.5:0/2986559271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c54106a80 0x7f9c541a43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:36:51.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.498+0000 7f9c4bfff640 1 --2- 172.21.15.5:0/2986559271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c54101420 0x7f9c541998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:36:51.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.498+0000 7f9c58978640 1 --2- 172.21.15.5:0/2986559271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c54100a80 0x7f9c54199360 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f9c5000b4a0 tx=0x7f9c5000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:36:51.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.498+0000 7f9c49ffb640 1 -- 172.21.15.5:0/2986559271 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c50014070 con 0x7f9c54100a80 2024-09-11T23:36:51.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.498+0000 7f9c5abdc640 1 -- 172.21.15.5:0/2986559271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c541a4af0 con 0x7f9c54100a80 2024-09-11T23:36:51.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.498+0000 7f9c49ffb640 1 -- 172.21.15.5:0/2986559271 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9c50010ac0 con 0x7f9c54100a80 2024-09-11T23:36:51.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.498+0000 7f9c49ffb640 1 -- 172.21.15.5:0/2986559271 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c50017c30 con 0x7f9c54100a80 2024-09-11T23:36:51.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.498+0000 7f9c5abdc640 1 -- 172.21.15.5:0/2986559271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c541a5030 con 0x7f9c54100a80 2024-09-11T23:36:51.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.499+0000 7f9c5abdc640 1 -- 172.21.15.5:0/2986559271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c54100f60 con 0x7f9c54100a80 2024-09-11T23:36:51.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.500+0000 7f9c49ffb640 1 -- 172.21.15.5:0/2986559271 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f9c50017070 con 0x7f9c54100a80 2024-09-11T23:36:51.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.501+0000 7f9c49ffb640 1 --2- 172.21.15.5:0/2986559271 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f9c3c0a2c00 0x7f9c3c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:51.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.501+0000 7f9c49ffb640 1 -- 172.21.15.5:0/2986559271 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7f9c500ceb40 con 0x7f9c54100a80 2024-09-11T23:36:51.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.501+0000 7f9c4bfff640 1 --2- 172.21.15.5:0/2986559271 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f9c3c0a2c00 0x7f9c3c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:51.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.502+0000 7f9c4bfff640 1 --2- 172.21.15.5:0/2986559271 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f9c3c0a2c00 0x7f9c3c0a50c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9c44000c00 tx=0x7f9c44031400 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:36:51.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.506+0000 7f9c49ffb640 1 -- 172.21.15.5:0/2986559271 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9c5009b680 con 0x7f9c54100a80 2024-09-11T23:36:51.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.684+0000 7f9c5abdc640 1 -- 172.21.15.5:0/2986559271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9c54108a80 con 0x7f9c54100a80 2024-09-11T23:36:51.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:51 smithi005 ceph-mon[31201]: pgmap v588: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-11T23:36:51.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.685+0000 7f9c49ffb640 1 -- 172.21.15.5:0/2986559271 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24843 (secure 0 0 0) 0x7f9c5009af80 con 0x7f9c54100a80 2024-09-11T23:36:51.685 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-11T23:36:51.685 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":88,"fsid":"1f5284d2-7094-11ef-bcea-c7b262605968","created":"2024-09-11T23:19:00.051813+0000","modified":"2024-09-11T23:27:52.098396+0000","last_up_change":"2024-09-11T23:25:53.433445+0000","last_in_change":"2024-09-11T23:25:29.443287+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:22:04.534014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:26:41.220887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:26:43.664094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T23:26:50.471521+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bf95ced0-780b-482f-87da-0b5e61de62ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6803","nonce":624761084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6805","nonce":624761084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6809","nonce":624761084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":624761084},{"type":"v1","addr":"172.21.15.5:6807","nonce":624761084}]},"public_addr":"172.21.15.5:6803/624761084","cluster_addr":"172.21.15.5:6805/624761084","heartbeat_back_addr":"172.21.15.5:6809/624761084","heartbeat_front_addr":"172.21.15.5:6807/624761084","state":["exists","up"]},{"osd":1,"uuid":"d926484f-78a6-497b-843d-f2db54ade4a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6801","nonce":2111290186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6803","nonce":2111290186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6807","nonce":2111290186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2111290186},{"type":"v1","addr":"172.21.15.159:6805","nonce":2111290186}]},"public_addr":"172.21.15.159:6801/2111290186","cluster_addr":"172.21.15.159:6803/2111290186","heartbeat_back_addr":"172.21.15.159:6807/2111290186","heartbeat_front_addr":"172.21.15.159:6805/2111290186","state":["exists","up"]},{"osd":2,"uuid":"d92cd431-0ba7-4171-82b8-60fa3d63a64b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6801","nonce":299915717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6803","nonce":299915717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6807","nonce":299915717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":299915717},{"type":"v1","addr":"172.21.15.172:6805","nonce":299915717}]},"public_addr":"172.21.15.172:6801/299915717","cluster_addr":"172.21.15.172:6803/299915717","heartbeat_back_addr":"172.21.15.172:6807/299915717","heartbeat_front_addr":"172.21.15.172:6805/299915717","state":["exists","up"]},{"osd":3,"uuid":"0521043b-559c-4671-b11e-9117871cff49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6811","nonce":2080498921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6813","nonce":2080498921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6817","nonce":2080498921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2080498921},{"type":"v1","addr":"172.21.15.5:6815","nonce":2080498921}]},"public_addr":"172.21.15.5:6811/2080498921","cluster_addr":"172.21.15.5:6813/2080498921","heartbeat_back_addr":"172.21.15.5:6817/2080498921","heartbeat_front_addr":"172.21.15.5:6815/2080498921","state":["exists","up"]},{"osd":4,"uuid":"b968d762-a46e-4ae2-b19d-8225f82de613","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6809","nonce":4185908786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6811","nonce":4185908786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6815","nonce":4185908786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":4185908786},{"type":"v1","addr":"172.21.15.159:6813","nonce":4185908786}]},"public_addr":"172.21.15.159:6809/4185908786","cluster_addr":"172.21.15.159:6811/4185908786","heartbeat_back_addr":"172.21.15.159:6815/4185908786","heartbeat_front_addr":"172.21.15.159:6813/4185908786","state":["exists","up"]},{"osd":5,"uuid":"1b0a518a-3d17-4635-81da-52f9ef83a574","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6809","nonce":3742759000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6811","nonce":3742759000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6815","nonce":3742759000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3742759000},{"type":"v1","addr":"172.21.15.172:6813","nonce":3742759000}]},"public_addr":"172.21.15.172:6809/3742759000","cluster_addr":"172.21.15.172:6811/3742759000","heartbeat_back_addr":"172.21.15.172:6815/3742759000","heartbeat_front_addr":"172.21.15.172:6813/3742759000","state":["exists","up"]},{"osd":6,"uuid":"c3a2db6c-9189-4e42-aa1e-52189a9c4291","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6819","nonce":4156823423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6821","nonce":4156823423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6825","nonce":4156823423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":4156823423},{"type":"v1","addr":"172.21.15.5:6823","nonce":4156823423}]},"public_addr":"172.21.15.5:6819/4156823423","cluster_addr":"172.21.15.5:6821/4156823423","heartbeat_back_addr":"172.21.15.5:6825/4156823423","heartbeat_front_addr":"172.21.15.5:6823/4156823423","state":["exists","up"]},{"osd":7,"uuid":"dfaadf28-74ab-4cda-8647-dcb58beb7cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6817","nonce":4222571927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6819","nonce":4222571927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6823","nonce":4222571927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":4222571927},{"type":"v1","addr":"172.21.15.159:6821","nonce":4222571927}]},"public_addr":"172.21.15.159:6817/4222571927","cluster_addr":"172.21.15.159:6819/4222571927","heartbeat_back_addr":"172.21.15.159:6823/4222571927","heartbeat_front_addr":"172.21.15.159:6821/4222571927","state":["exists","up"]},{"osd":8,"uuid":"47f66651-614c-4613-9793-69c140dbf705","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6817","nonce":3661505951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6819","nonce":3661505951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6823","nonce":3661505951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":3661505951},{"type":"v1","addr":"172.21.15.172:6821","nonce":3661505951}]},"public_addr":"172.21.15.172:6817/3661505951","cluster_addr":"172.21.15.172:6819/3661505951","heartbeat_back_addr":"172.21.15.172:6823/3661505951","heartbeat_front_addr":"172.21.15.172:6821/3661505951","state":["exists","up"]},{"osd":9,"uuid":"c97b8221-8cf9-4fab-9e27-ff7f3bd98152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6827","nonce":72036667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6829","nonce":72036667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6833","nonce":72036667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":72036667},{"type":"v1","addr":"172.21.15.5:6831","nonce":72036667}]},"public_addr":"172.21.15.5:6827/72036667","cluster_addr":"172.21.15.5:6829/72036667","heartbeat_back_addr":"172.21.15.5:6833/72036667","heartbeat_front_addr":"172.21.15.5:6831/72036667","state":["exists","up"]},{"osd":10,"uuid":"143376c1-f3f1-4df4-bcd3-a9b46fad8c1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6825","nonce":3334483164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6827","nonce":3334483164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6831","nonce":3334483164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":3334483164},{"type":"v1","addr":"172.21.15.159:6829","nonce":3334483164}]},"public_addr":"172.21.15.159:6825/3334483164","cluster_addr":"172.21.15.159:6827/3334483164","heartbeat_back_addr":"172.21.15.159:6831/3334483164","heartbeat_front_addr":"172.21.15.159:6829/3334483164","state":["exists","up"]},{"osd":11,"uuid":"5cc91ff9-fc0f-4e7a-8e4d-87df0e7efbeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6825","nonce":1965415663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6827","nonce":1965415663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6831","nonce":1965415663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1965415663},{"type":"v1","addr":"172.21.15.172:6829","nonce":1965415663}]},"public_addr":"172.21.15.172:6825/1965415663","cluster_addr":"172.21.15.172:6827/1965415663","heartbeat_back_addr":"172.21.15.172:6831/1965415663","heartbeat_front_addr":"172.21.15.172:6829/1965415663","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:21:13.024707+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:21:38.063741+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:22:02.221583+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:22:27.919711+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:22:53.870543+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:23:18.539905+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:23:43.694229+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:24:08.984704+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:24:34.378582+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:25:00.102231+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:25:25.367178+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:25:51.439033+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":10}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/2713701762":"2024-09-12T23:19:50.031855+0000","172.21.15.5:0/3135835713":"2024-09-12T23:19:50.031855+0000","172.21.15.5:0/3935034940":"2024-09-12T23:19:50.031855+0000","172.21.15.5:6801/1790126649":"2024-09-12T23:19:50.031855+0000","172.21.15.5:6801/1358356358":"2024-09-12T23:19:26.149011+0000","172.21.15.5:6800/1790126649":"2024-09-12T23:19:50.031855+0000","172.21.15.5:6800/1358356358":"2024-09-12T23:19:26.149011+0000","172.21.15.5:0/2243688290":"2024-09-12T23:19:26.149011+0000","172.21.15.5:0/1493331899":"2024-09-12T23:19:26.149011+0000","172.21.15.5:0/2329812802":"2024-09-12T23:19:26.149011+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:36:51.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.687+0000 7f9c5abdc640 1 -- 172.21.15.5:0/2986559271 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f9c3c0a2c00 msgr2=0x7f9c3c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:51.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.687+0000 7f9c5abdc640 1 --2- 172.21.15.5:0/2986559271 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f9c3c0a2c00 0x7f9c3c0a50c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9c44000c00 tx=0x7f9c44031400 comp rx=0 tx=0).stop 2024-09-11T23:36:51.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.687+0000 7f9c5abdc640 1 -- 172.21.15.5:0/2986559271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c54100a80 msgr2=0x7f9c54199360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:51.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.687+0000 7f9c5abdc640 1 --2- 172.21.15.5:0/2986559271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c54100a80 0x7f9c54199360 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f9c5000b4a0 tx=0x7f9c5000b960 comp rx=0 tx=0).stop 2024-09-11T23:36:51.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.687+0000 7f9c5abdc640 1 -- 172.21.15.5:0/2986559271 shutdown_connections 2024-09-11T23:36:51.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.687+0000 7f9c5abdc640 1 --2- 172.21.15.5:0/2986559271 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f9c3c0a2c00 0x7f9c3c0a50c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:51.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.687+0000 7f9c5abdc640 1 --2- 172.21.15.5:0/2986559271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9c54106a80 0x7f9c541a43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:51.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.687+0000 7f9c5abdc640 1 --2- 172.21.15.5:0/2986559271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c54101420 0x7f9c541998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:51.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.687+0000 7f9c5abdc640 1 --2- 172.21.15.5:0/2986559271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c54100a80 0x7f9c54199360 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:51.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.687+0000 7f9c5abdc640 1 -- 172.21.15.5:0/2986559271 >> 172.21.15.5:0/2986559271 conn(0x7f9c540fc7a0 msgr2=0x7f9c540fd110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:36:51.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.687+0000 7f9c5abdc640 1 -- 172.21.15.5:0/2986559271 shutdown_connections 2024-09-11T23:36:51.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:51.687+0000 7f9c5abdc640 1 -- 172.21.15.5:0/2986559271 wait complete. 2024-09-11T23:36:51.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:51 smithi159 ceph-mon[34394]: pgmap v588: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-11T23:36:51.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:51 smithi172 ceph-mon[34855]: pgmap v588: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-11T23:36:52.368 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph fs fail cephfs 2024-09-11T23:36:52.632 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:36:52.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:52 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/2986559271' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:36:52.880 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:52 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/2986559271' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:36:52.885 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:52 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/2986559271' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:36:53.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.147+0000 7f5913d6d640 1 -- 172.21.15.5:0/1543773311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f590c100ca0 msgr2=0x7f590c106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:53.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.147+0000 7f5913d6d640 1 --2- 172.21.15.5:0/1543773311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f590c100ca0 0x7f590c106840 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f58fc009930 tx=0x7f58fc02a420 comp rx=0 tx=0).stop 2024-09-11T23:36:53.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.147+0000 7f5913d6d640 1 -- 172.21.15.5:0/1543773311 shutdown_connections 2024-09-11T23:36:53.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.147+0000 7f5913d6d640 1 --2- 172.21.15.5:0/1543773311 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f590c106f50 0x7f590c10eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:53.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.147+0000 7f5913d6d640 1 --2- 172.21.15.5:0/1543773311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f590c100ca0 0x7f590c106840 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:53.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.147+0000 7f5913d6d640 1 --2- 172.21.15.5:0/1543773311 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f590c1002f0 0x7f590c1006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:53.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.147+0000 7f5913d6d640 1 -- 172.21.15.5:0/1543773311 >> 172.21.15.5:0/1543773311 conn(0x7f590c077210 msgr2=0x7f590c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:36:53.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.147+0000 7f5913d6d640 1 -- 172.21.15.5:0/1543773311 shutdown_connections 2024-09-11T23:36:53.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.147+0000 7f5913d6d640 1 -- 172.21.15.5:0/1543773311 wait complete. 2024-09-11T23:36:53.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.148+0000 7f5913d6d640 1 Processor -- start 2024-09-11T23:36:53.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.148+0000 7f5913d6d640 1 -- start start 2024-09-11T23:36:53.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.148+0000 7f5913d6d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f590c1002f0 0x7f590c198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:53.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.148+0000 7f5913d6d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f590c100ca0 0x7f590c198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:53.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.148+0000 7f5913d6d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f590c106f50 0x7f590c19ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:53.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.148+0000 7f5913d6d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f590c111f10 con 0x7f590c106f50 2024-09-11T23:36:53.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.148+0000 7f5913d6d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f590c111d90 con 0x7f590c100ca0 2024-09-11T23:36:53.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.148+0000 7f5913d6d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f590c112090 con 0x7f590c1002f0 2024-09-11T23:36:53.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.148+0000 7f591230a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f590c106f50 0x7f590c19ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:53.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.148+0000 7f591230a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f590c106f50 0x7f590c19ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58860/0 (socket says 172.21.15.5:58860) 2024-09-11T23:36:53.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.148+0000 7f591230a640 1 -- 172.21.15.5:0/3265498644 learned_addr learned my addr 172.21.15.5:0/3265498644 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:36:53.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.148+0000 7f5911b09640 1 --2- 172.21.15.5:0/3265498644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f590c1002f0 0x7f590c198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:53.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.148+0000 7f5911308640 1 --2- 172.21.15.5:0/3265498644 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f590c100ca0 0x7f590c198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:53.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.148+0000 7f591230a640 1 -- 172.21.15.5:0/3265498644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f590c1002f0 msgr2=0x7f590c198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:53.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.148+0000 7f591230a640 1 --2- 172.21.15.5:0/3265498644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f590c1002f0 0x7f590c198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:53.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.148+0000 7f591230a640 1 -- 172.21.15.5:0/3265498644 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f590c100ca0 msgr2=0x7f590c198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:53.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.148+0000 7f591230a640 1 --2- 172.21.15.5:0/3265498644 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f590c100ca0 0x7f590c198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:53.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.148+0000 7f591230a640 1 -- 172.21.15.5:0/3265498644 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f590c19d530 con 0x7f590c106f50 2024-09-11T23:36:53.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.149+0000 7f5911b09640 1 --2- 172.21.15.5:0/3265498644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f590c1002f0 0x7f590c198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:36:53.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.149+0000 7f591230a640 1 --2- 172.21.15.5:0/3265498644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f590c106f50 0x7f590c19ce50 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f5904009fd0 tx=0x7f590400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:36:53.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.149+0000 7f5902ffd640 1 -- 172.21.15.5:0/3265498644 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5904011830 con 0x7f590c106f50 2024-09-11T23:36:53.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.149+0000 7f5913d6d640 1 -- 172.21.15.5:0/3265498644 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f590c19d820 con 0x7f590c106f50 2024-09-11T23:36:53.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.149+0000 7f5902ffd640 1 -- 172.21.15.5:0/3265498644 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5904016070 con 0x7f590c106f50 2024-09-11T23:36:53.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.149+0000 7f5902ffd640 1 -- 172.21.15.5:0/3265498644 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5904010de0 con 0x7f590c106f50 2024-09-11T23:36:53.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.149+0000 7f5913d6d640 1 -- 172.21.15.5:0/3265498644 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f590c1a5100 con 0x7f590c106f50 2024-09-11T23:36:53.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.150+0000 7f5913d6d640 1 -- 172.21.15.5:0/3265498644 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f590c100750 con 0x7f590c106f50 2024-09-11T23:36:53.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.151+0000 7f5902ffd640 1 -- 172.21.15.5:0/3265498644 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f59040119d0 con 0x7f590c106f50 2024-09-11T23:36:53.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.152+0000 7f5902ffd640 1 --2- 172.21.15.5:0/3265498644 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f58f80a2b80 0x7f58f80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:53.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.152+0000 7f5902ffd640 1 -- 172.21.15.5:0/3265498644 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9187+0+0 (secure 0 0 0) 0x7f59040ceaf0 con 0x7f590c106f50 2024-09-11T23:36:53.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.152+0000 7f5911b09640 1 --2- 172.21.15.5:0/3265498644 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f58f80a2b80 0x7f58f80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:53.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.152+0000 7f5911b09640 1 --2- 172.21.15.5:0/3265498644 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f58f80a2b80 0x7f58f80a5040 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5908009fa0 tx=0x7f5908009570 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:36:53.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.156+0000 7f5902ffd640 1 -- 172.21.15.5:0/3265498644 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f590409b690 con 0x7f590c106f50 2024-09-11T23:36:53.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.367+0000 7f5913d6d640 1 -- 172.21.15.5:0/3265498644 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f590c10a170 con 0x7f590c106f50 2024-09-11T23:36:53.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.370+0000 7f5902ffd640 1 -- 172.21.15.5:0/3265498644 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v32) ==== 161+0+0 (secure 0 0 0) 0x7f590409af90 con 0x7f590c106f50 2024-09-11T23:36:53.369 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T23:36:53.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.373+0000 7f5913d6d640 1 -- 172.21.15.5:0/3265498644 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f58f80a2b80 msgr2=0x7f58f80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:53.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.373+0000 7f5913d6d640 1 --2- 172.21.15.5:0/3265498644 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f58f80a2b80 0x7f58f80a5040 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5908009fa0 tx=0x7f5908009570 comp rx=0 tx=0).stop 2024-09-11T23:36:53.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.373+0000 7f5913d6d640 1 -- 172.21.15.5:0/3265498644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f590c106f50 msgr2=0x7f590c19ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:53.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.373+0000 7f5913d6d640 1 --2- 172.21.15.5:0/3265498644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f590c106f50 0x7f590c19ce50 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f5904009fd0 tx=0x7f590400b8e0 comp rx=0 tx=0).stop 2024-09-11T23:36:53.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.373+0000 7f5913d6d640 1 -- 172.21.15.5:0/3265498644 shutdown_connections 2024-09-11T23:36:53.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.373+0000 7f5913d6d640 1 --2- 172.21.15.5:0/3265498644 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f58f80a2b80 0x7f58f80a5040 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:53.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.373+0000 7f5913d6d640 1 --2- 172.21.15.5:0/3265498644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f590c106f50 0x7f590c19ce50 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:53.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.373+0000 7f5913d6d640 1 --2- 172.21.15.5:0/3265498644 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f590c100ca0 0x7f590c198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:53.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.373+0000 7f5913d6d640 1 --2- 172.21.15.5:0/3265498644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f590c1002f0 0x7f590c198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:53.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.373+0000 7f5913d6d640 1 -- 172.21.15.5:0/3265498644 >> 172.21.15.5:0/3265498644 conn(0x7f590c077210 msgr2=0x7f590c105420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:36:53.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.373+0000 7f5913d6d640 1 -- 172.21.15.5:0/3265498644 shutdown_connections 2024-09-11T23:36:53.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:53.373+0000 7f5913d6d640 1 -- 172.21.15.5:0/3265498644 wait complete. 2024-09-11T23:36:53.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:53 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mon-a[31197]: 2024-09-11T23:36:53.368+0000 7f25835fc640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T23:36:53.876 INFO:journalctl@ceph.mds.b.smithi159.stdout:Sep 11 23:36:53 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-b[64498]: ignoring --setuser ceph since I am not root 2024-09-11T23:36:53.877 INFO:journalctl@ceph.mds.b.smithi159.stdout:Sep 11 23:36:53 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-b[64498]: ignoring --setgroup ceph since I am not root 2024-09-11T23:36:53.877 INFO:journalctl@ceph.mds.b.smithi159.stdout:Sep 11 23:36:53 smithi159 ceph-mds[64502]: -- 172.21.15.159:0/2360185349 <== mon.2 v2:172.21.15.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562c64de1860 con 0x562c64dbf400 2024-09-11T23:36:53.877 INFO:journalctl@ceph.mds.b.smithi159.stdout:Sep 11 23:36:53 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-b[64498]: starting mds.b at 2024-09-11T23:36:53.877 INFO:journalctl@ceph.mds.h.smithi159.stdout:Sep 11 23:36:53 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-h[64183]: ignoring --setuser ceph since I am not root 2024-09-11T23:36:53.877 INFO:journalctl@ceph.mds.h.smithi159.stdout:Sep 11 23:36:53 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-h[64183]: ignoring --setgroup ceph since I am not root 2024-09-11T23:36:53.877 INFO:journalctl@ceph.mds.h.smithi159.stdout:Sep 11 23:36:53 smithi159 ceph-mds[64187]: -- 172.21.15.159:0/4063924798 <== mon.2 v2:172.21.15.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555c7626d860 con 0x555c7624a800 2024-09-11T23:36:53.878 INFO:journalctl@ceph.mds.h.smithi159.stdout:Sep 11 23:36:53 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-h[64183]: starting mds.h at 2024-09-11T23:36:53.878 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:53 smithi159 ceph-mon[34394]: pgmap v589: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-11T23:36:53.878 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:53 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/3265498644' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-11T23:36:53.878 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:53 smithi159 ceph-mon[34394]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-11T23:36:53.878 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:53 smithi159 ceph-mon[34394]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T23:36:53.878 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:53 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/3265498644' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-11T23:36:53.878 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:53 smithi159 ceph-mon[34394]: osdmap e89: 12 total, 12 up, 12 in 2024-09-11T23:36:53.878 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:53 smithi159 ceph-mon[34394]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-11T23:36:53.878 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:53 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:36:53.879 INFO:journalctl@ceph.mds.e.smithi159.stdout:Sep 11 23:36:53 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-e[63882]: ignoring --setuser ceph since I am not root 2024-09-11T23:36:53.879 INFO:journalctl@ceph.mds.e.smithi159.stdout:Sep 11 23:36:53 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-e[63882]: ignoring --setgroup ceph since I am not root 2024-09-11T23:36:53.879 INFO:journalctl@ceph.mds.e.smithi159.stdout:Sep 11 23:36:53 smithi159 ceph-mds[63886]: -- 172.21.15.159:0/3483341525 <== mon.2 v2:172.21.15.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55721b431c20 con 0x55721b40f400 2024-09-11T23:36:53.879 INFO:journalctl@ceph.mds.e.smithi159.stdout:Sep 11 23:36:53 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-e[63882]: starting mds.e at 2024-09-11T23:36:53.884 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 11 23:36:53 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-c[64427]: ignoring --setuser ceph since I am not root 2024-09-11T23:36:53.884 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 11 23:36:53 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-c[64427]: ignoring --setgroup ceph since I am not root 2024-09-11T23:36:53.884 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 11 23:36:53 smithi172 ceph-mds[64431]: -- 172.21.15.172:0/1409776505 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56104c877860 con 0x56104c855400 2024-09-11T23:36:53.884 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 11 23:36:53 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-c[64427]: starting mds.c at 2024-09-11T23:36:53.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:53 smithi172 ceph-mon[34855]: pgmap v589: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-11T23:36:53.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:53 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/3265498644' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-11T23:36:53.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:53 smithi172 ceph-mon[34855]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-11T23:36:53.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:53 smithi172 ceph-mon[34855]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T23:36:53.885 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:53 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/3265498644' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-11T23:36:53.885 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:53 smithi172 ceph-mon[34855]: osdmap e89: 12 total, 12 up, 12 in 2024-09-11T23:36:53.885 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:53 smithi172 ceph-mon[34855]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-11T23:36:53.885 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:53 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:36:53.885 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 11 23:36:53 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-f[64124]: ignoring --setuser ceph since I am not root 2024-09-11T23:36:53.885 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 11 23:36:53 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-f[64124]: ignoring --setgroup ceph since I am not root 2024-09-11T23:36:53.885 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 11 23:36:53 smithi172 ceph-mds[64128]: -- 172.21.15.172:0/1799261835 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56081fbb1860 con 0x56081fb8f400 2024-09-11T23:36:53.886 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 11 23:36:53 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-f[64124]: starting mds.f at 2024-09-11T23:36:53.886 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 11 23:36:53 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-i[64733]: ignoring --setuser ceph since I am not root 2024-09-11T23:36:53.886 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 11 23:36:53 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-i[64733]: ignoring --setgroup ceph since I am not root 2024-09-11T23:36:53.886 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 11 23:36:53 smithi172 ceph-mds[64737]: -- 172.21.15.172:0/2305092877 <== mon.0 v2:172.21.15.5:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558c41bc7c20 con 0x558c41ba4800 2024-09-11T23:36:53.886 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 11 23:36:53 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-i[64733]: starting mds.i at 2024-09-11T23:36:53.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:53 smithi005 ceph-mon[31201]: pgmap v589: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-11T23:36:53.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:53 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/3265498644' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-11T23:36:53.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:53 smithi005 ceph-mon[31201]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-11T23:36:53.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:53 smithi005 ceph-mon[31201]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T23:36:53.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:53 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/3265498644' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-11T23:36:53.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:53 smithi005 ceph-mon[31201]: osdmap e89: 12 total, 12 up, 12 in 2024-09-11T23:36:53.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:53 smithi005 ceph-mon[31201]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-11T23:36:53.975 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:53 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:36:54.090 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T23:36:54.355 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:36:54.782 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:54 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:36:54.782 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:54 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:36:54.782 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:54 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:36:54.782 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:54 smithi005 ceph-mon[31201]: mds.? [v2:172.21.15.172:6834/1462396143,v1:172.21.15.172:6837/1462396143] up:boot 2024-09-11T23:36:54.782 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:54 smithi005 ceph-mon[31201]: mds.? [v2:172.21.15.172:6835/2183339991,v1:172.21.15.172:6838/2183339991] up:boot 2024-09-11T23:36:54.783 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:54 smithi005 ceph-mon[31201]: mds.? [v2:172.21.15.172:6836/31717864,v1:172.21.15.172:6839/31717864] up:boot 2024-09-11T23:36:54.783 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:54 smithi005 ceph-mon[31201]: mds.? [v2:172.21.15.159:6834/1202443322,v1:172.21.15.159:6835/1202443322] up:boot 2024-09-11T23:36:54.783 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:54 smithi005 ceph-mon[31201]: mds.? [v2:172.21.15.159:6836/99100849,v1:172.21.15.159:6837/99100849] up:boot 2024-09-11T23:36:54.783 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:54 smithi005 ceph-mon[31201]: mds.? [v2:172.21.15.159:6838/123516347,v1:172.21.15.159:6839/123516347] up:boot 2024-09-11T23:36:54.783 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:54 smithi005 ceph-mon[31201]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-11T23:36:54.783 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:54 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-11T23:36:54.783 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:54 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-11T23:36:54.783 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:54 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-11T23:36:54.783 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:54 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-11T23:36:54.783 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:54 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-11T23:36:54.783 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:54 smithi005 ceph-mon[31201]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-11T23:36:54.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:54 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:36:54.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:54 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:36:54.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:54 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:36:54.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:54 smithi159 ceph-mon[34394]: mds.? [v2:172.21.15.172:6834/1462396143,v1:172.21.15.172:6837/1462396143] up:boot 2024-09-11T23:36:54.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:54 smithi159 ceph-mon[34394]: mds.? [v2:172.21.15.172:6835/2183339991,v1:172.21.15.172:6838/2183339991] up:boot 2024-09-11T23:36:54.877 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:54 smithi159 ceph-mon[34394]: mds.? [v2:172.21.15.172:6836/31717864,v1:172.21.15.172:6839/31717864] up:boot 2024-09-11T23:36:54.877 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:54 smithi159 ceph-mon[34394]: mds.? [v2:172.21.15.159:6834/1202443322,v1:172.21.15.159:6835/1202443322] up:boot 2024-09-11T23:36:54.877 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:54 smithi159 ceph-mon[34394]: mds.? [v2:172.21.15.159:6836/99100849,v1:172.21.15.159:6837/99100849] up:boot 2024-09-11T23:36:54.877 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:54 smithi159 ceph-mon[34394]: mds.? [v2:172.21.15.159:6838/123516347,v1:172.21.15.159:6839/123516347] up:boot 2024-09-11T23:36:54.877 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:54 smithi159 ceph-mon[34394]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-11T23:36:54.877 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:54 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-11T23:36:54.877 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:54 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-11T23:36:54.877 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:54 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-11T23:36:54.878 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:54 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-11T23:36:54.878 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:54 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-11T23:36:54.878 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:54 smithi159 ceph-mon[34394]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-11T23:36:54.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:54.866+0000 7f685fed7640 1 -- 172.21.15.5:0/1279017316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6858103660 msgr2=0x7f685810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:54.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:54.866+0000 7f685fed7640 1 --2- 172.21.15.5:0/1279017316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6858103660 0x7f685810bb50 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f684c009900 tx=0x7f684c02a480 comp rx=0 tx=0).stop 2024-09-11T23:36:54.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:54.866+0000 7f685fed7640 1 -- 172.21.15.5:0/1279017316 shutdown_connections 2024-09-11T23:36:54.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:54.866+0000 7f685fed7640 1 --2- 172.21.15.5:0/1279017316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f685810c170 0x7f685810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:54.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:54.866+0000 7f685fed7640 1 --2- 172.21.15.5:0/1279017316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6858103660 0x7f685810bb50 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:54.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:54.866+0000 7f685fed7640 1 --2- 172.21.15.5:0/1279017316 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6858102d40 0x7f6858103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:54.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:54.866+0000 7f685fed7640 1 -- 172.21.15.5:0/1279017316 >> 172.21.15.5:0/1279017316 conn(0x7f68580fc7a0 msgr2=0x7f68580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:36:54.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:54.866+0000 7f685fed7640 1 -- 172.21.15.5:0/1279017316 shutdown_connections 2024-09-11T23:36:54.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:54.866+0000 7f685fed7640 1 -- 172.21.15.5:0/1279017316 wait complete. 2024-09-11T23:36:54.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:54.867+0000 7f685fed7640 1 Processor -- start 2024-09-11T23:36:54.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:54.867+0000 7f685fed7640 1 -- start start 2024-09-11T23:36:54.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:54.867+0000 7f685fed7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6858102d40 0x7f68581009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:54.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:54.867+0000 7f685fed7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6858103660 0x7f6858100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:54.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:54.867+0000 7f685fed7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f685810c170 0x7f6858101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:54.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:54.867+0000 7f685fed7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6858111e20 con 0x7f6858103660 2024-09-11T23:36:54.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:54.867+0000 7f685fed7640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6858111ca0 con 0x7f685810c170 2024-09-11T23:36:54.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:54.867+0000 7f685fed7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6858111fa0 con 0x7f6858102d40 2024-09-11T23:36:54.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:54.867+0000 7f685d472640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6858103660 0x7f6858100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:54.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:54.867+0000 7f685d472640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6858103660 0x7f6858100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37996/0 (socket says 172.21.15.5:37996) 2024-09-11T23:36:54.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:54.867+0000 7f685d472640 1 -- 172.21.15.5:0/2896437321 learned_addr learned my addr 172.21.15.5:0/2896437321 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:36:54.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:54.867+0000 7f685dc73640 1 --2- 172.21.15.5:0/2896437321 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6858102d40 0x7f68581009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:54.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:54.868+0000 7f685e474640 1 --2- 172.21.15.5:0/2896437321 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f685810c170 0x7f6858101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:54.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:54.868+0000 7f685d472640 1 -- 172.21.15.5:0/2896437321 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6858102d40 msgr2=0x7f68581009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:54.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:54.868+0000 7f685d472640 1 --2- 172.21.15.5:0/2896437321 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6858102d40 0x7f68581009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:54.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:54.868+0000 7f685d472640 1 -- 172.21.15.5:0/2896437321 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f685810c170 msgr2=0x7f6858101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:54.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:54.868+0000 7f685d472640 1 --2- 172.21.15.5:0/2896437321 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f685810c170 0x7f6858101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:54.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:54.868+0000 7f685d472640 1 -- 172.21.15.5:0/2896437321 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68581a6830 con 0x7f6858103660 2024-09-11T23:36:54.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:54.868+0000 7f685d472640 1 --2- 172.21.15.5:0/2896437321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6858103660 0x7f6858100ee0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f684c005940 tx=0x7f684c0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:36:54.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:54.868+0000 7f684affd640 1 -- 172.21.15.5:0/2896437321 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f684c03f030 con 0x7f6858103660 2024-09-11T23:36:54.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:54.868+0000 7f684affd640 1 -- 172.21.15.5:0/2896437321 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f684c0044c0 con 0x7f6858103660 2024-09-11T23:36:54.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:54.868+0000 7f685fed7640 1 -- 172.21.15.5:0/2896437321 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68581a6ac0 con 0x7f6858103660 2024-09-11T23:36:54.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:54.868+0000 7f684affd640 1 -- 172.21.15.5:0/2896437321 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f684c035070 con 0x7f6858103660 2024-09-11T23:36:54.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:54.868+0000 7f685fed7640 1 -- 172.21.15.5:0/2896437321 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68581a6ff0 con 0x7f6858103660 2024-09-11T23:36:54.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:54.869+0000 7f685fed7640 1 -- 172.21.15.5:0/2896437321 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6858103120 con 0x7f6858103660 2024-09-11T23:36:54.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:54.870+0000 7f684affd640 1 -- 172.21.15.5:0/2896437321 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f684c042030 con 0x7f6858103660 2024-09-11T23:36:54.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:54.871+0000 7f684affd640 1 --2- 172.21.15.5:0/2896437321 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f68440a2c00 0x7f68440a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:54.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:54.871+0000 7f685dc73640 1 --2- 172.21.15.5:0/2896437321 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f68440a2c00 0x7f68440a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:54.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:54.872+0000 7f684affd640 1 -- 172.21.15.5:0/2896437321 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9445+0+0 (secure 0 0 0) 0x7f684c0ef8b0 con 0x7f6858103660 2024-09-11T23:36:54.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:54.872+0000 7f685dc73640 1 --2- 172.21.15.5:0/2896437321 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f68440a2c00 0x7f68440a50c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6854005d00 tx=0x7f685400b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:36:54.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:54.876+0000 7f684affd640 1 -- 172.21.15.5:0/2896437321 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f684c0bc2f0 con 0x7f6858103660 2024-09-11T23:36:54.890 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:54 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:36:54.890 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:54 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:36:54.890 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:54 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' 2024-09-11T23:36:54.890 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:54 smithi172 ceph-mon[34855]: mds.? [v2:172.21.15.172:6834/1462396143,v1:172.21.15.172:6837/1462396143] up:boot 2024-09-11T23:36:54.890 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:54 smithi172 ceph-mon[34855]: mds.? [v2:172.21.15.172:6835/2183339991,v1:172.21.15.172:6838/2183339991] up:boot 2024-09-11T23:36:54.890 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:54 smithi172 ceph-mon[34855]: mds.? [v2:172.21.15.172:6836/31717864,v1:172.21.15.172:6839/31717864] up:boot 2024-09-11T23:36:54.891 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:54 smithi172 ceph-mon[34855]: mds.? [v2:172.21.15.159:6834/1202443322,v1:172.21.15.159:6835/1202443322] up:boot 2024-09-11T23:36:54.891 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:54 smithi172 ceph-mon[34855]: mds.? [v2:172.21.15.159:6836/99100849,v1:172.21.15.159:6837/99100849] up:boot 2024-09-11T23:36:54.891 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:54 smithi172 ceph-mon[34855]: mds.? [v2:172.21.15.159:6838/123516347,v1:172.21.15.159:6839/123516347] up:boot 2024-09-11T23:36:54.891 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:54 smithi172 ceph-mon[34855]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-11T23:36:54.891 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:54 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-11T23:36:54.892 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:54 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-11T23:36:54.892 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:54 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-11T23:36:54.892 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:54 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-11T23:36:54.892 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:54 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-11T23:36:54.892 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:54 smithi172 ceph-mon[34855]: from='mgr.14148 172.21.15.5:0/1699965355' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-11T23:36:55.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:55.089+0000 7f685fed7640 1 -- 172.21.15.5:0/2896437321 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f68581071e0 con 0x7f6858103660 2024-09-11T23:36:55.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:55.601+0000 7f684affd640 1 -- 172.21.15.5:0/2896437321 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v34) ==== 104+0+0 (secure 0 0 0) 0x7f684c0bbbf0 con 0x7f6858103660 2024-09-11T23:36:55.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:55.603+0000 7f685fed7640 1 -- 172.21.15.5:0/2896437321 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f68440a2c00 msgr2=0x7f68440a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:55.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:55.603+0000 7f685fed7640 1 --2- 172.21.15.5:0/2896437321 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f68440a2c00 0x7f68440a50c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6854005d00 tx=0x7f685400b410 comp rx=0 tx=0).stop 2024-09-11T23:36:55.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:55.603+0000 7f685fed7640 1 -- 172.21.15.5:0/2896437321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6858103660 msgr2=0x7f6858100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:55.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:55.603+0000 7f685fed7640 1 --2- 172.21.15.5:0/2896437321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6858103660 0x7f6858100ee0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f684c005940 tx=0x7f684c0040c0 comp rx=0 tx=0).stop 2024-09-11T23:36:55.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:55.603+0000 7f685fed7640 1 -- 172.21.15.5:0/2896437321 shutdown_connections 2024-09-11T23:36:55.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:55.603+0000 7f685fed7640 1 --2- 172.21.15.5:0/2896437321 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f68440a2c00 0x7f68440a50c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:55.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:55.603+0000 7f685fed7640 1 --2- 172.21.15.5:0/2896437321 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f685810c170 0x7f6858101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:55.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:55.603+0000 7f685fed7640 1 --2- 172.21.15.5:0/2896437321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6858103660 0x7f6858100ee0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:55.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:55.603+0000 7f685fed7640 1 --2- 172.21.15.5:0/2896437321 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6858102d40 0x7f68581009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:55.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:55.603+0000 7f685fed7640 1 -- 172.21.15.5:0/2896437321 >> 172.21.15.5:0/2896437321 conn(0x7f68580fc7a0 msgr2=0x7f68580fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:36:55.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:55.603+0000 7f685fed7640 1 -- 172.21.15.5:0/2896437321 shutdown_connections 2024-09-11T23:36:55.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:55.603+0000 7f685fed7640 1 -- 172.21.15.5:0/2896437321 wait complete. 2024-09-11T23:36:55.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:55 smithi159 ceph-mon[34394]: pgmap v591: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 716 B/s wr, 7 op/s 2024-09-11T23:36:55.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:55 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/2896437321' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T23:36:55.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:55 smithi172 ceph-mon[34855]: pgmap v591: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 716 B/s wr, 7 op/s 2024-09-11T23:36:55.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:55 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/2896437321' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T23:36:55.920 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:55 smithi005 ceph-mon[31201]: pgmap v591: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 716 B/s wr, 7 op/s 2024-09-11T23:36:55.920 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:55 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/2896437321' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T23:36:56.224 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T23:36:56.489 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:36:56.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:56 smithi159 ceph-mon[34394]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-11T23:36:56.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:56 smithi159 ceph-mon[34394]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-11T23:36:56.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:56 smithi159 ceph-mon[34394]: Cluster is now healthy 2024-09-11T23:36:56.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:56 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/2896437321' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-11T23:36:56.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:56 smithi159 ceph-mon[34394]: fsmap 12 up:standby 2024-09-11T23:36:56.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:56 smithi172 ceph-mon[34855]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-11T23:36:56.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:56 smithi172 ceph-mon[34855]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-11T23:36:56.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:56 smithi172 ceph-mon[34855]: Cluster is now healthy 2024-09-11T23:36:56.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:56 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/2896437321' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-11T23:36:56.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:56 smithi172 ceph-mon[34855]: fsmap 12 up:standby 2024-09-11T23:36:56.891 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:56 smithi005 ceph-mon[31201]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-11T23:36:56.891 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:56 smithi005 ceph-mon[31201]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-11T23:36:56.891 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:56 smithi005 ceph-mon[31201]: Cluster is now healthy 2024-09-11T23:36:56.891 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:56 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/2896437321' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-11T23:36:56.891 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:56 smithi005 ceph-mon[31201]: fsmap 12 up:standby 2024-09-11T23:36:56.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:56.979+0000 7fe106974640 1 -- 172.21.15.5:0/941750660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe100106f10 msgr2=0x7fe10010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:56.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:56.979+0000 7fe106974640 1 --2- 172.21.15.5:0/941750660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe100106f10 0x7fe10010ea90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8009ca0 tx=0x7fe0f802a8c0 comp rx=0 tx=0).stop 2024-09-11T23:36:57.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:56.979+0000 7fe106974640 1 -- 172.21.15.5:0/941750660 shutdown_connections 2024-09-11T23:36:57.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:56.979+0000 7fe106974640 1 --2- 172.21.15.5:0/941750660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe100106f10 0x7fe10010ea90 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:57.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:56.979+0000 7fe106974640 1 --2- 172.21.15.5:0/941750660 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe100102790 0x7fe1001067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:57.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:56.979+0000 7fe106974640 1 --2- 172.21.15.5:0/941750660 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe100101de0 0x7fe1001021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:57.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:56.979+0000 7fe106974640 1 -- 172.21.15.5:0/941750660 >> 172.21.15.5:0/941750660 conn(0x7fe1000fd8c0 msgr2=0x7fe1000ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:36:57.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:56.979+0000 7fe106974640 1 -- 172.21.15.5:0/941750660 shutdown_connections 2024-09-11T23:36:57.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:56.979+0000 7fe106974640 1 -- 172.21.15.5:0/941750660 wait complete. 2024-09-11T23:36:57.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:56.980+0000 7fe106974640 1 Processor -- start 2024-09-11T23:36:57.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:56.980+0000 7fe106974640 1 -- start start 2024-09-11T23:36:57.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:56.980+0000 7fe106974640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe100101de0 0x7fe100198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:57.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:56.980+0000 7fe106974640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe100102790 0x7fe100198780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:57.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:56.981+0000 7fe106974640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe100106f10 0x7fe10019cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:57.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:56.981+0000 7fe106974640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe100111e20 con 0x7fe100101de0 2024-09-11T23:36:57.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:56.981+0000 7fe106974640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe100111ca0 con 0x7fe100102790 2024-09-11T23:36:57.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:56.981+0000 7fe106974640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe100111fa0 con 0x7fe100106f10 2024-09-11T23:36:57.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:56.981+0000 7fe0fffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe100101de0 0x7fe100198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:57.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:56.981+0000 7fe0fffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe100101de0 0x7fe100198240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38020/0 (socket says 172.21.15.5:38020) 2024-09-11T23:36:57.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:56.981+0000 7fe0fffff640 1 -- 172.21.15.5:0/736701266 learned_addr learned my addr 172.21.15.5:0/736701266 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:36:57.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:56.981+0000 7fe104f11640 1 --2- 172.21.15.5:0/736701266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe100106f10 0x7fe10019cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:57.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:56.981+0000 7fe0f7fff640 1 --2- 172.21.15.5:0/736701266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe100102790 0x7fe100198780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:57.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:56.981+0000 7fe0fffff640 1 -- 172.21.15.5:0/736701266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe100106f10 msgr2=0x7fe10019cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:57.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:56.981+0000 7fe0fffff640 1 --2- 172.21.15.5:0/736701266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe100106f10 0x7fe10019cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:57.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:56.981+0000 7fe0fffff640 1 -- 172.21.15.5:0/736701266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe100102790 msgr2=0x7fe100198780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:57.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:56.981+0000 7fe0fffff640 1 --2- 172.21.15.5:0/736701266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe100102790 0x7fe100198780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:57.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:56.981+0000 7fe0fffff640 1 -- 172.21.15.5:0/736701266 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe10019d1f0 con 0x7fe100101de0 2024-09-11T23:36:57.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:56.981+0000 7fe0f7fff640 1 --2- 172.21.15.5:0/736701266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe100102790 0x7fe100198780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:36:57.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:56.981+0000 7fe0fffff640 1 --2- 172.21.15.5:0/736701266 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe100101de0 0x7fe100198240 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe0f000c890 tx=0x7fe0f000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:36:57.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:56.981+0000 7fe0fdffb640 1 -- 172.21.15.5:0/736701266 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f0004220 con 0x7fe100101de0 2024-09-11T23:36:57.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:56.981+0000 7fe0fdffb640 1 -- 172.21.15.5:0/736701266 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe0f00043c0 con 0x7fe100101de0 2024-09-11T23:36:57.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:56.981+0000 7fe106974640 1 -- 172.21.15.5:0/736701266 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe10019d4e0 con 0x7fe100101de0 2024-09-11T23:36:57.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:56.981+0000 7fe0fdffb640 1 -- 172.21.15.5:0/736701266 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f0004a00 con 0x7fe100101de0 2024-09-11T23:36:57.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:56.981+0000 7fe106974640 1 -- 172.21.15.5:0/736701266 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1001a4dc0 con 0x7fe100101de0 2024-09-11T23:36:57.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:56.983+0000 7fe106974640 1 -- 172.21.15.5:0/736701266 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1001021c0 con 0x7fe100101de0 2024-09-11T23:36:57.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:56.984+0000 7fe0fdffb640 1 -- 172.21.15.5:0/736701266 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fe0f0004ba0 con 0x7fe100101de0 2024-09-11T23:36:57.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:56.984+0000 7fe0fdffb640 1 --2- 172.21.15.5:0/736701266 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe0ec0a2c00 0x7fe0ec0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:57.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:56.985+0000 7fe0f7fff640 1 --2- 172.21.15.5:0/736701266 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe0ec0a2c00 0x7fe0ec0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:57.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:56.985+0000 7fe0fdffb640 1 -- 172.21.15.5:0/736701266 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9445+0+0 (secure 0 0 0) 0x7fe0f00cf1f0 con 0x7fe100101de0 2024-09-11T23:36:57.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:56.985+0000 7fe0f7fff640 1 --2- 172.21.15.5:0/736701266 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe0ec0a2c00 0x7fe0ec0a50c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe1001088e0 tx=0x7fe0e8005d20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:36:57.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:56.989+0000 7fe0fdffb640 1 -- 172.21.15.5:0/736701266 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe0f0014030 con 0x7fe100101de0 2024-09-11T23:36:57.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:57.168+0000 7fe106974640 1 -- 172.21.15.5:0/736701266 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe1001995a0 con 0x7fe100101de0 2024-09-11T23:36:57.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:57.611+0000 7fe0fdffb640 1 -- 172.21.15.5:0/736701266 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v90) ==== 181+0+0 (secure 0 0 0) 0x7fe0f009bc90 con 0x7fe100101de0 2024-09-11T23:36:57.610 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2024-09-11T23:36:57.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:57.614+0000 7fe106974640 1 -- 172.21.15.5:0/736701266 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe0ec0a2c00 msgr2=0x7fe0ec0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:57.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:57.614+0000 7fe106974640 1 --2- 172.21.15.5:0/736701266 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe0ec0a2c00 0x7fe0ec0a50c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe1001088e0 tx=0x7fe0e8005d20 comp rx=0 tx=0).stop 2024-09-11T23:36:57.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:57.614+0000 7fe106974640 1 -- 172.21.15.5:0/736701266 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe100101de0 msgr2=0x7fe100198240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:57.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:57.614+0000 7fe106974640 1 --2- 172.21.15.5:0/736701266 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe100101de0 0x7fe100198240 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe0f000c890 tx=0x7fe0f000cd50 comp rx=0 tx=0).stop 2024-09-11T23:36:57.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:57.614+0000 7fe106974640 1 -- 172.21.15.5:0/736701266 shutdown_connections 2024-09-11T23:36:57.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:57.614+0000 7fe106974640 1 --2- 172.21.15.5:0/736701266 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7fe0ec0a2c00 0x7fe0ec0a50c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:57.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:57.614+0000 7fe106974640 1 --2- 172.21.15.5:0/736701266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe100106f10 0x7fe10019cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:57.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:57.614+0000 7fe106974640 1 --2- 172.21.15.5:0/736701266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe100102790 0x7fe100198780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:57.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:57.614+0000 7fe106974640 1 --2- 172.21.15.5:0/736701266 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe100101de0 0x7fe100198240 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:57.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:57.614+0000 7fe106974640 1 -- 172.21.15.5:0/736701266 >> 172.21.15.5:0/736701266 conn(0x7fe1000fd8c0 msgr2=0x7fe1000fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:36:57.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:57.614+0000 7fe106974640 1 -- 172.21.15.5:0/736701266 shutdown_connections 2024-09-11T23:36:57.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:57.615+0000 7fe106974640 1 -- 172.21.15.5:0/736701266 wait complete. 2024-09-11T23:36:57.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:57 smithi159 ceph-mon[34394]: pgmap v592: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 4 op/s 2024-09-11T23:36:57.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:57 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/736701266' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T23:36:57.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:57 smithi172 ceph-mon[34855]: pgmap v592: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 4 op/s 2024-09-11T23:36:57.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:57 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/736701266' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T23:36:57.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:57 smithi005 ceph-mon[31201]: pgmap v592: 129 pgs: 129 active+clean; 158 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 4 op/s 2024-09-11T23:36:57.974 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:57 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/736701266' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T23:36:58.336 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T23:36:58.596 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:36:58.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:58 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/736701266' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T23:36:58.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:58 smithi159 ceph-mon[34394]: osdmap e90: 12 total, 12 up, 12 in 2024-09-11T23:36:58.881 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:58 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/736701266' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T23:36:58.881 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:58 smithi005 ceph-mon[31201]: osdmap e90: 12 total, 12 up, 12 in 2024-09-11T23:36:58.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:58 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/736701266' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T23:36:58.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:58 smithi172 ceph-mon[34855]: osdmap e90: 12 total, 12 up, 12 in 2024-09-11T23:36:59.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.089+0000 7f90db142640 1 -- 172.21.15.5:0/1935872591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90d4101420 msgr2=0x7f90d410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:59.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.089+0000 7f90db142640 1 --2- 172.21.15.5:0/1935872591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90d4101420 0x7f90d410d950 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f90cc009cd0 tx=0x7f90cc02a8e0 comp rx=0 tx=0).stop 2024-09-11T23:36:59.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.089+0000 7f90db142640 1 -- 172.21.15.5:0/1935872591 shutdown_connections 2024-09-11T23:36:59.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.089+0000 7f90db142640 1 --2- 172.21.15.5:0/1935872591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90d4101420 0x7f90d410d950 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:59.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.089+0000 7f90db142640 1 --2- 172.21.15.5:0/1935872591 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90d4100a80 0x7f90d4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:59.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.089+0000 7f90db142640 1 --2- 172.21.15.5:0/1935872591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90d4106a80 0x7f90d4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:59.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.089+0000 7f90db142640 1 -- 172.21.15.5:0/1935872591 >> 172.21.15.5:0/1935872591 conn(0x7f90d40fc7a0 msgr2=0x7f90d40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:36:59.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.089+0000 7f90db142640 1 -- 172.21.15.5:0/1935872591 shutdown_connections 2024-09-11T23:36:59.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.089+0000 7f90db142640 1 -- 172.21.15.5:0/1935872591 wait complete. 2024-09-11T23:36:59.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.089+0000 7f90db142640 1 Processor -- start 2024-09-11T23:36:59.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.090+0000 7f90db142640 1 -- start start 2024-09-11T23:36:59.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.090+0000 7f90db142640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90d4100a80 0x7f90d4198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:59.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.090+0000 7f90db142640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90d4101420 0x7f90d4198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:59.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.090+0000 7f90db142640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90d4106a80 0x7f90d419cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:59.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.090+0000 7f90db142640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f90d4110d80 con 0x7f90d4106a80 2024-09-11T23:36:59.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.090+0000 7f90db142640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f90d4110c00 con 0x7f90d4100a80 2024-09-11T23:36:59.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.090+0000 7f90db142640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f90d4110f00 con 0x7f90d4101420 2024-09-11T23:36:59.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.090+0000 7f90d96df640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90d4106a80 0x7f90d419cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:59.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.090+0000 7f90d96df640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90d4106a80 0x7f90d419cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38036/0 (socket says 172.21.15.5:38036) 2024-09-11T23:36:59.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.090+0000 7f90d96df640 1 -- 172.21.15.5:0/2829217046 learned_addr learned my addr 172.21.15.5:0/2829217046 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:36:59.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.090+0000 7f90d8ede640 1 --2- 172.21.15.5:0/2829217046 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90d4100a80 0x7f90d4198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:59.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.090+0000 7f90d3fff640 1 --2- 172.21.15.5:0/2829217046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90d4101420 0x7f90d4198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:59.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.090+0000 7f90d96df640 1 -- 172.21.15.5:0/2829217046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90d4101420 msgr2=0x7f90d4198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:59.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.090+0000 7f90d96df640 1 --2- 172.21.15.5:0/2829217046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90d4101420 0x7f90d4198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:59.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.090+0000 7f90d96df640 1 -- 172.21.15.5:0/2829217046 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90d4100a80 msgr2=0x7f90d4198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:59.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.090+0000 7f90d96df640 1 --2- 172.21.15.5:0/2829217046 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90d4100a80 0x7f90d4198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:59.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.090+0000 7f90d96df640 1 -- 172.21.15.5:0/2829217046 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90d419d2e0 con 0x7f90d4106a80 2024-09-11T23:36:59.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.091+0000 7f90d96df640 1 --2- 172.21.15.5:0/2829217046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90d4106a80 0x7f90d419cc00 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f90cc005e30 tx=0x7f90cc003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:36:59.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.091+0000 7f90d1ffb640 1 -- 172.21.15.5:0/2829217046 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90cc004240 con 0x7f90d4106a80 2024-09-11T23:36:59.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.091+0000 7f90d1ffb640 1 -- 172.21.15.5:0/2829217046 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f90cc031ce0 con 0x7f90d4106a80 2024-09-11T23:36:59.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.091+0000 7f90d1ffb640 1 -- 172.21.15.5:0/2829217046 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90cc030ea0 con 0x7f90d4106a80 2024-09-11T23:36:59.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.091+0000 7f90db142640 1 -- 172.21.15.5:0/2829217046 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90d419d570 con 0x7f90d4106a80 2024-09-11T23:36:59.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.091+0000 7f90db142640 1 -- 172.21.15.5:0/2829217046 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90d41a4eb0 con 0x7f90d4106a80 2024-09-11T23:36:59.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.092+0000 7f90db142640 1 -- 172.21.15.5:0/2829217046 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90d4100ee0 con 0x7f90d4106a80 2024-09-11T23:36:59.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.093+0000 7f90d1ffb640 1 -- 172.21.15.5:0/2829217046 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f90cc0305a0 con 0x7f90d4106a80 2024-09-11T23:36:59.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.094+0000 7f90d1ffb640 1 --2- 172.21.15.5:0/2829217046 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f90bc0a2c00 0x7f90bc0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:36:59.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.094+0000 7f90d1ffb640 1 -- 172.21.15.5:0/2829217046 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8862+0+0 (secure 0 0 0) 0x7f90cc02e030 con 0x7f90d4106a80 2024-09-11T23:36:59.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.094+0000 7f90d8ede640 1 --2- 172.21.15.5:0/2829217046 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f90bc0a2c00 0x7f90bc0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:36:59.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.095+0000 7f90d8ede640 1 --2- 172.21.15.5:0/2829217046 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f90bc0a2c00 0x7f90bc0a50c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f90c4005fd0 tx=0x7f90c400b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:36:59.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.099+0000 7f90d1ffb640 1 -- 172.21.15.5:0/2829217046 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f90cc04b060 con 0x7f90d4106a80 2024-09-11T23:36:59.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.274+0000 7f90db142640 1 -- 172.21.15.5:0/2829217046 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f90d410a000 con 0x7f90d4106a80 2024-09-11T23:36:59.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.617+0000 7f90d1ffb640 1 -- 172.21.15.5:0/2829217046 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v91) ==== 169+0+0 (secure 0 0 0) 0x7f90cc0bd620 con 0x7f90d4106a80 2024-09-11T23:36:59.617 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2024-09-11T23:36:59.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.620+0000 7f90db142640 1 -- 172.21.15.5:0/2829217046 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f90bc0a2c00 msgr2=0x7f90bc0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:59.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.620+0000 7f90db142640 1 --2- 172.21.15.5:0/2829217046 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f90bc0a2c00 0x7f90bc0a50c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f90c4005fd0 tx=0x7f90c400b390 comp rx=0 tx=0).stop 2024-09-11T23:36:59.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.620+0000 7f90db142640 1 -- 172.21.15.5:0/2829217046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90d4106a80 msgr2=0x7f90d419cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:36:59.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.620+0000 7f90db142640 1 --2- 172.21.15.5:0/2829217046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90d4106a80 0x7f90d419cc00 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f90cc005e30 tx=0x7f90cc003ba0 comp rx=0 tx=0).stop 2024-09-11T23:36:59.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.620+0000 7f90db142640 1 -- 172.21.15.5:0/2829217046 shutdown_connections 2024-09-11T23:36:59.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.620+0000 7f90db142640 1 --2- 172.21.15.5:0/2829217046 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f90bc0a2c00 0x7f90bc0a50c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:59.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.620+0000 7f90db142640 1 --2- 172.21.15.5:0/2829217046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90d4106a80 0x7f90d419cc00 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:59.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.620+0000 7f90db142640 1 --2- 172.21.15.5:0/2829217046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90d4101420 0x7f90d4198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:59.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.620+0000 7f90db142640 1 --2- 172.21.15.5:0/2829217046 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90d4100a80 0x7f90d4198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:36:59.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.620+0000 7f90db142640 1 -- 172.21.15.5:0/2829217046 >> 172.21.15.5:0/2829217046 conn(0x7f90d40fc7a0 msgr2=0x7f90d406aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:36:59.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.621+0000 7f90db142640 1 -- 172.21.15.5:0/2829217046 shutdown_connections 2024-09-11T23:36:59.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:36:59.621+0000 7f90db142640 1 -- 172.21.15.5:0/2829217046 wait complete. 2024-09-11T23:36:59.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:59 smithi159 ceph-mon[34394]: pgmap v594: 97 pgs: 97 active+clean; 577 KiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:36:59.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:36:59 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/2829217046' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T23:36:59.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:59 smithi172 ceph-mon[34855]: pgmap v594: 97 pgs: 97 active+clean; 577 KiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:36:59.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:36:59 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/2829217046' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T23:36:59.937 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:59 smithi005 ceph-mon[31201]: pgmap v594: 97 pgs: 97 active+clean; 577 KiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:36:59.938 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:36:59 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/2829217046' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T23:37:00.284 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-11T23:37:00.547 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:37:00.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:37:00 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/2829217046' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T23:37:00.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:37:00 smithi172 ceph-mon[34855]: osdmap e91: 12 total, 12 up, 12 in 2024-09-11T23:37:00.918 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:37:00 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/2829217046' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T23:37:00.918 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:37:00 smithi005 ceph-mon[31201]: osdmap e91: 12 total, 12 up, 12 in 2024-09-11T23:37:01.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.006+0000 7f0dbcf48640 1 -- 172.21.15.5:0/677070679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0db8103660 msgr2=0x7f0db810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:37:01.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.006+0000 7f0dbcf48640 1 --2- 172.21.15.5:0/677070679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0db8103660 0x7f0db810bb50 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f0da0009900 tx=0x7f0da002a480 comp rx=0 tx=0).stop 2024-09-11T23:37:01.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.006+0000 7f0dbcf48640 1 -- 172.21.15.5:0/677070679 shutdown_connections 2024-09-11T23:37:01.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.006+0000 7f0dbcf48640 1 --2- 172.21.15.5:0/677070679 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0db810c170 0x7f0db810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:37:01.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.006+0000 7f0dbcf48640 1 --2- 172.21.15.5:0/677070679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0db8103660 0x7f0db810bb50 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:37:01.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.006+0000 7f0dbcf48640 1 --2- 172.21.15.5:0/677070679 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0db8102d40 0x7f0db8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:37:01.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.006+0000 7f0dbcf48640 1 -- 172.21.15.5:0/677070679 >> 172.21.15.5:0/677070679 conn(0x7f0db80fc7a0 msgr2=0x7f0db80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:37:01.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.007+0000 7f0dbcf48640 1 -- 172.21.15.5:0/677070679 shutdown_connections 2024-09-11T23:37:01.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.007+0000 7f0dbcf48640 1 -- 172.21.15.5:0/677070679 wait complete. 2024-09-11T23:37:01.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.007+0000 7f0dbcf48640 1 Processor -- start 2024-09-11T23:37:01.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.007+0000 7f0dbcf48640 1 -- start start 2024-09-11T23:37:01.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.007+0000 7f0dbcf48640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0db8102d40 0x7f0db81984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:37:01.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.007+0000 7f0dbcf48640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0db8103660 0x7f0db8198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:37:01.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.008+0000 7f0dbcf48640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0db810c170 0x7f0db819cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:37:01.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.008+0000 7f0dbcf48640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0db8111ee0 con 0x7f0db810c170 2024-09-11T23:37:01.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.008+0000 7f0dbcf48640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f0db8111d60 con 0x7f0db8102d40 2024-09-11T23:37:01.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.008+0000 7f0dbcf48640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0db8112060 con 0x7f0db8103660 2024-09-11T23:37:01.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.008+0000 7f0db6d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0db810c170 0x7f0db819cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:37:01.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.008+0000 7f0db6d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0db810c170 0x7f0db819cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38062/0 (socket says 172.21.15.5:38062) 2024-09-11T23:37:01.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.008+0000 7f0db6d9d640 1 -- 172.21.15.5:0/3863322228 learned_addr learned my addr 172.21.15.5:0/3863322228 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-11T23:37:01.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.008+0000 7f0daffff640 1 --2- 172.21.15.5:0/3863322228 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0db8103660 0x7f0db8198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:37:01.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.008+0000 7f0db659c640 1 --2- 172.21.15.5:0/3863322228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0db8102d40 0x7f0db81984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:37:01.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.008+0000 7f0db6d9d640 1 -- 172.21.15.5:0/3863322228 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0db8103660 msgr2=0x7f0db8198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:37:01.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.008+0000 7f0db6d9d640 1 --2- 172.21.15.5:0/3863322228 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0db8103660 0x7f0db8198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:37:01.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.008+0000 7f0db6d9d640 1 -- 172.21.15.5:0/3863322228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0db8102d40 msgr2=0x7f0db81984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:37:01.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.008+0000 7f0db6d9d640 1 --2- 172.21.15.5:0/3863322228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0db8102d40 0x7f0db81984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:37:01.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.008+0000 7f0db6d9d640 1 -- 172.21.15.5:0/3863322228 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0db819d490 con 0x7f0db810c170 2024-09-11T23:37:01.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.008+0000 7f0daffff640 1 --2- 172.21.15.5:0/3863322228 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0db8103660 0x7f0db8198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:37:01.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.008+0000 7f0db6d9d640 1 --2- 172.21.15.5:0/3863322228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0db810c170 0x7f0db819cdb0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0db000b970 tx=0x7f0db000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:37:01.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.008+0000 7f0daf7fe640 1 -- 172.21.15.5:0/3863322228 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db0019070 con 0x7f0db810c170 2024-09-11T23:37:01.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.008+0000 7f0daf7fe640 1 -- 172.21.15.5:0/3863322228 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0db0014440 con 0x7f0db810c170 2024-09-11T23:37:01.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.008+0000 7f0daf7fe640 1 -- 172.21.15.5:0/3863322228 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db00075d0 con 0x7f0db810c170 2024-09-11T23:37:01.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.008+0000 7f0dbcf48640 1 -- 172.21.15.5:0/3863322228 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0db819d780 con 0x7f0db810c170 2024-09-11T23:37:01.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.008+0000 7f0dbcf48640 1 -- 172.21.15.5:0/3863322228 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0db81a5060 con 0x7f0db810c170 2024-09-11T23:37:01.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.009+0000 7f0dbcf48640 1 -- 172.21.15.5:0/3863322228 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0db81031a0 con 0x7f0db810c170 2024-09-11T23:37:01.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.011+0000 7f0daf7fe640 1 -- 172.21.15.5:0/3863322228 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f0db001c070 con 0x7f0db810c170 2024-09-11T23:37:01.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.011+0000 7f0daf7fe640 1 --2- 172.21.15.5:0/3863322228 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f0da40a2c00 0x7f0da40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:37:01.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.011+0000 7f0db659c640 1 --2- 172.21.15.5:0/3863322228 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f0da40a2c00 0x7f0da40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:37:01.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.011+0000 7f0daf7fe640 1 -- 172.21.15.5:0/3863322228 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8324+0+0 (secure 0 0 0) 0x7f0db00ce690 con 0x7f0db810c170 2024-09-11T23:37:01.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.012+0000 7f0db659c640 1 --2- 172.21.15.5:0/3863322228 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f0da40a2c00 0x7f0da40a50c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0da8009890 tx=0x7f0da8008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:37:01.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.016+0000 7f0daf7fe640 1 -- 172.21.15.5:0/3863322228 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0db009b590 con 0x7f0db810c170 2024-09-11T23:37:01.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:37:00 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/2829217046' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T23:37:01.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:37:00 smithi159 ceph-mon[34394]: osdmap e91: 12 total, 12 up, 12 in 2024-09-11T23:37:01.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.192+0000 7f0dbcf48640 1 -- 172.21.15.5:0/3863322228 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0db8106c50 con 0x7f0db810c170 2024-09-11T23:37:01.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.635+0000 7f0daf7fe640 1 -- 172.21.15.5:0/3863322228 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v92) ==== 178+0+0 (secure 0 0 0) 0x7f0db009ae90 con 0x7f0db810c170 2024-09-11T23:37:01.635 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data_ec' removed 2024-09-11T23:37:01.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.639+0000 7f0dbcf48640 1 -- 172.21.15.5:0/3863322228 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f0da40a2c00 msgr2=0x7f0da40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:37:01.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.639+0000 7f0dbcf48640 1 --2- 172.21.15.5:0/3863322228 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f0da40a2c00 0x7f0da40a50c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0da8009890 tx=0x7f0da8008040 comp rx=0 tx=0).stop 2024-09-11T23:37:01.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.639+0000 7f0dbcf48640 1 -- 172.21.15.5:0/3863322228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0db810c170 msgr2=0x7f0db819cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:37:01.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.639+0000 7f0dbcf48640 1 --2- 172.21.15.5:0/3863322228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0db810c170 0x7f0db819cdb0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0db000b970 tx=0x7f0db000be30 comp rx=0 tx=0).stop 2024-09-11T23:37:01.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.639+0000 7f0dbcf48640 1 -- 172.21.15.5:0/3863322228 shutdown_connections 2024-09-11T23:37:01.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.639+0000 7f0dbcf48640 1 --2- 172.21.15.5:0/3863322228 >> [v2:172.21.15.5:6800/2285128668,v1:172.21.15.5:6801/2285128668] conn(0x7f0da40a2c00 0x7f0da40a50c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:37:01.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.639+0000 7f0dbcf48640 1 --2- 172.21.15.5:0/3863322228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0db810c170 0x7f0db819cdb0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:37:01.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.639+0000 7f0dbcf48640 1 --2- 172.21.15.5:0/3863322228 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0db8103660 0x7f0db8198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:37:01.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.639+0000 7f0dbcf48640 1 --2- 172.21.15.5:0/3863322228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0db8102d40 0x7f0db81984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:37:01.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.639+0000 7f0dbcf48640 1 -- 172.21.15.5:0/3863322228 >> 172.21.15.5:0/3863322228 conn(0x7f0db80fc7a0 msgr2=0x7f0db80fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:37:01.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.640+0000 7f0dbcf48640 1 -- 172.21.15.5:0/3863322228 shutdown_connections 2024-09-11T23:37:01.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-11T23:37:01.640+0000 7f0dbcf48640 1 -- 172.21.15.5:0/3863322228 wait complete. 2024-09-11T23:37:01.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:37:01 smithi172 ceph-mon[34855]: pgmap v596: 33 pgs: 33 active+clean; 577 KiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:37:01.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:37:01 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/3863322228' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T23:37:01.972 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:37:01 smithi005 ceph-mon[31201]: pgmap v596: 33 pgs: 33 active+clean; 577 KiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:37:01.972 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:37:01 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/3863322228' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T23:37:02.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:37:01 smithi159 ceph-mon[34394]: pgmap v596: 33 pgs: 33 active+clean; 577 KiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:37:02.127 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:37:01 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/3863322228' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T23:37:02.326 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T23:37:02.364 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T23:37:02.414 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T23:37:02.441 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-11T23:37:02.442 DEBUG:teuthology.orchestra.run.smithi005:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-11T23:37:02.459 DEBUG:teuthology.orchestra.run.smithi159:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-11T23:37:02.475 DEBUG:teuthology.orchestra.run.smithi172:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-11T23:37:02.497 INFO:tasks.cephadm:Stopping all daemons... 2024-09-11T23:37:02.497 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-11T23:37:02.498 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mon.a 2024-09-11T23:37:02.812 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:37:02 smithi005 systemd[1]: Stopping Ceph mon.a for 1f5284d2-7094-11ef-bcea-c7b262605968... 2024-09-11T23:37:02.813 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:37:02 smithi005 ceph-mon[31201]: from='client.? 172.21.15.5:0/3863322228' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T23:37:02.813 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:37:02 smithi005 ceph-mon[31201]: osdmap e92: 12 total, 12 up, 12 in 2024-09-11T23:37:02.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:37:02 smithi159 ceph-mon[34394]: from='client.? 172.21.15.5:0/3863322228' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T23:37:02.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:37:02 smithi159 ceph-mon[34394]: osdmap e92: 12 total, 12 up, 12 in 2024-09-11T23:37:02.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:37:02 smithi172 ceph-mon[34855]: from='client.? 172.21.15.5:0/3863322228' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T23:37:02.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:37:02 smithi172 ceph-mon[34855]: osdmap e92: 12 total, 12 up, 12 in 2024-09-11T23:37:03.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:37:02 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mon-a[31197]: 2024-09-11T23:37:02.812+0000 7f2588e07640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:37:03.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:37:02 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mon-a[31197]: 2024-09-11T23:37:02.812+0000 7f2588e07640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-11T23:37:03.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:37:02 smithi005 podman[107585]: 2024-09-11 23:37:02.853604264 +0000 UTC m=+0.161158892 container died f8f83307d57dcb8f61652927b80317f09ac50c2f2331f53e220e6a2d4b5248ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mon-a, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T23:37:03.478 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:37:03 smithi005 podman[107585]: 2024-09-11 23:37:03.296160421 +0000 UTC m=+0.603715048 container cleanup f8f83307d57dcb8f61652927b80317f09ac50c2f2331f53e220e6a2d4b5248ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mon-a, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-11T23:37:03.481 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:37:03 smithi005 bash[107585]: ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mon-a 2024-09-11T23:37:03.739 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mon.a.service' 2024-09-11T23:37:03.765 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:37:03 smithi005 podman[107598]: 2024-09-11 23:37:03.506230024 +0000 UTC m=+0.647833127 container remove f8f83307d57dcb8f61652927b80317f09ac50c2f2331f53e220e6a2d4b5248ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mon-a, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T23:37:03.766 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:37:03 smithi005 systemd[1]: ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-11T23:37:03.766 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:37:03 smithi005 systemd[1]: Stopped Ceph mon.a for 1f5284d2-7094-11ef-bcea-c7b262605968. 2024-09-11T23:37:03.766 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 11 23:37:03 smithi005 systemd[1]: ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mon.a.service: Consumed 17.390s CPU time. 2024-09-11T23:37:03.808 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:37:03.808 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-11T23:37:03.808 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-11T23:37:03.808 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mon.b 2024-09-11T23:37:04.126 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:37:03 smithi159 systemd[1]: Stopping Ceph mon.b for 1f5284d2-7094-11ef-bcea-c7b262605968... 2024-09-11T23:37:04.606 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:37:04 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mon-b[34390]: 2024-09-11T23:37:04.129+0000 7fe44d91e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:37:04.606 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:37:04 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mon-b[34390]: 2024-09-11T23:37:04.129+0000 7fe44d91e640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-11T23:37:04.606 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:37:04 smithi159 podman[68030]: 2024-09-11 23:37:04.282850709 +0000 UTC m=+0.272659363 container died 2ee6c08b90d30636097d9a14f91d56e45e214b46be666aadf0d021cb21f15053 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mon-b, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T23:37:04.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:37:04 smithi159 podman[68030]: 2024-09-11 23:37:04.697069083 +0000 UTC m=+0.686877732 container cleanup 2ee6c08b90d30636097d9a14f91d56e45e214b46be666aadf0d021cb21f15053 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mon-b, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T23:37:04.876 INFO:journalctl@ceph.mon.b.smithi159.stdout:Sep 11 23:37:04 smithi159 bash[68030]: ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mon-b 2024-09-11T23:37:05.129 DEBUG:teuthology.orchestra.run.smithi159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mon.b.service' 2024-09-11T23:37:05.180 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:37:05.181 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-11T23:37:05.181 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-11T23:37:05.181 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mon.c 2024-09-11T23:37:05.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:37:05 smithi172 systemd[1]: Stopping Ceph mon.c for 1f5284d2-7094-11ef-bcea-c7b262605968... 2024-09-11T23:37:06.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:37:05 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mon-c[34851]: 2024-09-11T23:37:05.715+0000 7f084bac6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:37:06.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:37:05 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mon-c[34851]: 2024-09-11T23:37:05.715+0000 7f084bac6640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-11T23:37:06.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:37:05 smithi172 podman[68711]: 2024-09-11 23:37:05.889706706 +0000 UTC m=+0.515800341 container died ed4a3eb32157b08aa3d5531f2d4cf525e5f726d569926d5e651e4ddf4bb3ff4a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mon-c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-09-11T23:37:06.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:37:06 smithi172 podman[68711]: 2024-09-11 23:37:06.399555563 +0000 UTC m=+1.025649185 container cleanup ed4a3eb32157b08aa3d5531f2d4cf525e5f726d569926d5e651e4ddf4bb3ff4a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mon-c, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T23:37:06.634 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:37:06 smithi172 bash[68711]: ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mon-c 2024-09-11T23:37:06.881 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mon.c.service' 2024-09-11T23:37:06.903 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:37:06 smithi172 podman[68723]: 2024-09-11 23:37:06.651226081 +0000 UTC m=+0.760099592 container remove ed4a3eb32157b08aa3d5531f2d4cf525e5f726d569926d5e651e4ddf4bb3ff4a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mon-c, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T23:37:06.903 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:37:06 smithi172 systemd[1]: ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mon.c.service: Deactivated successfully. 2024-09-11T23:37:06.903 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:37:06 smithi172 systemd[1]: Stopped Ceph mon.c for 1f5284d2-7094-11ef-bcea-c7b262605968. 2024-09-11T23:37:06.903 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 11 23:37:06 smithi172 systemd[1]: ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mon.c.service: Consumed 9.929s CPU time. 2024-09-11T23:37:06.929 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:37:06.929 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-11T23:37:06.929 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-11T23:37:06.929 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mgr.x 2024-09-11T23:37:07.224 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:37:06 smithi005 systemd[1]: Stopping Ceph mgr.x for 1f5284d2-7094-11ef-bcea-c7b262605968... 2024-09-11T23:37:07.693 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:37:07 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-11T23:37:07.269+0000 7fd60c5ae640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:37:07.693 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:37:07 smithi005 podman[107705]: 2024-09-11 23:37:07.300508265 +0000 UTC m=+0.166942677 container died f1f3982d8ecf61e3b84562188cee6073757ba396815981e6b339a6957f9b19c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-11T23:37:07.974 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:37:07 smithi005 podman[107705]: 2024-09-11 23:37:07.793258608 +0000 UTC m=+0.659693015 container cleanup f1f3982d8ecf61e3b84562188cee6073757ba396815981e6b339a6957f9b19c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-11T23:37:07.974 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 11 23:37:07 smithi005 bash[107705]: ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-x 2024-09-11T23:37:08.223 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mgr.x.service' 2024-09-11T23:37:08.259 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:37:08.259 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-11T23:37:08.259 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-11T23:37:08.259 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mgr.y 2024-09-11T23:37:08.605 INFO:journalctl@ceph.mgr.y.smithi159.stdout:Sep 11 23:37:08 smithi159 systemd[1]: Stopping Ceph mgr.y for 1f5284d2-7094-11ef-bcea-c7b262605968... 2024-09-11T23:37:08.877 INFO:journalctl@ceph.mgr.y.smithi159.stdout:Sep 11 23:37:08 smithi159 podman[68153]: 2024-09-11 23:37:08.606730252 +0000 UTC m=+0.143758903 container died cdfc321bcc95a731b951aa1f6dc71720115ee55b651615e92d791c4e3ba6d98c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T23:37:09.254 INFO:journalctl@ceph.mgr.y.smithi159.stdout:Sep 11 23:37:09 smithi159 podman[68153]: 2024-09-11 23:37:09.003116808 +0000 UTC m=+0.540145453 container cleanup cdfc321bcc95a731b951aa1f6dc71720115ee55b651615e92d791c4e3ba6d98c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0) 2024-09-11T23:37:09.254 INFO:journalctl@ceph.mgr.y.smithi159.stdout:Sep 11 23:37:09 smithi159 bash[68153]: ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-y 2024-09-11T23:37:09.425 DEBUG:teuthology.orchestra.run.smithi159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mgr.y.service' 2024-09-11T23:37:09.460 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:37:09.461 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-11T23:37:09.461 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-11T23:37:09.461 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mgr.z 2024-09-11T23:37:09.803 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 11 23:37:09 smithi172 systemd[1]: Stopping Ceph mgr.z for 1f5284d2-7094-11ef-bcea-c7b262605968... 2024-09-11T23:37:10.097 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 11 23:37:09 smithi172 podman[68836]: 2024-09-11 23:37:09.81692304 +0000 UTC m=+0.132974018 container died 6d4592a099c95e5dcb7028b7b33b17448f0991fb000f69db63d1ac1630aeee24 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-z, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-11T23:37:10.383 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 11 23:37:10 smithi172 podman[68836]: 2024-09-11 23:37:10.20534823 +0000 UTC m=+0.521399197 container cleanup 6d4592a099c95e5dcb7028b7b33b17448f0991fb000f69db63d1ac1630aeee24 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-z, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T23:37:10.384 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 11 23:37:10 smithi172 bash[68836]: ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-z 2024-09-11T23:37:10.820 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mgr.z.service' 2024-09-11T23:37:10.843 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 11 23:37:10 smithi172 podman[68850]: 2024-09-11 23:37:10.590444825 +0000 UTC m=+0.766001798 container remove 6d4592a099c95e5dcb7028b7b33b17448f0991fb000f69db63d1ac1630aeee24 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mgr-z, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-11T23:37:10.843 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 11 23:37:10 smithi172 systemd[1]: ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-09-11T23:37:10.843 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 11 23:37:10 smithi172 systemd[1]: ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mgr.z.service: Failed with result 'exit-code'. 2024-09-11T23:37:10.843 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 11 23:37:10 smithi172 systemd[1]: Stopped Ceph mgr.z for 1f5284d2-7094-11ef-bcea-c7b262605968. 2024-09-11T23:37:10.844 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 11 23:37:10 smithi172 systemd[1]: ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mgr.z.service: Consumed 6.511s CPU time. 2024-09-11T23:37:10.858 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:37:10.858 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-11T23:37:10.858 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-11T23:37:10.858 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-1f5284d2-7094-11ef-bcea-c7b262605968@osd.0 2024-09-11T23:37:11.190 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 11 23:37:10 smithi005 systemd[1]: Stopping Ceph osd.0 for 1f5284d2-7094-11ef-bcea-c7b262605968... 2024-09-11T23:37:11.474 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 11 23:37:11 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-0[44749]: 2024-09-11T23:37:11.190+0000 7f6840838640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:37:11.474 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 11 23:37:11 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-0[44749]: 2024-09-11T23:37:11.190+0000 7f6840838640 -1 osd.0 92 *** Got signal Terminated *** 2024-09-11T23:37:11.474 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 11 23:37:11 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-0[44749]: 2024-09-11T23:37:11.190+0000 7f6840838640 -1 osd.0 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T23:37:17.057 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 11 23:37:16 smithi005 podman[107827]: 2024-09-11 23:37:16.751720422 +0000 UTC m=+5.697811162 container died 8ff4210548e91318cb497b08b277187c009f1a20e93134eb50cb9c1630e1474c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-11T23:37:17.425 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 11 23:37:17 smithi005 podman[107827]: 2024-09-11 23:37:17.157318028 +0000 UTC m=+6.103408768 container cleanup 8ff4210548e91318cb497b08b277187c009f1a20e93134eb50cb9c1630e1474c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-11T23:37:17.425 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 11 23:37:17 smithi005 bash[107827]: ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-0 2024-09-11T23:37:17.724 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 11 23:37:17 smithi005 podman[107844]: 2024-09-11 23:37:17.425915257 +0000 UTC m=+0.669039954 container remove 8ff4210548e91318cb497b08b277187c009f1a20e93134eb50cb9c1630e1474c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T23:37:18.070 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 11 23:37:17 smithi005 podman[107933]: 2024-09-11 23:37:17.697375764 +0000 UTC m=+0.016146415 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:37:18.070 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 11 23:37:17 smithi005 podman[107933]: 2024-09-11 23:37:17.818718168 +0000 UTC m=+0.137488808 container create 83b5812aa9ffdc6732ad7474b73f4129d7f673a70e6d3671fa795d9d1c8b31ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3) 2024-09-11T23:37:18.070 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 11 23:37:18 smithi005 podman[107933]: 2024-09-11 23:37:18.071222064 +0000 UTC m=+0.389992703 container init 83b5812aa9ffdc6732ad7474b73f4129d7f673a70e6d3671fa795d9d1c8b31ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-0-deactivate, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True) 2024-09-11T23:37:18.474 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 11 23:37:18 smithi005 podman[107933]: 2024-09-11 23:37:18.074786428 +0000 UTC m=+0.393557067 container start 83b5812aa9ffdc6732ad7474b73f4129d7f673a70e6d3671fa795d9d1c8b31ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-0-deactivate, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-11T23:37:18.474 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 11 23:37:18 smithi005 podman[107933]: 2024-09-11 23:37:18.163216087 +0000 UTC m=+0.481986741 container attach 83b5812aa9ffdc6732ad7474b73f4129d7f673a70e6d3671fa795d9d1c8b31ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T23:37:18.474 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 11 23:37:18 smithi005 podman[107933]: 2024-09-11 23:37:18.279539174 +0000 UTC m=+0.598309821 container died 83b5812aa9ffdc6732ad7474b73f4129d7f673a70e6d3671fa795d9d1c8b31ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-11T23:37:19.124 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@osd.0.service' 2024-09-11T23:37:19.165 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:37:19.166 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-11T23:37:19.166 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-11T23:37:19.166 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ceph-1f5284d2-7094-11ef-bcea-c7b262605968@osd.1 2024-09-11T23:37:19.500 INFO:journalctl@ceph.osd.1.smithi159.stdout:Sep 11 23:37:19 smithi159 systemd[1]: Stopping Ceph osd.1 for 1f5284d2-7094-11ef-bcea-c7b262605968... 2024-09-11T23:37:19.876 INFO:journalctl@ceph.osd.1.smithi159.stdout:Sep 11 23:37:19 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-1[38852]: 2024-09-11T23:37:19.499+0000 7f96f6b0b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:37:19.876 INFO:journalctl@ceph.osd.1.smithi159.stdout:Sep 11 23:37:19 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-1[38852]: 2024-09-11T23:37:19.499+0000 7f96f6b0b640 -1 osd.1 92 *** Got signal Terminated *** 2024-09-11T23:37:19.876 INFO:journalctl@ceph.osd.1.smithi159.stdout:Sep 11 23:37:19 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-1[38852]: 2024-09-11T23:37:19.499+0000 7f96f6b0b640 -1 osd.1 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T23:37:25.250 INFO:journalctl@ceph.osd.1.smithi159.stdout:Sep 11 23:37:24 smithi159 podman[68290]: 2024-09-11 23:37:24.951097792 +0000 UTC m=+5.578749688 container died 99c9ffbd3395d9b3519a86796929e08536a7c09fe7aa613ba2cd6dec34beaa20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-1, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-11T23:37:25.569 INFO:journalctl@ceph.osd.1.smithi159.stdout:Sep 11 23:37:25 smithi159 podman[68290]: 2024-09-11 23:37:25.341936562 +0000 UTC m=+5.969588447 container cleanup 99c9ffbd3395d9b3519a86796929e08536a7c09fe7aa613ba2cd6dec34beaa20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-1, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T23:37:25.569 INFO:journalctl@ceph.osd.1.smithi159.stdout:Sep 11 23:37:25 smithi159 bash[68290]: ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-1 2024-09-11T23:37:25.876 INFO:journalctl@ceph.osd.1.smithi159.stdout:Sep 11 23:37:25 smithi159 podman[68305]: 2024-09-11 23:37:25.568195661 +0000 UTC m=+0.612168650 container remove 99c9ffbd3395d9b3519a86796929e08536a7c09fe7aa613ba2cd6dec34beaa20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-1, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731) 2024-09-11T23:37:26.246 INFO:journalctl@ceph.osd.1.smithi159.stdout:Sep 11 23:37:25 smithi159 podman[68396]: 2024-09-11 23:37:25.871477854 +0000 UTC m=+0.016207367 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:37:26.246 INFO:journalctl@ceph.osd.1.smithi159.stdout:Sep 11 23:37:26 smithi159 podman[68396]: 2024-09-11 23:37:26.002452882 +0000 UTC m=+0.147182381 container create 81a322c30a85d90eb1b61efb544de726ec084e6a710bf47e36c8334f53d85bac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-11T23:37:26.247 INFO:journalctl@ceph.osd.1.smithi159.stdout:Sep 11 23:37:26 smithi159 podman[68396]: 2024-09-11 23:37:26.247275929 +0000 UTC m=+0.392005429 container init 81a322c30a85d90eb1b61efb544de726ec084e6a710bf47e36c8334f53d85bac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-11T23:37:26.626 INFO:journalctl@ceph.osd.1.smithi159.stdout:Sep 11 23:37:26 smithi159 podman[68396]: 2024-09-11 23:37:26.250777893 +0000 UTC m=+0.395507398 container start 81a322c30a85d90eb1b61efb544de726ec084e6a710bf47e36c8334f53d85bac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-11T23:37:26.626 INFO:journalctl@ceph.osd.1.smithi159.stdout:Sep 11 23:37:26 smithi159 podman[68396]: 2024-09-11 23:37:26.38901693 +0000 UTC m=+0.533746572 container attach 81a322c30a85d90eb1b61efb544de726ec084e6a710bf47e36c8334f53d85bac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-11T23:37:26.626 INFO:journalctl@ceph.osd.1.smithi159.stdout:Sep 11 23:37:26 smithi159 podman[68396]: 2024-09-11 23:37:26.440187498 +0000 UTC m=+0.584917003 container died 81a322c30a85d90eb1b61efb544de726ec084e6a710bf47e36c8334f53d85bac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-11T23:37:27.099 DEBUG:teuthology.orchestra.run.smithi159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@osd.1.service' 2024-09-11T23:37:27.139 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:37:27.139 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-11T23:37:27.139 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-11T23:37:27.139 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-1f5284d2-7094-11ef-bcea-c7b262605968@osd.2 2024-09-11T23:37:27.485 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 11 23:37:27 smithi172 systemd[1]: Stopping Ceph osd.2 for 1f5284d2-7094-11ef-bcea-c7b262605968... 2024-09-11T23:37:27.884 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 11 23:37:27 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-2[39800]: 2024-09-11T23:37:27.484+0000 7f63fddea640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:37:27.884 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 11 23:37:27 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-2[39800]: 2024-09-11T23:37:27.484+0000 7f63fddea640 -1 osd.2 92 *** Got signal Terminated *** 2024-09-11T23:37:27.884 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 11 23:37:27 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-2[39800]: 2024-09-11T23:37:27.484+0000 7f63fddea640 -1 osd.2 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T23:37:33.310 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 11 23:37:33 smithi172 podman[68974]: 2024-09-11 23:37:33.002108517 +0000 UTC m=+5.657471811 container died d659cb011028da4f8128be097cdbc5e7e59e8709fd2618cac5144fb21ca54d59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-11T23:37:33.634 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 11 23:37:33 smithi172 podman[68974]: 2024-09-11 23:37:33.393123159 +0000 UTC m=+6.048486495 container cleanup d659cb011028da4f8128be097cdbc5e7e59e8709fd2618cac5144fb21ca54d59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T23:37:33.634 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 11 23:37:33 smithi172 bash[68974]: ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-2 2024-09-11T23:37:34.009 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 11 23:37:33 smithi172 podman[68989]: 2024-09-11 23:37:33.661366485 +0000 UTC m=+0.655021365 container remove d659cb011028da4f8128be097cdbc5e7e59e8709fd2618cac5144fb21ca54d59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-11T23:37:34.347 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 11 23:37:34 smithi172 podman[69078]: 2024-09-11 23:37:33.913194727 +0000 UTC m=+0.016337533 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:37:34.347 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 11 23:37:34 smithi172 podman[69078]: 2024-09-11 23:37:34.028827162 +0000 UTC m=+0.131970001 container create 3e85457b387e0727cff37149165ed8848def34566167448c9c9c38e181407047 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-11T23:37:34.347 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 11 23:37:34 smithi172 podman[69078]: 2024-09-11 23:37:34.256608547 +0000 UTC m=+0.359751343 container init 3e85457b387e0727cff37149165ed8848def34566167448c9c9c38e181407047 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-11T23:37:34.347 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 11 23:37:34 smithi172 podman[69078]: 2024-09-11 23:37:34.26004426 +0000 UTC m=+0.363187057 container start 3e85457b387e0727cff37149165ed8848def34566167448c9c9c38e181407047 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-11T23:37:34.347 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 11 23:37:34 smithi172 podman[69078]: 2024-09-11 23:37:34.348200172 +0000 UTC m=+0.451342969 container attach 3e85457b387e0727cff37149165ed8848def34566167448c9c9c38e181407047 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-11T23:37:34.634 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 11 23:37:34 smithi172 podman[69078]: 2024-09-11 23:37:34.455388615 +0000 UTC m=+0.558531412 container died 3e85457b387e0727cff37149165ed8848def34566167448c9c9c38e181407047 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-11T23:37:35.121 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@osd.2.service' 2024-09-11T23:37:35.160 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:37:35.161 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-11T23:37:35.161 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-11T23:37:35.161 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-1f5284d2-7094-11ef-bcea-c7b262605968@osd.3 2024-09-11T23:37:35.474 INFO:journalctl@ceph.osd.3.smithi005.stdout:Sep 11 23:37:35 smithi005 systemd[1]: Stopping Ceph osd.3 for 1f5284d2-7094-11ef-bcea-c7b262605968... 2024-09-11T23:37:35.974 INFO:journalctl@ceph.osd.3.smithi005.stdout:Sep 11 23:37:35 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-3[51482]: 2024-09-11T23:37:35.486+0000 7f01a7972640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:37:35.974 INFO:journalctl@ceph.osd.3.smithi005.stdout:Sep 11 23:37:35 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-3[51482]: 2024-09-11T23:37:35.487+0000 7f01a7972640 -1 osd.3 92 *** Got signal Terminated *** 2024-09-11T23:37:35.974 INFO:journalctl@ceph.osd.3.smithi005.stdout:Sep 11 23:37:35 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-3[51482]: 2024-09-11T23:37:35.487+0000 7f01a7972640 -1 osd.3 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T23:37:37.724 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:37:37 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:37:37.433+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:37:38.724 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:37:38 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:37:38.447+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:37:39.224 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:37:38 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:37:38.798+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.834025+0000 front 2024-09-11T23:37:12.834061+0000 (oldest deadline 2024-09-11T23:37:38.134145+0000) 2024-09-11T23:37:39.384 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 11 23:37:39 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-5[46216]: 2024-09-11T23:37:39.120+0000 7f2004e1c640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.200320+0000 front 2024-09-11T23:37:14.200397+0000 (oldest deadline 2024-09-11T23:37:38.300428+0000) 2024-09-11T23:37:39.724 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:37:39 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:37:39.404+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:37:39.883 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:37:39 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:37:39.542+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:37:40.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:37:39 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:37:39.772+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:37:40.224 INFO:journalctl@ceph.osd.3.smithi005.stdout:Sep 11 23:37:39 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-3[51482]: 2024-09-11T23:37:39.991+0000 7f019ff80640 -1 osd.3 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.464090+0000 front 2024-09-11T23:37:15.464123+0000 (oldest deadline 2024-09-11T23:37:39.564244+0000) 2024-09-11T23:37:40.224 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:37:39 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:37:39.842+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.834025+0000 front 2024-09-11T23:37:12.834061+0000 (oldest deadline 2024-09-11T23:37:38.134145+0000) 2024-09-11T23:37:40.384 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 11 23:37:40 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-5[46216]: 2024-09-11T23:37:40.093+0000 7f2004e1c640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.200320+0000 front 2024-09-11T23:37:14.200397+0000 (oldest deadline 2024-09-11T23:37:38.300428+0000) 2024-09-11T23:37:40.384 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:37:40 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:37:40.315+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:13.834417+0000 front 2024-09-11T23:37:13.834333+0000 (oldest deadline 2024-09-11T23:37:39.734317+0000) 2024-09-11T23:37:40.724 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:37:40 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:37:40.392+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:37:40.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:37:40 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:37:40.512+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:37:41.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:37:40 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:37:40.792+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:37:41.163 INFO:journalctl@ceph.osd.3.smithi005.stdout:Sep 11 23:37:40 smithi005 podman[108053]: 2024-09-11 23:37:40.874128599 +0000 UTC m=+5.508217525 container died ebb09251c091f676549cd86dadea144d84f7eb43b708e566850c3fa55ef47609 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-3, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-11T23:37:41.163 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:37:40 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:37:40.873+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.834025+0000 front 2024-09-11T23:37:12.834061+0000 (oldest deadline 2024-09-11T23:37:38.134145+0000) 2024-09-11T23:37:41.383 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:37:41 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:37:41.267+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:13.834417+0000 front 2024-09-11T23:37:13.834333+0000 (oldest deadline 2024-09-11T23:37:39.734317+0000) 2024-09-11T23:37:41.384 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 11 23:37:41 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-5[46216]: 2024-09-11T23:37:41.066+0000 7f2004e1c640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.200320+0000 front 2024-09-11T23:37:14.200397+0000 (oldest deadline 2024-09-11T23:37:38.300428+0000) 2024-09-11T23:37:41.474 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:37:41 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:37:41.377+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:37:41.474 INFO:journalctl@ceph.osd.3.smithi005.stdout:Sep 11 23:37:41 smithi005 podman[108053]: 2024-09-11 23:37:41.246446585 +0000 UTC m=+5.880535509 container cleanup ebb09251c091f676549cd86dadea144d84f7eb43b708e566850c3fa55ef47609 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-3, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-11T23:37:41.474 INFO:journalctl@ceph.osd.3.smithi005.stdout:Sep 11 23:37:41 smithi005 bash[108053]: ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-3 2024-09-11T23:37:41.861 INFO:journalctl@ceph.osd.3.smithi005.stdout:Sep 11 23:37:41 smithi005 podman[108069]: 2024-09-11 23:37:41.531513452 +0000 UTC m=+0.655934812 container remove ebb09251c091f676549cd86dadea144d84f7eb43b708e566850c3fa55ef47609 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-3, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-11T23:37:41.883 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:37:41 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:37:41.505+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:37:42.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:37:41 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:37:41.767+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:37:42.142 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:37:41 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:37:41.861+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.834025+0000 front 2024-09-11T23:37:12.834061+0000 (oldest deadline 2024-09-11T23:37:38.134145+0000) 2024-09-11T23:37:42.142 INFO:journalctl@ceph.osd.3.smithi005.stdout:Sep 11 23:37:41 smithi005 podman[108159]: 2024-09-11 23:37:41.779693597 +0000 UTC m=+0.016583047 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:37:42.142 INFO:journalctl@ceph.osd.3.smithi005.stdout:Sep 11 23:37:41 smithi005 podman[108159]: 2024-09-11 23:37:41.899082615 +0000 UTC m=+0.135972108 container create e591581add9c0d47d3689c22ddadab0b6f36bb4894efd5bd19cafcc6578d3467 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T23:37:42.384 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 11 23:37:42 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-5[46216]: 2024-09-11T23:37:42.034+0000 7f2004e1c640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.200320+0000 front 2024-09-11T23:37:14.200397+0000 (oldest deadline 2024-09-11T23:37:38.300428+0000) 2024-09-11T23:37:42.384 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:37:42 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:37:42.267+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:13.834417+0000 front 2024-09-11T23:37:13.834333+0000 (oldest deadline 2024-09-11T23:37:39.734317+0000) 2024-09-11T23:37:42.402 INFO:journalctl@ceph.osd.3.smithi005.stdout:Sep 11 23:37:42 smithi005 podman[108159]: 2024-09-11 23:37:42.143293814 +0000 UTC m=+0.380183262 container init e591581add9c0d47d3689c22ddadab0b6f36bb4894efd5bd19cafcc6578d3467 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-11T23:37:42.402 INFO:journalctl@ceph.osd.3.smithi005.stdout:Sep 11 23:37:42 smithi005 podman[108159]: 2024-09-11 23:37:42.146765964 +0000 UTC m=+0.383655411 container start e591581add9c0d47d3689c22ddadab0b6f36bb4894efd5bd19cafcc6578d3467 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-11T23:37:42.402 INFO:journalctl@ceph.osd.3.smithi005.stdout:Sep 11 23:37:42 smithi005 podman[108159]: 2024-09-11 23:37:42.23507592 +0000 UTC m=+0.471965378 container attach e591581add9c0d47d3689c22ddadab0b6f36bb4894efd5bd19cafcc6578d3467 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T23:37:42.403 INFO:journalctl@ceph.osd.3.smithi005.stdout:Sep 11 23:37:42 smithi005 podman[108159]: 2024-09-11 23:37:42.340315587 +0000 UTC m=+0.577205035 container died e591581add9c0d47d3689c22ddadab0b6f36bb4894efd5bd19cafcc6578d3467 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-3-deactivate, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-11T23:37:42.724 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:37:42 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:37:42.402+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:37:42.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:37:42 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:37:42.501+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:37:42.904 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@osd.3.service' 2024-09-11T23:37:42.987 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:37:42.987 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-11T23:37:42.987 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-11T23:37:42.987 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ceph-1f5284d2-7094-11ef-bcea-c7b262605968@osd.4 2024-09-11T23:37:43.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:37:42 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:37:42.815+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:37:43.126 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 11 23:37:43 smithi159 systemd[1]: Stopping Ceph osd.4 for 1f5284d2-7094-11ef-bcea-c7b262605968... 2024-09-11T23:37:43.224 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:37:42 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:37:42.855+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.834025+0000 front 2024-09-11T23:37:12.834061+0000 (oldest deadline 2024-09-11T23:37:38.134145+0000) 2024-09-11T23:37:43.384 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:37:43 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:37:43.223+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:13.834417+0000 front 2024-09-11T23:37:13.834333+0000 (oldest deadline 2024-09-11T23:37:39.734317+0000) 2024-09-11T23:37:43.384 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 11 23:37:43 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-5[46216]: 2024-09-11T23:37:43.029+0000 7f2004e1c640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.200320+0000 front 2024-09-11T23:37:14.200397+0000 (oldest deadline 2024-09-11T23:37:38.300428+0000) 2024-09-11T23:37:43.724 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:37:43 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:37:43.398+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:37:43.876 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:37:43 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:37:43.768+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:37:43.876 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 11 23:37:43 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-4[45422]: 2024-09-11T23:37:43.596+0000 7f03537ef640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:37:43.876 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 11 23:37:43 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-4[45422]: 2024-09-11T23:37:43.596+0000 7f03537ef640 -1 osd.4 92 *** Got signal Terminated *** 2024-09-11T23:37:43.876 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 11 23:37:43 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-4[45422]: 2024-09-11T23:37:43.596+0000 7f03537ef640 -1 osd.4 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T23:37:43.883 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:37:43 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:37:43.495+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:37:44.224 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:37:43 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:37:43.854+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.834025+0000 front 2024-09-11T23:37:12.834061+0000 (oldest deadline 2024-09-11T23:37:38.134145+0000) 2024-09-11T23:37:44.270 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 11 23:37:44 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-5[46216]: 2024-09-11T23:37:44.006+0000 7f2004e1c640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.200320+0000 front 2024-09-11T23:37:14.200397+0000 (oldest deadline 2024-09-11T23:37:38.300428+0000) 2024-09-11T23:37:44.528 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:37:44 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:37:44.271+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:13.834417+0000 front 2024-09-11T23:37:13.834333+0000 (oldest deadline 2024-09-11T23:37:39.734317+0000) 2024-09-11T23:37:44.724 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:37:44 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:37:44.384+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:37:44.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:37:44 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:37:44.528+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:37:45.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:37:44 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:37:44.765+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:37:45.224 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:37:44 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:37:44.815+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.834025+0000 front 2024-09-11T23:37:12.834061+0000 (oldest deadline 2024-09-11T23:37:38.134145+0000) 2024-09-11T23:37:45.309 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 11 23:37:44 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-5[46216]: 2024-09-11T23:37:44.993+0000 7f2004e1c640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.200320+0000 front 2024-09-11T23:37:14.200397+0000 (oldest deadline 2024-09-11T23:37:38.300428+0000) 2024-09-11T23:37:45.634 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:37:45 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:37:45.532+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:37:45.634 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:37:45 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:37:45.310+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:13.834417+0000 front 2024-09-11T23:37:13.834333+0000 (oldest deadline 2024-09-11T23:37:39.734317+0000) 2024-09-11T23:37:45.724 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:37:45 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:37:45.352+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:37:46.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:37:45 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:37:45.745+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:37:46.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:37:45 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:37:45.745+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:37:46.224 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:37:45 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:37:45.830+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.834025+0000 front 2024-09-11T23:37:12.834061+0000 (oldest deadline 2024-09-11T23:37:38.134145+0000) 2024-09-11T23:37:46.271 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 11 23:37:45 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-5[46216]: 2024-09-11T23:37:45.998+0000 7f2004e1c640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.200320+0000 front 2024-09-11T23:37:14.200397+0000 (oldest deadline 2024-09-11T23:37:38.300428+0000) 2024-09-11T23:37:46.536 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:37:46 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:37:46.272+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:13.834417+0000 front 2024-09-11T23:37:13.834333+0000 (oldest deadline 2024-09-11T23:37:39.734317+0000) 2024-09-11T23:37:46.724 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:37:46 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:37:46.362+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:37:46.876 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 11 23:37:46 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-4[45422]: 2024-09-11T23:37:46.558+0000 7f034fe05640 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.965671+0000 front 2024-09-11T23:37:22.965832+0000 (oldest deadline 2024-09-11T23:37:45.865775+0000) 2024-09-11T23:37:46.876 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:37:46 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:37:46.701+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:37:46.876 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:37:46 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:37:46.701+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:37:46.883 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:37:46 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:37:46.537+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:37:47.224 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:37:46 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:37:46.831+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.834025+0000 front 2024-09-11T23:37:12.834061+0000 (oldest deadline 2024-09-11T23:37:38.134145+0000) 2024-09-11T23:37:47.376 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:37:46 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:37:46.929+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.226339+0000 front 2024-09-11T23:37:22.226512+0000 (oldest deadline 2024-09-11T23:37:46.326534+0000) 2024-09-11T23:37:47.383 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 11 23:37:47 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-5[46216]: 2024-09-11T23:37:47.018+0000 7f2004e1c640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.200320+0000 front 2024-09-11T23:37:14.200397+0000 (oldest deadline 2024-09-11T23:37:38.300428+0000) 2024-09-11T23:37:47.384 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:37:47 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:37:47.267+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:13.834417+0000 front 2024-09-11T23:37:13.834333+0000 (oldest deadline 2024-09-11T23:37:39.734317+0000) 2024-09-11T23:37:47.724 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:37:47 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:37:47.347+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:37:47.876 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 11 23:37:47 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-4[45422]: 2024-09-11T23:37:47.513+0000 7f034fe05640 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.965671+0000 front 2024-09-11T23:37:22.965832+0000 (oldest deadline 2024-09-11T23:37:45.865775+0000) 2024-09-11T23:37:47.876 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:37:47 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:37:47.731+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:37:47.876 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:37:47 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:37:47.731+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:37:47.883 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:37:47 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:37:47.511+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:37:48.224 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:37:47 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:37:47.824+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.834025+0000 front 2024-09-11T23:37:12.834061+0000 (oldest deadline 2024-09-11T23:37:38.134145+0000) 2024-09-11T23:37:48.235 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 11 23:37:47 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-5[46216]: 2024-09-11T23:37:47.977+0000 7f2004e1c640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.200320+0000 front 2024-09-11T23:37:14.200397+0000 (oldest deadline 2024-09-11T23:37:38.300428+0000) 2024-09-11T23:37:48.376 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:37:47 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:37:47.944+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.226339+0000 front 2024-09-11T23:37:22.226512+0000 (oldest deadline 2024-09-11T23:37:46.326534+0000) 2024-09-11T23:37:48.507 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:37:48 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:37:48.236+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:13.834417+0000 front 2024-09-11T23:37:13.834333+0000 (oldest deadline 2024-09-11T23:37:39.734317+0000) 2024-09-11T23:37:48.724 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:37:48 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:37:48.347+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:37:48.724 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:37:48 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:37:48.347+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:21.854620+0000 front 2024-09-11T23:37:21.854475+0000 (oldest deadline 2024-09-11T23:37:47.754591+0000) 2024-09-11T23:37:48.876 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 11 23:37:48 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-4[45422]: 2024-09-11T23:37:48.549+0000 7f034fe05640 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.965671+0000 front 2024-09-11T23:37:22.965832+0000 (oldest deadline 2024-09-11T23:37:45.865775+0000) 2024-09-11T23:37:48.876 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:37:48 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:37:48.714+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:37:48.876 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:37:48 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:37:48.714+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:37:48.883 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:37:48 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:37:48.508+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:37:48.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:37:48 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:37:48.508+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:37:49.224 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:37:48 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:37:48.861+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.834025+0000 front 2024-09-11T23:37:12.834061+0000 (oldest deadline 2024-09-11T23:37:38.134145+0000) 2024-09-11T23:37:49.224 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:37:48 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:37:48.861+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:24.436485+0000 front 2024-09-11T23:37:24.436378+0000 (oldest deadline 2024-09-11T23:37:47.936355+0000) 2024-09-11T23:37:49.376 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 11 23:37:49 smithi159 podman[68511]: 2024-09-11 23:37:49.144720032 +0000 UTC m=+5.959152837 container died f04068ec645d5dbe6e57e9c59afc801c3e310cbba5428d34907b8fbc3c87704c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T23:37:49.377 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:37:48 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:37:48.939+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.226339+0000 front 2024-09-11T23:37:22.226512+0000 (oldest deadline 2024-09-11T23:37:46.326534+0000) 2024-09-11T23:37:49.383 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 11 23:37:49 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-5[46216]: 2024-09-11T23:37:49.018+0000 7f2004e1c640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.200320+0000 front 2024-09-11T23:37:14.200397+0000 (oldest deadline 2024-09-11T23:37:38.300428+0000) 2024-09-11T23:37:49.384 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:37:49 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:37:49.198+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:13.834417+0000 front 2024-09-11T23:37:13.834333+0000 (oldest deadline 2024-09-11T23:37:39.734317+0000) 2024-09-11T23:37:49.724 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:37:49 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:37:49.361+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:37:49.724 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:37:49 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:37:49.361+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:21.854620+0000 front 2024-09-11T23:37:21.854475+0000 (oldest deadline 2024-09-11T23:37:47.754591+0000) 2024-09-11T23:37:49.748 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 11 23:37:49 smithi159 podman[68511]: 2024-09-11 23:37:49.521037794 +0000 UTC m=+6.335470591 container cleanup f04068ec645d5dbe6e57e9c59afc801c3e310cbba5428d34907b8fbc3c87704c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-4, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-11T23:37:49.748 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 11 23:37:49 smithi159 bash[68511]: ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-4 2024-09-11T23:37:49.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:37:49 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:37:49.530+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:37:49.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:37:49 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:37:49.530+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:37:50.097 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:37:49 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:37:49.904+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.226339+0000 front 2024-09-11T23:37:22.226512+0000 (oldest deadline 2024-09-11T23:37:46.326534+0000) 2024-09-11T23:37:50.097 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 11 23:37:49 smithi159 podman[68528]: 2024-09-11 23:37:49.772349485 +0000 UTC m=+0.625653874 container remove f04068ec645d5dbe6e57e9c59afc801c3e310cbba5428d34907b8fbc3c87704c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-11T23:37:50.097 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:37:49 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:37:49.748+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:37:50.097 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:37:49 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:37:49.748+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:37:50.224 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:37:49 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:37:49.850+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.834025+0000 front 2024-09-11T23:37:12.834061+0000 (oldest deadline 2024-09-11T23:37:38.134145+0000) 2024-09-11T23:37:50.224 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:37:49 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:37:49.850+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:24.436485+0000 front 2024-09-11T23:37:24.436378+0000 (oldest deadline 2024-09-11T23:37:47.936355+0000) 2024-09-11T23:37:50.376 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 11 23:37:50 smithi159 podman[68616]: 2024-09-11 23:37:50.09816844 +0000 UTC m=+0.113084666 container create 879e890505688f0be4423edf4930be441a9ac237f7e367b33adbc8314d39bb1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T23:37:50.376 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 11 23:37:50 smithi159 podman[68616]: 2024-09-11 23:37:50.001090008 +0000 UTC m=+0.016006242 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:37:50.376 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 11 23:37:50 smithi159 podman[68616]: 2024-09-11 23:37:50.334183143 +0000 UTC m=+0.349099383 container init 879e890505688f0be4423edf4930be441a9ac237f7e367b33adbc8314d39bb1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-11T23:37:50.376 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 11 23:37:50 smithi159 podman[68616]: 2024-09-11 23:37:50.337784405 +0000 UTC m=+0.352700631 container start 879e890505688f0be4423edf4930be441a9ac237f7e367b33adbc8314d39bb1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-11T23:37:50.383 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 11 23:37:50 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-5[46216]: 2024-09-11T23:37:50.017+0000 7f2004e1c640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.200320+0000 front 2024-09-11T23:37:14.200397+0000 (oldest deadline 2024-09-11T23:37:38.300428+0000) 2024-09-11T23:37:50.384 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:37:50 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:37:50.195+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:13.834417+0000 front 2024-09-11T23:37:13.834333+0000 (oldest deadline 2024-09-11T23:37:39.734317+0000) 2024-09-11T23:37:50.724 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:37:50 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:37:50.372+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:37:50.724 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:37:50 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:37:50.372+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:21.854620+0000 front 2024-09-11T23:37:21.854475+0000 (oldest deadline 2024-09-11T23:37:47.754591+0000) 2024-09-11T23:37:50.782 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 11 23:37:50 smithi159 podman[68616]: 2024-09-11 23:37:50.451315221 +0000 UTC m=+0.466231463 container attach 879e890505688f0be4423edf4930be441a9ac237f7e367b33adbc8314d39bb1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-4-deactivate, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-11T23:37:50.783 INFO:journalctl@ceph.osd.4.smithi159.stdout:Sep 11 23:37:50 smithi159 podman[68616]: 2024-09-11 23:37:50.528209563 +0000 UTC m=+0.543125789 container died 879e890505688f0be4423edf4930be441a9ac237f7e367b33adbc8314d39bb1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-11T23:37:50.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:37:50 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:37:50.558+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:37:50.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:37:50 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:37:50.558+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:37:51.126 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:37:50 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:37:50.899+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.226339+0000 front 2024-09-11T23:37:22.226512+0000 (oldest deadline 2024-09-11T23:37:46.326534+0000) 2024-09-11T23:37:51.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:37:50 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:37:50.782+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:37:51.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:37:50 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:37:50.782+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:37:51.214 DEBUG:teuthology.orchestra.run.smithi159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@osd.4.service' 2024-09-11T23:37:51.224 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:37:50 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:37:50.839+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.834025+0000 front 2024-09-11T23:37:12.834061+0000 (oldest deadline 2024-09-11T23:37:38.134145+0000) 2024-09-11T23:37:51.224 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:37:50 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:37:50.839+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:24.436485+0000 front 2024-09-11T23:37:24.436378+0000 (oldest deadline 2024-09-11T23:37:47.936355+0000) 2024-09-11T23:37:51.257 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:37:51.257 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-11T23:37:51.257 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-11T23:37:51.258 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-1f5284d2-7094-11ef-bcea-c7b262605968@osd.5 2024-09-11T23:37:51.285 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:37:51 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:37:51.175+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:13.834417+0000 front 2024-09-11T23:37:13.834333+0000 (oldest deadline 2024-09-11T23:37:39.734317+0000) 2024-09-11T23:37:51.286 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 11 23:37:50 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-5[46216]: 2024-09-11T23:37:50.996+0000 7f2004e1c640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.200320+0000 front 2024-09-11T23:37:14.200397+0000 (oldest deadline 2024-09-11T23:37:38.300428+0000) 2024-09-11T23:37:51.286 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 11 23:37:50 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-5[46216]: 2024-09-11T23:37:50.996+0000 7f2004e1c640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:24.201507+0000 front 2024-09-11T23:37:24.201725+0000 (oldest deadline 2024-09-11T23:37:50.101606+0000) 2024-09-11T23:37:51.634 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 11 23:37:51 smithi172 systemd[1]: Stopping Ceph osd.5 for 1f5284d2-7094-11ef-bcea-c7b262605968... 2024-09-11T23:37:51.634 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:37:51 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:37:51.516+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:37:51.634 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:37:51 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:37:51.516+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:37:51.724 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:37:51 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:37:51.405+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:37:51.724 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:37:51 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:37:51.405+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:21.854620+0000 front 2024-09-11T23:37:21.854475+0000 (oldest deadline 2024-09-11T23:37:47.754591+0000) 2024-09-11T23:37:52.038 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 11 23:37:51 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-5[46216]: 2024-09-11T23:37:51.762+0000 7f2008806640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:37:52.038 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 11 23:37:51 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-5[46216]: 2024-09-11T23:37:51.762+0000 7f2008806640 -1 osd.5 92 *** Got signal Terminated *** 2024-09-11T23:37:52.038 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 11 23:37:51 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-5[46216]: 2024-09-11T23:37:51.762+0000 7f2008806640 -1 osd.5 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T23:37:52.126 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:37:51 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:37:51.869+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.226339+0000 front 2024-09-11T23:37:22.226512+0000 (oldest deadline 2024-09-11T23:37:46.326534+0000) 2024-09-11T23:37:52.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:37:51 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:37:51.803+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:37:52.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:37:51 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:37:51.803+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:37:52.224 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:37:51 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:37:51.818+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.834025+0000 front 2024-09-11T23:37:12.834061+0000 (oldest deadline 2024-09-11T23:37:38.134145+0000) 2024-09-11T23:37:52.224 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:37:51 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:37:51.818+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:24.436485+0000 front 2024-09-11T23:37:24.436378+0000 (oldest deadline 2024-09-11T23:37:47.936355+0000) 2024-09-11T23:37:52.384 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:37:52 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:37:52.129+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:13.834417+0000 front 2024-09-11T23:37:13.834333+0000 (oldest deadline 2024-09-11T23:37:39.734317+0000) 2024-09-11T23:37:52.384 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 11 23:37:52 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-5[46216]: 2024-09-11T23:37:52.037+0000 7f2004e1c640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.200320+0000 front 2024-09-11T23:37:14.200397+0000 (oldest deadline 2024-09-11T23:37:38.300428+0000) 2024-09-11T23:37:52.384 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 11 23:37:52 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-5[46216]: 2024-09-11T23:37:52.037+0000 7f2004e1c640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:24.201507+0000 front 2024-09-11T23:37:24.201725+0000 (oldest deadline 2024-09-11T23:37:50.101606+0000) 2024-09-11T23:37:52.724 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:37:52 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:37:52.388+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:37:52.724 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:37:52 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:37:52.388+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:21.854620+0000 front 2024-09-11T23:37:21.854475+0000 (oldest deadline 2024-09-11T23:37:47.754591+0000) 2024-09-11T23:37:52.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:37:52 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:37:52.555+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:37:52.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:37:52 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:37:52.555+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:37:53.126 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:37:52 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:37:52.885+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.226339+0000 front 2024-09-11T23:37:22.226512+0000 (oldest deadline 2024-09-11T23:37:46.326534+0000) 2024-09-11T23:37:53.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:37:52 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:37:52.825+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:37:53.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:37:52 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:37:52.825+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:37:53.224 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:37:52 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:37:52.861+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.834025+0000 front 2024-09-11T23:37:12.834061+0000 (oldest deadline 2024-09-11T23:37:38.134145+0000) 2024-09-11T23:37:53.224 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:37:52 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:37:52.861+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:24.436485+0000 front 2024-09-11T23:37:24.436378+0000 (oldest deadline 2024-09-11T23:37:47.936355+0000) 2024-09-11T23:37:53.383 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:37:53 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:37:53.148+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:13.834417+0000 front 2024-09-11T23:37:13.834333+0000 (oldest deadline 2024-09-11T23:37:39.734317+0000) 2024-09-11T23:37:53.384 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 11 23:37:53 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-5[46216]: 2024-09-11T23:37:53.028+0000 7f2004e1c640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.200320+0000 front 2024-09-11T23:37:14.200397+0000 (oldest deadline 2024-09-11T23:37:38.300428+0000) 2024-09-11T23:37:53.384 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 11 23:37:53 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-5[46216]: 2024-09-11T23:37:53.028+0000 7f2004e1c640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:24.201507+0000 front 2024-09-11T23:37:24.201725+0000 (oldest deadline 2024-09-11T23:37:50.101606+0000) 2024-09-11T23:37:53.724 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:37:53 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:37:53.403+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:37:53.724 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:37:53 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:37:53.403+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:21.854620+0000 front 2024-09-11T23:37:21.854475+0000 (oldest deadline 2024-09-11T23:37:47.754591+0000) 2024-09-11T23:37:53.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:37:53 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:37:53.558+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:37:53.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:37:53 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:37:53.558+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:37:54.126 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:37:53 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:37:53.856+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.226339+0000 front 2024-09-11T23:37:22.226512+0000 (oldest deadline 2024-09-11T23:37:46.326534+0000) 2024-09-11T23:37:54.126 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:37:53 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:37:53.856+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:30.328020+0000 front 2024-09-11T23:37:30.327934+0000 (oldest deadline 2024-09-11T23:37:53.227832+0000) 2024-09-11T23:37:54.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:37:53 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:37:53.782+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:37:54.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:37:53 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:37:53.782+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:37:54.224 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:37:53 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:37:53.819+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.834025+0000 front 2024-09-11T23:37:12.834061+0000 (oldest deadline 2024-09-11T23:37:38.134145+0000) 2024-09-11T23:37:54.224 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:37:53 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:37:53.819+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:24.436485+0000 front 2024-09-11T23:37:24.436378+0000 (oldest deadline 2024-09-11T23:37:47.936355+0000) 2024-09-11T23:37:54.384 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:37:54 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:37:54.194+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:13.834417+0000 front 2024-09-11T23:37:13.834333+0000 (oldest deadline 2024-09-11T23:37:39.734317+0000) 2024-09-11T23:37:54.384 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:37:54 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:37:54.194+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.535814+0000 front 2024-09-11T23:37:28.535868+0000 (oldest deadline 2024-09-11T23:37:53.235954+0000) 2024-09-11T23:37:54.384 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 11 23:37:53 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-5[46216]: 2024-09-11T23:37:53.985+0000 7f2004e1c640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.200320+0000 front 2024-09-11T23:37:14.200397+0000 (oldest deadline 2024-09-11T23:37:38.300428+0000) 2024-09-11T23:37:54.384 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 11 23:37:53 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-5[46216]: 2024-09-11T23:37:53.985+0000 7f2004e1c640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:24.201507+0000 front 2024-09-11T23:37:24.201725+0000 (oldest deadline 2024-09-11T23:37:50.101606+0000) 2024-09-11T23:37:54.384 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 11 23:37:53 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-5[46216]: 2024-09-11T23:37:53.985+0000 7f2004e1c640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:30.101904+0000 front 2024-09-11T23:37:30.102029+0000 (oldest deadline 2024-09-11T23:37:53.602024+0000) 2024-09-11T23:37:54.724 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:37:54 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:37:54.429+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:37:54.724 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:37:54 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:37:54.429+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:21.854620+0000 front 2024-09-11T23:37:21.854475+0000 (oldest deadline 2024-09-11T23:37:47.754591+0000) 2024-09-11T23:37:54.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:37:54 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:37:54.597+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:37:54.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:37:54 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:37:54.597+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:37:54.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:37:54 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:37:54.597+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:37:55.126 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:37:54 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:37:54.878+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.226339+0000 front 2024-09-11T23:37:22.226512+0000 (oldest deadline 2024-09-11T23:37:46.326534+0000) 2024-09-11T23:37:55.126 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:37:54 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:37:54.878+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:30.328020+0000 front 2024-09-11T23:37:30.327934+0000 (oldest deadline 2024-09-11T23:37:53.227832+0000) 2024-09-11T23:37:55.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:37:54 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:37:54.787+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:37:55.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:37:54 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:37:54.787+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:37:55.207 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 11 23:37:54 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-5[46216]: 2024-09-11T23:37:54.955+0000 7f2004e1c640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.200320+0000 front 2024-09-11T23:37:14.200397+0000 (oldest deadline 2024-09-11T23:37:38.300428+0000) 2024-09-11T23:37:55.207 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 11 23:37:54 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-5[46216]: 2024-09-11T23:37:54.955+0000 7f2004e1c640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:24.201507+0000 front 2024-09-11T23:37:24.201725+0000 (oldest deadline 2024-09-11T23:37:50.101606+0000) 2024-09-11T23:37:55.207 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 11 23:37:54 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-5[46216]: 2024-09-11T23:37:54.955+0000 7f2004e1c640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:30.101904+0000 front 2024-09-11T23:37:30.102029+0000 (oldest deadline 2024-09-11T23:37:53.602024+0000) 2024-09-11T23:37:55.224 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:37:54 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:37:54.805+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.834025+0000 front 2024-09-11T23:37:12.834061+0000 (oldest deadline 2024-09-11T23:37:38.134145+0000) 2024-09-11T23:37:55.224 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:37:54 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:37:54.805+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:24.436485+0000 front 2024-09-11T23:37:24.436378+0000 (oldest deadline 2024-09-11T23:37:47.936355+0000) 2024-09-11T23:37:55.564 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:37:55 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:37:55.207+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:13.834417+0000 front 2024-09-11T23:37:13.834333+0000 (oldest deadline 2024-09-11T23:37:39.734317+0000) 2024-09-11T23:37:55.564 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:37:55 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:37:55.207+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.535814+0000 front 2024-09-11T23:37:28.535868+0000 (oldest deadline 2024-09-11T23:37:53.235954+0000) 2024-09-11T23:37:55.724 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:37:55 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:37:55.413+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:37:55.724 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:37:55 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:37:55.413+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:21.854620+0000 front 2024-09-11T23:37:21.854475+0000 (oldest deadline 2024-09-11T23:37:47.754591+0000) 2024-09-11T23:37:55.724 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:37:55 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:37:55.413+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:31.255703+0000 front 2024-09-11T23:37:31.255597+0000 (oldest deadline 2024-09-11T23:37:55.355509+0000) 2024-09-11T23:37:55.883 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:37:55 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:37:55.564+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:37:55.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:37:55 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:37:55.564+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:37:55.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:37:55 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:37:55.564+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:37:56.126 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:37:55 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:37:55.901+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.226339+0000 front 2024-09-11T23:37:22.226512+0000 (oldest deadline 2024-09-11T23:37:46.326534+0000) 2024-09-11T23:37:56.126 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:37:55 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:37:55.901+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:30.328020+0000 front 2024-09-11T23:37:30.327934+0000 (oldest deadline 2024-09-11T23:37:53.227832+0000) 2024-09-11T23:37:56.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:37:55 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:37:55.781+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:37:56.127 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:37:55 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:37:55.781+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:37:56.127 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:37:55 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:37:55.781+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:29.348479+0000 front 2024-09-11T23:37:29.348492+0000 (oldest deadline 2024-09-11T23:37:55.248606+0000) 2024-09-11T23:37:56.188 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 11 23:37:55 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-5[46216]: 2024-09-11T23:37:55.906+0000 7f2004e1c640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.200320+0000 front 2024-09-11T23:37:14.200397+0000 (oldest deadline 2024-09-11T23:37:38.300428+0000) 2024-09-11T23:37:56.188 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 11 23:37:55 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-5[46216]: 2024-09-11T23:37:55.906+0000 7f2004e1c640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:24.201507+0000 front 2024-09-11T23:37:24.201725+0000 (oldest deadline 2024-09-11T23:37:50.101606+0000) 2024-09-11T23:37:56.188 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 11 23:37:55 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-5[46216]: 2024-09-11T23:37:55.906+0000 7f2004e1c640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:30.101904+0000 front 2024-09-11T23:37:30.102029+0000 (oldest deadline 2024-09-11T23:37:53.602024+0000) 2024-09-11T23:37:56.224 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:37:55 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:37:55.766+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.834025+0000 front 2024-09-11T23:37:12.834061+0000 (oldest deadline 2024-09-11T23:37:38.134145+0000) 2024-09-11T23:37:56.224 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:37:55 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:37:55.766+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:24.436485+0000 front 2024-09-11T23:37:24.436378+0000 (oldest deadline 2024-09-11T23:37:47.936355+0000) 2024-09-11T23:37:56.224 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:37:55 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:37:55.766+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:32.037497+0000 front 2024-09-11T23:37:32.037333+0000 (oldest deadline 2024-09-11T23:37:54.937260+0000) 2024-09-11T23:37:56.586 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:37:56 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:37:56.188+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:13.834417+0000 front 2024-09-11T23:37:13.834333+0000 (oldest deadline 2024-09-11T23:37:39.734317+0000) 2024-09-11T23:37:56.586 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:37:56 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:37:56.188+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.535814+0000 front 2024-09-11T23:37:28.535868+0000 (oldest deadline 2024-09-11T23:37:53.235954+0000) 2024-09-11T23:37:56.724 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:37:56 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:37:56.459+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:37:56.724 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:37:56 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:37:56.459+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:21.854620+0000 front 2024-09-11T23:37:21.854475+0000 (oldest deadline 2024-09-11T23:37:47.754591+0000) 2024-09-11T23:37:56.724 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:37:56 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:37:56.459+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:31.255703+0000 front 2024-09-11T23:37:31.255597+0000 (oldest deadline 2024-09-11T23:37:55.355509+0000) 2024-09-11T23:37:56.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:37:56 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:37:56.585+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:37:56.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:37:56 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:37:56.585+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:37:56.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:37:56 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:37:56.585+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:37:57.126 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:37:56 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:37:56.868+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.226339+0000 front 2024-09-11T23:37:22.226512+0000 (oldest deadline 2024-09-11T23:37:46.326534+0000) 2024-09-11T23:37:57.126 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:37:56 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:37:56.868+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:30.328020+0000 front 2024-09-11T23:37:30.327934+0000 (oldest deadline 2024-09-11T23:37:53.227832+0000) 2024-09-11T23:37:57.127 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:37:56 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:37:56.813+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:37:57.127 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:37:56 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:37:56.813+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:37:57.127 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:37:56 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:37:56.813+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:29.348479+0000 front 2024-09-11T23:37:29.348492+0000 (oldest deadline 2024-09-11T23:37:55.248606+0000) 2024-09-11T23:37:57.224 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:37:56 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:37:56.737+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.834025+0000 front 2024-09-11T23:37:12.834061+0000 (oldest deadline 2024-09-11T23:37:38.134145+0000) 2024-09-11T23:37:57.224 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:37:56 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:37:56.737+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:24.436485+0000 front 2024-09-11T23:37:24.436378+0000 (oldest deadline 2024-09-11T23:37:47.936355+0000) 2024-09-11T23:37:57.225 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:37:56 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:37:56.737+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:32.037497+0000 front 2024-09-11T23:37:32.037333+0000 (oldest deadline 2024-09-11T23:37:54.937260+0000) 2024-09-11T23:37:57.556 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 11 23:37:57 smithi172 podman[69194]: 2024-09-11 23:37:57.243571289 +0000 UTC m=+5.782727248 container died 5fa46bde900e2b9658a7df62a574e6f01878a6e745161ffc860141db0e980374 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T23:37:57.557 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:37:57 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:37:57.163+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:13.834417+0000 front 2024-09-11T23:37:13.834333+0000 (oldest deadline 2024-09-11T23:37:39.734317+0000) 2024-09-11T23:37:57.557 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:37:57 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:37:57.163+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.535814+0000 front 2024-09-11T23:37:28.535868+0000 (oldest deadline 2024-09-11T23:37:53.235954+0000) 2024-09-11T23:37:57.724 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:37:57 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:37:57.415+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:37:57.724 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:37:57 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:37:57.415+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:21.854620+0000 front 2024-09-11T23:37:21.854475+0000 (oldest deadline 2024-09-11T23:37:47.754591+0000) 2024-09-11T23:37:57.724 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:37:57 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:37:57.415+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:31.255703+0000 front 2024-09-11T23:37:31.255597+0000 (oldest deadline 2024-09-11T23:37:55.355509+0000) 2024-09-11T23:37:57.883 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 11 23:37:57 smithi172 podman[69194]: 2024-09-11 23:37:57.65548243 +0000 UTC m=+6.194638392 container cleanup 5fa46bde900e2b9658a7df62a574e6f01878a6e745161ffc860141db0e980374 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True) 2024-09-11T23:37:57.884 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 11 23:37:57 smithi172 bash[69194]: ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-5 2024-09-11T23:37:57.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:37:57 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:37:57.591+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:37:57.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:37:57 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:37:57.591+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:37:57.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:37:57 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:37:57.591+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:37:58.126 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:37:57 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:37:57.900+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.226339+0000 front 2024-09-11T23:37:22.226512+0000 (oldest deadline 2024-09-11T23:37:46.326534+0000) 2024-09-11T23:37:58.126 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:37:57 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:37:57.900+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:30.328020+0000 front 2024-09-11T23:37:30.327934+0000 (oldest deadline 2024-09-11T23:37:53.227832+0000) 2024-09-11T23:37:58.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:37:57 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:37:57.821+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:37:58.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:37:57 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:37:57.821+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:37:58.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:37:57 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:37:57.821+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:29.348479+0000 front 2024-09-11T23:37:29.348492+0000 (oldest deadline 2024-09-11T23:37:55.248606+0000) 2024-09-11T23:37:58.224 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:37:57 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:37:57.769+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.834025+0000 front 2024-09-11T23:37:12.834061+0000 (oldest deadline 2024-09-11T23:37:38.134145+0000) 2024-09-11T23:37:58.224 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:37:57 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:37:57.769+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:24.436485+0000 front 2024-09-11T23:37:24.436378+0000 (oldest deadline 2024-09-11T23:37:47.936355+0000) 2024-09-11T23:37:58.224 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:37:57 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:37:57.769+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:32.037497+0000 front 2024-09-11T23:37:32.037333+0000 (oldest deadline 2024-09-11T23:37:54.937260+0000) 2024-09-11T23:37:58.265 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 11 23:37:57 smithi172 podman[69209]: 2024-09-11 23:37:57.940409934 +0000 UTC m=+0.691681586 container remove 5fa46bde900e2b9658a7df62a574e6f01878a6e745161ffc860141db0e980374 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T23:37:58.265 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:37:58 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:37:58.133+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:13.834417+0000 front 2024-09-11T23:37:13.834333+0000 (oldest deadline 2024-09-11T23:37:39.734317+0000) 2024-09-11T23:37:58.265 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:37:58 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:37:58.133+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.535814+0000 front 2024-09-11T23:37:28.535868+0000 (oldest deadline 2024-09-11T23:37:53.235954+0000) 2024-09-11T23:37:58.526 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 11 23:37:58 smithi172 podman[69295]: 2024-09-11 23:37:58.168759107 +0000 UTC m=+0.015689173 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:37:58.526 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 11 23:37:58 smithi172 podman[69295]: 2024-09-11 23:37:58.282818098 +0000 UTC m=+0.129748149 container create a14078123b76c838fad82df67750d09fd0fb5bcf4acf94bea01642bd1ca8001e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-5-deactivate, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-11T23:37:58.724 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:37:58 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:37:58.418+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:37:58.724 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:37:58 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:37:58.418+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:21.854620+0000 front 2024-09-11T23:37:21.854475+0000 (oldest deadline 2024-09-11T23:37:47.754591+0000) 2024-09-11T23:37:58.724 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:37:58 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:37:58.418+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:31.255703+0000 front 2024-09-11T23:37:31.255597+0000 (oldest deadline 2024-09-11T23:37:55.355509+0000) 2024-09-11T23:37:58.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:37:58 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:37:58.584+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:37:58.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:37:58 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:37:58.584+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:37:58.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:37:58 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:37:58.584+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:37:58.884 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 11 23:37:58 smithi172 podman[69295]: 2024-09-11 23:37:58.527107376 +0000 UTC m=+0.374037437 container init a14078123b76c838fad82df67750d09fd0fb5bcf4acf94bea01642bd1ca8001e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-11T23:37:58.884 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 11 23:37:58 smithi172 podman[69295]: 2024-09-11 23:37:58.530825975 +0000 UTC m=+0.377756032 container start a14078123b76c838fad82df67750d09fd0fb5bcf4acf94bea01642bd1ca8001e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3) 2024-09-11T23:37:58.885 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 11 23:37:58 smithi172 podman[69295]: 2024-09-11 23:37:58.618791825 +0000 UTC m=+0.465721877 container attach a14078123b76c838fad82df67750d09fd0fb5bcf4acf94bea01642bd1ca8001e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-11T23:37:58.885 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 11 23:37:58 smithi172 podman[69295]: 2024-09-11 23:37:58.727336993 +0000 UTC m=+0.574267053 container died a14078123b76c838fad82df67750d09fd0fb5bcf4acf94bea01642bd1ca8001e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-11T23:37:59.126 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:37:58 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:37:58.892+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.226339+0000 front 2024-09-11T23:37:22.226512+0000 (oldest deadline 2024-09-11T23:37:46.326534+0000) 2024-09-11T23:37:59.126 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:37:58 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:37:58.892+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:30.328020+0000 front 2024-09-11T23:37:30.327934+0000 (oldest deadline 2024-09-11T23:37:53.227832+0000) 2024-09-11T23:37:59.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:37:58 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:37:58.848+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:37:59.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:37:58 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:37:58.848+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:37:59.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:37:58 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:37:58.848+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:29.348479+0000 front 2024-09-11T23:37:29.348492+0000 (oldest deadline 2024-09-11T23:37:55.248606+0000) 2024-09-11T23:37:59.224 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:37:58 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:37:58.729+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.834025+0000 front 2024-09-11T23:37:12.834061+0000 (oldest deadline 2024-09-11T23:37:38.134145+0000) 2024-09-11T23:37:59.224 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:37:58 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:37:58.729+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:24.436485+0000 front 2024-09-11T23:37:24.436378+0000 (oldest deadline 2024-09-11T23:37:47.936355+0000) 2024-09-11T23:37:59.224 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:37:58 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:37:58.729+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:32.037497+0000 front 2024-09-11T23:37:32.037333+0000 (oldest deadline 2024-09-11T23:37:54.937260+0000) 2024-09-11T23:37:59.322 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:37:59 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:37:59.117+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:13.834417+0000 front 2024-09-11T23:37:13.834333+0000 (oldest deadline 2024-09-11T23:37:39.734317+0000) 2024-09-11T23:37:59.322 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:37:59 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:37:59.117+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.535814+0000 front 2024-09-11T23:37:28.535868+0000 (oldest deadline 2024-09-11T23:37:53.235954+0000) 2024-09-11T23:37:59.348 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@osd.5.service' 2024-09-11T23:37:59.431 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:37:59.431 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-11T23:37:59.431 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-11T23:37:59.431 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-1f5284d2-7094-11ef-bcea-c7b262605968@osd.6 2024-09-11T23:37:59.634 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:37:59 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:37:59.535+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:37:59.634 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:37:59 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:37:59.535+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:37:59.634 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:37:59 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:37:59.535+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:37:59.724 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:37:59 smithi005 systemd[1]: Stopping Ceph osd.6 for 1f5284d2-7094-11ef-bcea-c7b262605968... 2024-09-11T23:37:59.724 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:37:59 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:37:59.444+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:37:59.724 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:37:59 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:37:59.444+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:21.854620+0000 front 2024-09-11T23:37:21.854475+0000 (oldest deadline 2024-09-11T23:37:47.754591+0000) 2024-09-11T23:37:59.724 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:37:59 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:37:59.444+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:31.255703+0000 front 2024-09-11T23:37:31.255597+0000 (oldest deadline 2024-09-11T23:37:55.355509+0000) 2024-09-11T23:38:00.126 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:37:59 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:37:59.848+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.226339+0000 front 2024-09-11T23:37:22.226512+0000 (oldest deadline 2024-09-11T23:37:46.326534+0000) 2024-09-11T23:38:00.126 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:37:59 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:37:59.848+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:30.328020+0000 front 2024-09-11T23:37:30.327934+0000 (oldest deadline 2024-09-11T23:37:53.227832+0000) 2024-09-11T23:38:00.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:37:59 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:37:59.869+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:38:00.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:37:59 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:37:59.869+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:38:00.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:37:59 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:37:59.869+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:29.348479+0000 front 2024-09-11T23:37:29.348492+0000 (oldest deadline 2024-09-11T23:37:55.248606+0000) 2024-09-11T23:38:00.224 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:37:59 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:37:59.734+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.834025+0000 front 2024-09-11T23:37:12.834061+0000 (oldest deadline 2024-09-11T23:37:38.134145+0000) 2024-09-11T23:38:00.224 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:37:59 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:37:59.734+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:24.436485+0000 front 2024-09-11T23:37:24.436378+0000 (oldest deadline 2024-09-11T23:37:47.936355+0000) 2024-09-11T23:38:00.224 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:37:59 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:37:59.734+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:32.037497+0000 front 2024-09-11T23:37:32.037333+0000 (oldest deadline 2024-09-11T23:37:54.937260+0000) 2024-09-11T23:38:00.224 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:37:59 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:37:59.752+0000 7f0b40231640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:38:00.224 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:37:59 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:37:59.752+0000 7f0b40231640 -1 osd.6 92 *** Got signal Terminated *** 2024-09-11T23:38:00.224 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:37:59 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:37:59.752+0000 7f0b40231640 -1 osd.6 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T23:38:00.383 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:00 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:00.132+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:13.834417+0000 front 2024-09-11T23:37:13.834333+0000 (oldest deadline 2024-09-11T23:37:39.734317+0000) 2024-09-11T23:38:00.384 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:00 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:00.132+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.535814+0000 front 2024-09-11T23:37:28.535868+0000 (oldest deadline 2024-09-11T23:37:53.235954+0000) 2024-09-11T23:38:00.694 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:00 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:00.404+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:38:00.694 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:00 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:00.404+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:21.854620+0000 front 2024-09-11T23:37:21.854475+0000 (oldest deadline 2024-09-11T23:37:47.754591+0000) 2024-09-11T23:38:00.694 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:00 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:00.404+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:31.255703+0000 front 2024-09-11T23:37:31.255597+0000 (oldest deadline 2024-09-11T23:37:55.355509+0000) 2024-09-11T23:38:00.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:00 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:00.561+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:38:00.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:00 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:00.561+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:38:00.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:00 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:00.561+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:38:00.974 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:38:00 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:38:00.694+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.834025+0000 front 2024-09-11T23:37:12.834061+0000 (oldest deadline 2024-09-11T23:37:38.134145+0000) 2024-09-11T23:38:00.974 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:38:00 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:38:00.694+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:24.436485+0000 front 2024-09-11T23:37:24.436378+0000 (oldest deadline 2024-09-11T23:37:47.936355+0000) 2024-09-11T23:38:00.974 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:38:00 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:38:00.694+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:32.037497+0000 front 2024-09-11T23:37:32.037333+0000 (oldest deadline 2024-09-11T23:37:54.937260+0000) 2024-09-11T23:38:01.126 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:00 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:38:00.866+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.226339+0000 front 2024-09-11T23:37:22.226512+0000 (oldest deadline 2024-09-11T23:37:46.326534+0000) 2024-09-11T23:38:01.126 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:00 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:38:00.866+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:30.328020+0000 front 2024-09-11T23:37:30.327934+0000 (oldest deadline 2024-09-11T23:37:53.227832+0000) 2024-09-11T23:38:01.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:00 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:00.916+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:38:01.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:00 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:00.916+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:38:01.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:00 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:00.916+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:29.348479+0000 front 2024-09-11T23:37:29.348492+0000 (oldest deadline 2024-09-11T23:37:55.248606+0000) 2024-09-11T23:38:01.589 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:01 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:01.182+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:13.834417+0000 front 2024-09-11T23:37:13.834333+0000 (oldest deadline 2024-09-11T23:37:39.734317+0000) 2024-09-11T23:38:01.590 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:01 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:01.182+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.535814+0000 front 2024-09-11T23:37:28.535868+0000 (oldest deadline 2024-09-11T23:37:53.235954+0000) 2024-09-11T23:38:01.590 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:01 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:01.182+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:38.838655+0000 front 2024-09-11T23:37:38.838783+0000 (oldest deadline 2024-09-11T23:38:01.038957+0000) 2024-09-11T23:38:01.721 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:01 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:01.421+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:38:01.721 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:01 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:01.421+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:21.854620+0000 front 2024-09-11T23:37:21.854475+0000 (oldest deadline 2024-09-11T23:37:47.754591+0000) 2024-09-11T23:38:01.721 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:01 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:01.421+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:31.255703+0000 front 2024-09-11T23:37:31.255597+0000 (oldest deadline 2024-09-11T23:37:55.355509+0000) 2024-09-11T23:38:01.883 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:01 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:01.589+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:38:01.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:01 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:01.589+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:38:01.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:01 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:01.589+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:38:01.974 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:38:01 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:38:01.722+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.834025+0000 front 2024-09-11T23:37:12.834061+0000 (oldest deadline 2024-09-11T23:37:38.134145+0000) 2024-09-11T23:38:01.974 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:38:01 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:38:01.722+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:24.436485+0000 front 2024-09-11T23:37:24.436378+0000 (oldest deadline 2024-09-11T23:37:47.936355+0000) 2024-09-11T23:38:01.974 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:38:01 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:38:01.722+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:32.037497+0000 front 2024-09-11T23:37:32.037333+0000 (oldest deadline 2024-09-11T23:37:54.937260+0000) 2024-09-11T23:38:02.126 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:01 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:38:01.841+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.226339+0000 front 2024-09-11T23:37:22.226512+0000 (oldest deadline 2024-09-11T23:37:46.326534+0000) 2024-09-11T23:38:02.126 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:01 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:38:01.841+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:30.328020+0000 front 2024-09-11T23:37:30.327934+0000 (oldest deadline 2024-09-11T23:37:53.227832+0000) 2024-09-11T23:38:02.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:01 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:01.904+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:38:02.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:01 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:01.904+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:38:02.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:01 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:01.904+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:29.348479+0000 front 2024-09-11T23:37:29.348492+0000 (oldest deadline 2024-09-11T23:37:55.248606+0000) 2024-09-11T23:38:02.127 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:01 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:01.904+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:39.949729+0000 front 2024-09-11T23:37:39.949814+0000 (oldest deadline 2024-09-11T23:38:01.649521+0000) 2024-09-11T23:38:02.628 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:02 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:02.144+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:13.834417+0000 front 2024-09-11T23:37:13.834333+0000 (oldest deadline 2024-09-11T23:37:39.734317+0000) 2024-09-11T23:38:02.628 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:02 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:02.144+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.535814+0000 front 2024-09-11T23:37:28.535868+0000 (oldest deadline 2024-09-11T23:37:53.235954+0000) 2024-09-11T23:38:02.628 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:02 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:02.144+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:38.838655+0000 front 2024-09-11T23:37:38.838783+0000 (oldest deadline 2024-09-11T23:38:01.038957+0000) 2024-09-11T23:38:02.684 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:02 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:02.427+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:38:02.684 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:02 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:02.427+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:21.854620+0000 front 2024-09-11T23:37:21.854475+0000 (oldest deadline 2024-09-11T23:37:47.754591+0000) 2024-09-11T23:38:02.684 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:02 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:02.427+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:31.255703+0000 front 2024-09-11T23:37:31.255597+0000 (oldest deadline 2024-09-11T23:37:55.355509+0000) 2024-09-11T23:38:02.684 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:02 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:02.427+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:35.355865+0000 front 2024-09-11T23:37:35.356312+0000 (oldest deadline 2024-09-11T23:38:02.356390+0000) 2024-09-11T23:38:02.883 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:02 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:02.628+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:38:02.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:02 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:02.628+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:38:02.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:02 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:02.628+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:38:02.974 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:38:02 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:38:02.685+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.834025+0000 front 2024-09-11T23:37:12.834061+0000 (oldest deadline 2024-09-11T23:37:38.134145+0000) 2024-09-11T23:38:02.974 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:38:02 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:38:02.685+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:24.436485+0000 front 2024-09-11T23:37:24.436378+0000 (oldest deadline 2024-09-11T23:37:47.936355+0000) 2024-09-11T23:38:02.974 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:38:02 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:38:02.685+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:32.037497+0000 front 2024-09-11T23:37:32.037333+0000 (oldest deadline 2024-09-11T23:37:54.937260+0000) 2024-09-11T23:38:02.974 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:38:02 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:38:02.685+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:37.838121+0000 front 2024-09-11T23:37:37.838138+0000 (oldest deadline 2024-09-11T23:38:01.938154+0000) 2024-09-11T23:38:03.126 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:02 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:38:02.830+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.226339+0000 front 2024-09-11T23:37:22.226512+0000 (oldest deadline 2024-09-11T23:37:46.326534+0000) 2024-09-11T23:38:03.126 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:02 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:38:02.830+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:30.328020+0000 front 2024-09-11T23:37:30.327934+0000 (oldest deadline 2024-09-11T23:37:53.227832+0000) 2024-09-11T23:38:03.126 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:02 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:38:02.830+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:40.230211+0000 front 2024-09-11T23:37:40.230160+0000 (oldest deadline 2024-09-11T23:38:01.930049+0000) 2024-09-11T23:38:03.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:02 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:02.909+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:38:03.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:02 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:02.909+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:38:03.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:02 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:02.909+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:29.348479+0000 front 2024-09-11T23:37:29.348492+0000 (oldest deadline 2024-09-11T23:37:55.248606+0000) 2024-09-11T23:38:03.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:02 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:02.909+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:39.949729+0000 front 2024-09-11T23:37:39.949814+0000 (oldest deadline 2024-09-11T23:38:01.649521+0000) 2024-09-11T23:38:03.628 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:03 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:03.170+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:13.834417+0000 front 2024-09-11T23:37:13.834333+0000 (oldest deadline 2024-09-11T23:37:39.734317+0000) 2024-09-11T23:38:03.628 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:03 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:03.170+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.535814+0000 front 2024-09-11T23:37:28.535868+0000 (oldest deadline 2024-09-11T23:37:53.235954+0000) 2024-09-11T23:38:03.628 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:03 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:03.170+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:38.838655+0000 front 2024-09-11T23:37:38.838783+0000 (oldest deadline 2024-09-11T23:38:01.038957+0000) 2024-09-11T23:38:03.696 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:03 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:03.393+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:38:03.696 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:03 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:03.393+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:21.854620+0000 front 2024-09-11T23:37:21.854475+0000 (oldest deadline 2024-09-11T23:37:47.754591+0000) 2024-09-11T23:38:03.696 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:03 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:03.393+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:31.255703+0000 front 2024-09-11T23:37:31.255597+0000 (oldest deadline 2024-09-11T23:37:55.355509+0000) 2024-09-11T23:38:03.696 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:03 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:03.393+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:35.355865+0000 front 2024-09-11T23:37:35.356312+0000 (oldest deadline 2024-09-11T23:38:02.356390+0000) 2024-09-11T23:38:03.883 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:03 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:03.628+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:38:03.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:03 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:03.628+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:38:03.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:03 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:03.628+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:38:03.974 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:38:03 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:38:03.694+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.834025+0000 front 2024-09-11T23:37:12.834061+0000 (oldest deadline 2024-09-11T23:37:38.134145+0000) 2024-09-11T23:38:03.974 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:38:03 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:38:03.694+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:24.436485+0000 front 2024-09-11T23:37:24.436378+0000 (oldest deadline 2024-09-11T23:37:47.936355+0000) 2024-09-11T23:38:03.974 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:38:03 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:38:03.694+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:32.037497+0000 front 2024-09-11T23:37:32.037333+0000 (oldest deadline 2024-09-11T23:37:54.937260+0000) 2024-09-11T23:38:03.974 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:38:03 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:38:03.694+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:37.838121+0000 front 2024-09-11T23:37:37.838138+0000 (oldest deadline 2024-09-11T23:38:01.938154+0000) 2024-09-11T23:38:04.126 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:03 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:38:03.875+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.226339+0000 front 2024-09-11T23:37:22.226512+0000 (oldest deadline 2024-09-11T23:37:46.326534+0000) 2024-09-11T23:38:04.126 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:03 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:38:03.875+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:30.328020+0000 front 2024-09-11T23:37:30.327934+0000 (oldest deadline 2024-09-11T23:37:53.227832+0000) 2024-09-11T23:38:04.126 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:03 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:38:03.875+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:40.230211+0000 front 2024-09-11T23:37:40.230160+0000 (oldest deadline 2024-09-11T23:38:01.930049+0000) 2024-09-11T23:38:04.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:03 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:03.922+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:38:04.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:03 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:03.922+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:38:04.127 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:03 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:03.922+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:29.348479+0000 front 2024-09-11T23:37:29.348492+0000 (oldest deadline 2024-09-11T23:37:55.248606+0000) 2024-09-11T23:38:04.127 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:03 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:03.922+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:39.949729+0000 front 2024-09-11T23:37:39.949814+0000 (oldest deadline 2024-09-11T23:38:01.649521+0000) 2024-09-11T23:38:04.383 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:04 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:04.130+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:13.834417+0000 front 2024-09-11T23:37:13.834333+0000 (oldest deadline 2024-09-11T23:37:39.734317+0000) 2024-09-11T23:38:04.384 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:04 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:04.130+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.535814+0000 front 2024-09-11T23:37:28.535868+0000 (oldest deadline 2024-09-11T23:37:53.235954+0000) 2024-09-11T23:38:04.384 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:04 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:04.130+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:38.838655+0000 front 2024-09-11T23:37:38.838783+0000 (oldest deadline 2024-09-11T23:38:01.038957+0000) 2024-09-11T23:38:04.665 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:04 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:04.383+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:38:04.666 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:04 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:04.383+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:21.854620+0000 front 2024-09-11T23:37:21.854475+0000 (oldest deadline 2024-09-11T23:37:47.754591+0000) 2024-09-11T23:38:04.666 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:04 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:04.383+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:31.255703+0000 front 2024-09-11T23:37:31.255597+0000 (oldest deadline 2024-09-11T23:37:55.355509+0000) 2024-09-11T23:38:04.666 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:04 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:04.383+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:35.355865+0000 front 2024-09-11T23:37:35.356312+0000 (oldest deadline 2024-09-11T23:38:02.356390+0000) 2024-09-11T23:38:04.974 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:38:04 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:38:04.666+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.834025+0000 front 2024-09-11T23:37:12.834061+0000 (oldest deadline 2024-09-11T23:37:38.134145+0000) 2024-09-11T23:38:04.974 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:38:04 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:38:04.666+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:24.436485+0000 front 2024-09-11T23:37:24.436378+0000 (oldest deadline 2024-09-11T23:37:47.936355+0000) 2024-09-11T23:38:04.974 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:38:04 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:38:04.666+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:32.037497+0000 front 2024-09-11T23:37:32.037333+0000 (oldest deadline 2024-09-11T23:37:54.937260+0000) 2024-09-11T23:38:04.974 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:38:04 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6[58407]: 2024-09-11T23:38:04.666+0000 7f0b3883f640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:37.838121+0000 front 2024-09-11T23:37:37.838138+0000 (oldest deadline 2024-09-11T23:38:01.938154+0000) 2024-09-11T23:38:05.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:04 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:04.677+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:38:05.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:04 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:04.677+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:38:05.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:04 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:04.677+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:38:05.376 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:04 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:38:04.899+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.226339+0000 front 2024-09-11T23:37:22.226512+0000 (oldest deadline 2024-09-11T23:37:46.326534+0000) 2024-09-11T23:38:05.376 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:04 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:38:04.899+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:30.328020+0000 front 2024-09-11T23:37:30.327934+0000 (oldest deadline 2024-09-11T23:37:53.227832+0000) 2024-09-11T23:38:05.376 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:04 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:38:04.899+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:40.230211+0000 front 2024-09-11T23:37:40.230160+0000 (oldest deadline 2024-09-11T23:38:01.930049+0000) 2024-09-11T23:38:05.376 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:04 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:04.906+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:38:05.377 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:04 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:04.906+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:38:05.377 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:04 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:04.906+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:29.348479+0000 front 2024-09-11T23:37:29.348492+0000 (oldest deadline 2024-09-11T23:37:55.248606+0000) 2024-09-11T23:38:05.377 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:04 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:04.907+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:39.949729+0000 front 2024-09-11T23:37:39.949814+0000 (oldest deadline 2024-09-11T23:38:01.649521+0000) 2024-09-11T23:38:05.599 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:38:05 smithi005 podman[108262]: 2024-09-11 23:38:05.313017939 +0000 UTC m=+5.670509520 container died 92219e28af49e541f2a36fe19eed29134445df122dfd58f92af1e9bc0ec4832d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731) 2024-09-11T23:38:05.600 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:05 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:05.380+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:38:05.600 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:05 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:05.380+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:21.854620+0000 front 2024-09-11T23:37:21.854475+0000 (oldest deadline 2024-09-11T23:37:47.754591+0000) 2024-09-11T23:38:05.600 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:05 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:05.380+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:31.255703+0000 front 2024-09-11T23:37:31.255597+0000 (oldest deadline 2024-09-11T23:37:55.355509+0000) 2024-09-11T23:38:05.600 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:05 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:05.380+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:35.355865+0000 front 2024-09-11T23:37:35.356312+0000 (oldest deadline 2024-09-11T23:38:02.356390+0000) 2024-09-11T23:38:05.633 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:05 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:05.139+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:13.834417+0000 front 2024-09-11T23:37:13.834333+0000 (oldest deadline 2024-09-11T23:37:39.734317+0000) 2024-09-11T23:38:05.634 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:05 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:05.139+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.535814+0000 front 2024-09-11T23:37:28.535868+0000 (oldest deadline 2024-09-11T23:37:53.235954+0000) 2024-09-11T23:38:05.634 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:05 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:05.139+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:38.838655+0000 front 2024-09-11T23:37:38.838783+0000 (oldest deadline 2024-09-11T23:38:01.038957+0000) 2024-09-11T23:38:05.974 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:38:05 smithi005 podman[108262]: 2024-09-11 23:38:05.699421285 +0000 UTC m=+6.056912867 container cleanup 92219e28af49e541f2a36fe19eed29134445df122dfd58f92af1e9bc0ec4832d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T23:38:05.974 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:38:05 smithi005 bash[108262]: ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6 2024-09-11T23:38:06.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:05 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:05.704+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:38:06.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:05 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:05.704+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:38:06.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:05 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:05.704+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:38:06.376 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:05 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:38:05.889+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.226339+0000 front 2024-09-11T23:37:22.226512+0000 (oldest deadline 2024-09-11T23:37:46.326534+0000) 2024-09-11T23:38:06.376 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:05 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:38:05.889+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:30.328020+0000 front 2024-09-11T23:37:30.327934+0000 (oldest deadline 2024-09-11T23:37:53.227832+0000) 2024-09-11T23:38:06.376 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:05 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:38:05.889+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:40.230211+0000 front 2024-09-11T23:37:40.230160+0000 (oldest deadline 2024-09-11T23:38:01.930049+0000) 2024-09-11T23:38:06.376 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:05 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:05.922+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:38:06.377 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:05 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:05.922+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:38:06.377 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:05 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:05.922+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:29.348479+0000 front 2024-09-11T23:37:29.348492+0000 (oldest deadline 2024-09-11T23:37:55.248606+0000) 2024-09-11T23:38:06.377 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:05 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:05.922+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:39.949729+0000 front 2024-09-11T23:37:39.949814+0000 (oldest deadline 2024-09-11T23:38:01.649521+0000) 2024-09-11T23:38:06.425 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:38:06 smithi005 podman[108288]: 2024-09-11 23:38:06.084699776 +0000 UTC m=+0.763891382 container remove 92219e28af49e541f2a36fe19eed29134445df122dfd58f92af1e9bc0ec4832d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-11T23:38:06.633 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:06 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:06.142+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:13.834417+0000 front 2024-09-11T23:37:13.834333+0000 (oldest deadline 2024-09-11T23:37:39.734317+0000) 2024-09-11T23:38:06.634 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:06 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:06.142+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.535814+0000 front 2024-09-11T23:37:28.535868+0000 (oldest deadline 2024-09-11T23:37:53.235954+0000) 2024-09-11T23:38:06.634 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:06 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:06.142+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:38.838655+0000 front 2024-09-11T23:37:38.838783+0000 (oldest deadline 2024-09-11T23:38:01.038957+0000) 2024-09-11T23:38:06.695 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:38:06 smithi005 podman[108376]: 2024-09-11 23:38:06.477184308 +0000 UTC m=+0.111897476 container create 218ec452f719dc4f9a72715d288764f83f3a22f8a2184eded59233804a76c472 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-11T23:38:06.695 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:38:06 smithi005 podman[108376]: 2024-09-11 23:38:06.381811461 +0000 UTC m=+0.016524640 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:38:06.695 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:06 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:06.426+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:38:06.696 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:06 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:06.426+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:21.854620+0000 front 2024-09-11T23:37:21.854475+0000 (oldest deadline 2024-09-11T23:37:47.754591+0000) 2024-09-11T23:38:06.696 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:06 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:06.426+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:31.255703+0000 front 2024-09-11T23:37:31.255597+0000 (oldest deadline 2024-09-11T23:37:55.355509+0000) 2024-09-11T23:38:06.696 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:06 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:06.426+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:35.355865+0000 front 2024-09-11T23:37:35.356312+0000 (oldest deadline 2024-09-11T23:38:02.356390+0000) 2024-09-11T23:38:06.974 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:38:06 smithi005 podman[108376]: 2024-09-11 23:38:06.69622083 +0000 UTC m=+0.330933997 container init 218ec452f719dc4f9a72715d288764f83f3a22f8a2184eded59233804a76c472 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-11T23:38:06.975 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:38:06 smithi005 podman[108376]: 2024-09-11 23:38:06.699914939 +0000 UTC m=+0.334628116 container start 218ec452f719dc4f9a72715d288764f83f3a22f8a2184eded59233804a76c472 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-11T23:38:06.975 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:38:06 smithi005 podman[108376]: 2024-09-11 23:38:06.813188959 +0000 UTC m=+0.447902128 container attach 218ec452f719dc4f9a72715d288764f83f3a22f8a2184eded59233804a76c472 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-11T23:38:06.975 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 11 23:38:06 smithi005 podman[108376]: 2024-09-11 23:38:06.899807471 +0000 UTC m=+0.534520643 container died 218ec452f719dc4f9a72715d288764f83f3a22f8a2184eded59233804a76c472 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-6-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-11T23:38:07.112 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:06 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:06.655+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:38:07.113 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:06 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:06.655+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:38:07.113 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:06 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:06.655+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:38:07.376 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:06 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:38:06.928+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.226339+0000 front 2024-09-11T23:37:22.226512+0000 (oldest deadline 2024-09-11T23:37:46.326534+0000) 2024-09-11T23:38:07.376 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:06 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:38:06.928+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:30.328020+0000 front 2024-09-11T23:37:30.327934+0000 (oldest deadline 2024-09-11T23:37:53.227832+0000) 2024-09-11T23:38:07.376 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:06 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:38:06.928+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:40.230211+0000 front 2024-09-11T23:37:40.230160+0000 (oldest deadline 2024-09-11T23:38:01.930049+0000) 2024-09-11T23:38:07.376 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:06 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:06.902+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:38:07.377 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:06 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:06.902+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:38:07.377 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:06 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:06.902+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:29.348479+0000 front 2024-09-11T23:37:29.348492+0000 (oldest deadline 2024-09-11T23:37:55.248606+0000) 2024-09-11T23:38:07.377 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:06 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:06.902+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:39.949729+0000 front 2024-09-11T23:37:39.949814+0000 (oldest deadline 2024-09-11T23:38:01.649521+0000) 2024-09-11T23:38:07.383 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:07 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:07.113+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:13.834417+0000 front 2024-09-11T23:37:13.834333+0000 (oldest deadline 2024-09-11T23:37:39.734317+0000) 2024-09-11T23:38:07.384 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:07 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:07.113+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.535814+0000 front 2024-09-11T23:37:28.535868+0000 (oldest deadline 2024-09-11T23:37:53.235954+0000) 2024-09-11T23:38:07.384 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:07 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:07.113+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:38.838655+0000 front 2024-09-11T23:37:38.838783+0000 (oldest deadline 2024-09-11T23:38:01.038957+0000) 2024-09-11T23:38:07.616 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:07 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:07.438+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:38:07.616 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:07 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:07.438+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:21.854620+0000 front 2024-09-11T23:37:21.854475+0000 (oldest deadline 2024-09-11T23:37:47.754591+0000) 2024-09-11T23:38:07.616 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:07 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:07.438+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:31.255703+0000 front 2024-09-11T23:37:31.255597+0000 (oldest deadline 2024-09-11T23:37:55.355509+0000) 2024-09-11T23:38:07.616 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:07 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:07.438+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:35.355865+0000 front 2024-09-11T23:37:35.356312+0000 (oldest deadline 2024-09-11T23:38:02.356390+0000) 2024-09-11T23:38:07.636 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@osd.6.service' 2024-09-11T23:38:07.682 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:38:07.682 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-11T23:38:07.682 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-11T23:38:07.683 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ceph-1f5284d2-7094-11ef-bcea-c7b262605968@osd.7 2024-09-11T23:38:07.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:07 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:07.606+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:38:07.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:07 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:07.606+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:38:07.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:07 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:07.606+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:38:07.974 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:07 smithi159 systemd[1]: Stopping Ceph osd.7 for 1f5284d2-7094-11ef-bcea-c7b262605968... 2024-09-11T23:38:07.974 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:07 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:38:07.925+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.226339+0000 front 2024-09-11T23:37:22.226512+0000 (oldest deadline 2024-09-11T23:37:46.326534+0000) 2024-09-11T23:38:07.974 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:07 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:38:07.925+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:30.328020+0000 front 2024-09-11T23:37:30.327934+0000 (oldest deadline 2024-09-11T23:37:53.227832+0000) 2024-09-11T23:38:07.974 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:07 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:38:07.925+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:40.230211+0000 front 2024-09-11T23:37:40.230160+0000 (oldest deadline 2024-09-11T23:38:01.930049+0000) 2024-09-11T23:38:07.975 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:07 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:07.927+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:38:07.975 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:07 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:07.927+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:38:07.975 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:07 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:07.927+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:29.348479+0000 front 2024-09-11T23:37:29.348492+0000 (oldest deadline 2024-09-11T23:37:55.248606+0000) 2024-09-11T23:38:07.975 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:07 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:07.927+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:39.949729+0000 front 2024-09-11T23:37:39.949814+0000 (oldest deadline 2024-09-11T23:38:01.649521+0000) 2024-09-11T23:38:08.376 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:07 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:38:07.974+0000 7f41d05c5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:38:08.376 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:07 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:38:07.974+0000 7f41d05c5640 -1 osd.7 92 *** Got signal Terminated *** 2024-09-11T23:38:08.376 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:07 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:38:07.974+0000 7f41d05c5640 -1 osd.7 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T23:38:08.588 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:08 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:08.145+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:13.834417+0000 front 2024-09-11T23:37:13.834333+0000 (oldest deadline 2024-09-11T23:37:39.734317+0000) 2024-09-11T23:38:08.588 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:08 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:08.145+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.535814+0000 front 2024-09-11T23:37:28.535868+0000 (oldest deadline 2024-09-11T23:37:53.235954+0000) 2024-09-11T23:38:08.588 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:08 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:08.145+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:38.838655+0000 front 2024-09-11T23:37:38.838783+0000 (oldest deadline 2024-09-11T23:38:01.038957+0000) 2024-09-11T23:38:08.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:08 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:08.588+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:38:08.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:08 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:08.588+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:38:08.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:08 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:08.588+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:38:08.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:08 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:08.483+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:38:08.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:08 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:08.483+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:21.854620+0000 front 2024-09-11T23:37:21.854475+0000 (oldest deadline 2024-09-11T23:37:47.754591+0000) 2024-09-11T23:38:08.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:08 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:08.483+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:31.255703+0000 front 2024-09-11T23:37:31.255597+0000 (oldest deadline 2024-09-11T23:37:55.355509+0000) 2024-09-11T23:38:08.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:08 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:08.483+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:35.355865+0000 front 2024-09-11T23:37:35.356312+0000 (oldest deadline 2024-09-11T23:38:02.356390+0000) 2024-09-11T23:38:09.277 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:08 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:38:08.974+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.226339+0000 front 2024-09-11T23:37:22.226512+0000 (oldest deadline 2024-09-11T23:37:46.326534+0000) 2024-09-11T23:38:09.277 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:08 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:38:08.974+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:30.328020+0000 front 2024-09-11T23:37:30.327934+0000 (oldest deadline 2024-09-11T23:37:53.227832+0000) 2024-09-11T23:38:09.278 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:08 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:38:08.974+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:40.230211+0000 front 2024-09-11T23:37:40.230160+0000 (oldest deadline 2024-09-11T23:38:01.930049+0000) 2024-09-11T23:38:09.278 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:08 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:08.897+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:38:09.278 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:08 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:08.897+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:38:09.278 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:08 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:08.897+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:29.348479+0000 front 2024-09-11T23:37:29.348492+0000 (oldest deadline 2024-09-11T23:37:55.248606+0000) 2024-09-11T23:38:09.278 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:08 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:08.897+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:39.949729+0000 front 2024-09-11T23:37:39.949814+0000 (oldest deadline 2024-09-11T23:38:01.649521+0000) 2024-09-11T23:38:09.617 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:09 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:09.170+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:13.834417+0000 front 2024-09-11T23:37:13.834333+0000 (oldest deadline 2024-09-11T23:37:39.734317+0000) 2024-09-11T23:38:09.617 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:09 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:09.170+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.535814+0000 front 2024-09-11T23:37:28.535868+0000 (oldest deadline 2024-09-11T23:37:53.235954+0000) 2024-09-11T23:38:09.617 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:09 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:09.170+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:38.838655+0000 front 2024-09-11T23:37:38.838783+0000 (oldest deadline 2024-09-11T23:38:01.038957+0000) 2024-09-11T23:38:09.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:09 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:09.617+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:38:09.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:09 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:09.617+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:38:09.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:09 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:09.617+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:38:09.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:09 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:09.504+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:38:09.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:09 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:09.504+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:21.854620+0000 front 2024-09-11T23:37:21.854475+0000 (oldest deadline 2024-09-11T23:37:47.754591+0000) 2024-09-11T23:38:09.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:09 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:09.504+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:31.255703+0000 front 2024-09-11T23:37:31.255597+0000 (oldest deadline 2024-09-11T23:37:55.355509+0000) 2024-09-11T23:38:09.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:09 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:09.504+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:35.355865+0000 front 2024-09-11T23:37:35.356312+0000 (oldest deadline 2024-09-11T23:38:02.356390+0000) 2024-09-11T23:38:10.291 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:10 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:38:10.001+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.226339+0000 front 2024-09-11T23:37:22.226512+0000 (oldest deadline 2024-09-11T23:37:46.326534+0000) 2024-09-11T23:38:10.291 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:10 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:38:10.001+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:30.328020+0000 front 2024-09-11T23:37:30.327934+0000 (oldest deadline 2024-09-11T23:37:53.227832+0000) 2024-09-11T23:38:10.291 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:10 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:38:10.001+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:40.230211+0000 front 2024-09-11T23:37:40.230160+0000 (oldest deadline 2024-09-11T23:38:01.930049+0000) 2024-09-11T23:38:10.291 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:09 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:09.944+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:38:10.291 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:09 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:09.944+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:38:10.291 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:09 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:09.944+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:29.348479+0000 front 2024-09-11T23:37:29.348492+0000 (oldest deadline 2024-09-11T23:37:55.248606+0000) 2024-09-11T23:38:10.291 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:09 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:09.944+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:39.949729+0000 front 2024-09-11T23:37:39.949814+0000 (oldest deadline 2024-09-11T23:38:01.649521+0000) 2024-09-11T23:38:10.383 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:10 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:10.142+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:13.834417+0000 front 2024-09-11T23:37:13.834333+0000 (oldest deadline 2024-09-11T23:37:39.734317+0000) 2024-09-11T23:38:10.384 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:10 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:10.142+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.535814+0000 front 2024-09-11T23:37:28.535868+0000 (oldest deadline 2024-09-11T23:37:53.235954+0000) 2024-09-11T23:38:10.384 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:10 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:10.142+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:38.838655+0000 front 2024-09-11T23:37:38.838783+0000 (oldest deadline 2024-09-11T23:38:01.038957+0000) 2024-09-11T23:38:10.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:10 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:10.498+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:38:10.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:10 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:10.498+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:21.854620+0000 front 2024-09-11T23:37:21.854475+0000 (oldest deadline 2024-09-11T23:37:47.754591+0000) 2024-09-11T23:38:10.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:10 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:10.498+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:31.255703+0000 front 2024-09-11T23:37:31.255597+0000 (oldest deadline 2024-09-11T23:37:55.355509+0000) 2024-09-11T23:38:10.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:10 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:10.498+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:35.355865+0000 front 2024-09-11T23:37:35.356312+0000 (oldest deadline 2024-09-11T23:38:02.356390+0000) 2024-09-11T23:38:11.105 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:10 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:10.634+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:38:11.105 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:10 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:10.634+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:38:11.105 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:10 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:10.634+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:38:11.376 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:10 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:38:10.963+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.226339+0000 front 2024-09-11T23:37:22.226512+0000 (oldest deadline 2024-09-11T23:37:46.326534+0000) 2024-09-11T23:38:11.376 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:10 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:38:10.963+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:30.328020+0000 front 2024-09-11T23:37:30.327934+0000 (oldest deadline 2024-09-11T23:37:53.227832+0000) 2024-09-11T23:38:11.376 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:10 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:38:10.963+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:40.230211+0000 front 2024-09-11T23:37:40.230160+0000 (oldest deadline 2024-09-11T23:38:01.930049+0000) 2024-09-11T23:38:11.376 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:10 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:38:10.963+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:47.830908+0000 front 2024-09-11T23:37:47.830938+0000 (oldest deadline 2024-09-11T23:38:10.130976+0000) 2024-09-11T23:38:11.376 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:10 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:10.912+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:38:11.377 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:10 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:10.912+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:38:11.377 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:10 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:10.912+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:29.348479+0000 front 2024-09-11T23:37:29.348492+0000 (oldest deadline 2024-09-11T23:37:55.248606+0000) 2024-09-11T23:38:11.377 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:10 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:10.912+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:39.949729+0000 front 2024-09-11T23:37:39.949814+0000 (oldest deadline 2024-09-11T23:38:01.649521+0000) 2024-09-11T23:38:11.383 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:11 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:11.105+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:13.834417+0000 front 2024-09-11T23:37:13.834333+0000 (oldest deadline 2024-09-11T23:37:39.734317+0000) 2024-09-11T23:38:11.383 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:11 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:11.105+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.535814+0000 front 2024-09-11T23:37:28.535868+0000 (oldest deadline 2024-09-11T23:37:53.235954+0000) 2024-09-11T23:38:11.383 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:11 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:11.105+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:38.838655+0000 front 2024-09-11T23:37:38.838783+0000 (oldest deadline 2024-09-11T23:38:01.038957+0000) 2024-09-11T23:38:11.724 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:11 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:11.459+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:38:11.724 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:11 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:11.459+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:21.854620+0000 front 2024-09-11T23:37:21.854475+0000 (oldest deadline 2024-09-11T23:37:47.754591+0000) 2024-09-11T23:38:11.724 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:11 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:11.459+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:31.255703+0000 front 2024-09-11T23:37:31.255597+0000 (oldest deadline 2024-09-11T23:37:55.355509+0000) 2024-09-11T23:38:11.724 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:11 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:11.459+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:35.355865+0000 front 2024-09-11T23:37:35.356312+0000 (oldest deadline 2024-09-11T23:38:02.356390+0000) 2024-09-11T23:38:12.112 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:11 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:11.677+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:38:12.112 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:11 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:11.677+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:38:12.112 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:11 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:11.677+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:38:12.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:11 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:11.874+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:38:12.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:11 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:11.874+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:38:12.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:11 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:11.874+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:29.348479+0000 front 2024-09-11T23:37:29.348492+0000 (oldest deadline 2024-09-11T23:37:55.248606+0000) 2024-09-11T23:38:12.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:11 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:11.874+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:39.949729+0000 front 2024-09-11T23:37:39.949814+0000 (oldest deadline 2024-09-11T23:38:01.649521+0000) 2024-09-11T23:38:12.127 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:11 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:11.874+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:45.750312+0000 front 2024-09-11T23:37:45.750357+0000 (oldest deadline 2024-09-11T23:38:11.550939+0000) 2024-09-11T23:38:12.127 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:11 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:38:11.923+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.226339+0000 front 2024-09-11T23:37:22.226512+0000 (oldest deadline 2024-09-11T23:37:46.326534+0000) 2024-09-11T23:38:12.127 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:11 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:38:11.923+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:30.328020+0000 front 2024-09-11T23:37:30.327934+0000 (oldest deadline 2024-09-11T23:37:53.227832+0000) 2024-09-11T23:38:12.127 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:11 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:38:11.923+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:40.230211+0000 front 2024-09-11T23:37:40.230160+0000 (oldest deadline 2024-09-11T23:38:01.930049+0000) 2024-09-11T23:38:12.127 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:11 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:38:11.923+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:47.830908+0000 front 2024-09-11T23:37:47.830938+0000 (oldest deadline 2024-09-11T23:38:10.130976+0000) 2024-09-11T23:38:12.384 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:12 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:12.112+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:13.834417+0000 front 2024-09-11T23:37:13.834333+0000 (oldest deadline 2024-09-11T23:37:39.734317+0000) 2024-09-11T23:38:12.384 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:12 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:12.112+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.535814+0000 front 2024-09-11T23:37:28.535868+0000 (oldest deadline 2024-09-11T23:37:53.235954+0000) 2024-09-11T23:38:12.384 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:12 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:12.112+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:38.838655+0000 front 2024-09-11T23:37:38.838783+0000 (oldest deadline 2024-09-11T23:38:01.038957+0000) 2024-09-11T23:38:12.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:12 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:12.502+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:38:12.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:12 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:12.502+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:21.854620+0000 front 2024-09-11T23:37:21.854475+0000 (oldest deadline 2024-09-11T23:37:47.754591+0000) 2024-09-11T23:38:12.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:12 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:12.502+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:31.255703+0000 front 2024-09-11T23:37:31.255597+0000 (oldest deadline 2024-09-11T23:37:55.355509+0000) 2024-09-11T23:38:12.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:12 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:12.502+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:35.355865+0000 front 2024-09-11T23:37:35.356312+0000 (oldest deadline 2024-09-11T23:38:02.356390+0000) 2024-09-11T23:38:13.120 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:12 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:12.635+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:38:13.120 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:12 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:12.635+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:38:13.120 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:12 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:12.635+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:38:13.126 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:12 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:38:12.927+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.226339+0000 front 2024-09-11T23:37:22.226512+0000 (oldest deadline 2024-09-11T23:37:46.326534+0000) 2024-09-11T23:38:13.126 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:12 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:38:12.927+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:30.328020+0000 front 2024-09-11T23:37:30.327934+0000 (oldest deadline 2024-09-11T23:37:53.227832+0000) 2024-09-11T23:38:13.126 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:12 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:38:12.927+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:40.230211+0000 front 2024-09-11T23:37:40.230160+0000 (oldest deadline 2024-09-11T23:38:01.930049+0000) 2024-09-11T23:38:13.126 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:12 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7[52171]: 2024-09-11T23:38:12.927+0000 7f41c8bd3640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:47.830908+0000 front 2024-09-11T23:37:47.830938+0000 (oldest deadline 2024-09-11T23:38:10.130976+0000) 2024-09-11T23:38:13.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:12 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:12.852+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:38:13.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:12 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:12.852+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:38:13.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:12 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:12.852+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:29.348479+0000 front 2024-09-11T23:37:29.348492+0000 (oldest deadline 2024-09-11T23:37:55.248606+0000) 2024-09-11T23:38:13.127 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:12 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:12.852+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:39.949729+0000 front 2024-09-11T23:37:39.949814+0000 (oldest deadline 2024-09-11T23:38:01.649521+0000) 2024-09-11T23:38:13.127 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:12 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:12.852+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:45.750312+0000 front 2024-09-11T23:37:45.750357+0000 (oldest deadline 2024-09-11T23:38:11.550939+0000) 2024-09-11T23:38:13.383 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:13 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:13.120+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:13.834417+0000 front 2024-09-11T23:37:13.834333+0000 (oldest deadline 2024-09-11T23:37:39.734317+0000) 2024-09-11T23:38:13.384 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:13 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:13.120+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.535814+0000 front 2024-09-11T23:37:28.535868+0000 (oldest deadline 2024-09-11T23:37:53.235954+0000) 2024-09-11T23:38:13.384 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:13 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:13.120+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:38.838655+0000 front 2024-09-11T23:37:38.838783+0000 (oldest deadline 2024-09-11T23:38:01.038957+0000) 2024-09-11T23:38:13.799 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:13 smithi159 podman[68717]: 2024-09-11 23:38:13.505222646 +0000 UTC m=+5.629824131 container died 18de8a52d56caac0fda04cf6038f73dfbd3aa48015b5b3ff9a6f93a721077279 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3) 2024-09-11T23:38:13.883 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:13 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:13.634+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:38:13.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:13 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:13.634+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:38:13.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:13 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:13.634+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:38:13.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:13 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:13.634+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:47.980419+0000 front 2024-09-11T23:37:47.980346+0000 (oldest deadline 2024-09-11T23:38:13.280366+0000) 2024-09-11T23:38:13.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:13 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:13.486+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:38:13.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:13 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:13.486+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:21.854620+0000 front 2024-09-11T23:37:21.854475+0000 (oldest deadline 2024-09-11T23:37:47.754591+0000) 2024-09-11T23:38:13.975 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:13 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:13.486+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:31.255703+0000 front 2024-09-11T23:37:31.255597+0000 (oldest deadline 2024-09-11T23:37:55.355509+0000) 2024-09-11T23:38:13.975 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:13 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:13.486+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:35.355865+0000 front 2024-09-11T23:37:35.356312+0000 (oldest deadline 2024-09-11T23:38:02.356390+0000) 2024-09-11T23:38:14.126 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:13 smithi159 podman[68717]: 2024-09-11 23:38:13.891200104 +0000 UTC m=+6.015801580 container cleanup 18de8a52d56caac0fda04cf6038f73dfbd3aa48015b5b3ff9a6f93a721077279 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-11T23:38:14.126 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:13 smithi159 bash[68717]: ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7 2024-09-11T23:38:14.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:13 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:13.840+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:38:14.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:13 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:13.840+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:38:14.127 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:13 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:13.840+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:29.348479+0000 front 2024-09-11T23:37:29.348492+0000 (oldest deadline 2024-09-11T23:37:55.248606+0000) 2024-09-11T23:38:14.127 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:13 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:13.840+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:39.949729+0000 front 2024-09-11T23:37:39.949814+0000 (oldest deadline 2024-09-11T23:38:01.649521+0000) 2024-09-11T23:38:14.127 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:13 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:13.841+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:45.750312+0000 front 2024-09-11T23:37:45.750357+0000 (oldest deadline 2024-09-11T23:38:11.550939+0000) 2024-09-11T23:38:14.500 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:14 smithi159 podman[68745]: 2024-09-11 23:38:14.147523591 +0000 UTC m=+0.636389902 container remove 18de8a52d56caac0fda04cf6038f73dfbd3aa48015b5b3ff9a6f93a721077279 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-11T23:38:14.586 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:14 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:14.168+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:13.834417+0000 front 2024-09-11T23:37:13.834333+0000 (oldest deadline 2024-09-11T23:37:39.734317+0000) 2024-09-11T23:38:14.586 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:14 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:14.168+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.535814+0000 front 2024-09-11T23:37:28.535868+0000 (oldest deadline 2024-09-11T23:37:53.235954+0000) 2024-09-11T23:38:14.586 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:14 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:14.168+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:38.838655+0000 front 2024-09-11T23:37:38.838783+0000 (oldest deadline 2024-09-11T23:38:01.038957+0000) 2024-09-11T23:38:14.587 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:14 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:14.168+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:47.440308+0000 front 2024-09-11T23:37:47.440350+0000 (oldest deadline 2024-09-11T23:38:13.340320+0000) 2024-09-11T23:38:14.798 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:14 smithi159 podman[68834]: 2024-09-11 23:38:14.404041661 +0000 UTC m=+0.015831103 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:38:14.798 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:14 smithi159 podman[68834]: 2024-09-11 23:38:14.518427547 +0000 UTC m=+0.130216979 container create 635751b5efec09db0aff20141365f1bb400b12b6665a2aeb7f8d3a51e2549e53 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True) 2024-09-11T23:38:14.799 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:14 smithi159 podman[68834]: 2024-09-11 23:38:14.74583528 +0000 UTC m=+0.357624713 container init 635751b5efec09db0aff20141365f1bb400b12b6665a2aeb7f8d3a51e2549e53 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-11T23:38:14.799 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:14 smithi159 podman[68834]: 2024-09-11 23:38:14.749288937 +0000 UTC m=+0.361078371 container start 635751b5efec09db0aff20141365f1bb400b12b6665a2aeb7f8d3a51e2549e53 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-11T23:38:14.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:14 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:14.586+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:38:14.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:14 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:14.586+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:38:14.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:14 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:14.586+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:38:14.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:14 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:14.586+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:47.980419+0000 front 2024-09-11T23:37:47.980346+0000 (oldest deadline 2024-09-11T23:38:13.280366+0000) 2024-09-11T23:38:14.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:14 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:14.516+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:38:14.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:14 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:14.516+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:21.854620+0000 front 2024-09-11T23:37:21.854475+0000 (oldest deadline 2024-09-11T23:37:47.754591+0000) 2024-09-11T23:38:14.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:14 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:14.516+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:31.255703+0000 front 2024-09-11T23:37:31.255597+0000 (oldest deadline 2024-09-11T23:37:55.355509+0000) 2024-09-11T23:38:14.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:14 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:14.516+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:35.355865+0000 front 2024-09-11T23:37:35.356312+0000 (oldest deadline 2024-09-11T23:38:02.356390+0000) 2024-09-11T23:38:14.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:14 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:14.516+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:48.058457+0000 front 2024-09-11T23:37:48.058435+0000 (oldest deadline 2024-09-11T23:38:13.958238+0000) 2024-09-11T23:38:15.126 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:14 smithi159 podman[68834]: 2024-09-11 23:38:14.854324227 +0000 UTC m=+0.466113681 container attach 635751b5efec09db0aff20141365f1bb400b12b6665a2aeb7f8d3a51e2549e53 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-11T23:38:15.126 INFO:journalctl@ceph.osd.7.smithi159.stdout:Sep 11 23:38:14 smithi159 podman[68834]: 2024-09-11 23:38:14.941525055 +0000 UTC m=+0.553314495 container died 635751b5efec09db0aff20141365f1bb400b12b6665a2aeb7f8d3a51e2549e53 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-11T23:38:15.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:14 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:14.798+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:38:15.127 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:14 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:14.798+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:38:15.127 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:14 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:14.798+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:29.348479+0000 front 2024-09-11T23:37:29.348492+0000 (oldest deadline 2024-09-11T23:37:55.248606+0000) 2024-09-11T23:38:15.127 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:14 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:14.798+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:39.949729+0000 front 2024-09-11T23:37:39.949814+0000 (oldest deadline 2024-09-11T23:38:01.649521+0000) 2024-09-11T23:38:15.127 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:14 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:14.798+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:45.750312+0000 front 2024-09-11T23:37:45.750357+0000 (oldest deadline 2024-09-11T23:38:11.550939+0000) 2024-09-11T23:38:15.588 DEBUG:teuthology.orchestra.run.smithi159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@osd.7.service' 2024-09-11T23:38:15.617 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:15 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:15.194+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:13.834417+0000 front 2024-09-11T23:37:13.834333+0000 (oldest deadline 2024-09-11T23:37:39.734317+0000) 2024-09-11T23:38:15.617 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:15 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:15.194+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.535814+0000 front 2024-09-11T23:37:28.535868+0000 (oldest deadline 2024-09-11T23:37:53.235954+0000) 2024-09-11T23:38:15.617 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:15 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:15.194+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:38.838655+0000 front 2024-09-11T23:37:38.838783+0000 (oldest deadline 2024-09-11T23:38:01.038957+0000) 2024-09-11T23:38:15.617 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:15 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:15.194+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:47.440308+0000 front 2024-09-11T23:37:47.440350+0000 (oldest deadline 2024-09-11T23:38:13.340320+0000) 2024-09-11T23:38:15.628 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:38:15.629 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-11T23:38:15.629 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-11T23:38:15.629 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-1f5284d2-7094-11ef-bcea-c7b262605968@osd.8 2024-09-11T23:38:15.884 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:15 smithi172 systemd[1]: Stopping Ceph osd.8 for 1f5284d2-7094-11ef-bcea-c7b262605968... 2024-09-11T23:38:15.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:15 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:15.617+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:38:15.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:15 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:15.617+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:38:15.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:15 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:15.617+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:38:15.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:15 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:15.617+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:47.980419+0000 front 2024-09-11T23:37:47.980346+0000 (oldest deadline 2024-09-11T23:38:13.280366+0000) 2024-09-11T23:38:15.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:15 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:15.492+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:38:15.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:15 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:15.492+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:21.854620+0000 front 2024-09-11T23:37:21.854475+0000 (oldest deadline 2024-09-11T23:37:47.754591+0000) 2024-09-11T23:38:15.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:15 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:15.492+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:31.255703+0000 front 2024-09-11T23:37:31.255597+0000 (oldest deadline 2024-09-11T23:37:55.355509+0000) 2024-09-11T23:38:15.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:15 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:15.492+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:35.355865+0000 front 2024-09-11T23:37:35.356312+0000 (oldest deadline 2024-09-11T23:38:02.356390+0000) 2024-09-11T23:38:15.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:15 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:15.492+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:48.058457+0000 front 2024-09-11T23:37:48.058435+0000 (oldest deadline 2024-09-11T23:38:13.958238+0000) 2024-09-11T23:38:16.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:15 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:15.845+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:38:16.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:15 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:15.845+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:38:16.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:15 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:15.845+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:29.348479+0000 front 2024-09-11T23:37:29.348492+0000 (oldest deadline 2024-09-11T23:37:55.248606+0000) 2024-09-11T23:38:16.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:15 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:15.845+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:39.949729+0000 front 2024-09-11T23:37:39.949814+0000 (oldest deadline 2024-09-11T23:38:01.649521+0000) 2024-09-11T23:38:16.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:15 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:15.845+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:45.750312+0000 front 2024-09-11T23:37:45.750357+0000 (oldest deadline 2024-09-11T23:38:11.550939+0000) 2024-09-11T23:38:16.230 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:15 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:15.958+0000 7f7395a9f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:38:16.231 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:15 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:15.958+0000 7f7395a9f640 -1 osd.8 92 *** Got signal Terminated *** 2024-09-11T23:38:16.231 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:15 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:15.958+0000 7f7395a9f640 -1 osd.8 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T23:38:16.583 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:16 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:16.230+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:13.834417+0000 front 2024-09-11T23:37:13.834333+0000 (oldest deadline 2024-09-11T23:37:39.734317+0000) 2024-09-11T23:38:16.583 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:16 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:16.230+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.535814+0000 front 2024-09-11T23:37:28.535868+0000 (oldest deadline 2024-09-11T23:37:53.235954+0000) 2024-09-11T23:38:16.583 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:16 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:16.230+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:38.838655+0000 front 2024-09-11T23:37:38.838783+0000 (oldest deadline 2024-09-11T23:38:01.038957+0000) 2024-09-11T23:38:16.584 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:16 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:16.230+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:47.440308+0000 front 2024-09-11T23:37:47.440350+0000 (oldest deadline 2024-09-11T23:38:13.340320+0000) 2024-09-11T23:38:16.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:16 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:16.579+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:38:16.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:16 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:16.579+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:38:16.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:16 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:16.579+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:38:16.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:16 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:16.579+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:47.980419+0000 front 2024-09-11T23:37:47.980346+0000 (oldest deadline 2024-09-11T23:38:13.280366+0000) 2024-09-11T23:38:16.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:16 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:16.478+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:38:16.975 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:16 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:16.478+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:21.854620+0000 front 2024-09-11T23:37:21.854475+0000 (oldest deadline 2024-09-11T23:37:47.754591+0000) 2024-09-11T23:38:16.975 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:16 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:16.478+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:31.255703+0000 front 2024-09-11T23:37:31.255597+0000 (oldest deadline 2024-09-11T23:37:55.355509+0000) 2024-09-11T23:38:16.975 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:16 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:16.478+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:35.355865+0000 front 2024-09-11T23:37:35.356312+0000 (oldest deadline 2024-09-11T23:38:02.356390+0000) 2024-09-11T23:38:16.975 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:16 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:16.478+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:48.058457+0000 front 2024-09-11T23:37:48.058435+0000 (oldest deadline 2024-09-11T23:38:13.958238+0000) 2024-09-11T23:38:17.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:16 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:16.864+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:38:17.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:16 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:16.864+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:38:17.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:16 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:16.864+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:29.348479+0000 front 2024-09-11T23:37:29.348492+0000 (oldest deadline 2024-09-11T23:37:55.248606+0000) 2024-09-11T23:38:17.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:16 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:16.864+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:39.949729+0000 front 2024-09-11T23:37:39.949814+0000 (oldest deadline 2024-09-11T23:38:01.649521+0000) 2024-09-11T23:38:17.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:16 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:16.864+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:45.750312+0000 front 2024-09-11T23:37:45.750357+0000 (oldest deadline 2024-09-11T23:38:11.550939+0000) 2024-09-11T23:38:17.533 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:17 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:17.220+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:13.834417+0000 front 2024-09-11T23:37:13.834333+0000 (oldest deadline 2024-09-11T23:37:39.734317+0000) 2024-09-11T23:38:17.533 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:17 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:17.220+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.535814+0000 front 2024-09-11T23:37:28.535868+0000 (oldest deadline 2024-09-11T23:37:53.235954+0000) 2024-09-11T23:38:17.533 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:17 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:17.220+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:38.838655+0000 front 2024-09-11T23:37:38.838783+0000 (oldest deadline 2024-09-11T23:38:01.038957+0000) 2024-09-11T23:38:17.533 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:17 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:17.220+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:47.440308+0000 front 2024-09-11T23:37:47.440350+0000 (oldest deadline 2024-09-11T23:38:13.340320+0000) 2024-09-11T23:38:17.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:17 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:17.533+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:38:17.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:17 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:17.533+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:38:17.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:17 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:17.533+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:38:17.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:17 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:17.533+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:47.980419+0000 front 2024-09-11T23:37:47.980346+0000 (oldest deadline 2024-09-11T23:38:13.280366+0000) 2024-09-11T23:38:17.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:17 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:17.533+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:53.280722+0000 front 2024-09-11T23:37:53.280840+0000 (oldest deadline 2024-09-11T23:38:17.380847+0000) 2024-09-11T23:38:17.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:17 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:17.528+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:38:17.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:17 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:17.528+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:21.854620+0000 front 2024-09-11T23:37:21.854475+0000 (oldest deadline 2024-09-11T23:37:47.754591+0000) 2024-09-11T23:38:17.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:17 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:17.528+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:31.255703+0000 front 2024-09-11T23:37:31.255597+0000 (oldest deadline 2024-09-11T23:37:55.355509+0000) 2024-09-11T23:38:17.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:17 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:17.528+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:35.355865+0000 front 2024-09-11T23:37:35.356312+0000 (oldest deadline 2024-09-11T23:38:02.356390+0000) 2024-09-11T23:38:17.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:17 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:17.528+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:48.058457+0000 front 2024-09-11T23:37:48.058435+0000 (oldest deadline 2024-09-11T23:38:13.958238+0000) 2024-09-11T23:38:18.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:17 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:17.832+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:38:18.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:17 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:17.832+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:38:18.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:17 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:17.832+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:29.348479+0000 front 2024-09-11T23:37:29.348492+0000 (oldest deadline 2024-09-11T23:37:55.248606+0000) 2024-09-11T23:38:18.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:17 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:17.832+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:39.949729+0000 front 2024-09-11T23:37:39.949814+0000 (oldest deadline 2024-09-11T23:38:01.649521+0000) 2024-09-11T23:38:18.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:17 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:17.832+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:45.750312+0000 front 2024-09-11T23:37:45.750357+0000 (oldest deadline 2024-09-11T23:38:11.550939+0000) 2024-09-11T23:38:18.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:17 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:17.832+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:51.551481+0000 front 2024-09-11T23:37:51.551457+0000 (oldest deadline 2024-09-11T23:38:17.451368+0000) 2024-09-11T23:38:18.493 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:18 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:18.193+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:13.834417+0000 front 2024-09-11T23:37:13.834333+0000 (oldest deadline 2024-09-11T23:37:39.734317+0000) 2024-09-11T23:38:18.494 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:18 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:18.193+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.535814+0000 front 2024-09-11T23:37:28.535868+0000 (oldest deadline 2024-09-11T23:37:53.235954+0000) 2024-09-11T23:38:18.494 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:18 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:18.193+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:38.838655+0000 front 2024-09-11T23:37:38.838783+0000 (oldest deadline 2024-09-11T23:38:01.038957+0000) 2024-09-11T23:38:18.494 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:18 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:18.193+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:47.440308+0000 front 2024-09-11T23:37:47.440350+0000 (oldest deadline 2024-09-11T23:38:13.340320+0000) 2024-09-11T23:38:18.883 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:18 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:18.494+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:38:18.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:18 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:18.494+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:38:18.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:18 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:18.494+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:38:18.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:18 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:18.494+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:47.980419+0000 front 2024-09-11T23:37:47.980346+0000 (oldest deadline 2024-09-11T23:38:13.280366+0000) 2024-09-11T23:38:18.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:18 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:18.494+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:53.280722+0000 front 2024-09-11T23:37:53.280840+0000 (oldest deadline 2024-09-11T23:38:17.380847+0000) 2024-09-11T23:38:18.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:18 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:18.484+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:38:18.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:18 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:18.484+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:21.854620+0000 front 2024-09-11T23:37:21.854475+0000 (oldest deadline 2024-09-11T23:37:47.754591+0000) 2024-09-11T23:38:18.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:18 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:18.484+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:31.255703+0000 front 2024-09-11T23:37:31.255597+0000 (oldest deadline 2024-09-11T23:37:55.355509+0000) 2024-09-11T23:38:18.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:18 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:18.484+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:35.355865+0000 front 2024-09-11T23:37:35.356312+0000 (oldest deadline 2024-09-11T23:38:02.356390+0000) 2024-09-11T23:38:18.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:18 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:18.484+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:48.058457+0000 front 2024-09-11T23:37:48.058435+0000 (oldest deadline 2024-09-11T23:38:13.958238+0000) 2024-09-11T23:38:19.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:18 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:18.812+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:38:19.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:18 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:18.812+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:38:19.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:18 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:18.812+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:29.348479+0000 front 2024-09-11T23:37:29.348492+0000 (oldest deadline 2024-09-11T23:37:55.248606+0000) 2024-09-11T23:38:19.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:18 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:18.812+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:39.949729+0000 front 2024-09-11T23:37:39.949814+0000 (oldest deadline 2024-09-11T23:38:01.649521+0000) 2024-09-11T23:38:19.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:18 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:18.812+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:45.750312+0000 front 2024-09-11T23:37:45.750357+0000 (oldest deadline 2024-09-11T23:38:11.550939+0000) 2024-09-11T23:38:19.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:18 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:18.812+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:51.551481+0000 front 2024-09-11T23:37:51.551457+0000 (oldest deadline 2024-09-11T23:38:17.451368+0000) 2024-09-11T23:38:19.465 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:19 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:19.182+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:13.834417+0000 front 2024-09-11T23:37:13.834333+0000 (oldest deadline 2024-09-11T23:37:39.734317+0000) 2024-09-11T23:38:19.465 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:19 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:19.182+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.535814+0000 front 2024-09-11T23:37:28.535868+0000 (oldest deadline 2024-09-11T23:37:53.235954+0000) 2024-09-11T23:38:19.466 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:19 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:19.182+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:38.838655+0000 front 2024-09-11T23:37:38.838783+0000 (oldest deadline 2024-09-11T23:38:01.038957+0000) 2024-09-11T23:38:19.466 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:19 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:19.182+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:47.440308+0000 front 2024-09-11T23:37:47.440350+0000 (oldest deadline 2024-09-11T23:38:13.340320+0000) 2024-09-11T23:38:19.466 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:19 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:19.182+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:55.041193+0000 front 2024-09-11T23:37:55.041156+0000 (oldest deadline 2024-09-11T23:38:19.141268+0000) 2024-09-11T23:38:19.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:19 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:19.466+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:38:19.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:19 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:19.466+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:38:19.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:19 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:19.466+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:38:19.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:19 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:19.466+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:47.980419+0000 front 2024-09-11T23:37:47.980346+0000 (oldest deadline 2024-09-11T23:38:13.280366+0000) 2024-09-11T23:38:19.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:19 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:19.466+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:53.280722+0000 front 2024-09-11T23:37:53.280840+0000 (oldest deadline 2024-09-11T23:38:17.380847+0000) 2024-09-11T23:38:19.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:19 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:19.498+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:38:19.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:19 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:19.498+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:21.854620+0000 front 2024-09-11T23:37:21.854475+0000 (oldest deadline 2024-09-11T23:37:47.754591+0000) 2024-09-11T23:38:19.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:19 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:19.498+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:31.255703+0000 front 2024-09-11T23:37:31.255597+0000 (oldest deadline 2024-09-11T23:37:55.355509+0000) 2024-09-11T23:38:19.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:19 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:19.498+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:35.355865+0000 front 2024-09-11T23:37:35.356312+0000 (oldest deadline 2024-09-11T23:38:02.356390+0000) 2024-09-11T23:38:19.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:19 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:19.498+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:48.058457+0000 front 2024-09-11T23:37:48.058435+0000 (oldest deadline 2024-09-11T23:38:13.958238+0000) 2024-09-11T23:38:19.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:19 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:19.498+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:55.659321+0000 front 2024-09-11T23:37:55.659458+0000 (oldest deadline 2024-09-11T23:38:19.159225+0000) 2024-09-11T23:38:20.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:19 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:19.806+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:38:20.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:19 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:19.806+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:38:20.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:19 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:19.806+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:29.348479+0000 front 2024-09-11T23:37:29.348492+0000 (oldest deadline 2024-09-11T23:37:55.248606+0000) 2024-09-11T23:38:20.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:19 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:19.806+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:39.949729+0000 front 2024-09-11T23:37:39.949814+0000 (oldest deadline 2024-09-11T23:38:01.649521+0000) 2024-09-11T23:38:20.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:19 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:19.806+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:45.750312+0000 front 2024-09-11T23:37:45.750357+0000 (oldest deadline 2024-09-11T23:38:11.550939+0000) 2024-09-11T23:38:20.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:19 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:19.806+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:51.551481+0000 front 2024-09-11T23:37:51.551457+0000 (oldest deadline 2024-09-11T23:38:17.451368+0000) 2024-09-11T23:38:20.440 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:20 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:20.188+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:13.834417+0000 front 2024-09-11T23:37:13.834333+0000 (oldest deadline 2024-09-11T23:37:39.734317+0000) 2024-09-11T23:38:20.440 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:20 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:20.188+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.535814+0000 front 2024-09-11T23:37:28.535868+0000 (oldest deadline 2024-09-11T23:37:53.235954+0000) 2024-09-11T23:38:20.440 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:20 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:20.188+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:38.838655+0000 front 2024-09-11T23:37:38.838783+0000 (oldest deadline 2024-09-11T23:38:01.038957+0000) 2024-09-11T23:38:20.440 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:20 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:20.188+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:47.440308+0000 front 2024-09-11T23:37:47.440350+0000 (oldest deadline 2024-09-11T23:38:13.340320+0000) 2024-09-11T23:38:20.440 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:20 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8[52811]: 2024-09-11T23:38:20.188+0000 7f73920b5640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:55.041193+0000 front 2024-09-11T23:37:55.041156+0000 (oldest deadline 2024-09-11T23:38:19.141268+0000) 2024-09-11T23:38:20.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:20 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:20.440+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:38:20.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:20 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:20.440+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:38:20.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:20 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:20.440+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:38:20.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:20 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:20.440+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:47.980419+0000 front 2024-09-11T23:37:47.980346+0000 (oldest deadline 2024-09-11T23:38:13.280366+0000) 2024-09-11T23:38:20.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:20 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:20.440+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:53.280722+0000 front 2024-09-11T23:37:53.280840+0000 (oldest deadline 2024-09-11T23:38:17.380847+0000) 2024-09-11T23:38:20.975 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:20 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:20.526+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:38:20.975 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:20 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:20.526+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:21.854620+0000 front 2024-09-11T23:37:21.854475+0000 (oldest deadline 2024-09-11T23:37:47.754591+0000) 2024-09-11T23:38:20.975 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:20 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:20.526+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:31.255703+0000 front 2024-09-11T23:37:31.255597+0000 (oldest deadline 2024-09-11T23:37:55.355509+0000) 2024-09-11T23:38:20.975 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:20 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:20.526+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:35.355865+0000 front 2024-09-11T23:37:35.356312+0000 (oldest deadline 2024-09-11T23:38:02.356390+0000) 2024-09-11T23:38:20.975 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:20 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:20.526+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:48.058457+0000 front 2024-09-11T23:37:48.058435+0000 (oldest deadline 2024-09-11T23:38:13.958238+0000) 2024-09-11T23:38:20.975 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:20 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:20.526+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:55.659321+0000 front 2024-09-11T23:37:55.659458+0000 (oldest deadline 2024-09-11T23:38:19.159225+0000) 2024-09-11T23:38:21.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:20 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:20.809+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:38:21.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:20 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:20.809+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:38:21.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:20 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:20.809+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:29.348479+0000 front 2024-09-11T23:37:29.348492+0000 (oldest deadline 2024-09-11T23:37:55.248606+0000) 2024-09-11T23:38:21.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:20 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:20.809+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:39.949729+0000 front 2024-09-11T23:37:39.949814+0000 (oldest deadline 2024-09-11T23:38:01.649521+0000) 2024-09-11T23:38:21.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:20 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:20.809+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:45.750312+0000 front 2024-09-11T23:37:45.750357+0000 (oldest deadline 2024-09-11T23:38:11.550939+0000) 2024-09-11T23:38:21.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:20 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:20.809+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:51.551481+0000 front 2024-09-11T23:37:51.551457+0000 (oldest deadline 2024-09-11T23:38:17.451368+0000) 2024-09-11T23:38:21.591 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:21 smithi172 podman[69409]: 2024-09-11 23:38:21.303007324 +0000 UTC m=+5.478987637 container died cd2e4639a2b00f9a78735a46c8e75d20accb7b5223db2c5cc40674914a01f98a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-11T23:38:21.591 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:21 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:21.434+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:38:21.591 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:21 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:21.434+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:38:21.591 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:21 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:21.434+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:38:21.591 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:21 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:21.434+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:47.980419+0000 front 2024-09-11T23:37:47.980346+0000 (oldest deadline 2024-09-11T23:38:13.280366+0000) 2024-09-11T23:38:21.591 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:21 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:21.434+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:53.280722+0000 front 2024-09-11T23:37:53.280840+0000 (oldest deadline 2024-09-11T23:38:17.380847+0000) 2024-09-11T23:38:21.883 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:21 smithi172 podman[69409]: 2024-09-11 23:38:21.682874475 +0000 UTC m=+5.858854777 container cleanup cd2e4639a2b00f9a78735a46c8e75d20accb7b5223db2c5cc40674914a01f98a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-11T23:38:21.884 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:21 smithi172 bash[69409]: ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8 2024-09-11T23:38:21.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:21 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:21.574+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:38:21.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:21 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:21.574+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:21.854620+0000 front 2024-09-11T23:37:21.854475+0000 (oldest deadline 2024-09-11T23:37:47.754591+0000) 2024-09-11T23:38:21.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:21 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:21.574+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:31.255703+0000 front 2024-09-11T23:37:31.255597+0000 (oldest deadline 2024-09-11T23:37:55.355509+0000) 2024-09-11T23:38:21.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:21 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:21.574+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:35.355865+0000 front 2024-09-11T23:37:35.356312+0000 (oldest deadline 2024-09-11T23:38:02.356390+0000) 2024-09-11T23:38:21.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:21 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:21.574+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:48.058457+0000 front 2024-09-11T23:37:48.058435+0000 (oldest deadline 2024-09-11T23:38:13.958238+0000) 2024-09-11T23:38:21.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:21 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:21.574+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:55.659321+0000 front 2024-09-11T23:37:55.659458+0000 (oldest deadline 2024-09-11T23:38:19.159225+0000) 2024-09-11T23:38:22.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:21 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:21.840+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:38:22.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:21 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:21.840+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:38:22.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:21 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:21.840+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:29.348479+0000 front 2024-09-11T23:37:29.348492+0000 (oldest deadline 2024-09-11T23:37:55.248606+0000) 2024-09-11T23:38:22.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:21 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:21.840+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:39.949729+0000 front 2024-09-11T23:37:39.949814+0000 (oldest deadline 2024-09-11T23:38:01.649521+0000) 2024-09-11T23:38:22.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:21 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:21.840+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:45.750312+0000 front 2024-09-11T23:37:45.750357+0000 (oldest deadline 2024-09-11T23:38:11.550939+0000) 2024-09-11T23:38:22.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:21 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:21.840+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:51.551481+0000 front 2024-09-11T23:37:51.551457+0000 (oldest deadline 2024-09-11T23:38:17.451368+0000) 2024-09-11T23:38:22.347 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:22 smithi172 podman[69426]: 2024-09-11 23:38:22.00125657 +0000 UTC m=+0.688731073 container remove cd2e4639a2b00f9a78735a46c8e75d20accb7b5223db2c5cc40674914a01f98a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-11T23:38:22.634 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:22 smithi172 podman[69514]: 2024-09-11 23:38:22.251542346 +0000 UTC m=+0.016260203 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:38:22.634 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:22 smithi172 podman[69514]: 2024-09-11 23:38:22.398330618 +0000 UTC m=+0.163048468 container create d055b7a12b31066b285e79742494c9c2a2dcd020f40b8a4fcc49fcf3c0c160d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T23:38:22.634 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:22 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:22.482+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:38:22.634 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:22 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:22.482+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:38:22.634 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:22 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:22.482+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:38:22.634 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:22 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:22.482+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:47.980419+0000 front 2024-09-11T23:37:47.980346+0000 (oldest deadline 2024-09-11T23:38:13.280366+0000) 2024-09-11T23:38:22.634 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:22 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:22.482+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:53.280722+0000 front 2024-09-11T23:37:53.280840+0000 (oldest deadline 2024-09-11T23:38:17.380847+0000) 2024-09-11T23:38:22.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:22 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:22.605+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:38:22.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:22 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:22.605+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:21.854620+0000 front 2024-09-11T23:37:21.854475+0000 (oldest deadline 2024-09-11T23:37:47.754591+0000) 2024-09-11T23:38:22.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:22 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:22.605+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:31.255703+0000 front 2024-09-11T23:37:31.255597+0000 (oldest deadline 2024-09-11T23:37:55.355509+0000) 2024-09-11T23:38:22.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:22 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:22.605+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:35.355865+0000 front 2024-09-11T23:37:35.356312+0000 (oldest deadline 2024-09-11T23:38:02.356390+0000) 2024-09-11T23:38:22.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:22 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:22.605+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:48.058457+0000 front 2024-09-11T23:37:48.058435+0000 (oldest deadline 2024-09-11T23:38:13.958238+0000) 2024-09-11T23:38:22.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:22 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:22.605+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:55.659321+0000 front 2024-09-11T23:37:55.659458+0000 (oldest deadline 2024-09-11T23:38:19.159225+0000) 2024-09-11T23:38:23.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:22 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:22.827+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:38:23.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:22 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:22.827+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:38:23.127 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:22 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:22.827+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:29.348479+0000 front 2024-09-11T23:37:29.348492+0000 (oldest deadline 2024-09-11T23:37:55.248606+0000) 2024-09-11T23:38:23.127 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:22 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:22.827+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:39.949729+0000 front 2024-09-11T23:37:39.949814+0000 (oldest deadline 2024-09-11T23:38:01.649521+0000) 2024-09-11T23:38:23.127 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:22 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:22.827+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:45.750312+0000 front 2024-09-11T23:37:45.750357+0000 (oldest deadline 2024-09-11T23:38:11.550939+0000) 2024-09-11T23:38:23.127 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:22 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:22.827+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:51.551481+0000 front 2024-09-11T23:37:51.551457+0000 (oldest deadline 2024-09-11T23:38:17.451368+0000) 2024-09-11T23:38:23.134 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:22 smithi172 podman[69514]: 2024-09-11 23:38:22.658409466 +0000 UTC m=+0.423127314 container init d055b7a12b31066b285e79742494c9c2a2dcd020f40b8a4fcc49fcf3c0c160d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_CLEAN=True) 2024-09-11T23:38:23.134 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:22 smithi172 podman[69514]: 2024-09-11 23:38:22.661623019 +0000 UTC m=+0.426340868 container start d055b7a12b31066b285e79742494c9c2a2dcd020f40b8a4fcc49fcf3c0c160d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True) 2024-09-11T23:38:23.134 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:22 smithi172 podman[69514]: 2024-09-11 23:38:22.738015492 +0000 UTC m=+0.502733352 container attach d055b7a12b31066b285e79742494c9c2a2dcd020f40b8a4fcc49fcf3c0c160d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-11T23:38:23.134 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 11 23:38:22 smithi172 podman[69514]: 2024-09-11 23:38:22.852141191 +0000 UTC m=+0.616859046 container died d055b7a12b31066b285e79742494c9c2a2dcd020f40b8a4fcc49fcf3c0c160d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True) 2024-09-11T23:38:23.469 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@osd.8.service' 2024-09-11T23:38:23.510 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:38:23.510 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-11T23:38:23.510 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-11T23:38:23.510 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-1f5284d2-7094-11ef-bcea-c7b262605968@osd.9 2024-09-11T23:38:23.719 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:23 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:23.528+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:38:23.719 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:23 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:23.528+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:38:23.719 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:23 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:23.528+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:38:23.719 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:23 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:23.528+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:47.980419+0000 front 2024-09-11T23:37:47.980346+0000 (oldest deadline 2024-09-11T23:38:13.280366+0000) 2024-09-11T23:38:23.719 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:23 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:23.528+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:53.280722+0000 front 2024-09-11T23:37:53.280840+0000 (oldest deadline 2024-09-11T23:38:17.380847+0000) 2024-09-11T23:38:23.819 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:23 smithi005 systemd[1]: Stopping Ceph osd.9 for 1f5284d2-7094-11ef-bcea-c7b262605968... 2024-09-11T23:38:23.819 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:23 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:23.623+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:38:23.819 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:23 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:23.624+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:21.854620+0000 front 2024-09-11T23:37:21.854475+0000 (oldest deadline 2024-09-11T23:37:47.754591+0000) 2024-09-11T23:38:23.819 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:23 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:23.624+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:31.255703+0000 front 2024-09-11T23:37:31.255597+0000 (oldest deadline 2024-09-11T23:37:55.355509+0000) 2024-09-11T23:38:23.819 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:23 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:23.624+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:35.355865+0000 front 2024-09-11T23:37:35.356312+0000 (oldest deadline 2024-09-11T23:38:02.356390+0000) 2024-09-11T23:38:23.819 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:23 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:23.624+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:48.058457+0000 front 2024-09-11T23:37:48.058435+0000 (oldest deadline 2024-09-11T23:38:13.958238+0000) 2024-09-11T23:38:23.819 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:23 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:23.624+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:55.659321+0000 front 2024-09-11T23:37:55.659458+0000 (oldest deadline 2024-09-11T23:38:19.159225+0000) 2024-09-11T23:38:23.819 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:23 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:23.818+0000 7f7b96785640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:38:23.820 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:23 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:23.818+0000 7f7b96785640 -1 osd.9 92 *** Got signal Terminated *** 2024-09-11T23:38:23.820 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:23 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:23.818+0000 7f7b96785640 -1 osd.9 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T23:38:24.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:23 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:23.860+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:38:24.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:23 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:23.860+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:38:24.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:23 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:23.860+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:29.348479+0000 front 2024-09-11T23:37:29.348492+0000 (oldest deadline 2024-09-11T23:37:55.248606+0000) 2024-09-11T23:38:24.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:23 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:23.860+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:39.949729+0000 front 2024-09-11T23:37:39.949814+0000 (oldest deadline 2024-09-11T23:38:01.649521+0000) 2024-09-11T23:38:24.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:23 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:23.860+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:45.750312+0000 front 2024-09-11T23:37:45.750357+0000 (oldest deadline 2024-09-11T23:38:11.550939+0000) 2024-09-11T23:38:24.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:23 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:23.860+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:51.551481+0000 front 2024-09-11T23:37:51.551457+0000 (oldest deadline 2024-09-11T23:38:17.451368+0000) 2024-09-11T23:38:24.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:24 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:24.547+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:38:24.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:24 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:24.547+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:38:24.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:24 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:24.547+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:38:24.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:24 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:24.547+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:47.980419+0000 front 2024-09-11T23:37:47.980346+0000 (oldest deadline 2024-09-11T23:38:13.280366+0000) 2024-09-11T23:38:24.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:24 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:24.547+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:53.280722+0000 front 2024-09-11T23:37:53.280840+0000 (oldest deadline 2024-09-11T23:38:17.380847+0000) 2024-09-11T23:38:24.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:24 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:24.656+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:38:24.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:24 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:24.656+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:21.854620+0000 front 2024-09-11T23:37:21.854475+0000 (oldest deadline 2024-09-11T23:37:47.754591+0000) 2024-09-11T23:38:24.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:24 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:24.656+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:31.255703+0000 front 2024-09-11T23:37:31.255597+0000 (oldest deadline 2024-09-11T23:37:55.355509+0000) 2024-09-11T23:38:24.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:24 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:24.656+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:35.355865+0000 front 2024-09-11T23:37:35.356312+0000 (oldest deadline 2024-09-11T23:38:02.356390+0000) 2024-09-11T23:38:24.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:24 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:24.656+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:48.058457+0000 front 2024-09-11T23:37:48.058435+0000 (oldest deadline 2024-09-11T23:38:13.958238+0000) 2024-09-11T23:38:24.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:24 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:24.656+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:55.659321+0000 front 2024-09-11T23:37:55.659458+0000 (oldest deadline 2024-09-11T23:38:19.159225+0000) 2024-09-11T23:38:25.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:24 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:24.813+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:38:25.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:24 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:24.813+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:38:25.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:24 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:24.813+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:29.348479+0000 front 2024-09-11T23:37:29.348492+0000 (oldest deadline 2024-09-11T23:37:55.248606+0000) 2024-09-11T23:38:25.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:24 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:24.813+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:39.949729+0000 front 2024-09-11T23:37:39.949814+0000 (oldest deadline 2024-09-11T23:38:01.649521+0000) 2024-09-11T23:38:25.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:24 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:24.813+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:45.750312+0000 front 2024-09-11T23:37:45.750357+0000 (oldest deadline 2024-09-11T23:38:11.550939+0000) 2024-09-11T23:38:25.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:24 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:24.813+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:51.551481+0000 front 2024-09-11T23:37:51.551457+0000 (oldest deadline 2024-09-11T23:38:17.451368+0000) 2024-09-11T23:38:25.883 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:25 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:25.545+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:38:25.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:25 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:25.545+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:38:25.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:25 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:25.545+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:38:25.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:25 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:25.545+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:47.980419+0000 front 2024-09-11T23:37:47.980346+0000 (oldest deadline 2024-09-11T23:38:13.280366+0000) 2024-09-11T23:38:25.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:25 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:25.545+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:53.280722+0000 front 2024-09-11T23:37:53.280840+0000 (oldest deadline 2024-09-11T23:38:17.380847+0000) 2024-09-11T23:38:25.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:25 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:25.631+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:38:25.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:25 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:25.631+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:21.854620+0000 front 2024-09-11T23:37:21.854475+0000 (oldest deadline 2024-09-11T23:37:47.754591+0000) 2024-09-11T23:38:25.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:25 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:25.631+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:31.255703+0000 front 2024-09-11T23:37:31.255597+0000 (oldest deadline 2024-09-11T23:37:55.355509+0000) 2024-09-11T23:38:25.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:25 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:25.631+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:35.355865+0000 front 2024-09-11T23:37:35.356312+0000 (oldest deadline 2024-09-11T23:38:02.356390+0000) 2024-09-11T23:38:25.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:25 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:25.631+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:48.058457+0000 front 2024-09-11T23:37:48.058435+0000 (oldest deadline 2024-09-11T23:38:13.958238+0000) 2024-09-11T23:38:25.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:25 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:25.631+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:55.659321+0000 front 2024-09-11T23:37:55.659458+0000 (oldest deadline 2024-09-11T23:38:19.159225+0000) 2024-09-11T23:38:26.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:25 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:25.832+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:38:26.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:25 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:25.832+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:38:26.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:25 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:25.832+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:29.348479+0000 front 2024-09-11T23:37:29.348492+0000 (oldest deadline 2024-09-11T23:37:55.248606+0000) 2024-09-11T23:38:26.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:25 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:25.832+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:39.949729+0000 front 2024-09-11T23:37:39.949814+0000 (oldest deadline 2024-09-11T23:38:01.649521+0000) 2024-09-11T23:38:26.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:25 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:25.832+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:45.750312+0000 front 2024-09-11T23:37:45.750357+0000 (oldest deadline 2024-09-11T23:38:11.550939+0000) 2024-09-11T23:38:26.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:25 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:25.832+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:51.551481+0000 front 2024-09-11T23:37:51.551457+0000 (oldest deadline 2024-09-11T23:38:17.451368+0000) 2024-09-11T23:38:26.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:25 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:25.832+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-11T23:38:03.852786+0000 front 2024-09-11T23:38:03.852724+0000 (oldest deadline 2024-09-11T23:38:25.552642+0000) 2024-09-11T23:38:26.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:26 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:26.584+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:38:26.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:26 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:26.584+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:38:26.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:26 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:26.584+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:38:26.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:26 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:26.584+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:47.980419+0000 front 2024-09-11T23:37:47.980346+0000 (oldest deadline 2024-09-11T23:38:13.280366+0000) 2024-09-11T23:38:26.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:26 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:26.584+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:53.280722+0000 front 2024-09-11T23:37:53.280840+0000 (oldest deadline 2024-09-11T23:38:17.380847+0000) 2024-09-11T23:38:26.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:26 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:26.636+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:38:26.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:26 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:26.636+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:21.854620+0000 front 2024-09-11T23:37:21.854475+0000 (oldest deadline 2024-09-11T23:37:47.754591+0000) 2024-09-11T23:38:26.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:26 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:26.636+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:31.255703+0000 front 2024-09-11T23:37:31.255597+0000 (oldest deadline 2024-09-11T23:37:55.355509+0000) 2024-09-11T23:38:26.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:26 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:26.636+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:35.355865+0000 front 2024-09-11T23:37:35.356312+0000 (oldest deadline 2024-09-11T23:38:02.356390+0000) 2024-09-11T23:38:26.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:26 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:26.636+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:48.058457+0000 front 2024-09-11T23:37:48.058435+0000 (oldest deadline 2024-09-11T23:38:13.958238+0000) 2024-09-11T23:38:26.975 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:26 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:26.636+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:55.659321+0000 front 2024-09-11T23:37:55.659458+0000 (oldest deadline 2024-09-11T23:38:19.159225+0000) 2024-09-11T23:38:27.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:26 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:26.838+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:38:27.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:26 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:26.838+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:38:27.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:26 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:26.838+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:29.348479+0000 front 2024-09-11T23:37:29.348492+0000 (oldest deadline 2024-09-11T23:37:55.248606+0000) 2024-09-11T23:38:27.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:26 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:26.838+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:39.949729+0000 front 2024-09-11T23:37:39.949814+0000 (oldest deadline 2024-09-11T23:38:01.649521+0000) 2024-09-11T23:38:27.127 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:26 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:26.838+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:45.750312+0000 front 2024-09-11T23:37:45.750357+0000 (oldest deadline 2024-09-11T23:38:11.550939+0000) 2024-09-11T23:38:27.127 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:26 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:26.838+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:51.551481+0000 front 2024-09-11T23:37:51.551457+0000 (oldest deadline 2024-09-11T23:38:17.451368+0000) 2024-09-11T23:38:27.127 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:26 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:26.838+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-11T23:38:03.852786+0000 front 2024-09-11T23:38:03.852724+0000 (oldest deadline 2024-09-11T23:38:25.552642+0000) 2024-09-11T23:38:27.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:27 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:27.555+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:38:27.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:27 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:27.555+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:38:27.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:27 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:27.555+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:38:27.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:27 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:27.555+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:47.980419+0000 front 2024-09-11T23:37:47.980346+0000 (oldest deadline 2024-09-11T23:38:13.280366+0000) 2024-09-11T23:38:27.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:27 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:27.555+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:53.280722+0000 front 2024-09-11T23:37:53.280840+0000 (oldest deadline 2024-09-11T23:38:17.380847+0000) 2024-09-11T23:38:27.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:27 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:27.609+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:38:27.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:27 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:27.609+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:21.854620+0000 front 2024-09-11T23:37:21.854475+0000 (oldest deadline 2024-09-11T23:37:47.754591+0000) 2024-09-11T23:38:27.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:27 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:27.609+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:31.255703+0000 front 2024-09-11T23:37:31.255597+0000 (oldest deadline 2024-09-11T23:37:55.355509+0000) 2024-09-11T23:38:27.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:27 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:27.609+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:35.355865+0000 front 2024-09-11T23:37:35.356312+0000 (oldest deadline 2024-09-11T23:38:02.356390+0000) 2024-09-11T23:38:27.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:27 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:27.609+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:48.058457+0000 front 2024-09-11T23:37:48.058435+0000 (oldest deadline 2024-09-11T23:38:13.958238+0000) 2024-09-11T23:38:27.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:27 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:27.609+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:55.659321+0000 front 2024-09-11T23:37:55.659458+0000 (oldest deadline 2024-09-11T23:38:19.159225+0000) 2024-09-11T23:38:28.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:27 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:27.856+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:38:28.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:27 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:27.856+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:38:28.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:27 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:27.856+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:29.348479+0000 front 2024-09-11T23:37:29.348492+0000 (oldest deadline 2024-09-11T23:37:55.248606+0000) 2024-09-11T23:38:28.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:27 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:27.856+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:39.949729+0000 front 2024-09-11T23:37:39.949814+0000 (oldest deadline 2024-09-11T23:38:01.649521+0000) 2024-09-11T23:38:28.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:27 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:27.856+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:45.750312+0000 front 2024-09-11T23:37:45.750357+0000 (oldest deadline 2024-09-11T23:38:11.550939+0000) 2024-09-11T23:38:28.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:27 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:27.856+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:51.551481+0000 front 2024-09-11T23:37:51.551457+0000 (oldest deadline 2024-09-11T23:38:17.451368+0000) 2024-09-11T23:38:28.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:27 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:27.856+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-11T23:38:03.852786+0000 front 2024-09-11T23:38:03.852724+0000 (oldest deadline 2024-09-11T23:38:25.552642+0000) 2024-09-11T23:38:28.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:28 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:28.511+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:38:28.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:28 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:28.511+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:38:28.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:28 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:28.511+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:38:28.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:28 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:28.511+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:47.980419+0000 front 2024-09-11T23:37:47.980346+0000 (oldest deadline 2024-09-11T23:38:13.280366+0000) 2024-09-11T23:38:28.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:28 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:28.511+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:53.280722+0000 front 2024-09-11T23:37:53.280840+0000 (oldest deadline 2024-09-11T23:38:17.380847+0000) 2024-09-11T23:38:28.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:28 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:28.609+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:12.652524+0000 front 2024-09-11T23:37:12.652616+0000 (oldest deadline 2024-09-11T23:37:37.352607+0000) 2024-09-11T23:38:28.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:28 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:28.609+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:21.854620+0000 front 2024-09-11T23:37:21.854475+0000 (oldest deadline 2024-09-11T23:37:47.754591+0000) 2024-09-11T23:38:28.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:28 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:28.609+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:31.255703+0000 front 2024-09-11T23:37:31.255597+0000 (oldest deadline 2024-09-11T23:37:55.355509+0000) 2024-09-11T23:38:28.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:28 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:28.609+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:35.355865+0000 front 2024-09-11T23:37:35.356312+0000 (oldest deadline 2024-09-11T23:38:02.356390+0000) 2024-09-11T23:38:28.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:28 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:28.609+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:48.058457+0000 front 2024-09-11T23:37:48.058435+0000 (oldest deadline 2024-09-11T23:38:13.958238+0000) 2024-09-11T23:38:28.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:28 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9[65365]: 2024-09-11T23:38:28.609+0000 7f7b8ed93640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:55.659321+0000 front 2024-09-11T23:37:55.659458+0000 (oldest deadline 2024-09-11T23:38:19.159225+0000) 2024-09-11T23:38:29.376 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:28 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:28.890+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:38:29.376 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:28 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:28.890+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:38:29.376 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:28 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:28.890+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:29.348479+0000 front 2024-09-11T23:37:29.348492+0000 (oldest deadline 2024-09-11T23:37:55.248606+0000) 2024-09-11T23:38:29.376 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:28 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:28.890+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:39.949729+0000 front 2024-09-11T23:37:39.949814+0000 (oldest deadline 2024-09-11T23:38:01.649521+0000) 2024-09-11T23:38:29.376 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:28 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:28.890+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:45.750312+0000 front 2024-09-11T23:37:45.750357+0000 (oldest deadline 2024-09-11T23:38:11.550939+0000) 2024-09-11T23:38:29.376 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:28 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:28.890+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:51.551481+0000 front 2024-09-11T23:37:51.551457+0000 (oldest deadline 2024-09-11T23:38:17.451368+0000) 2024-09-11T23:38:29.376 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:28 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:28.890+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-11T23:38:03.852786+0000 front 2024-09-11T23:38:03.852724+0000 (oldest deadline 2024-09-11T23:38:25.552642+0000) 2024-09-11T23:38:29.585 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:29 smithi005 podman[108481]: 2024-09-11 23:38:29.318784086 +0000 UTC m=+5.603766758 container died 27e4dfe9e9a504773a4402de9d43a176b9aed09f979a3f4818b9d2e330712700 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-11T23:38:29.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:29 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:29.558+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:38:29.885 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:29 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:29.558+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:38:29.885 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:29 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:29.559+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:38:29.885 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:29 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:29.559+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:47.980419+0000 front 2024-09-11T23:37:47.980346+0000 (oldest deadline 2024-09-11T23:38:13.280366+0000) 2024-09-11T23:38:29.885 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:29 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:29.559+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:53.280722+0000 front 2024-09-11T23:37:53.280840+0000 (oldest deadline 2024-09-11T23:38:17.380847+0000) 2024-09-11T23:38:29.944 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:29 smithi005 podman[108481]: 2024-09-11 23:38:29.702248985 +0000 UTC m=+5.987231657 container cleanup 27e4dfe9e9a504773a4402de9d43a176b9aed09f979a3f4818b9d2e330712700 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-11T23:38:29.944 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:29 smithi005 bash[108481]: ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9 2024-09-11T23:38:30.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:29 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:29.847+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:38:30.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:29 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:29.847+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:38:30.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:29 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:29.847+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:29.348479+0000 front 2024-09-11T23:37:29.348492+0000 (oldest deadline 2024-09-11T23:37:55.248606+0000) 2024-09-11T23:38:30.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:29 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:29.847+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:39.949729+0000 front 2024-09-11T23:37:39.949814+0000 (oldest deadline 2024-09-11T23:38:01.649521+0000) 2024-09-11T23:38:30.126 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:29 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:29.847+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:45.750312+0000 front 2024-09-11T23:37:45.750357+0000 (oldest deadline 2024-09-11T23:38:11.550939+0000) 2024-09-11T23:38:30.127 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:29 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:29.847+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:51.551481+0000 front 2024-09-11T23:37:51.551457+0000 (oldest deadline 2024-09-11T23:38:17.451368+0000) 2024-09-11T23:38:30.127 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:29 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:29.847+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-11T23:38:03.852786+0000 front 2024-09-11T23:38:03.852724+0000 (oldest deadline 2024-09-11T23:38:25.552642+0000) 2024-09-11T23:38:30.224 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:29 smithi005 podman[108496]: 2024-09-11 23:38:29.94509509 +0000 UTC m=+0.620255754 container remove 27e4dfe9e9a504773a4402de9d43a176b9aed09f979a3f4818b9d2e330712700 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T23:38:30.564 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:30 smithi005 podman[108585]: 2024-09-11 23:38:30.279347583 +0000 UTC m=+0.106104942 container create 4fe1fc82da2b74be2524d45c7212e403a4106a1ebbbd2ec7cfcccfecf7cf1ec2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS) 2024-09-11T23:38:30.564 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:30 smithi005 podman[108585]: 2024-09-11 23:38:30.189431847 +0000 UTC m=+0.016189170 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:38:30.564 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:30 smithi005 podman[108585]: 2024-09-11 23:38:30.490774917 +0000 UTC m=+0.317532241 container init 4fe1fc82da2b74be2524d45c7212e403a4106a1ebbbd2ec7cfcccfecf7cf1ec2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T23:38:30.564 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:30 smithi005 podman[108585]: 2024-09-11 23:38:30.494769575 +0000 UTC m=+0.321526889 container start 4fe1fc82da2b74be2524d45c7212e403a4106a1ebbbd2ec7cfcccfecf7cf1ec2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux ) 2024-09-11T23:38:30.564 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:30 smithi005 podman[108585]: 2024-09-11 23:38:30.564925419 +0000 UTC m=+0.391682752 container attach 4fe1fc82da2b74be2524d45c7212e403a4106a1ebbbd2ec7cfcccfecf7cf1ec2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-11T23:38:30.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:30 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:30.573+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:38:30.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:30 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:30.573+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:38:30.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:30 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:30.573+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:38:30.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:30 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:30.573+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:47.980419+0000 front 2024-09-11T23:37:47.980346+0000 (oldest deadline 2024-09-11T23:38:13.280366+0000) 2024-09-11T23:38:30.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:30 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:30.573+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:53.280722+0000 front 2024-09-11T23:37:53.280840+0000 (oldest deadline 2024-09-11T23:38:17.380847+0000) 2024-09-11T23:38:30.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:30 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:30.573+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-11T23:38:04.382816+0000 front 2024-09-11T23:38:04.382713+0000 (oldest deadline 2024-09-11T23:38:29.682501+0000) 2024-09-11T23:38:30.974 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:30 smithi005 podman[108585]: 2024-09-11 23:38:30.692673182 +0000 UTC m=+0.519430511 container died 4fe1fc82da2b74be2524d45c7212e403a4106a1ebbbd2ec7cfcccfecf7cf1ec2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-11T23:38:31.216 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@osd.9.service' 2024-09-11T23:38:31.243 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:31 smithi005 podman[108608]: 2024-09-11 23:38:31.201697688 +0000 UTC m=+0.498470190 container remove 4fe1fc82da2b74be2524d45c7212e403a4106a1ebbbd2ec7cfcccfecf7cf1ec2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-9-deactivate, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-11T23:38:31.243 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:31 smithi005 systemd[1]: ceph-1f5284d2-7094-11ef-bcea-c7b262605968@osd.9.service: Deactivated successfully. 2024-09-11T23:38:31.243 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:31 smithi005 systemd[1]: Stopped Ceph osd.9 for 1f5284d2-7094-11ef-bcea-c7b262605968. 2024-09-11T23:38:31.243 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 11 23:38:31 smithi005 systemd[1]: ceph-1f5284d2-7094-11ef-bcea-c7b262605968@osd.9.service: Consumed 2min 28.122s CPU time. 2024-09-11T23:38:31.261 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:38:31.261 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-11T23:38:31.261 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-11T23:38:31.261 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ceph-1f5284d2-7094-11ef-bcea-c7b262605968@osd.10 2024-09-11T23:38:31.288 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:30 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:30.886+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:38:31.288 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:30 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:30.886+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:38:31.289 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:30 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:30.886+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:29.348479+0000 front 2024-09-11T23:37:29.348492+0000 (oldest deadline 2024-09-11T23:37:55.248606+0000) 2024-09-11T23:38:31.289 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:30 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:30.886+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:39.949729+0000 front 2024-09-11T23:37:39.949814+0000 (oldest deadline 2024-09-11T23:38:01.649521+0000) 2024-09-11T23:38:31.289 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:30 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:30.886+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:45.750312+0000 front 2024-09-11T23:37:45.750357+0000 (oldest deadline 2024-09-11T23:38:11.550939+0000) 2024-09-11T23:38:31.289 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:30 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:30.886+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:51.551481+0000 front 2024-09-11T23:37:51.551457+0000 (oldest deadline 2024-09-11T23:38:17.451368+0000) 2024-09-11T23:38:31.289 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:30 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:30.886+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-11T23:38:03.852786+0000 front 2024-09-11T23:38:03.852724+0000 (oldest deadline 2024-09-11T23:38:25.552642+0000) 2024-09-11T23:38:31.560 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:31 smithi159 systemd[1]: Stopping Ceph osd.10 for 1f5284d2-7094-11ef-bcea-c7b262605968... 2024-09-11T23:38:31.871 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:31 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:31.560+0000 7f49c270b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:38:31.871 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:31 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:31.560+0000 7f49c270b640 -1 osd.10 92 *** Got signal Terminated *** 2024-09-11T23:38:31.871 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:31 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:31.560+0000 7f49c270b640 -1 osd.10 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T23:38:31.871 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:31 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:31.871+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:38:31.871 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:31 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:31.871+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:38:31.871 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:31 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:31.871+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:29.348479+0000 front 2024-09-11T23:37:29.348492+0000 (oldest deadline 2024-09-11T23:37:55.248606+0000) 2024-09-11T23:38:31.871 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:31 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:31.871+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:39.949729+0000 front 2024-09-11T23:37:39.949814+0000 (oldest deadline 2024-09-11T23:38:01.649521+0000) 2024-09-11T23:38:31.872 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:31 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:31.871+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:45.750312+0000 front 2024-09-11T23:37:45.750357+0000 (oldest deadline 2024-09-11T23:38:11.550939+0000) 2024-09-11T23:38:31.872 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:31 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:31.871+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:51.551481+0000 front 2024-09-11T23:37:51.551457+0000 (oldest deadline 2024-09-11T23:38:17.451368+0000) 2024-09-11T23:38:31.872 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:31 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:31.871+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-11T23:38:03.852786+0000 front 2024-09-11T23:38:03.852724+0000 (oldest deadline 2024-09-11T23:38:25.552642+0000) 2024-09-11T23:38:31.883 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:31 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:31.546+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:38:31.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:31 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:31.546+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:38:31.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:31 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:31.546+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:38:31.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:31 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:31.546+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:47.980419+0000 front 2024-09-11T23:37:47.980346+0000 (oldest deadline 2024-09-11T23:38:13.280366+0000) 2024-09-11T23:38:31.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:31 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:31.546+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:53.280722+0000 front 2024-09-11T23:37:53.280840+0000 (oldest deadline 2024-09-11T23:38:17.380847+0000) 2024-09-11T23:38:31.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:31 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:31.546+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-11T23:38:04.382816+0000 front 2024-09-11T23:38:04.382713+0000 (oldest deadline 2024-09-11T23:38:29.682501+0000) 2024-09-11T23:38:32.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:32 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:32.595+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:38:32.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:32 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:32.595+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:38:32.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:32 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:32.595+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:38:32.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:32 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:32.595+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:47.980419+0000 front 2024-09-11T23:37:47.980346+0000 (oldest deadline 2024-09-11T23:38:13.280366+0000) 2024-09-11T23:38:32.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:32 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:32.595+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:53.280722+0000 front 2024-09-11T23:37:53.280840+0000 (oldest deadline 2024-09-11T23:38:17.380847+0000) 2024-09-11T23:38:32.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:32 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:32.595+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-11T23:38:04.382816+0000 front 2024-09-11T23:38:04.382713+0000 (oldest deadline 2024-09-11T23:38:29.682501+0000) 2024-09-11T23:38:33.376 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:32 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:32.904+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:38:33.376 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:32 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:32.904+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:38:33.376 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:32 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:32.904+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:29.348479+0000 front 2024-09-11T23:37:29.348492+0000 (oldest deadline 2024-09-11T23:37:55.248606+0000) 2024-09-11T23:38:33.376 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:32 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:32.904+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:39.949729+0000 front 2024-09-11T23:37:39.949814+0000 (oldest deadline 2024-09-11T23:38:01.649521+0000) 2024-09-11T23:38:33.376 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:32 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:32.904+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:45.750312+0000 front 2024-09-11T23:37:45.750357+0000 (oldest deadline 2024-09-11T23:38:11.550939+0000) 2024-09-11T23:38:33.376 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:32 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:32.904+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:51.551481+0000 front 2024-09-11T23:37:51.551457+0000 (oldest deadline 2024-09-11T23:38:17.451368+0000) 2024-09-11T23:38:33.376 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:32 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:32.904+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-11T23:38:03.852786+0000 front 2024-09-11T23:38:03.852724+0000 (oldest deadline 2024-09-11T23:38:25.552642+0000) 2024-09-11T23:38:33.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:33 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:33.581+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:38:33.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:33 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:33.581+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:38:33.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:33 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:33.581+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:38:33.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:33 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:33.581+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:47.980419+0000 front 2024-09-11T23:37:47.980346+0000 (oldest deadline 2024-09-11T23:38:13.280366+0000) 2024-09-11T23:38:33.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:33 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:33.581+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:53.280722+0000 front 2024-09-11T23:37:53.280840+0000 (oldest deadline 2024-09-11T23:38:17.380847+0000) 2024-09-11T23:38:33.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:33 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:33.581+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-11T23:38:04.382816+0000 front 2024-09-11T23:38:04.382713+0000 (oldest deadline 2024-09-11T23:38:29.682501+0000) 2024-09-11T23:38:34.376 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:33 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:33.951+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:38:34.376 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:33 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:33.951+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:38:34.376 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:33 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:33.951+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:29.348479+0000 front 2024-09-11T23:37:29.348492+0000 (oldest deadline 2024-09-11T23:37:55.248606+0000) 2024-09-11T23:38:34.376 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:33 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:33.951+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:39.949729+0000 front 2024-09-11T23:37:39.949814+0000 (oldest deadline 2024-09-11T23:38:01.649521+0000) 2024-09-11T23:38:34.376 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:33 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:33.951+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:45.750312+0000 front 2024-09-11T23:37:45.750357+0000 (oldest deadline 2024-09-11T23:38:11.550939+0000) 2024-09-11T23:38:34.376 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:33 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:33.951+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:51.551481+0000 front 2024-09-11T23:37:51.551457+0000 (oldest deadline 2024-09-11T23:38:17.451368+0000) 2024-09-11T23:38:34.377 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:33 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:33.951+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-11T23:38:03.852786+0000 front 2024-09-11T23:38:03.852724+0000 (oldest deadline 2024-09-11T23:38:25.552642+0000) 2024-09-11T23:38:34.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:34 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:34.559+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:38:34.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:34 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:34.559+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:38:34.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:34 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:34.559+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:38:34.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:34 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:34.559+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:47.980419+0000 front 2024-09-11T23:37:47.980346+0000 (oldest deadline 2024-09-11T23:38:13.280366+0000) 2024-09-11T23:38:34.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:34 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:34.559+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:53.280722+0000 front 2024-09-11T23:37:53.280840+0000 (oldest deadline 2024-09-11T23:38:17.380847+0000) 2024-09-11T23:38:34.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:34 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:34.559+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-11T23:38:04.382816+0000 front 2024-09-11T23:38:04.382713+0000 (oldest deadline 2024-09-11T23:38:29.682501+0000) 2024-09-11T23:38:35.376 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:34 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:34.934+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:38:35.376 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:34 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:34.934+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:38:35.376 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:34 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:34.934+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:29.348479+0000 front 2024-09-11T23:37:29.348492+0000 (oldest deadline 2024-09-11T23:37:55.248606+0000) 2024-09-11T23:38:35.376 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:34 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:34.934+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:39.949729+0000 front 2024-09-11T23:37:39.949814+0000 (oldest deadline 2024-09-11T23:38:01.649521+0000) 2024-09-11T23:38:35.376 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:34 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:34.934+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:45.750312+0000 front 2024-09-11T23:37:45.750357+0000 (oldest deadline 2024-09-11T23:38:11.550939+0000) 2024-09-11T23:38:35.376 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:34 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:34.934+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:51.551481+0000 front 2024-09-11T23:37:51.551457+0000 (oldest deadline 2024-09-11T23:38:17.451368+0000) 2024-09-11T23:38:35.376 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:34 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:34.934+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-11T23:38:03.852786+0000 front 2024-09-11T23:38:03.852724+0000 (oldest deadline 2024-09-11T23:38:25.552642+0000) 2024-09-11T23:38:35.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:35 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:35.602+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:38:35.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:35 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:35.602+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:38:35.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:35 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:35.602+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:38:35.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:35 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:35.602+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:47.980419+0000 front 2024-09-11T23:37:47.980346+0000 (oldest deadline 2024-09-11T23:38:13.280366+0000) 2024-09-11T23:38:35.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:35 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:35.602+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:53.280722+0000 front 2024-09-11T23:37:53.280840+0000 (oldest deadline 2024-09-11T23:38:17.380847+0000) 2024-09-11T23:38:35.884 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:35 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:35.602+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-11T23:38:04.382816+0000 front 2024-09-11T23:38:04.382713+0000 (oldest deadline 2024-09-11T23:38:29.682501+0000) 2024-09-11T23:38:36.376 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:35 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:35.980+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:14.146212+0000 front 2024-09-11T23:37:14.146021+0000 (oldest deadline 2024-09-11T23:37:39.446228+0000) 2024-09-11T23:38:36.376 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:35 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:35.980+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.347407+0000 front 2024-09-11T23:37:22.347357+0000 (oldest deadline 2024-09-11T23:37:45.247581+0000) 2024-09-11T23:38:36.376 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:35 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:35.980+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:29.348479+0000 front 2024-09-11T23:37:29.348492+0000 (oldest deadline 2024-09-11T23:37:55.248606+0000) 2024-09-11T23:38:36.376 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:35 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:35.980+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-11T23:37:39.949729+0000 front 2024-09-11T23:37:39.949814+0000 (oldest deadline 2024-09-11T23:38:01.649521+0000) 2024-09-11T23:38:36.377 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:35 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:35.980+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:45.750312+0000 front 2024-09-11T23:37:45.750357+0000 (oldest deadline 2024-09-11T23:38:11.550939+0000) 2024-09-11T23:38:36.377 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:35 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:35.980+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:51.551481+0000 front 2024-09-11T23:37:51.551457+0000 (oldest deadline 2024-09-11T23:38:17.451368+0000) 2024-09-11T23:38:36.377 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:35 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10[59162]: 2024-09-11T23:38:35.980+0000 7f49bed21640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-11T23:38:03.852786+0000 front 2024-09-11T23:38:03.852724+0000 (oldest deadline 2024-09-11T23:38:25.552642+0000) 2024-09-11T23:38:37.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:36 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:36.641+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:38:37.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:36 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:36.641+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:38:37.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:36 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:36.641+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:38:37.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:36 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:36.641+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:47.980419+0000 front 2024-09-11T23:37:47.980346+0000 (oldest deadline 2024-09-11T23:38:13.280366+0000) 2024-09-11T23:38:37.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:36 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:36.641+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:53.280722+0000 front 2024-09-11T23:37:53.280840+0000 (oldest deadline 2024-09-11T23:38:17.380847+0000) 2024-09-11T23:38:37.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:36 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:36.641+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-11T23:38:04.382816+0000 front 2024-09-11T23:38:04.382713+0000 (oldest deadline 2024-09-11T23:38:29.682501+0000) 2024-09-11T23:38:37.368 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:37 smithi159 podman[68937]: 2024-09-11 23:38:37.097258341 +0000 UTC m=+5.632637480 container died 74623e2a797711dd969fdca1327f6df6e4943d5588a10f6b76b63848a945e0cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2) 2024-09-11T23:38:37.619 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:37 smithi159 podman[68937]: 2024-09-11 23:38:37.443590224 +0000 UTC m=+5.978969363 container cleanup 74623e2a797711dd969fdca1327f6df6e4943d5588a10f6b76b63848a945e0cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-11T23:38:37.619 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:37 smithi159 bash[68937]: ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10 2024-09-11T23:38:37.876 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:37 smithi159 podman[68951]: 2024-09-11 23:38:37.62002847 +0000 UTC m=+0.513375025 container remove 74623e2a797711dd969fdca1327f6df6e4943d5588a10f6b76b63848a945e0cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-11T23:38:38.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:37 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:37.652+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:38:38.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:37 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:37.652+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:38:38.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:37 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:37.652+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:38:38.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:37 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:37.652+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:47.980419+0000 front 2024-09-11T23:37:47.980346+0000 (oldest deadline 2024-09-11T23:38:13.280366+0000) 2024-09-11T23:38:38.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:37 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:37.652+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:53.280722+0000 front 2024-09-11T23:37:53.280840+0000 (oldest deadline 2024-09-11T23:38:17.380847+0000) 2024-09-11T23:38:38.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:37 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:37.652+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-11T23:38:04.382816+0000 front 2024-09-11T23:38:04.382713+0000 (oldest deadline 2024-09-11T23:38:29.682501+0000) 2024-09-11T23:38:38.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:37 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:37.652+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6820 osd.7 since back 2024-09-11T23:38:09.683091+0000 front 2024-09-11T23:38:09.683028+0000 (oldest deadline 2024-09-11T23:38:37.283501+0000) 2024-09-11T23:38:38.338 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:38 smithi159 podman[69043]: 2024-09-11 23:38:37.952987946 +0000 UTC m=+0.015930428 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:38:38.338 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:38 smithi159 podman[69043]: 2024-09-11 23:38:38.054179203 +0000 UTC m=+0.117121718 container create 628cb0fe13adcc772921cab8c8d64c32a4e9165d4a9bbef4365050ceae636085 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-11T23:38:38.338 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:38 smithi159 podman[69043]: 2024-09-11 23:38:38.264812251 +0000 UTC m=+0.327754731 container init 628cb0fe13adcc772921cab8c8d64c32a4e9165d4a9bbef4365050ceae636085 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10-deactivate, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True) 2024-09-11T23:38:38.338 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:38 smithi159 podman[69043]: 2024-09-11 23:38:38.268006529 +0000 UTC m=+0.330948999 container start 628cb0fe13adcc772921cab8c8d64c32a4e9165d4a9bbef4365050ceae636085 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10-deactivate, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-11T23:38:38.339 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:38 smithi159 podman[69043]: 2024-09-11 23:38:38.339723913 +0000 UTC m=+0.402666393 container attach 628cb0fe13adcc772921cab8c8d64c32a4e9165d4a9bbef4365050ceae636085 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T23:38:38.626 INFO:journalctl@ceph.osd.10.smithi159.stdout:Sep 11 23:38:38 smithi159 podman[69043]: 2024-09-11 23:38:38.459429073 +0000 UTC m=+0.522371543 container died 628cb0fe13adcc772921cab8c8d64c32a4e9165d4a9bbef4365050ceae636085 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-11T23:38:39.019 DEBUG:teuthology.orchestra.run.smithi159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@osd.10.service' 2024-09-11T23:38:39.035 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:38 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:38.695+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:38:39.035 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:38 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:38.695+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:38:39.035 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:38 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:38.695+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:38:39.035 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:38 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:38.695+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:47.980419+0000 front 2024-09-11T23:37:47.980346+0000 (oldest deadline 2024-09-11T23:38:13.280366+0000) 2024-09-11T23:38:39.035 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:38 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:38.695+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:53.280722+0000 front 2024-09-11T23:37:53.280840+0000 (oldest deadline 2024-09-11T23:38:17.380847+0000) 2024-09-11T23:38:39.035 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:38 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:38.695+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-11T23:38:04.382816+0000 front 2024-09-11T23:38:04.382713+0000 (oldest deadline 2024-09-11T23:38:29.682501+0000) 2024-09-11T23:38:39.036 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:38 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:38.695+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6820 osd.7 since back 2024-09-11T23:38:09.683091+0000 front 2024-09-11T23:38:09.683028+0000 (oldest deadline 2024-09-11T23:38:37.283501+0000) 2024-09-11T23:38:39.102 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:38:39.103 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-11T23:38:39.103 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-11T23:38:39.103 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-1f5284d2-7094-11ef-bcea-c7b262605968@osd.11 2024-09-11T23:38:39.384 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:39 smithi172 systemd[1]: Stopping Ceph osd.11 for 1f5284d2-7094-11ef-bcea-c7b262605968... 2024-09-11T23:38:39.736 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:39 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:39.434+0000 7f2d728f1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:38:39.736 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:39 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:39.434+0000 7f2d728f1640 -1 osd.11 92 *** Got signal Terminated *** 2024-09-11T23:38:39.736 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:39 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:39.434+0000 7f2d728f1640 -1 osd.11 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T23:38:40.133 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:39 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:39.736+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:38:40.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:39 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:39.736+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:38:40.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:39 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:39.736+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:38:40.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:39 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:39.736+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:47.980419+0000 front 2024-09-11T23:37:47.980346+0000 (oldest deadline 2024-09-11T23:38:13.280366+0000) 2024-09-11T23:38:40.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:39 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:39.736+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:53.280722+0000 front 2024-09-11T23:37:53.280840+0000 (oldest deadline 2024-09-11T23:38:17.380847+0000) 2024-09-11T23:38:40.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:39 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:39.736+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-11T23:38:04.382816+0000 front 2024-09-11T23:38:04.382713+0000 (oldest deadline 2024-09-11T23:38:29.682501+0000) 2024-09-11T23:38:40.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:39 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:39.736+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6820 osd.7 since back 2024-09-11T23:38:09.683091+0000 front 2024-09-11T23:38:09.683028+0000 (oldest deadline 2024-09-11T23:38:37.283501+0000) 2024-09-11T23:38:41.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:40 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:40.702+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:38:41.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:40 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:40.702+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:38:41.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:40 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:40.702+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:38:41.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:40 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:40.702+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:47.980419+0000 front 2024-09-11T23:37:47.980346+0000 (oldest deadline 2024-09-11T23:38:13.280366+0000) 2024-09-11T23:38:41.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:40 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:40.702+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:53.280722+0000 front 2024-09-11T23:37:53.280840+0000 (oldest deadline 2024-09-11T23:38:17.380847+0000) 2024-09-11T23:38:41.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:40 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:40.702+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-11T23:38:04.382816+0000 front 2024-09-11T23:38:04.382713+0000 (oldest deadline 2024-09-11T23:38:29.682501+0000) 2024-09-11T23:38:41.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:40 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:40.702+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6820 osd.7 since back 2024-09-11T23:38:09.683091+0000 front 2024-09-11T23:38:09.683028+0000 (oldest deadline 2024-09-11T23:38:37.283501+0000) 2024-09-11T23:38:42.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:41 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:41.693+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:38:42.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:41 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:41.693+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:38:42.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:41 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:41.693+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:38:42.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:41 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:41.693+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:47.980419+0000 front 2024-09-11T23:37:47.980346+0000 (oldest deadline 2024-09-11T23:38:13.280366+0000) 2024-09-11T23:38:42.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:41 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:41.693+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:53.280722+0000 front 2024-09-11T23:37:53.280840+0000 (oldest deadline 2024-09-11T23:38:17.380847+0000) 2024-09-11T23:38:42.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:41 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:41.693+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-11T23:38:04.382816+0000 front 2024-09-11T23:38:04.382713+0000 (oldest deadline 2024-09-11T23:38:29.682501+0000) 2024-09-11T23:38:42.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:41 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:41.693+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6820 osd.7 since back 2024-09-11T23:38:09.683091+0000 front 2024-09-11T23:38:09.683028+0000 (oldest deadline 2024-09-11T23:38:37.283501+0000) 2024-09-11T23:38:42.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:41 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:41.693+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6820 osd.8 since back 2024-09-11T23:38:17.283887+0000 front 2024-09-11T23:38:17.283909+0000 (oldest deadline 2024-09-11T23:38:41.383997+0000) 2024-09-11T23:38:43.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:42 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:42.667+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:38:43.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:42 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:42.667+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:38:43.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:42 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:42.667+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:38:43.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:42 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:42.667+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:47.980419+0000 front 2024-09-11T23:37:47.980346+0000 (oldest deadline 2024-09-11T23:38:13.280366+0000) 2024-09-11T23:38:43.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:42 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:42.667+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:53.280722+0000 front 2024-09-11T23:37:53.280840+0000 (oldest deadline 2024-09-11T23:38:17.380847+0000) 2024-09-11T23:38:43.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:42 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:42.667+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-11T23:38:04.382816+0000 front 2024-09-11T23:38:04.382713+0000 (oldest deadline 2024-09-11T23:38:29.682501+0000) 2024-09-11T23:38:43.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:42 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:42.667+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6820 osd.7 since back 2024-09-11T23:38:09.683091+0000 front 2024-09-11T23:38:09.683028+0000 (oldest deadline 2024-09-11T23:38:37.283501+0000) 2024-09-11T23:38:43.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:42 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:42.667+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6820 osd.8 since back 2024-09-11T23:38:17.283887+0000 front 2024-09-11T23:38:17.283909+0000 (oldest deadline 2024-09-11T23:38:41.383997+0000) 2024-09-11T23:38:44.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:43 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:43.654+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-11T23:37:15.375097+0000 front 2024-09-11T23:37:15.375116+0000 (oldest deadline 2024-09-11T23:37:39.475085+0000) 2024-09-11T23:38:44.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:43 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:43.654+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6804 osd.1 since back 2024-09-11T23:37:22.376259+0000 front 2024-09-11T23:37:22.376185+0000 (oldest deadline 2024-09-11T23:37:48.276185+0000) 2024-09-11T23:38:44.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:43 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:43.654+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-11T23:37:28.777203+0000 front 2024-09-11T23:37:28.777371+0000 (oldest deadline 2024-09-11T23:37:54.077312+0000) 2024-09-11T23:38:44.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:43 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:43.654+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6812 osd.4 since back 2024-09-11T23:37:47.980419+0000 front 2024-09-11T23:37:47.980346+0000 (oldest deadline 2024-09-11T23:38:13.280366+0000) 2024-09-11T23:38:44.134 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:43 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:43.654+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-11T23:37:53.280722+0000 front 2024-09-11T23:37:53.280840+0000 (oldest deadline 2024-09-11T23:38:17.380847+0000) 2024-09-11T23:38:44.135 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:43 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:43.654+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-11T23:38:04.382816+0000 front 2024-09-11T23:38:04.382713+0000 (oldest deadline 2024-09-11T23:38:29.682501+0000) 2024-09-11T23:38:44.135 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:43 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:43.654+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.159:6820 osd.7 since back 2024-09-11T23:38:09.683091+0000 front 2024-09-11T23:38:09.683028+0000 (oldest deadline 2024-09-11T23:38:37.283501+0000) 2024-09-11T23:38:44.135 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:43 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11[59627]: 2024-09-11T23:38:43.654+0000 7f2d6aeff640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6820 osd.8 since back 2024-09-11T23:38:17.283887+0000 front 2024-09-11T23:38:17.283909+0000 (oldest deadline 2024-09-11T23:38:41.383997+0000) 2024-09-11T23:38:45.053 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:44 smithi172 podman[69628]: 2024-09-11 23:38:44.800235078 +0000 UTC m=+5.492751977 container died e9df7bd98fcedf5ff818741b07833543fd9bcb9660d3dd40feedc5aaed5da422 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-11T23:38:45.318 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:45 smithi172 podman[69628]: 2024-09-11 23:38:45.134930959 +0000 UTC m=+5.827447861 container cleanup e9df7bd98fcedf5ff818741b07833543fd9bcb9660d3dd40feedc5aaed5da422 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T23:38:45.318 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:45 smithi172 bash[69628]: ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11 2024-09-11T23:38:45.633 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:45 smithi172 podman[69643]: 2024-09-11 23:38:45.31934362 +0000 UTC m=+0.517285365 container remove e9df7bd98fcedf5ff818741b07833543fd9bcb9660d3dd40feedc5aaed5da422 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-b53b6d3) 2024-09-11T23:38:46.005 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:45 smithi172 podman[69731]: 2024-09-11 23:38:45.720156112 +0000 UTC m=+0.085745963 container create 71b713d22bbaa574e7e49548e07cda3d06bfd08d38c551c0280fbe5ed5e21ced (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11-deactivate, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T23:38:46.005 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:45 smithi172 podman[69731]: 2024-09-11 23:38:45.650475518 +0000 UTC m=+0.016065383 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:38:46.005 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:45 smithi172 podman[69731]: 2024-09-11 23:38:45.92251138 +0000 UTC m=+0.288101231 container init 71b713d22bbaa574e7e49548e07cda3d06bfd08d38c551c0280fbe5ed5e21ced (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-11T23:38:46.005 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:45 smithi172 podman[69731]: 2024-09-11 23:38:45.925676346 +0000 UTC m=+0.291266198 container start 71b713d22bbaa574e7e49548e07cda3d06bfd08d38c551c0280fbe5ed5e21ced (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-11T23:38:46.005 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:46 smithi172 podman[69731]: 2024-09-11 23:38:46.00581245 +0000 UTC m=+0.371402309 container attach 71b713d22bbaa574e7e49548e07cda3d06bfd08d38c551c0280fbe5ed5e21ced (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-11T23:38:46.383 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 11 23:38:46 smithi172 podman[69731]: 2024-09-11 23:38:46.112176188 +0000 UTC m=+0.477766059 container died 71b713d22bbaa574e7e49548e07cda3d06bfd08d38c551c0280fbe5ed5e21ced (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T23:38:46.691 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@osd.11.service' 2024-09-11T23:38:46.730 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:38:46.730 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-11T23:38:46.731 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-11T23:38:46.731 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mds.a 2024-09-11T23:38:47.045 INFO:journalctl@ceph.mds.a.smithi005.stdout:Sep 11 23:38:46 smithi005 systemd[1]: Stopping Ceph mds.a for 1f5284d2-7094-11ef-bcea-c7b262605968... 2024-09-11T23:38:47.474 INFO:journalctl@ceph.mds.a.smithi005.stdout:Sep 11 23:38:47 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-a[72411]: 2024-09-11T23:38:47.045+0000 7f14f63b3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:38:47.474 INFO:journalctl@ceph.mds.a.smithi005.stdout:Sep 11 23:38:47 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-a[72411]: 2024-09-11T23:38:47.045+0000 7f14f63b3640 -1 mds.a *** got signal Terminated *** 2024-09-11T23:38:51.361 INFO:journalctl@ceph.mds.a.smithi005.stdout:Sep 11 23:38:51 smithi005 podman[108698]: 2024-09-11 23:38:51.054658588 +0000 UTC m=+4.119130671 container died 24640fa9d37a549ce2e2874a7e9c513b9384cc72fe916ee24fdbc83fb65248b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-a, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-11T23:38:51.678 INFO:journalctl@ceph.mds.a.smithi005.stdout:Sep 11 23:38:51 smithi005 podman[108698]: 2024-09-11 23:38:51.444710257 +0000 UTC m=+4.509182341 container cleanup 24640fa9d37a549ce2e2874a7e9c513b9384cc72fe916ee24fdbc83fb65248b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-a, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T23:38:51.678 INFO:journalctl@ceph.mds.a.smithi005.stdout:Sep 11 23:38:51 smithi005 bash[108698]: ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-a 2024-09-11T23:38:51.838 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mds.a.service' 2024-09-11T23:38:51.875 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:38:51.875 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-11T23:38:51.876 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-11T23:38:51.876 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mds.d 2024-09-11T23:38:52.206 INFO:journalctl@ceph.mds.d.smithi005.stdout:Sep 11 23:38:51 smithi005 systemd[1]: Stopping Ceph mds.d for 1f5284d2-7094-11ef-bcea-c7b262605968... 2024-09-11T23:38:52.474 INFO:journalctl@ceph.mds.d.smithi005.stdout:Sep 11 23:38:52 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-d[71220]: 2024-09-11T23:38:52.206+0000 7fdd69f6d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:38:52.474 INFO:journalctl@ceph.mds.d.smithi005.stdout:Sep 11 23:38:52 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-d[71220]: 2024-09-11T23:38:52.206+0000 7fdd69f6d640 -1 mds.d *** got signal Terminated *** 2024-09-11T23:38:56.474 INFO:journalctl@ceph.mds.d.smithi005.stdout:Sep 11 23:38:56 smithi005 podman[108820]: 2024-09-11 23:38:56.219953843 +0000 UTC m=+4.117241699 container died 3a21c7a513f6abba004d5beffd9731fdb437a9f4643e5ca10ed55aea598dedd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-d, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-11T23:38:56.956 INFO:journalctl@ceph.mds.d.smithi005.stdout:Sep 11 23:38:56 smithi005 podman[108820]: 2024-09-11 23:38:56.673224536 +0000 UTC m=+4.570512419 container cleanup 3a21c7a513f6abba004d5beffd9731fdb437a9f4643e5ca10ed55aea598dedd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-d, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-b53b6d3, ceph=True) 2024-09-11T23:38:56.957 INFO:journalctl@ceph.mds.d.smithi005.stdout:Sep 11 23:38:56 smithi005 bash[108820]: ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-d 2024-09-11T23:38:57.106 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mds.d.service' 2024-09-11T23:38:57.140 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:38:57.140 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-11T23:38:57.140 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-11T23:38:57.141 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mds.g 2024-09-11T23:38:57.474 INFO:journalctl@ceph.mds.g.smithi005.stdout:Sep 11 23:38:57 smithi005 systemd[1]: Stopping Ceph mds.g for 1f5284d2-7094-11ef-bcea-c7b262605968... 2024-09-11T23:38:57.474 INFO:journalctl@ceph.mds.g.smithi005.stdout:Sep 11 23:38:57 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-g[72023]: 2024-09-11T23:38:57.468+0000 7f34d4308640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:38:57.474 INFO:journalctl@ceph.mds.g.smithi005.stdout:Sep 11 23:38:57 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-g[72023]: 2024-09-11T23:38:57.468+0000 7f34d4308640 -1 mds.g *** got signal Terminated *** 2024-09-11T23:39:00.619 INFO:journalctl@ceph.mds.g.smithi005.stdout:Sep 11 23:39:00 smithi005 podman[108940]: 2024-09-11 23:39:00.363963027 +0000 UTC m=+2.999615966 container died 48c20a1f938338a65db9939d94a3f3219c997bc10d87eaea745f86dae0a736a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-g, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-11T23:39:00.877 INFO:journalctl@ceph.mds.g.smithi005.stdout:Sep 11 23:39:00 smithi005 podman[108940]: 2024-09-11 23:39:00.710647974 +0000 UTC m=+3.346300902 container cleanup 48c20a1f938338a65db9939d94a3f3219c997bc10d87eaea745f86dae0a736a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-g, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T23:39:00.877 INFO:journalctl@ceph.mds.g.smithi005.stdout:Sep 11 23:39:00 smithi005 bash[108940]: ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-g 2024-09-11T23:39:01.118 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mds.g.service' 2024-09-11T23:39:01.140 INFO:journalctl@ceph.mds.g.smithi005.stdout:Sep 11 23:39:00 smithi005 podman[108953]: 2024-09-11 23:39:00.878502782 +0000 UTC m=+0.506454402 container remove 48c20a1f938338a65db9939d94a3f3219c997bc10d87eaea745f86dae0a736a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-g, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T23:39:01.141 INFO:journalctl@ceph.mds.g.smithi005.stdout:Sep 11 23:39:01 smithi005 systemd[1]: ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mds.g.service: Deactivated successfully. 2024-09-11T23:39:01.141 INFO:journalctl@ceph.mds.g.smithi005.stdout:Sep 11 23:39:01 smithi005 systemd[1]: Stopped Ceph mds.g for 1f5284d2-7094-11ef-bcea-c7b262605968. 2024-09-11T23:39:01.141 INFO:journalctl@ceph.mds.g.smithi005.stdout:Sep 11 23:39:01 smithi005 systemd[1]: ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mds.g.service: Consumed 1.023s CPU time. 2024-09-11T23:39:01.151 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:39:01.151 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-11T23:39:01.151 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-11T23:39:01.151 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mds.j 2024-09-11T23:39:01.474 INFO:journalctl@ceph.mds.j.smithi005.stdout:Sep 11 23:39:01 smithi005 systemd[1]: Stopping Ceph mds.j for 1f5284d2-7094-11ef-bcea-c7b262605968... 2024-09-11T23:39:01.974 INFO:journalctl@ceph.mds.j.smithi005.stdout:Sep 11 23:39:01 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-j[70826]: 2024-09-11T23:39:01.498+0000 7f1cc938e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:39:01.974 INFO:journalctl@ceph.mds.j.smithi005.stdout:Sep 11 23:39:01 smithi005 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-j[70826]: 2024-09-11T23:39:01.498+0000 7f1cc938e640 -1 mds.j *** got signal Terminated *** 2024-09-11T23:39:05.414 INFO:journalctl@ceph.mds.j.smithi005.stdout:Sep 11 23:39:05 smithi005 podman[109062]: 2024-09-11 23:39:05.146032613 +0000 UTC m=+3.764085612 container died 6fd8b844226b0398d417afe7d8597df55bdda6101df46afe77c22c569d8f987b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-j, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-11T23:39:05.724 INFO:journalctl@ceph.mds.j.smithi005.stdout:Sep 11 23:39:05 smithi005 podman[109062]: 2024-09-11 23:39:05.505840351 +0000 UTC m=+4.123893349 container cleanup 6fd8b844226b0398d417afe7d8597df55bdda6101df46afe77c22c569d8f987b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-j, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-11T23:39:05.724 INFO:journalctl@ceph.mds.j.smithi005.stdout:Sep 11 23:39:05 smithi005 bash[109062]: ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-j 2024-09-11T23:39:05.890 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mds.j.service' 2024-09-11T23:39:05.925 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:39:05.925 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-11T23:39:05.925 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-11T23:39:05.925 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mds.b 2024-09-11T23:39:06.285 INFO:journalctl@ceph.mds.b.smithi159.stdout:Sep 11 23:39:05 smithi159 systemd[1]: Stopping Ceph mds.b for 1f5284d2-7094-11ef-bcea-c7b262605968... 2024-09-11T23:39:06.626 INFO:journalctl@ceph.mds.b.smithi159.stdout:Sep 11 23:39:06 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-b[64498]: 2024-09-11T23:39:06.285+0000 7f89928ca640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:39:06.626 INFO:journalctl@ceph.mds.b.smithi159.stdout:Sep 11 23:39:06 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-b[64498]: 2024-09-11T23:39:06.285+0000 7f89928ca640 -1 mds.b *** got signal Terminated *** 2024-09-11T23:39:09.785 INFO:journalctl@ceph.mds.b.smithi159.stdout:Sep 11 23:39:09 smithi159 podman[69159]: 2024-09-11 23:39:09.440448643 +0000 UTC m=+3.321009356 container died f6b2c4ebdb71b52ad077707d2aa85987bcdc92e39c7bddf48e1cfe455a2ba76b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-b, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-11T23:39:10.085 INFO:journalctl@ceph.mds.b.smithi159.stdout:Sep 11 23:39:09 smithi159 podman[69159]: 2024-09-11 23:39:09.876593986 +0000 UTC m=+3.757154712 container cleanup f6b2c4ebdb71b52ad077707d2aa85987bcdc92e39c7bddf48e1cfe455a2ba76b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-b, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T23:39:10.085 INFO:journalctl@ceph.mds.b.smithi159.stdout:Sep 11 23:39:09 smithi159 bash[69159]: ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-b 2024-09-11T23:39:10.308 DEBUG:teuthology.orchestra.run.smithi159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mds.b.service' 2024-09-11T23:39:10.344 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:39:10.344 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-11T23:39:10.344 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-11T23:39:10.344 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mds.e 2024-09-11T23:39:10.626 INFO:journalctl@ceph.mds.e.smithi159.stdout:Sep 11 23:39:10 smithi159 systemd[1]: Stopping Ceph mds.e for 1f5284d2-7094-11ef-bcea-c7b262605968... 2024-09-11T23:39:11.126 INFO:journalctl@ceph.mds.e.smithi159.stdout:Sep 11 23:39:10 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-e[63882]: 2024-09-11T23:39:10.655+0000 7f9297558640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:39:11.126 INFO:journalctl@ceph.mds.e.smithi159.stdout:Sep 11 23:39:10 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-e[63882]: 2024-09-11T23:39:10.655+0000 7f9297558640 -1 mds.e *** got signal Terminated *** 2024-09-11T23:39:13.780 INFO:journalctl@ceph.mds.e.smithi159.stdout:Sep 11 23:39:13 smithi159 podman[69279]: 2024-09-11 23:39:13.442618409 +0000 UTC m=+2.883306574 container died 3fa760af338f5565ad6381cb7241801c2d09e637a7f1a4f1711d5f71ba1d0112 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-e, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-11T23:39:14.114 INFO:journalctl@ceph.mds.e.smithi159.stdout:Sep 11 23:39:13 smithi159 podman[69279]: 2024-09-11 23:39:13.880399639 +0000 UTC m=+3.321087805 container cleanup 3fa760af338f5565ad6381cb7241801c2d09e637a7f1a4f1711d5f71ba1d0112 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-e, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-11T23:39:14.114 INFO:journalctl@ceph.mds.e.smithi159.stdout:Sep 11 23:39:13 smithi159 bash[69279]: ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-e 2024-09-11T23:39:14.273 DEBUG:teuthology.orchestra.run.smithi159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mds.e.service' 2024-09-11T23:39:14.306 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:39:14.307 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-11T23:39:14.307 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-11T23:39:14.307 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mds.h 2024-09-11T23:39:14.626 INFO:journalctl@ceph.mds.h.smithi159.stdout:Sep 11 23:39:14 smithi159 systemd[1]: Stopping Ceph mds.h for 1f5284d2-7094-11ef-bcea-c7b262605968... 2024-09-11T23:39:15.126 INFO:journalctl@ceph.mds.h.smithi159.stdout:Sep 11 23:39:14 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-h[64183]: 2024-09-11T23:39:14.634+0000 7fc49c64b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:39:15.126 INFO:journalctl@ceph.mds.h.smithi159.stdout:Sep 11 23:39:14 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-h[64183]: 2024-09-11T23:39:14.634+0000 7fc49c64b640 -1 mds.h *** got signal Terminated *** 2024-09-11T23:39:17.876 INFO:journalctl@ceph.mds.h.smithi159.stdout:Sep 11 23:39:17 smithi159 podman[69398]: 2024-09-11 23:39:17.45059889 +0000 UTC m=+2.920678610 container died 3aa3463c53753b75bc8edea0bff8cb966e2889540a71fb11bc3334ded9f4abc1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-h, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-b53b6d3) 2024-09-11T23:39:18.376 INFO:journalctl@ceph.mds.h.smithi159.stdout:Sep 11 23:39:18 smithi159 podman[69398]: 2024-09-11 23:39:18.101152983 +0000 UTC m=+3.571232702 container cleanup 3aa3463c53753b75bc8edea0bff8cb966e2889540a71fb11bc3334ded9f4abc1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-h, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T23:39:18.376 INFO:journalctl@ceph.mds.h.smithi159.stdout:Sep 11 23:39:18 smithi159 bash[69398]: ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-h 2024-09-11T23:39:18.535 DEBUG:teuthology.orchestra.run.smithi159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mds.h.service' 2024-09-11T23:39:18.568 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:39:18.568 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-11T23:39:18.568 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-11T23:39:18.569 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mds.k 2024-09-11T23:39:18.896 INFO:journalctl@ceph.mds.k.smithi159.stdout:Sep 11 23:39:18 smithi159 systemd[1]: Stopping Ceph mds.k for 1f5284d2-7094-11ef-bcea-c7b262605968... 2024-09-11T23:39:19.376 INFO:journalctl@ceph.mds.k.smithi159.stdout:Sep 11 23:39:18 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-k[63581]: 2024-09-11T23:39:18.896+0000 7fb58dbb0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:39:19.376 INFO:journalctl@ceph.mds.k.smithi159.stdout:Sep 11 23:39:18 smithi159 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-k[63581]: 2024-09-11T23:39:18.896+0000 7fb58dbb0640 -1 mds.k *** got signal Terminated *** 2024-09-11T23:39:22.171 INFO:journalctl@ceph.mds.k.smithi159.stdout:Sep 11 23:39:21 smithi159 podman[69516]: 2024-09-11 23:39:21.906038541 +0000 UTC m=+3.111460297 container died 75a8503077496deea605ced73188b934c00d2c0dbfaa107b89d08a9bc5f9550f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , ceph=True) 2024-09-11T23:39:22.430 INFO:journalctl@ceph.mds.k.smithi159.stdout:Sep 11 23:39:22 smithi159 podman[69516]: 2024-09-11 23:39:22.246382027 +0000 UTC m=+3.451803784 container cleanup 75a8503077496deea605ced73188b934c00d2c0dbfaa107b89d08a9bc5f9550f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-k, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T23:39:22.430 INFO:journalctl@ceph.mds.k.smithi159.stdout:Sep 11 23:39:22 smithi159 bash[69516]: ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-k 2024-09-11T23:39:22.671 DEBUG:teuthology.orchestra.run.smithi159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mds.k.service' 2024-09-11T23:39:22.693 INFO:journalctl@ceph.mds.k.smithi159.stdout:Sep 11 23:39:22 smithi159 podman[69528]: 2024-09-11 23:39:22.431058684 +0000 UTC m=+0.519765986 container remove 75a8503077496deea605ced73188b934c00d2c0dbfaa107b89d08a9bc5f9550f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T23:39:22.693 INFO:journalctl@ceph.mds.k.smithi159.stdout:Sep 11 23:39:22 smithi159 systemd[1]: ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mds.k.service: Deactivated successfully. 2024-09-11T23:39:22.693 INFO:journalctl@ceph.mds.k.smithi159.stdout:Sep 11 23:39:22 smithi159 systemd[1]: Stopped Ceph mds.k for 1f5284d2-7094-11ef-bcea-c7b262605968. 2024-09-11T23:39:22.703 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:39:22.703 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-11T23:39:22.704 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-11T23:39:22.704 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mds.c 2024-09-11T23:39:23.006 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 11 23:39:22 smithi172 systemd[1]: Stopping Ceph mds.c for 1f5284d2-7094-11ef-bcea-c7b262605968... 2024-09-11T23:39:23.266 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 11 23:39:23 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-c[64427]: 2024-09-11T23:39:23.006+0000 7f1e6fe13640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:39:23.266 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 11 23:39:23 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-c[64427]: 2024-09-11T23:39:23.006+0000 7f1e6fe13640 -1 mds.c *** got signal Terminated *** 2024-09-11T23:39:25.765 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 11 23:39:25 smithi172 podman[69833]: 2024-09-11 23:39:25.432220759 +0000 UTC m=+2.522752493 container died a3587b6467da5fcd358e568f26cb27f8cee9d0321ceb7ad6fa3a43d0c18aadb6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-c, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T23:39:26.057 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 11 23:39:25 smithi172 podman[69833]: 2024-09-11 23:39:25.857032699 +0000 UTC m=+2.947564432 container cleanup a3587b6467da5fcd358e568f26cb27f8cee9d0321ceb7ad6fa3a43d0c18aadb6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-c, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-11T23:39:26.057 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 11 23:39:25 smithi172 bash[69833]: ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-c 2024-09-11T23:39:26.291 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mds.c.service' 2024-09-11T23:39:26.313 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 11 23:39:26 smithi172 podman[69858]: 2024-09-11 23:39:26.058154083 +0000 UTC m=+0.621112162 container remove a3587b6467da5fcd358e568f26cb27f8cee9d0321ceb7ad6fa3a43d0c18aadb6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-c, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3) 2024-09-11T23:39:26.314 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 11 23:39:26 smithi172 systemd[1]: ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mds.c.service: Deactivated successfully. 2024-09-11T23:39:26.314 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 11 23:39:26 smithi172 systemd[1]: Stopped Ceph mds.c for 1f5284d2-7094-11ef-bcea-c7b262605968. 2024-09-11T23:39:26.314 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 11 23:39:26 smithi172 systemd[1]: ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mds.c.service: Consumed 8.128s CPU time. 2024-09-11T23:39:26.328 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:39:26.328 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-11T23:39:26.328 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-11T23:39:26.328 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mds.f 2024-09-11T23:39:26.634 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 11 23:39:26 smithi172 systemd[1]: Stopping Ceph mds.f for 1f5284d2-7094-11ef-bcea-c7b262605968... 2024-09-11T23:39:27.134 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 11 23:39:26 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-f[64124]: 2024-09-11T23:39:26.651+0000 7f50dc1d5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:39:27.134 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 11 23:39:26 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-f[64124]: 2024-09-11T23:39:26.651+0000 7f50dc1d5640 -1 mds.f *** got signal Terminated *** 2024-09-11T23:39:29.710 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 11 23:39:29 smithi172 podman[69966]: 2024-09-11 23:39:29.439971881 +0000 UTC m=+2.885669422 container died efbbb98c4e73734e204901142de4c9a68d7bcb5b286b04a9ba4960ce418637d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-f, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-11T23:39:30.077 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 11 23:39:29 smithi172 podman[69966]: 2024-09-11 23:39:29.802078181 +0000 UTC m=+3.247775725 container cleanup efbbb98c4e73734e204901142de4c9a68d7bcb5b286b04a9ba4960ce418637d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-f, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-11T23:39:30.077 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 11 23:39:29 smithi172 bash[69966]: ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-f 2024-09-11T23:39:30.233 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mds.f.service' 2024-09-11T23:39:30.267 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:39:30.267 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-11T23:39:30.267 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-11T23:39:30.268 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mds.i 2024-09-11T23:39:30.580 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 11 23:39:30 smithi172 systemd[1]: Stopping Ceph mds.i for 1f5284d2-7094-11ef-bcea-c7b262605968... 2024-09-11T23:39:30.883 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 11 23:39:30 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-i[64733]: 2024-09-11T23:39:30.581+0000 7f198670d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:39:30.884 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 11 23:39:30 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-i[64733]: 2024-09-11T23:39:30.581+0000 7f198670d640 -1 mds.i *** got signal Terminated *** 2024-09-11T23:39:33.731 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 11 23:39:33 smithi172 podman[70088]: 2024-09-11 23:39:33.439417779 +0000 UTC m=+2.951928289 container died 2f4e129ca679c932b263ee4fcbf7e4e866c493fad9e4529f25765a234289412a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-i, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-11T23:39:34.064 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 11 23:39:33 smithi172 podman[70088]: 2024-09-11 23:39:33.831121426 +0000 UTC m=+3.343631925 container cleanup 2f4e129ca679c932b263ee4fcbf7e4e866c493fad9e4529f25765a234289412a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-i, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2) 2024-09-11T23:39:34.064 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 11 23:39:33 smithi172 bash[70088]: ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-i 2024-09-11T23:39:34.200 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mds.i.service' 2024-09-11T23:39:34.233 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:39:34.233 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-11T23:39:34.233 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-11T23:39:34.233 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mds.l 2024-09-11T23:39:34.383 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 11 23:39:34 smithi172 systemd[1]: Stopping Ceph mds.l for 1f5284d2-7094-11ef-bcea-c7b262605968... 2024-09-11T23:39:34.883 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 11 23:39:34 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-l[63825]: 2024-09-11T23:39:34.543+0000 7fe7cc2ba640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:39:34.884 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 11 23:39:34 smithi172 ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-l[63825]: 2024-09-11T23:39:34.543+0000 7fe7cc2ba640 -1 mds.l *** got signal Terminated *** 2024-09-11T23:39:38.808 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 11 23:39:38 smithi172 podman[70209]: 2024-09-11 23:39:38.549455294 +0000 UTC m=+4.100856469 container died 568f52ec07f3ed90f29a34e8e26e68be78743ec3cf6ab9eb81c3db46ea3ce5a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-l, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T23:39:39.133 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 11 23:39:38 smithi172 podman[70209]: 2024-09-11 23:39:38.950975488 +0000 UTC m=+4.502376671 container cleanup 568f52ec07f3ed90f29a34e8e26e68be78743ec3cf6ab9eb81c3db46ea3ce5a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-l, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3) 2024-09-11T23:39:39.134 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 11 23:39:38 smithi172 bash[70209]: ceph-1f5284d2-7094-11ef-bcea-c7b262605968-mds-l 2024-09-11T23:39:39.299 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1f5284d2-7094-11ef-bcea-c7b262605968@mds.l.service' 2024-09-11T23:39:39.331 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T23:39:39.332 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-11T23:39:39.332 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-11T23:39:39.544 INFO:teuthology.orchestra.run.smithi005.stdout:Deleting cluster with fsid: 1f5284d2-7094-11ef-bcea-c7b262605968 2024-09-11T23:39:42.130 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-11T23:39:42.333 INFO:teuthology.orchestra.run.smithi159.stdout:Deleting cluster with fsid: 1f5284d2-7094-11ef-bcea-c7b262605968 2024-09-11T23:39:44.793 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-11T23:39:44.993 INFO:teuthology.orchestra.run.smithi172.stdout:Deleting cluster with fsid: 1f5284d2-7094-11ef-bcea-c7b262605968 2024-09-11T23:39:47.449 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T23:39:47.484 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T23:39:47.518 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T23:39:47.545 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-11T23:39:47.547 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901468/remote/smithi005/crash 2024-09-11T23:39:47.548 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/crash -- . 2024-09-11T23:39:47.592 INFO:teuthology.orchestra.run.smithi005.stderr:tar: /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-11T23:39:47.592 INFO:teuthology.orchestra.run.smithi005.stderr:tar: Error is not recoverable: exiting now 2024-09-11T23:39:47.594 DEBUG:teuthology.misc:Transferring archived files from smithi159:/var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901468/remote/smithi159/crash 2024-09-11T23:39:47.594 DEBUG:teuthology.orchestra.run.smithi159:> sudo tar c -f - -C /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/crash -- . 2024-09-11T23:39:47.633 INFO:teuthology.orchestra.run.smithi159.stderr:tar: /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-11T23:39:47.633 INFO:teuthology.orchestra.run.smithi159.stderr:tar: Error is not recoverable: exiting now 2024-09-11T23:39:47.635 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901468/remote/smithi172/crash 2024-09-11T23:39:47.636 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/crash -- . 2024-09-11T23:39:47.670 INFO:teuthology.orchestra.run.smithi172.stderr:tar: /var/lib/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-11T23:39:47.670 INFO:teuthology.orchestra.run.smithi172.stderr:tar: Error is not recoverable: exiting now 2024-09-11T23:39:47.672 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-11T23:39:47.672 DEBUG:teuthology.orchestra.run.smithi005:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-11T23:39:47.711 INFO:tasks.cephadm:Compressing logs... 2024-09-11T23:39:47.712 DEBUG:teuthology.orchestra.run.smithi005:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T23:39:47.755 DEBUG:teuthology.orchestra.run.smithi159:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T23:39:47.758 DEBUG:teuthology.orchestra.run.smithi172:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T23:39:47.780 INFO:teuthology.orchestra.run.smithi005.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-09-11T23:39:47.781 INFO:teuthology.orchestra.run.smithi005.stderr:: No such file or directory 2024-09-11T23:39:47.781 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-osd.0.log 2024-09-11T23:39:47.782 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-osd.9.log 2024-09-11T23:39:47.782 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-11T23:39:47.795 INFO:teuthology.orchestra.run.smithi172.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-11T23:39:47.795 INFO:teuthology.orchestra.run.smithi172.stderr:: No such file or directory 2024-09-11T23:39:47.795 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-11T23:39:47.795 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mds.i.log 2024-09-11T23:39:47.796 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mon.c.log 2024-09-11T23:39:47.796 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph.audit.log: /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-11T23:39:47.796 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-osd.11.log 2024-09-11T23:39:47.796 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-osd.2.log 2024-09-11T23:39:47.796 INFO:teuthology.orchestra.run.smithi172.stderr: 82.8% -- replaced with /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-11T23:39:47.796 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-osd.5.log 2024-09-11T23:39:47.796 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph.log 2024-09-11T23:39:47.796 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mds.l.log 2024-09-11T23:39:47.796 INFO:teuthology.orchestra.run.smithi172.stderr: 90.4% -- replaced with /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-11T23:39:47.796 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-osd.8.log 2024-09-11T23:39:47.796 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mds.l.log: 86.6% -- replaced with /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-11T23:39:47.796 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mgr.z.log 2024-09-11T23:39:47.797 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-osd.8.log: 94.8% -- replaced with /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mds.l.log.gz 2024-09-11T23:39:47.797 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mds.c.log 2024-09-11T23:39:47.797 INFO:teuthology.orchestra.run.smithi159.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-osd.10.log 2024-09-11T23:39:47.797 INFO:teuthology.orchestra.run.smithi159.stderr:: No such file or directory 2024-09-11T23:39:47.797 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-osd.1.log 2024-09-11T23:39:47.798 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-osd.7.log 2024-09-11T23:39:47.798 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-11T23:39:47.798 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mds.b.log 2024-09-11T23:39:47.798 INFO:teuthology.orchestra.run.smithi159.stderr:gzip/var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-volume.log: -5 --verbose -- /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mds.k.log 2024-09-11T23:39:47.798 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-osd.4.log 2024-09-11T23:39:47.798 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-11T23:39:47.798 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-osd.4.log: /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph.audit.log: 90.4% -- replaced with /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-11T23:39:47.798 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-11T23:39:47.798 INFO:teuthology.orchestra.run.smithi159.stderr: 94.7% -- replaced with /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mds.k.log.gz 2024-09-11T23:39:47.798 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mgr.y.log 2024-09-11T23:39:47.798 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph.cephadm.log: 82.8% -- replaced with /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-11T23:39:47.798 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph.log 2024-09-11T23:39:47.798 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mds.h.log 2024-09-11T23:39:47.802 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph.log: 86.6% -- replaced with /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-11T23:39:47.802 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mon.b.log 2024-09-11T23:39:47.802 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mds.h.log: 92.6% -- replaced with /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mgr.y.log.gz 2024-09-11T23:39:47.802 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mds.e.log 2024-09-11T23:39:47.803 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mon.b.log: 90.9% -- replaced with /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-11T23:39:47.804 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mgr.z.log: 90.9% -- replaced with /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-11T23:39:47.804 INFO:teuthology.orchestra.run.smithi172.stderr: 92.7% -- replaced with /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mgr.z.log.gz 2024-09-11T23:39:47.805 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mds.f.log 2024-09-11T23:39:47.805 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-11T23:39:47.805 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-osd.0.log: /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-11T23:39:47.805 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mds.a.log 2024-09-11T23:39:47.805 INFO:teuthology.orchestra.run.smithi005.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-09-11T23:39:47.805 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-11T23:39:47.808 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mon.a.log 2024-09-11T23:39:47.808 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mds.a.log: /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mds.g.log 2024-09-11T23:39:47.808 INFO:teuthology.orchestra.run.smithi005.stderr: 82.9%/var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mon.a.log: -- replaced with /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-11T23:39:47.808 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-osd.6.log 2024-09-11T23:39:47.808 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph.log 2024-09-11T23:39:47.808 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-osd.6.log: 90.3% -- replaced with /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-11T23:39:47.808 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mds.d.log 2024-09-11T23:39:47.808 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph.log: 94.7% -- replaced with /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mds.a.log.gz 2024-09-11T23:39:47.809 INFO:teuthology.orchestra.run.smithi005.stderr: 94.7% -- replaced with /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mds.g.log.gz 2024-09-11T23:39:47.809 INFO:teuthology.orchestra.run.smithi005.stderr: 86.6% -- replaced with /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-11T23:39:47.809 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mgr.x.log 2024-09-11T23:39:47.809 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mds.j.log 2024-09-11T23:39:47.809 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-osd.3.log 2024-09-11T23:39:47.809 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mds.j.log: 94.7% -- replaced with /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mds.d.log.gz 2024-09-11T23:39:47.809 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-09-11T23:39:47.809 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-osd.3.log: 94.7% -- replaced with /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mds.j.log.gz 2024-09-11T23:39:47.809 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-11T23:39:47.809 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.log: 90.9% -- replaced with /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-11T23:39:47.810 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-11T23:39:47.817 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-11T23:39:47.819 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/cephadm.log: 93.6% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-11T23:39:47.832 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-11T23:39:48.040 INFO:teuthology.orchestra.run.smithi005.stderr: 90.3% -- replaced with /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mgr.x.log.gz 2024-09-11T23:39:48.146 INFO:teuthology.orchestra.run.smithi172.stderr: 92.0% -- replaced with /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mon.c.log.gz 2024-09-11T23:39:48.164 INFO:teuthology.orchestra.run.smithi159.stderr: 92.0% -- replaced with /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mon.b.log.gz 2024-09-11T23:39:48.489 INFO:teuthology.orchestra.run.smithi005.stderr: 90.4% -- replaced with /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mon.a.log.gz 2024-09-11T23:39:49.095 INFO:teuthology.orchestra.run.smithi172.stderr: 95.5% -- replaced with /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mds.f.log.gz 2024-09-11T23:39:49.382 INFO:teuthology.orchestra.run.smithi159.stderr: 95.6% -- replaced with /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mds.e.log.gz 2024-09-11T23:39:50.921 INFO:teuthology.orchestra.run.smithi172.stderr: 96.1% -- replaced with /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mds.c.log.gz 2024-09-11T23:39:58.999 INFO:teuthology.orchestra.run.smithi172.stderr: 91.7% -- replaced with /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-osd.11.log.gz 2024-09-11T23:40:00.389 INFO:teuthology.orchestra.run.smithi159.stderr: 93.8% -- replaced with /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mds.h.log.gz 2024-09-11T23:40:01.669 INFO:teuthology.orchestra.run.smithi005.stderr: 91.9% -- replaced with /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-osd.0.log.gz 2024-09-11T23:40:01.724 INFO:teuthology.orchestra.run.smithi005.stderr: 91.7% -- replaced with /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-osd.6.log.gz 2024-09-11T23:40:02.152 INFO:teuthology.orchestra.run.smithi159.stderr: 91.8% -- replaced with /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-osd.1.log.gz 2024-09-11T23:40:03.081 INFO:teuthology.orchestra.run.smithi172.stderr: 93.8% -- replaced with /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mds.i.log.gz 2024-09-11T23:40:03.115 INFO:teuthology.orchestra.run.smithi172.stderr: 91.3% -- replaced with /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-osd.8.log.gz 2024-09-11T23:40:05.830 INFO:teuthology.orchestra.run.smithi159.stderr: 91.6% -- replaced with /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-osd.10.log.gz 2024-09-11T23:40:08.698 INFO:teuthology.orchestra.run.smithi005.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-09-11T23:40:10.516 INFO:teuthology.orchestra.run.smithi159.stderr: 91.5% -- replaced with /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-osd.7.log.gz 2024-09-11T23:40:11.570 INFO:teuthology.orchestra.run.smithi005.stderr: 91.9% -- replaced with /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-osd.9.log.gz 2024-09-11T23:40:15.736 INFO:teuthology.orchestra.run.smithi172.stderr: 91.4% -- replaced with /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-osd.2.log.gz 2024-09-11T23:40:18.680 INFO:teuthology.orchestra.run.smithi005.stderr: 91.5% -- replaced with /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-osd.3.log.gz 2024-09-11T23:40:18.682 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-09-11T23:40:18.682 INFO:teuthology.orchestra.run.smithi005.stderr:real 0m30.913s 2024-09-11T23:40:18.682 INFO:teuthology.orchestra.run.smithi005.stderr:user 1m41.164s 2024-09-11T23:40:18.682 INFO:teuthology.orchestra.run.smithi005.stderr:sys 0m3.062s 2024-09-11T23:40:19.347 INFO:teuthology.orchestra.run.smithi172.stderr: 91.4% -- replaced with /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-osd.5.log.gz 2024-09-11T23:40:19.350 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-09-11T23:40:19.350 INFO:teuthology.orchestra.run.smithi172.stderr:real 0m31.578s 2024-09-11T23:40:19.350 INFO:teuthology.orchestra.run.smithi172.stderr:user 1m42.915s 2024-09-11T23:40:19.350 INFO:teuthology.orchestra.run.smithi172.stderr:sys 0m3.057s 2024-09-11T23:40:23.573 INFO:teuthology.orchestra.run.smithi159.stderr: 93.4% -- replaced with /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-mds.b.log.gz 2024-09-11T23:40:29.601 INFO:teuthology.orchestra.run.smithi159.stderr: 91.8% -- replaced with /var/log/ceph/1f5284d2-7094-11ef-bcea-c7b262605968/ceph-osd.4.log.gz 2024-09-11T23:40:29.603 INFO:teuthology.orchestra.run.smithi159.stderr: 2024-09-11T23:40:29.603 INFO:teuthology.orchestra.run.smithi159.stderr:real 0m41.830s 2024-09-11T23:40:29.603 INFO:teuthology.orchestra.run.smithi159.stderr:user 2m22.435s 2024-09-11T23:40:29.603 INFO:teuthology.orchestra.run.smithi159.stderr:sys 0m4.504s 2024-09-11T23:40:29.604 INFO:tasks.cephadm:Archiving logs... 2024-09-11T23:40:29.604 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901468/remote/smithi005/log 2024-09-11T23:40:29.605 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T23:40:45.228 DEBUG:teuthology.misc:Transferring archived files from smithi159:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901468/remote/smithi159/log 2024-09-11T23:40:45.229 DEBUG:teuthology.orchestra.run.smithi159:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T23:41:06.006 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901468/remote/smithi172/log 2024-09-11T23:41:06.007 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T23:41:22.414 INFO:tasks.cephadm:Removing cluster... 2024-09-11T23:41:22.414 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 --force 2024-09-11T23:41:22.628 INFO:teuthology.orchestra.run.smithi005.stdout:Deleting cluster with fsid: 1f5284d2-7094-11ef-bcea-c7b262605968 2024-09-11T23:41:23.023 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 --force 2024-09-11T23:41:23.227 INFO:teuthology.orchestra.run.smithi159.stdout:Deleting cluster with fsid: 1f5284d2-7094-11ef-bcea-c7b262605968 2024-09-11T23:41:23.713 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1f5284d2-7094-11ef-bcea-c7b262605968 --force 2024-09-11T23:41:23.914 INFO:teuthology.orchestra.run.smithi172.stdout:Deleting cluster with fsid: 1f5284d2-7094-11ef-bcea-c7b262605968 2024-09-11T23:41:24.316 INFO:tasks.cephadm:Removing cephadm ... 2024-09-11T23:41:24.317 DEBUG:teuthology.orchestra.run.smithi005:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-11T23:41:24.335 DEBUG:teuthology.orchestra.run.smithi159:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-11T23:41:24.352 DEBUG:teuthology.orchestra.run.smithi172:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-11T23:41:24.368 INFO:tasks.cephadm:Teardown complete 2024-09-11T23:41:24.368 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-11T23:41:24.379 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-11T23:41:24.379 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T23:41:24.382 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T23:41:24.395 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T23:41:24.519 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-11T23:41:24.530 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-11T23:41:24.530 DEBUG:teuthology.orchestra.run.smithi005:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T23:41:24.533 DEBUG:teuthology.orchestra.run.smithi159:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T23:41:24.536 DEBUG:teuthology.orchestra.run.smithi172:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T23:41:24.545 INFO:teuthology.orchestra.run.smithi005.stderr:bash: line 1: ntpq: command not found 2024-09-11T23:41:24.548 INFO:teuthology.orchestra.run.smithi159.stderr:bash: line 1: ntpq: command not found 2024-09-11T23:41:24.550 INFO:teuthology.orchestra.run.smithi172.stderr:bash: line 1: ntpq: command not found 2024-09-11T23:41:24.551 INFO:teuthology.orchestra.run.smithi005.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T23:41:24.551 INFO:teuthology.orchestra.run.smithi005.stdout:=============================================================================== 2024-09-11T23:41:24.551 INFO:teuthology.orchestra.run.smithi005.stdout:^* hv01.front.sepia.ceph.com 3 6 377 59 +2031us[+2089us] +/- 49ms 2024-09-11T23:41:24.551 INFO:teuthology.orchestra.run.smithi005.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 60 -1423us[-1365us] +/- 64ms 2024-09-11T23:41:24.551 INFO:teuthology.orchestra.run.smithi005.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 62 -1691us[-1633us] +/- 81ms 2024-09-11T23:41:24.551 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:41:24.553 INFO:teuthology.orchestra.run.smithi159.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T23:41:24.554 INFO:teuthology.orchestra.run.smithi159.stdout:=============================================================================== 2024-09-11T23:41:24.554 INFO:teuthology.orchestra.run.smithi159.stdout:^* hv01.front.sepia.ceph.com 3 6 377 63 +2065us[+2064us] +/- 49ms 2024-09-11T23:41:24.554 INFO:teuthology.orchestra.run.smithi159.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 61 -1394us[-1394us] +/- 64ms 2024-09-11T23:41:24.554 INFO:teuthology.orchestra.run.smithi159.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 61 -1666us[-1666us] +/- 81ms 2024-09-11T23:41:24.554 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:41:24.555 INFO:teuthology.orchestra.run.smithi172.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T23:41:24.555 INFO:teuthology.orchestra.run.smithi172.stdout:=============================================================================== 2024-09-11T23:41:24.555 INFO:teuthology.orchestra.run.smithi172.stdout:^* hv01.front.sepia.ceph.com 3 6 377 60 +2069us[+2056us] +/- 49ms 2024-09-11T23:41:24.555 INFO:teuthology.orchestra.run.smithi172.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 58 -1392us[-1392us] +/- 64ms 2024-09-11T23:41:24.555 INFO:teuthology.orchestra.run.smithi172.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 62 -1662us[-1674us] +/- 81ms 2024-09-11T23:41:24.555 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:41:24.555 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-11T23:41:24.567 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-11T23:41:24.568 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-11T23:41:24.592 DEBUG:teuthology.orchestra.run.smithi005:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T23:41:24.669 DEBUG:teuthology.orchestra.run.smithi159:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T23:41:24.737 DEBUG:teuthology.orchestra.run.smithi172:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T23:41:24.804 DEBUG:teuthology.orchestra.run.smithi005:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T23:41:24.833 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:41:24.833 DEBUG:teuthology.orchestra.run.smithi159:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T23:41:24.861 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:41:24.862 DEBUG:teuthology.orchestra.run.smithi172:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T23:41:24.889 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:41:24.890 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-11T23:41:24.901 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-11T23:41:24.942 INFO:teuthology.task.internal:Duration was 1718.267501 seconds 2024-09-11T23:41:24.943 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-11T23:41:24.976 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-11T23:41:24.976 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T23:41:24.979 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T23:41:24.982 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T23:41:25.018 INFO:teuthology.orchestra.run.smithi005.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T23:41:25.019 INFO:teuthology.orchestra.run.smithi159.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T23:41:25.021 INFO:teuthology.orchestra.run.smithi172.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T23:41:25.420 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-11T23:41:25.421 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi005.front.sepia.ceph.com 2024-09-11T23:41:25.421 DEBUG:teuthology.orchestra.run.smithi005:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T23:41:25.442 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi159.front.sepia.ceph.com 2024-09-11T23:41:25.443 DEBUG:teuthology.orchestra.run.smithi159:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T23:41:25.481 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi172.front.sepia.ceph.com 2024-09-11T23:41:25.481 DEBUG:teuthology.orchestra.run.smithi172:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T23:41:25.507 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-11T23:41:25.507 DEBUG:teuthology.orchestra.run.smithi005:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T23:41:25.509 DEBUG:teuthology.orchestra.run.smithi159:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T23:41:25.524 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T23:41:25.574 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-11T23:41:25.574 DEBUG:teuthology.orchestra.run.smithi005:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T23:41:25.577 DEBUG:teuthology.orchestra.run.smithi159:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T23:41:25.590 DEBUG:teuthology.orchestra.run.smithi172:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T23:41:26.086 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-11T23:41:26.097 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-11T23:41:26.098 DEBUG:teuthology.orchestra.run.smithi005:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T23:41:26.124 DEBUG:teuthology.orchestra.run.smithi159:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T23:41:26.150 DEBUG:teuthology.orchestra.run.smithi172:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T23:41:26.176 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-11T23:41:26.187 DEBUG:teuthology.orchestra.run.smithi005:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T23:41:26.189 DEBUG:teuthology.orchestra.run.smithi159:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T23:41:26.192 DEBUG:teuthology.orchestra.run.smithi172:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T23:41:26.211 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = core 2024-09-11T23:41:26.214 INFO:teuthology.orchestra.run.smithi159.stdout:kernel.core_pattern = core 2024-09-11T23:41:26.240 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = core 2024-09-11T23:41:26.273 DEBUG:teuthology.orchestra.run.smithi005:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T23:41:26.288 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:41:26.288 DEBUG:teuthology.orchestra.run.smithi159:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T23:41:26.302 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:41:26.303 DEBUG:teuthology.orchestra.run.smithi172:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T23:41:26.327 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:41:26.328 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-11T23:41:26.339 INFO:teuthology.task.internal:Transferring archived files... 2024-09-11T23:41:26.340 DEBUG:teuthology.misc:Transferring archived files from smithi005:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901468/remote/smithi005 2024-09-11T23:41:26.340 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T23:41:26.388 DEBUG:teuthology.misc:Transferring archived files from smithi159:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901468/remote/smithi159 2024-09-11T23:41:26.389 DEBUG:teuthology.orchestra.run.smithi159:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T23:41:26.427 DEBUG:teuthology.misc:Transferring archived files from smithi172:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901468/remote/smithi172 2024-09-11T23:41:26.427 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T23:41:26.465 INFO:teuthology.task.internal:Removing archive directory... 2024-09-11T23:41:26.465 DEBUG:teuthology.orchestra.run.smithi005:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T23:41:26.467 DEBUG:teuthology.orchestra.run.smithi159:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T23:41:26.470 DEBUG:teuthology.orchestra.run.smithi172:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T23:41:26.514 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-11T23:41:26.528 INFO:teuthology.task.internal:Not uploading archives. 2024-09-11T23:41:26.529 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-11T23:41:26.550 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-11T23:41:26.550 DEBUG:teuthology.orchestra.run.smithi005:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T23:41:26.553 DEBUG:teuthology.orchestra.run.smithi159:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T23:41:26.555 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T23:41:26.566 INFO:teuthology.orchestra.run.smithi005.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 23:41 /home/ubuntu/cephtest 2024-09-11T23:41:26.568 INFO:teuthology.orchestra.run.smithi159.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 23:41 /home/ubuntu/cephtest 2024-09-11T23:41:26.570 INFO:teuthology.orchestra.run.smithi172.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 23:41 /home/ubuntu/cephtest 2024-09-11T23:41:26.571 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-11T23:41:26.584 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-11T23:41:26.652 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/suites/fsx}} duration: 1718.2675008773804 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-11T23:41:26.653 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T23:41:26.752 INFO:teuthology.run:pass